Job Description:
- Cloud DataInformation Architect Core skillset with implementing Cloud data pipelines
- Tools AWS Databricks Snowflake Python Fivetran
Requirements
- Candidate must be experienced working in projects involving AWS Databricks Python
- AWS Native data Architecture and services like S3 lamda Glue EMR
- Databricks Spark
- Experience with handing AWS Cloud platform
Responsibilities
- Identify define foundational business data domain data domain elements
- Identifyingcollaborating with data product and stewards in business circles to capture data definitions
- Driving data sourceLineage report
- Reference data needs identification
- Recommending data extraction and replication patterns
- Experience on data migration from big data to AWS Cloud on S3 Snowflake Redshift
- Understands where to obtain information needed to make the appropriate decisions
- Demonstrates ability to break down a problem to manageable pieces and implement effective timely solutions
- Identifies the problem versus the symptom
- Manages problems that require involvement of others to solve
- Reaches sound decisions quickly
- Carefully evaluates alternative risks and solutions before taking action
- Optimizes the use of all available resources
- Develops solutions to meet business needs that reflect a clear understanding of the objectives practices and procedures of the corporation department and business unit
Skills
- Hands on experience on AWS databricks especially S3 Snowflake python
- Experience on Shell scripting
- Exceptionally strong analytical and problem solving skills
- Relevant experience with ETL methods and with retrieving data from dimensional data models and data warehouses
- Strong experience with relational databases and data access methods especially SQL
- Excellent collaboration and crossfunctional leadership skills
- Excellent communication skills both written and verbal
- Ability to manage multiple initiatives and priorities in a fastpaced collaborative environment
- Ability to leverage data assets to respond to complex questions that require timely answers
- Has working knowledge on migrating relational and dimensional databases on AWS Cloud platform
Aws,databricks,pyspark,Snowflake,Python,Glue