Position: Senior Data Engineer
Location: Los Angeles CA*Day 1 Onsite*
Mandatory skills: Snowflake ADF DBT Informatica SQL Kafka
Skill set | Must/Good | Required proficiency level (0-5) |
Snowflake | Must | 5 |
Experience with Azure Data Factory Azure Synapse Informatica DBTKafka) | Must | 5 |
Strong SQL skills for querying and transforming data. | Must | 5 |
Leverage Direct Lake and Delta Table integration for high-performance data access and real-time analytics | Must | 5 |
Collaborate with data engineering teams to ensure efficient data pipelines and refresh strategies. | Must | 5 |
Build and optimize semantic models and table structures for performance and scalability. | Must | 4 |
Understanding of data modeling best practices and performance tuning. | Good to have | 4 |
Knowledge of CI/CD tools and version control (Git Tabular Editor TMDL). | Good to have | 4 |
Senior Data Lead with Azure Data Factory (ADF) DataBricks
Job Summary
The Senior Technical Lead will be responsible for leading technical teams and overseeing the implementation of projects related to Snowflake Azure Data Factory (ADF) and Data Bricks. The role involves ensuring the successful delivery of data solutions and optimizing data pipelines for efficient performance. (1.) Key Responsibilities
1. Lead and manage technical teams providing guidance and support in the implementation of snowflake azure data factory (adf) and data bricks projects.
2. Design develop and maintain data pipelines using snowflake azure data factory (adf) and data bricks to support business requirements.
3. Work closely with stakeholders to gather requirements identify opportunities for data analytics and propose data driven solutions.
4. Monitor and troubleshoot data pipelines ensuring data quality reliability and performance.
5. Stay updated with the latest trends and technologies in data management and analytics incorporating best practices into projects.
6. Collaborate with cross functional teams to integrate data solutions with existing systems and applications.
7. Provide technical expertise and mentorship to team members promoting a culture of learning and innovation.
Skill Requirements
1. Proficiency in snowflake including data modeling querying and performance optimization.
2. Strong experience in azure data factory (adf) for data integration and orchestration.
3. Handson knowledge of data bricks for data engineering data processing and machine learning.
4. Ability to design develop and optimize complex data pipelines for etl processes.
5. Strong problem-solving skills and the ability to troubleshoot data pipeline issues.
6. Excellent communication skills to interact with technical and nontechnical stakeholders effectively.
7. Strong leadership skills to guide and motivate technical teams towards project delivery and success.
8. Experience in agile methodologies and project management practices for efficient project execution.
Certifications: Relevant certifications in Snowflake Azure Data Factory (ADF) DataBricks are a plus.