Engineering Lead Analyst
Engineering Lead Analyst
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
As a Lead Data Engineer your role is to spearhead the data engineering teams and elevate the team to the next level! You will be responsible for laying out the architecture of the new project as well as selecting the tech stack associated with it. You will plan out the development cycles deploying AGILE if possible and create the foundations for good data stewardship with our new data products!
You will also set up a solid code framework that needs to be built to purpose yet have enough flexibility to adapt to new business use cases tough but rewarding challenge!
Responsibilities
Lead the design development and maintenance of scalable data platforms using Azure Fabric integrating multiple data sources.
Migrate legacy data infrastructure from Azure Synapse to Azure Fabric while ensuring performance security and scalability.
Build and optimize data systems pipelines and analytical tools leveraging a bronze-silver-gold architecture.
Develop and configure Databricks notebooks and pipelines for ingestion of data from both on-premise and cloud environments following native Databricks standards.
Collaborate with stakeholders to translate business needs into robust data solutions and effectively communicate technical progress risks and recommendations.
Implement strong data governance and access control mechanisms to ensure data quality security and compliance.
Lead and mentor junior team members fostering technical growth and professional development.
Conduct advanced data analysis to support decision-making and reporting needs.
Apply QA testing practices within data workflows particularly in healthcare environments
Drive initiatives in Data Discovery Data Lineage and Data Quality across the organization.
Qualifications :
Bachelors degree in Computer Science Data Science Mathematics Information Technology or a related field.
5 years of experience as a Data Engineer or similar role with hands-on involvement in end-to-end project execution.
Proven experience in Azure data technologies particularly Azure Synapse Azure Data Factory (ADF) or Azure Fabric.
Proficiency in developing and managing Databricks notebooks and implementing data engineering frameworks.
Strong command of Python with deep understanding of at least one object-oriented library.
Advanced SQL skills and solid knowledge of relational databases and SQL-based data warehouses.
Experience building large-scale batch and real-time data pipelines.
Skilled in integrating and managing data from multiple sources including data quality checks and cleanups.
Solid understanding of data modeling data mining and data segmentation techniques.
Familiarity with Data Governance principles and practices.
Experience working with Azure Cloud CI/CD pipelines and Agile methodologies.
Strong ability to work independently and a desire to lead and mentor junior Data Engineers.
Remote Work :
Yes
Employment Type :
Full-time
Employment Type
Remote
