Lead Data Engineer
Lead Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Not Disclosed
Salary Not Disclosed
1 Vacancy
Job Description
Job Title: Lead Data Engineer
Spikewell India Pvt. Ltd (a subsidiary of Spikewell LLC USA) is a rapidly growing Information Technology products and services company. We pioneer in providing innovative scalable robust and secure solutions in the everchanging technology landscape of Web Mobile Cloud AI/ML and Blockchain technologies. Spikewells portfolio includes leading consumer banks large health care institutions and rapidly growing AdTech companies. We are constantly pursuing acquiring and retaining the best talent with competitive employment benefits and fostering a supportive work environment.
Job Overview:
We are seeking an experienced and a highly skilled Azure Data Engineer with 4 years of experience to join our Data Engineering team playing a critical role in supporting and enhancing our clients Azure Data Lakehouse environment. This role involves developing maintaining and optimizing data pipelines using Azure Data Factory ensuring efficient data ingestion and ETL processes from various upstream sources. Additionally the role includes data modeling to design and implement models that fulfill both analytical and operational requirements aligning with business needs and best practices. The team will work closely with our clients onshore team to manage and organize large datasets ensuring data quality integrity and security while adhering to healthcare regulations and standards. The team will also support data governance through the use of Informatica implementing policies managing data catalogs and maintaining data lineage and metadata. The team members are expected to be available online until at least 11am EST to facilitate seamless communication with the onshore team.
Key Responsibilities:
- Develop maintain and optimize data pipelines using Azure Data Factory for efficient data ingestion and ETL processes.
- Design and implement scalable data models that meet both analytical and operational needs.
- Manage and organize large datasets to ensure data quality integrity and compliance with healthcare regulations.
- Troubleshoot and resolve datarelated issues to enhance system performance and reliability.
- Assist in managing the data governance platform (Informatica) including data cataloging metadata management and data lineage.
- Implement and enforce data governance policies and procedures.
- Participate in data quality initiatives to ensure accuracy integrity and consistency across datasets.
- Collaborate with onshore team members maintaining overlapping working hours as needed for effective communication.
Required Skills and Knowledge:
- 4 Years of Experience: 4 years of relevant experience in data engineering is a must.
- Azure Data Lakehouse Proficiency: Experience with Azure Data Lakehouse architecture for data storage and analytics.
- Azure Data Factory Expertise: Skilled in developing maintaining and optimizing data pipelines using Azure Data Factory for data ingestion and ETL processes..
- Data Modeling Skills: Ability to design and implement efficient data models that meet analytical and operational requirements..
- Informatica Experience: Knowledge of using Informatica for data governance including data cataloging metadata management and data lineage.
- Data Governance Principles: Familiarity with data governance implementation and policy enforcement.
- Data Quality Management: Experience in maintaining data accuracy integrity and consistency across large datasets.
- Healthcare Data Regulations: Understanding of healthcare industry standards and regulations such as HIPAA to ensure data security and compliance.
- SQL and Programming Skills: Proficiency in SQL and possibly other programming languages like Python or Scala used in data engineering.
- Large Dataset Management: Ability to manage and organize large volumes of data efficiently.
- Data Security Practices: Knowledge of best practices for securing sensitive data within cloud environments.
- Relevant certification (e.g. Microsoft Certified: Azure Data Engineer Associate) is preferred.
Education Requirements:
- Bachelors degree in Computer Science Information Technology or a related field with 4 years of relevant experience.
What We Offer:
- A chance to work with some of the worlds leading healthcare providers.
- Competitive salary and benefits package.
- Opportunities for professional development and certifications.
- A collaborative and innovative work environment with a focus on healthcare IT.
- The opportunity to work on impactful projects that improve patient care and healthcare services.
How to Apply:
Please submit your resume and a cover letter detailing your relevant experience to
Employment Type
Full-Time
