DA Lead Data Engineer

Labcorp is a leader in diagnostics drug development and healthcare innovation. Across every role we harness data and AI to work smarter move faster and create breakthrough solutions that improve health outcomes for people. With our global scale and deep expertise youll do meaningful work grow your career and make a real impact. Together were improving health and improving lives.

Labcorp is a global leader in diagnostic testing and drug development solutions helping healthcare providers researchers and patients make informed decisions that advance care. Join us in our mission to improve health and improve lives.

Labcorp is seeking a DA Lead Data Engineer to join our team at Bengaluru India Office.

Work Schedule

Candidates are required to follow the work schedule from 2:00 PM to 11:00 PM IST.

Job Responsibilities:

• Designing and implementing highly performant data ingestion pipelines from multiple sources

• Delivering and presenting proofs of concept to of key technology components to project stakeholders.

• Developing scalable and re-usable frameworks for ingesting of data sets

• Integrating the end-to-end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is maintained at all times

• Working with event based / streaming technologies to ingest and process data

• Do analysis of new requirements and propose a solution

• Evaluating the performance and applicability of multiple tools against customer requirements

Minimum Qualifications

• Bachelors degree in computer science Engineering or related field.

• 5 years or more of hands-on experience on PySpark Python Spark Scala Able to perform data validation delivery quality and integrity.

• 5 years or more of Snowflake /Databricks Cloud Data Warehouse Implementation experience should possess skill pertaining to handling various file formats (XMLJSONAvroParquet)

• 2 years of more experience in Extraction Transformation and Loading (ETL) data from multiple data sources & various data formats (Structured Semi-Structured & Unstructured).

• 2 or more years of hands-on experience with Big Data model techniques using Python / Spark

• 2 or more years of experience in CI/CD domain using Jenkins Terraform Docker AWS and Kubernetes.

Additional Job Standards

• Should be able to work with modern schedulers (Airflow Matillion etc.) and distributed data systems such as Hadoop Spark Kafka etc.

• Should have experience in business intelligence reporting and/or delivery of modern visualization solutions (Tableau Power BI)

• Good working exposure on cloud technologies of AWS - EC2 S3 Lambda SQS SNS

• Strong Programming experience using PL/SQL packages Stored procedures views Materialized views triggers Indexes etc.

• Strong communication and collaboration skills.

• Strong understanding on Data Warehousing concepts using Fact Dimension tables and various methods of loading data.

• Experience in Pharma industry is a plus.

Labcorp is proud to be an Equal Opportunity Employer:

Labcorp strives for inclusion and belonging in the workforce and does not tolerate harassment or discrimination of any kind. We make employment decisions based on the needs of our business and the qualifications and merit of the individual. Qualified applicants will receive consideration for employment without regard to race religion color national origin sex (including pregnancy childbirth or related medical conditions) family or parental status marital civil union or domestic partnership status sexual orientation gender identity gender expression personal appearance age veteran status disability genetic information or any other legally protected characteristic. Additionally all qualified applicants with arrest or conviction records will be considered for employment in accordance with applicable law.

We encourage all to apply

If you are an individual with a disability who needs assistance using our online tools to search and apply for jobs or needs an accommodation please visit ouraccessibility siteor contact us atLabcorp Accessibility. Formore information about how we collect and store your personal data please see ourPrivacy Statement.