Data Engineer with AWS Databricks
Share
Job Location:
Monthly Salary:
Posted on:
9 hours ago
Vacancies:
1 Vacancy
Job Summary
Role: Data Engineer Healthcare (AWS Databricks).
Location: Eagan MN (Onsite).
Duration: Long Term Contract.
Overview:
- Seeking an experienced Data Engineer with strong healthcare domain expertise and proficiency in AWS-native services Databricks SQL and PySpark. This role involves designing and orchestrating ETL/ELT pipelines leveraged through Databricks Workspace and Medallion Architecture to support robust compliant healthcare data transformation initiatives.
Key Responsibilities:
- Build complex ETL/ELT pipelines using Databricks Workspace and PySpark ensuring secure processing of sensitive healthcare data.
- Architect and optimize solutions using Databricks Medallion Architecture and AWS data stack (e.g. S3 Glue Redshift).
- Orchestrate jobs via Databricks Workspace for seamless workflow automation.
- Leverage Data Vault 2.0 methodologies in pipeline design (preferred but not mandatory).
- Collaborate on data migration projects as needed.
- Write advanced SQL queries for data analysis and transformation tasks.
- Ensure compliance with security and healthcare data governance standards.
- Engage with cross-functional teams to deliver scalable reliable healthcare analytics solutions.
Required Skills & Experience:
- Healthcare data engineering experience (mandatory).
- Advanced SQL proficiency.
- Experience with AWS native services and Databricks development (using AWS or equivalent cloud stack).
- Strong PySpark and pipeline orchestration capability.
- Familiarity with Databricks Medallion Architecture.
- Exposure to Data Vault 2.0 methodologies.
- Data migration project experience (preferred).
- Strong communication and collaboration skills.
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
