Role: EDI Data Engineer Healthcare Domain
Location: NYC NY & Canada (Remote)
Job Type: Contract
Note: Need minimum 10 years experience and recent lead expertise
Summary:
- The Senior Data Engineer designs and leads scalable data architectures and pipelines to support analytics and business intelligence.
- This role focuses on data optimization workflow automation and ensuring reliable data operations in a cloud-based environment
Minimum Qualifications:
- 8 years of IT experience with 5 years in:
- Python PySpark and SQL for big data processing
- Data lakes (Iceberg format) ETL (Informatica) and data quality
- AWS services: S3 Glue Redshift Lambda EMR Airflow Postgres
- BASH/Shell scripting
- Experience with healthcare data and leading data teams
- Agile development experience
Responsibilities:
- Design and maintain scalable data pipelines and architectures
- Lead data projects and ensure best practices
- Optimize data systems for analytics and reporting
- Ensure data quality and system reliability in production environments