Senior Data Engineer

New York City, NY - USA

Monthly Salary: Not Disclosed

Posted on: 2 hours ago

Vacancies: 1 Vacancy

Job Summary

Job Description

Senior Data Engineer Position Summary

Lead complex data engineering projects
Design data architectures aligned with business requirements
Optimize data workflows and manage data pipelines
Ensure smooth operation of data systems

Minimum Qualifications

8 years overall IT experience
Minimum 5 years of experience in required technologies

Technical Skills

Strong experience with Python scripting and PySpark
Proficiency in SQL and big data processing
Experience with data lake processing in Iceberg format
Experience with AWS Glue jobs
Experience with AWS services: S3 Redshift Lambda EMR Airflow Postgres SNS EventBridge
Expertise in BASH/Shell scripting
Strong understanding of healthcare finance systems
Experience leading data engineering teams
Experience working in Agile environments

Responsibilities

Lead development of large-scale data pipelines and architectures
Design build and test data architectures aligned with business needs
Provide technical leadership and ensure best practices
Collaborate with product finance and business teams
Oversee development of predictive and prescriptive analytics solutions
Ensure technical quality and data movement across environments
Align data architecture with Healthfirst solution architecture

Job Description Senior Data Engineer Position Summary Lead complex data engineering projects Design data architectures aligned with business requirements Optimize data workflows and manage data pipelines Ensure smooth operation of data systems Minimum Qualifications 8 years overall IT experie...