Lead Data Platform Engineer

We are seeking a Lead Data Platform Engineer (REMOTE) for a full time and direct hire role for one of our amazing health tech partners in the United States. This role is remote but you MUST be living in the United States and be willing to work east coast hours. You MUST be a US Citizen for Green Card Holder. This role does NOT offer sponsorship its NOT a consulting role and we do NOT work with 3rd parties!

Overview:

This hands-on Engineer will help architect build and maintain modern cloud-based data solutions in a scalable AWS environment. You will contribute to the development of enterprise-grade data platforms analytics infrastructure and data processing frameworks that support business intelligence operational reporting and product innovation. You will work closely with cross-functional teams to design reliable data pipelines optimize data workflows and improve overall platform performance security and scalability. This position is ideal for someone who enjoys solving complex data challenges and influencing technical direction across cloud-native systems.

Responsibilities:

• Design develop and support scalable data pipelines and cloud-native data architectures.
• Build and maintain production-ready applications and data processing frameworks using Python PySpark Scala and related technologies.
• Partner with engineering and business stakeholders to deliver analytics-ready datasets and reporting capabilities.
• Contribute to technical architecture decisions platform improvements and development best practices.
• Develop and optimize ETL/ELT workflows and streaming data solutions.
• Create and manage data models reporting structures and analytics dashboards using AWS-native tools.
• Work with relational and NoSQL databases to support high-volume data processing and storage requirements.
• Implement cloud infrastructure solutions leveraging AWS services and container orchestration platforms such as Kubernetes or ECS.
• Collaborate with operations teams on backup disaster recovery data retention and security strategies.
• Participate in code reviews technical mentorship and collaborative problem-solving across the engineering organization.
• Evaluate and recommend modern technologies and frameworks that improve scalability efficiency and reliability.

Requirements:

• 3 years of professional experience in software engineering data engineering or cloud platform development.
• Strong experience building and maintaining scalable data platforms and distributed processing systems.
• Proficiency in Python PySpark Scala and/or Typescript.
• Hands-on experience developing Spark-based ETL and reporting frameworks using Spark SQL and Spark Streaming.
• Experience with AWS cloud services including tools such as S3 Redshift Glue Athena EMR Lambda Step Functions EventBridge and QuickSight.
• Knowledge of modern data storage and serialization formats such as Parquet and Iceberg.
• Experience with relational databases and NoSQL technologies.
• Strong understanding of cloud security concepts including IAM KMS encryption Secrets Manager and data access controls.
• Ability to independently troubleshoot technical challenges and deliver scalable solutions with minimal oversight.
• Experience designing cloud-native applications and services in production environments.
• Bachelors degree in Computer Science Engineering Mathematics or a related technical discipline or equivalent practical experience.

Preferred Experience:

• Experience building enterprise data lakes data platforms or Data-as-a-Service solutions.
• Familiarity with healthcare systems healthcare analytics or healthcare IT environments.
• Exposure to modern analytics and reporting platforms in large-scale cloud ecosystems.

All qualified applicants will receive consideration for employment without regard to race color national origin age ancestry religion sex sexual orientation gender identity gender expression marital status disability medical condition genetic information pregnancy or military or veteran status. You must be legally authorized to work in the United States without current or future sponsorship.