Data Engineer
Cupertino, CA - USA
Job Summary
Location: Remote (California)
We are seeking a Junior Data Engineer to support a confidential project within the Health sector. This role will focus on modernizing data pipelines optimizing metric computation and enabling scalable analytics through cloud-based solutions.
Airflow pipeline overhaul
- Build out of Athena Operator support for Airflow jobs
- Custom SQL hidden in QuickSight moved under source control
- Compute moved to AWS Athena where possible
- Correct operators used for Python jobs
- Rebuild of Airflow testing process to remove need for separate Airflow testing for query-only updates
Metric job optimization
- AI-driven scan of code to look for improvement opportunities
- Investigation of whether and when to use Spark
Automated metrics extraction
- AI-based sweep of code to build text-based metrics descriptors
- Generation of v1 metrics catalog pulling from metric descriptors
- 3 years experience as a Data Engineer supporting complex enviroments
- Hands on experience with AWS services specifically Athena and managed Airlfow for using Python plus familiarity with Github and Apache Spark
- Strong programming skills in SQL Python and Pandas for writing code
- AI Agentic Coding experience to support day to day productivity for production at scale day to day use not something you use on the side for fun. Preferably skill creating and integrating custom MCPs. Claude Code Gemini Copilot or any similar tool will suffice.
- Experience with CI/CD tools such as Concourse CI or similar pipelines
- Familiarity with AWS Glue
- Experience with medical care delivery data
About INSPYR Solutions
Technology is our focus and quality is our commitment. As a national expert in delivering flexible technology and talent solutions we strategically align industry and technical expertise with our clients business objectives and cultural needs. Our solutions are tailored to each client and include a wide variety of professional services project and talent solutions. By always striving for excellence and focusing on the human aspect of our business we work seamlessly with our talent and clients to match the right solutions to the right opportunities. Learn more about us at .
INSPYR Solutions provides Equal Employment Opportunities (EEO) to all employees and applicants for employment without regard to race color religion sex national origin age disability or addition to federal law requirements INSPYR Solutions complies with applicable state and local laws governing nondiscrimination in employment in every location in which the company has facilities.
INSPYR Solutions provides Equal Employment Opportunities (EEO) to all employees and applicants for employment without regard to race color religion sex national origin age disability genetics or any other protected status. INSPYR Solutions complies with all applicable laws governing nondiscrimination in employment in every location in which the company has facilities. Applicants requiring reasonable accommodation during the application or interview process should contact for assistance.
Information collected and processed through your application with INSPYR Solutions (including any job applications you choose to submit) is subject to INSPYR Solutions Privacy Policy and INSPYR Solutions AI and Automated Employment Decision Tool Policy: By submitting an application you are consenting to being contacted by INSPYR Solutions through phone email or text.
Required Experience:
IC