Job Description:
Short Description:
Client is looking for a senior data engineer for its data modernization efforts associated with its Medicaid data ecosystem.
Complete Description:
1. Position Purpose
The Senior Data Engineer serves as the primary technical engine for the agencys Medicaid data ecosystem. This role is unique: it requires a high-level mastery of our current legacy environmentcharacterized by SSIS ETL processes managed via Team Foundation Server (TFS)while actively spearheading the execution of our cloud modernization roadmap. Under the direction of the Lead Data Warehouse Solution Architect you will ensure the stability of current Medicaid reporting while building the future-state Azure Synapse and Databricks Lakehouse.
2. Key Responsibilities
A. Legacy Maintenance & Operational Excellence (Current State)
- ETL Management: Maintain troubleshoot and modify complex SSIS packages handling high-volume Medicaid claims provider and member data.
- Version Control: Manage code deployments and branching strategies within TFS ensuring continuous integration of legacy SQL assets.
- Legacy Reporting Support: Support and optimize SSRS report queries and SSAS tabular/multidimensional models to ensure federal and state compliance reporting remains uninterrupted.
B. Modernization & Migration Execution (Future State)
- Cloud Development: Implement Medallion Architecture (Bronze/Silver/Gold) using Azure Databricks (PySpark/SQL) as designed by the Lead Architect.
- Pipeline Refactoring: Lead the transition of legacy SSIS logic into Azure Data Factory (ADF) and Databricks notebooks.
- DevOps Transformation: Facilitate the migration of source control and CI/CD pipelines from TFS to Azure DevOps (Git).
- Synapse Integration: Build and tune Dedicated and Serverless SQL Pools within Azure Synapse to facilitate advanced analytics and AI-readiness.
C. Data Governance & Security
- Medicaid Compliance: Implement Row-Level Security (RLS) and automated data masking for PHI/PII in accordance with HIPAA CMS MARS-E and NIST standards.
- Data Quality: Develop automated data validation frameworks to ensure data parity between legacy SQL systems and the new Cloud Lakehouse.
3. Competencies for Success
- Technical Agility: The ability to pivot between a 10-year-old SSIS package and a modern Databricks Spark job in the same day.
- Collaboration: Ability to take high-level architectural blueprints from the Lead Architect and translate them into high-performance production-ready code.
- Attention to Detail: Absolute precision in Medicaid data handling where an error in logic can impact member benefits or federal funding.
CONTRACT JOB DESCRIPTION
Responsibilities:
Leads the adoption or implementation of an advanced technology or platform.
Expert on the functionality or usage of a particular system platform or technology product.
Serves as a consultant to clients guiding the efficient use or adoption of a particular IT product or platform.
Creates implementation testing and/or integration plans.
Demonstrates expertise in a particular IT platform or service allowing for maximum IT investment.
Minimum Education/ Certification Requirements:
Bachelors degree in Information Technology or related field or equivalent experience.
Training or certification in a particular product or IT platform/service as required.
Technical Skills:
Maintaining SQL Server (SSIS/SSAS/SSRS) while concurrently deploying Azure cloud solutions.
Expert-level proficiency in SSIS and T-SQL. Advanced proficiency in Azure Databricks (Unity Catalog Delta Lake) and Azure Synapse.
Deep experience with TFS (Team Foundation Server) and a strong desire to migrate workflows to Git/Azure DevOps.
Mastery of SQL and Python (PySpark).
6-10 yrs. leading advanced technology projects or service projects
6-10 yrs. full system engineering lifecycle
Experience with Microsoft Purview for data cataloging.
Extensive experience with Medicaid/Medicare data structures (e.g. MMIS EDI 837/835 claims processing).
Microsoft Certified: Azure Data Engineer Associate or Databricks Certified Professional Data Engineer.
Experience in a government or highly regulated environment.
Flexible work from home options available.
About Us
AHU Technologies INC. is an IT consulting and permanent staffing firm that meets and exceeds the evolving IT service needs of leading corporations within the United States. We have been providing IT solutions to customers from different industry sectors helping them control costs and release internal resources to focus on strategic issues.
AHU Technologies INC. was co-founded by visionary young techno-commercial entrepreneurs who remain as our principal consultants. Maintaining working relationships with a cadre of other highly skilled independent consultants we have a growing number of resources available for development projects. We are currently working on Various projects such as media entertainment ERP Solutions data warehousing Web Applications Telecommunications and medical to our clients all over the world.