Data Engineer, Baton Rouge, La

Baton Rouge, LA - USA

Monthly Salary: Not Disclosed

Posted on: Yesterday

Vacancies: 1 Vacancy

Job Summary

Title: Data Engineer
Agency: State of Louisiana Louisiana Louisiana Department of Health
Location:628 North 4th Street Baton Rouge LA 70802
Telework Policy: The primary work location will be Contractor Remote Facility
RFR Number: SR-5253733
System or Program Supported: OPH DMI Team Staffing

The scope of the proposed services will include the following:

Assess feasibility and technical requirements for LINKS DataLake integration.
Collaborate with OPH Immunization Program OPH Bureau of Health Informatics and STChealthon data specifications and recurring ingestion pipelines.
Build and optimize ETL workflows for LINKS and complementary datasets (Vital Records labs registries).
Design scalable data workflows to improve data quality integrity and identity resolution.
Implement data governance observability and lineage tracking across all pipelines.
Mentor engineers support testing and enforce best practices in orchestration and architecture.
Document and communicate technical solutions to technical and non-technical stakeholders.
Expertise and/or relevant experience in the following areas are mandatory:
3 years of experience in data engineering and/or data architecture
2 years of experience with Python for ETL and automation (pandas requests API integration).
2 years hands-on experience with SQL queries stored procedures performance tuning (preferable Oracle SQL Server MySQL)
1 year experience with ETL orchestration tools (Prefect Airflow or equivalent).
1 year experience with cloud platforms (Azure AWS or GCP) including data onboarding/migration.
1 year exposure to data lake / medallion architecture (bronze silver gold)
2 years of experience providing written documentation and verbal communication for cross-functional collaboration.
Expertise and/or relevant experience in the following areas are desirable but not mandatory:
5 years of experience in data engineering roles
Experience integrating or developing REST/JSON or XML APIs
Familiarity with CI/CD pipelines (GitHub Actions Azure DevOps etc.).
Exposure to Infrastructure as Code experience (Terraform CloudFormation).
Experience with data governance and metadata tools (Atlan OpenMetadata Collibra).
Public health/healthcare dataset or similar experience including PHI/PII handling.
Familiarity with SAS and R workflows to support epidemiologists and analysts.
Experience with additional SQL platforms (Postgres Snowflake Redshift BigQuery).
Familiarity with data quality frameworks (Great Expectations Deequ).
Experience with real-time/streaming tools (Kafka Spark Streaming).
Familiarity with big data frameworks for large-scale transformations (Spark Hadoop).
Knowledge of data security and compliance frameworks (HIPAA SOC 2 etc.).
Agile/SCRUM team experience.

Debbie Pedigo
CEO / Senior Staffing Consultant

830.433.4604
210.401.4501

Pedigo Staffing Services

Cooperative Contracts:
DIR ITSAC (Department of Information) IT Staffing #DIR-CPO-5738
TIPS (Texas Interlocal Purchasing System) Staffing #230703
TIPS (Texas Interlocal Purchasing System) Technology Services #240101
BuyBoard Temporary Staffing #774-25
State of Louisiana IT Staffing #CW8873
State of Oklahoma IT Staffing #SW1025
State of Oklahoma Staffing #0132

Title: Data EngineerAgency: State of Louisiana Louisiana Louisiana Department of HealthLocation:628 North 4th Street Baton Rouge LA 70802Telework Policy: The primary work location will be Contractor Remote FacilityRFR Number: SR-5253733System or Program Supported: OPH DMI Team StaffingThe scope of t...

Assess feasibility and technical requirements for LINKS DataLake integration.
Collaborate with OPH Immunization Program OPH Bureau of Health Informatics and STChealthon data specifications and recurring ingestion pipelines.
Build and optimize ETL workflows for LINKS and complementary datasets (Vital Records labs registries).
Design scalable data workflows to improve data quality integrity and identity resolution.
Implement data governance observability and lineage tracking across all pipelines.
Mentor engineers support testing and enforce best practices in orchestration and architecture.
Document and communicate technical solutions to technical and non-technical stakeholders.
Expertise and/or relevant experience in the following areas are mandatory:
3 years of experience in data engineering and/or data architecture
2 years of experience with Python for ETL and automation (pandas requests API integration).
2 years hands-on experience with SQL queries stored procedures performance tuning (preferable Oracle SQL Server MySQL)
1 year experience with ETL orchestration tools (Prefect Airflow or equivalent).
1 year experience with cloud platforms (Azure AWS or GCP) including data onboarding/migration.
1 year exposure to data lake / medallion architecture (bronze silver gold)
2 years of experience providing written documentation and verbal communication for cross-functional collaboration.
Expertise and/or relevant experience in the following areas are desirable but not mandatory:
5 years of experience in data engineering roles
Experience integrating or developing REST/JSON or XML APIs
Familiarity with CI/CD pipelines (GitHub Actions Azure DevOps etc.).
Exposure to Infrastructure as Code experience (Terraform CloudFormation).
Experience with data governance and metadata tools (Atlan OpenMetadata Collibra).
Public health/healthcare dataset or similar experience including PHI/PII handling.
Familiarity with SAS and R workflows to support epidemiologists and analysts.
Experience with additional SQL platforms (Postgres Snowflake Redshift BigQuery).
Familiarity with data quality frameworks (Great Expectations Deequ).
Experience with real-time/streaming tools (Kafka Spark Streaming).
Familiarity with big data frameworks for large-scale transformations (Spark Hadoop).
Knowledge of data security and compliance frameworks (HIPAA SOC 2 etc.).
Agile/SCRUM team experience.