Data Scientist

Data Scientist

We are seeking a Data Scientist to join our team. The selected candidate will work in a hybrid schedule in Indianapolis Indiana.

This role supports data integration pipeline development data modeling governance and documentation while collaborating with cross-functional teams to deliver high-quality reliable data products for the agency.

The position plays a key role in implementing the agencys data strategy by developing batch and streaming pipelines optimizing data warehouse workloads and enforcing data governance standards. The position assists with requirements gathering solution reviews and technical support and works closely with data architects scientists analysts and project managers to translate business needs into technical designs. This role supports operational processes contributes to policy and procedure improvements and may provide mentorship or supervision based on agency needs.

Job Duties

• Assists with the data technology strategy including resolving strategic data integration issues such as data quality and stewardship real-time and event-based data integration and crafting a universal vision for data integration.

• Provides direction and oversight for the design and implementation of data solutions for integration and synthesis across multiple secure systems.

• Assists with the definition implementation and continued adherence to new data management policies and design standards for data engineering.

• Provides advice training and technical support for various projects.

• Participates in project activities such as requirements gathering solution reviews and explaining technical complexities to non-technical personnel.

• Works closely with solution leads project managers data architects data scientists and data analysts on solution design architecture and implementation.

• Assists with extraction transformation and loading of data from a wide variety of data sources using various data engineering tools and methods.

• Designs builds and maintains batch and streaming data pipelines in Azure Databricks using PySpark Spark SQL and Delta Lake following a medallion (bronze/silver/gold) lakehouse architecture.

• Develops loads and tunes dimensional data models and SQL workloads in Azure Synapse Analytics (dedicated and serverless SQL pools) to support reporting and dashboard needs.

• Orchestrates and monitors data workflows using Databricks Workflows/Jobs and Synapse or Azure Data Factory pipelines including scheduling alerting and failure recovery.

• Applies data governance and security controls (e.g. Unity Catalog permissions role-based access row- and column-level security and data masking) to protect sensitive health data (PHI/PII) in accordance with HIPAA and agency policy.

• Assists in documenting and demonstrating solutions by developing documentation flowcharts layouts diagrams charts code comments and clear code.

• Assists in operations by conducting systems analysis and recommending changes in policies and procedures.

Additional Information

The job description is not designed to cover or contain a comprehensive listing of activities duties or responsibilities required of the employee. Other duties responsibilities and activities may change or be assigned at any time.