Senior Data EngineerData Architect

This is a remote position.

Senior Data Engineer/Data Architect

The agency is the State Medicaid Agency for South Carolina. This agency is focused on the modernization of the States Medicaid Management Information System (MMIS). The modernization is a major undertaking and requires major transformation of culture processes and technology. The modernization program supports the Departments transition from primarily a fee-for-service payor of claims towards a program and policy driver for health outcomes primarily through managed care programs. The programs strategy supports significant innovation in MMIS thinking and mindset and is aligned with MMIS innovation at the national level as well.

The Data Operations Hub (DOH) serves as the centralized platform and team responsible for ingesting validating transforming securing and provisioning all enterprise data to support analytics reporting operational efficiency and regulatory compliance.

The Candidate will be a key member of the Data Operations Hub Team. Your role involves designing developing and implementing analytical data solutions that align with the Agencys strategic goals. You will leverage your expertise in data architecture data modeling data migrations and data integration collaborating with cross-functional teams to achieve target state architecture goals.

Represent the Data Operations Hub team in various forums advising on Data Solutions.

Lead the design and maintenance of scalable data solutions including data lakes and warehouses.

Collaborate with cross-functional teams to ensure data product solutions support business needs and enable data-driven decision-making.

Evaluate and select data technologies driving the adoption of emerging technologies.

Develop architectural models using sparkx or other data modeling tool available and other artifacts to support data initiatives.

Serve as a subject matter expert in specific areas.

Experience with modern data processing technologies such as Python Java Airflow etc. using data mesh & data lake.

Contribute to the data engineering community and advocate for agency data practices.

Engage in hands-on coding and design to implement production solutions.

Optimize system performance by resolving inefficiencies.

Design reusable data frameworks using new technologies.

Education and Certifications:

Bachelors or Masters degree in Computer Science or related field.

Required Skills:

4 years experience as a Data Engineer or similar role leading technologists to manage anticipate and solve complex technical items within your domain of expertise

4 years hands-on experience in system design application development and operational stability

4 years experience and expertise in architecture disciplines and programming languages

4 years experience and deep knowledge of data architecture modeling integration cloud data services data domain driven design best practices and industry trends in data engineering

4 years practical experience with AWS/Azure services and data engineering disciplines

4 years advanced experience in one or more data engineering disciplines e.g. ETL/ELT event processing

4 years proficiency in SQL data warehousing solutions and cloud native relational databases e.g. Snowflake Athena Postgres

Preferred Skills:

4 years business architecture knowledge and experience with architecture assessment frameworks

Additional Skills:

Strong problem-solving communication and interpersonal skills

Ability to evaluate and recommend technologies for future state architecture