Azure Data Engineer

Innovitusa

Not Interested
Bookmark
Report This Job

profile Job Location:

Jackson, MO - USA

profile Monthly Salary: Not Disclosed
Posted on: Yesterday
Vacancies: 1 Vacancy

Job Summary

Description

Design build and maintain Azure-based data pipelines using Synapse Analytics to support MSIS and related education systems.

Develop and optimize ETL/ELT processes to ingest transform and validate K-12 education data from multiple source systems.

Implement and manage data models views and performance tuning in Azure SQL and Synapse environments.

Monitor troubleshoot and resolve data pipeline and performance issues.

Document data flows transformations and technical standards.

Collaborate with analysts reporting teams and vendors to deliver timely accurate data for federal and state reporting.

Required Skills

A minimum of 5 years of experience in the following:

Advanced development and orchestration of data pipelines using Azure Data Factory/Synapse or similar cloud based platforms. (pipelines triggers integration runtimes parameterization).

Data warehousing and analytics engineering using Azure Synapse Analytics or similar cloud based platforms (dedicated and serverless SQL pools).

Strong T-SQL skills including query optimization indexing strategies stored procedures and performance tuning.

Implementation of ETL/ELT frameworks including incremental loads CDC patterns and error handling.

Integration of structured and semi-structured data (CSV JSON XML) from APIs SFTP and vendor systems.

Source control and deployment practices using Azure DevOps Git and CI/CD pipelines.

Preferred Skills:

Experience with student information management systems and K-12 data and reporting

Experience with Common Education Data Standards (CEDS)

Azure Data Engineer Associate certification

Description Design build and maintain Azure-based data pipelines using Synapse Analytics to support MSIS and related education systems. Develop and optimize ETL/ELT processes to ingest transform and validate K-12 education data from multiple source systems. Implement and manage data models views ...
View more view more

Key Skills

  • Apache Hive
  • S3
  • Hadoop
  • Redshift
  • Spark
  • AWS
  • Apache Pig
  • NoSQL
  • Big Data
  • Data Warehouse
  • Kafka
  • Scala