Senior Data Engineer (Hybrid)

Serigor Inc.

Not Interested
Bookmark
Report This Job

profile Job Location:

Durham - USA

profile Monthly Salary: Not Disclosed
Posted on: 30+ days ago
Vacancies: 1 Vacancy

Job Summary

Job Title: Senior Data Engineer (Hybrid)
Location: Durham NC
Duration: 12 Month

Job Description:

The client is seeking a Senior Data Engineer to lead the development and optimization of end-to-end solutions using Microsoft Azure Synapse Analytics ensuring data accessibility performance and security for the Child Welfare Program.

The Department of Health and Human Services (DHHS) requires the assistance of a contract resource to serve as a Senior Synapse Data Engineer. The primary purpose of this position is to lead the development and optimization of our data pipelines analytics solutions and cloud-based data platforms. This role will be instrumental in designing and implementing end-to-end data engineering solutions using Microsoft Azure Synapse Analytics to meet child welfare business needs.

Key Responsibilities:

Synapse

  • Design Develop and maintain data models in Synapse to support reporting and analytics
  • Develop ETL solutions using Azure Synapse Analytics Pipelines and dedicated SQL pools for extraction transformation and aggregation from Salesforce objects.
  • Analyze the source system and design the ETL data load.
  • Ability to create and configure Azure Synapse Analytics workspace.
  • Create pipelines in Azure Synapse using Linked Services/Datasets/Pipeline to Extract Transform and Load data from different sources like SalesForce.
  • Perform needed monitoring troubleshooting and maintenance of the data architecture and pipelines.

Power BI Tools

  • Collaborate with data engineers analysts and stakeholders to gather requirements design visualizations and provide training to use self-service BI Tools.

Skills:

Skill

Required/Desired

Amount

of Experience

Experience in designing and optimizing scalable data pipelines using modern platforms like Azure Synapse Snowflake or Databricks workflows

Required

5

Years

Programming Languages: Strong proficiency in Python or Scala for data processing.

Required

3

Years

SQL Mastery: Advanced query writing performance tuning and optimization.

Required

7

Years

Experience with Data Modeling and Warehousing (star schema snowflake schema)

Required

4

Years

Experience with ETL/ELT processes

Required

5

Years

Experience with Azure Data Platform (Azure Data Factory Azure Data Lake and Azure SQL Database)

Highly desired

4

Years

Familiarity with Event Hubs Azure Stream Analytics and Azure Functions

Desired

4

Years

Experience with Programming and Scripting (SQL T-SQL and data query optimization)

Desired

1

Years

Experience with cloud platforms (e.g. AWS and Azure) and associated services for data processing and storage

Desired

5

Years

Experience with Power BI

Nice to have

1

Years

Job Title: Senior Data Engineer (Hybrid) Location: Durham NC Duration: 12 Month Job Description: The client is seeking a Senior Data Engineer to lead the development and optimization of end-to-end solutions using Microsoft Azure Synapse Analytics ensuring data accessibility performance and securi...
View more view more

Key Skills

  • Apache Hive
  • S3
  • Hadoop
  • Redshift
  • Spark
  • AWS
  • Apache Pig
  • NoSQL
  • Big Data
  • Data Warehouse
  • Kafka
  • Scala