drjobs Sr Data Engineer

Sr Data Engineer

Employer Active

1 Vacancy
drjobs

Job Alert

You will be updated with latest job alerts via email
Valid email field required
Send jobs
Send me jobs like this
drjobs

Job Alert

You will be updated with latest job alerts via email

Valid email field required
Send jobs
Job Location drjobs

Pune - India

Monthly Salary drjobs

Not Disclosed

drjobs

Salary Not Disclosed

Vacancy

1 Vacancy

Job Description

Position Summary:

We are seeking a talented Sr. Data Engineer with a strong background in data engineering to join our team. You will play a key role in designing building and maintaining data pipelines using a variety of technologies with a focus on the Microsoft Azure cloud platform.

Responsibilities:

  • Design develop and implement data pipelines using Azure Data Factory (ADF) or other orchestration tools.
  • Write efficient SQL queries to extract transform and load (ETL) data from various sources into Azure Synapse Analytics.
  • Utilize PySpark and Python for complex data processing tasks on large datasets within Azure Databricks.
  • Collaborate with data analysts to understand data requirements and ensure data quality.
  • Handson experience in designing and developing Datalakes and Warehouses
  • Implement data governance practices to ensure data security and compliance.
  • Monitor and maintain data pipelines for optimal performance and troubleshoot any issues.
  • Develop and maintain unit tests for data pipeline code.
  • Work collaboratively with other engineers and data professionals in an Agile development environment.

Preferred Skills & Experience:

  • Good knowledge of PySpark & working knowledge of Python
  • Full stack Azure Data Engineering skills (Azure Data Factory DataBricks and Synapse Analytics)
  • Experience with large dataset handling
  • Handson experience in designing and developing Datalakes and Warehouses

New Vision is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees


Required Experience:

Senior IC

Employment Type

Full-Time

Company Industry

About Company

Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.