drjobs Senior Data Engineer Bangalore

Senior Data Engineer Bangalore

Employer Active

1 Vacancy
drjobs

Job Alert

You will be updated with latest job alerts via email
Valid email field required
Send jobs
Send me jobs like this
drjobs

Job Alert

You will be updated with latest job alerts via email

Valid email field required
Send jobs
Job Location drjobs

Bengaluru Rural - India

Monthly Salary drjobs

Not Disclosed

drjobs

Salary Not Disclosed

Vacancy

1 Vacancy

Job Description

Location: Bangalore (Hybrid)

We are seeking a Senior Data Engineer to join our team and leverage their expertise in Snowflake dbt and data transformation tools to build and maintain scalable data pipelines. You will be responsible for extracting transforming and loading (ETL) data from Microsoft SQL Server (MSSQL) into our Snowflake data warehouse ensuring clean reliable data for analysis and reporting.

WHAT YOU WILL DO

  • Design develop and maintain data pipelines using Snowflake dbt or Coalesce.
  • Write and optimize SQL queries within dbt for efficient data transformation in Snowflake.
  • Utilize Coalesce or similar data transformation tools to migrate data from MSSQL to Snowflake.
  • Cleanse validate and transform data to ensure accuracy and consistency.
  • Design and implement data models in dbt to transform raw data into analyticalready datasets.
  • Automate data pipelines and ensure their reliability and scalability.
  • Collaborate with data analysts data scientists and business stakeholders to understand data needs and translate them into technical solutions.
  • Develop and implement unit tests for data pipelines and data models.
  • Monitor and troubleshoot data pipelines for any issues.
  • Document data pipelines and models for future reference.

WHO YOU ARE

  • Bachelors degree in Computer Science Data Science Statistics or a related field
  • 57 years of experience as a Data Engineer or similar role.
  • Proven experience with Snowflake including writing SQL queries and leveraging its functionalities.
  • Expertise in dbt including model development testing and deployment.
  • Experience with Python language.
  • Experience with data transformation tools like dbt Coalesce or Hevo Data.
  • Strong understanding of data warehousing concepts and best practices.
  • Experience with ETL/ELT processes.
  • Experience with ClickHouse.
  • Excellent SQL programming skills (TSQL and Snowflake SQL).
  • Experience with version control systems (e.g. Git).
  • Familiarity with data quality concepts and techniques.
  • Excellent communication and collaboration skills.

ADDITIONAL KNOWLEDGE/SKILLS/ABILITIES

  • Experience with cloud platforms (e.g. AWS Azure).
  • Experience with data orchestration tools (e.g. Airflow Luigi).
  • Experience with data governance and security practices.
  • Experience with Windows PowerShell Linux Shell


Required Experience:

Senior IC

Employment Type

Full-Time

Company Industry

About Company

Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.