Data Engineer

New York City, NY - USA

Yearly Salary: $ 120000 - 135000

Posted on: 23 hours ago

Vacancies: 1 Vacancy

Job Summary

Purpose of Position:

We are looking for an experienced and highly skilled Data Engineer to join our Data Governance Team. The ideal candidate will have a strong background in data engineering with specific experience in Databricks. You will be responsible for designing building and maintaining scalable data pipelines and architectures to enable advanced analytics and data-driven decision-making across the organization.

Essential Job Functions:

Design and develop scalable data pipelines using Databricks ensuring efficient data processing and integration from various sources.
Collaborate with data scientists analysts and business stakeholders to understand data requirements and deliver solutions that meet their needs.
Implement best practices for data management storage and retrieval focusing on optimizing performance and ensuring data integrity.
Work with large datasets and perform data cleansing transformation and aggregation to support analytics and reporting functions.
Monitor and troubleshoot data pipeline performance ensuring high availability and reliability.
Stay updated with the latest advancements in data engineering and Databricks technologies to continuously improve our data infrastructure.
Document data processes and workflows ensuring transparency and knowledge sharing across the team.
Ensure data security and compliance with regulatory requirements and industry best practices.

Perform other duties as directed.

Knowledge Skills and Experience Requirements:

Bachelors degree in Computer Science Information Technology Engineering orequivalent experience
3 years of experience as a Data Engineer preferred proven expertise in using Databricks.
Strong proficiency in data processing tools and languages such as SQL Python and Spark.
Experience with cloud platforms particularly Azure and integration with Databricks.
Understanding of data architecture principles and experience with ETL tools and methodologies.
Excellent problem-solving skills with the ability to manage multiple priorities in a fast-paced environment.
Strong communication skills with the ability to collaborate effectively with cross-functional teams.

Working Conditions:

This is a full-time position operating on a hybrid schedule with three days per week in the 275 7th Ave NY office.

Purpose of Position:We are looking for an experienced and highly skilled Data Engineer to join our Data Governance Team. The ideal candidate will have a strong background in data engineering with specific experience in Databricks. You will be responsible for designing building and maintaining scalab...

Purpose of Position:

Essential Job Functions:

Design and develop scalable data pipelines using Databricks ensuring efficient data processing and integration from various sources.
Collaborate with data scientists analysts and business stakeholders to understand data requirements and deliver solutions that meet their needs.
Implement best practices for data management storage and retrieval focusing on optimizing performance and ensuring data integrity.
Work with large datasets and perform data cleansing transformation and aggregation to support analytics and reporting functions.
Monitor and troubleshoot data pipeline performance ensuring high availability and reliability.
Stay updated with the latest advancements in data engineering and Databricks technologies to continuously improve our data infrastructure.
Document data processes and workflows ensuring transparency and knowledge sharing across the team.
Ensure data security and compliance with regulatory requirements and industry best practices.

Perform other duties as directed.

Knowledge Skills and Experience Requirements:

Bachelors degree in Computer Science Information Technology Engineering orequivalent experience
3 years of experience as a Data Engineer preferred proven expertise in using Databricks.
Strong proficiency in data processing tools and languages such as SQL Python and Spark.
Experience with cloud platforms particularly Azure and integration with Databricks.
Understanding of data architecture principles and experience with ETL tools and methodologies.
Excellent problem-solving skills with the ability to manage multiple priorities in a fast-paced environment.
Strong communication skills with the ability to collaborate effectively with cross-functional teams.

Working Conditions:

This is a full-time position operating on a hybrid schedule with three days per week in the 275 7th Ave NY office.