We are looking for a skilled and experienced Manager in Data Engineering with a focus on Databricks. The ideal candidate will lead our data engineering team to design develop and maintain our data infrastructure ensuring our data is accurate timely and available for analysis. The candidate will also be responsible for managing a team of data engineers to support our organizations data needs and work closely with other teams to ensure data integrity and compliance.
Responsibilities:
Manage a team of data engineers to develop maintain and improve data pipelines data architecture and data models using Databricks.
Design and implement scalable and efficient data processing solutions to meet business requirements.
Work closely with other teams including Data Science Product and Operations to ensure data quality accuracy and compliance with regulations.
Implement best practices for data governance data security and data privacy.
Manage and prioritize multiple projects and initiatives simultaneously.
Evaluate and recommend new technologies tools and processes to improve our data engineering capabilities.
Collaborate with other managers to develop and execute strategies to drive the organizations data initiatives.
Qualifications :
Bachelors or Masters degree in Computer Science Information Systems or related field.
6 years of experience in data engineering with a focus on Bigdata and Apache Spark based solutions.
2 years of Experience building and maintaining data pipelines using Databricks.
2 years of Experience managing a team of data engineers.
Strong understanding of distributed computing data architecture and data modeling.
Familiarity with cloud-based data platforms such as AWS Azure or Google Cloud.
Experience with SQL Python and other programming languages.
Excellent problem-solving skills and ability to prioritize and manage multiple tasks.
Strong communication and collaboration skills.
Experience in data governance data security and data privacy.
Familiarity with data security and privacy regulations such as GDPR and CCPA.
Preferred qualifications:
Databricks Certification(s).
Familiarity with agile development methodologies.
Remote Work :
No
Employment Type :
Full-time
Blend360 is an award-winning provider of data, analytics, and talent solutions for Fortune 500 companies. The company has made the Inc. 5000 list of Fastest Growing Companies every year they have been in business and has been awarded a world-class ranking in client satisfaction for th ... View more