Employer Active
Job Alert
You will be updated with latest job alerts via emailJob Alert
You will be updated with latest job alerts via emailNot Disclosed
Salary Not Disclosed
1 Vacancy
Own the end-to-end architecture deployment and lifecycle management of the Databricks platform on AWS
Optimize platform performance scalability cost-efficiency and security
Partner with DevOps and cloud infrastructure teams to uphold reliability and compliance standards
Design and architect Unity Catalog integration with enterprise metadata solutions like Atlan
Configure platform integrations with AWS-native services data science platforms (e.g. POSIT) and multiple notebook environments
Establish and codify development best practices for data engineering notebooks and secure data sharing
Collaborate across engineering governance and business teams to align technical strategy with stakeholder needs
Lead architectural planning and delivery coordination alongside security governance and analytics teams
Bachelors or Masters degree in Computer Science Data Engineering or a related field
8 years of experience in data platform engineering including 4 years managing Databricks environments
Deep familiarity with data catalog tools (Atlan or similar)
Proficient in Spark Python SQL and AWS services such as S3 IAM CloudWatch
Strong understanding of data security and governance frameworks
Excellent communication skills and stakeholder management abilities
Thanks
Jay
Full-time