Databricks Engineer

We are seeking a talented and experienced Databricks Engineer to join our innovative team in Bengaluru this role you will be responsible for designing implementing and optimising data pipelines and analytics solutions using the Databricks platform. You will collaborate closely with cross-functional teams to deliver high-quality scalable data solutions that drive business insights and decision-making.

• Develop and optimise ETL processes using Databricks and Apache Spark
• Design and implement efficient data models and schemas for optimal data storage and retrieval
• Collaborate with data scientists and analysts to build and deploy machine learning models
• Ensure data quality consistency and reliability across all data pipelines
• Optimise query performance and troubleshoot data processing issues
• Implement robust data security and access control measures
• Stay abreast of the latest Databricks features and best practices
• Participate in code reviews and contribute to the teams knowledge base
• Mentor junior team members and share expertise in big data technologies
• Develop and maintain documentation for data processes and workflows
• Collaborate with stakeholders to understand business requirements and translate them into technical solutions

Qualifications :

• Bachelors degree in Computer Science Data Science or a related field
• 6 years of experience in data engineering or a related field
• Strong proficiency in Databricks platform and Apache Spark
• Excellent SQL skills and experience with Python or Scala
• Proven experience in designing and implementing ETL processes and data pipelines
• Solid understanding of big data technologies and distributed computing concepts
• Experience working with cloud platforms such as AWS Azure or GCP
• Familiarity with version control systems preferably Git
• Strong analytical and problem-solving skills with keen attention to detail
• Excellent communication and collaboration skills
• Experience with data warehousing and analytics concepts
• Knowledge of data governance and compliance standards
• Experience with real-time data processing and streaming technologies
• Ability to work in a fast-paced dynamic environment and manage multiple priorities
• Databricks certifications are desirable

Additional Information :

At Version 1 we believe in providing our employees with a comprehensive benefits package that prioritises their well-being professional growth and financial stability. 

One of our standout advantages is the ability to work with a hybrid schedule along with business travel allowing our employees to strike a balance between work and life. We also offer a range of tech-related benefits including an innovative Tech Scheme to help keep our team members up-to-date with the latest technology. 

We prioritise the health and safety of our employees providing private medical and life insurance coverage as well as free eye tests and contributions towards glasses. Our team members can also stay ahead of the curve with incentivized certifications and accreditations including AWS Microsoft Oracle and Red Hat. 

Our employee-designed Profit Share scheme divides a portion of our companys profits each quarter amongst employees. We are dedicated to helping our employees reach their full potential offering Pathways Career Development Quarterly a programme designed to support professional growth. 

Remote Work :

No

Employment Type :

Full-time