Databricks Engineer

About the team:

Capco is a fully independent global management and technology consultancy. For nearly 20 years we have combined innovative thinking with deep industry knowledge to deliver business consulting digital transformation and technology services to Finance and Energy markets. Our collaborative and efficient approach helps clients reduce costs and manage risk and regulatory change while increasing revenues. We are thinkers innovators and disruptors. We are small enough to care but large enough to matter

About the Job:

As a member of our Data Team you will design and implement a comprehensive data strategy ensuring high-quality data management transformation and integration to meet project goals. You will need a strong background in data migration from RDBMS to Databricks and a deep understanding of modern data architecture principles. You will collaborate with stakeholders and leverage best practices in data governance analytics and process optimization.

What Youll Get to Do:

• Implement scalable data solutions on Databricks to drive business insights and operational efficiency
• Translate complex business requirements into technical solutions leveraging Databricks and modern data platforms
• Lead strategic data migrations from legacy RDBMS systems to cloud-native Databricks environments with minimal disruption
• Design and optimize data pipelines that support enterprise-wide analytics reporting and machine learning initiatives
• Develop robust ETL frameworks using Databricks to ensure high-quality timely and secure data delivery
• Continuously improve data workflows for performance scalability and cost-efficiency aligning with business KPIs
• Collaborate with cross-functional teamsincluding product analytics and ITto align data solutions with organizational goals
• Establish and enforce data engineering best practices ensuring consistency quality and compliance across projects.
• Evaluate emerging technologies and recommend tools that enhance data capabilities and business values
• Mentor junior engineers fostering a culture of continuous learning and technical excellence
• Operationalize machine learning pipelines on Databricks from data preparation to model deployment and monitoring
• Partner with DevOps and infrastructure teams to ensure reliable and secure deployment of data systems
• Ensure compliance with data governance privacy and regulatory standards integrating controls into data workflows
• Align data architecture with enterprise IT strategy working closely with architects and leadership to support long-term scalability

What Youll Bring With You:

• Proven experience delivering data-driven solutions using Databricks with a focus on business impact and scalability
• Databricks certifications and hands-on expertise in building ETL pipelines data lakes and ML workflows
• Experience with cloud platforms such as AWS Azure or GCP and understanding of their data ecosystems
• Strong grasp of big data technologies (e.g. Spark Delta Lake) and modern data architecture principles
• Proficient in machine learning lifecycle management using tools like MLflow scikit-learn and Spark MLlib
• Deep understanding of data modeling warehousing and SQL with experience in both traditional and cloud-native environments
• Skills in Python and SQL with the ability to write clean maintainable and efficient code
• Knowledge of data governance quality frameworks and security best practices
• Familiarity with containerization (Docker) and orchestration (Kubernetes) for scalable deployments
• Strong analytical and problem-solving skills with a consulting mindset for identifying opportunities and delivering value
• Excellent communication and stakeholder management skills with experience presenting technical concepts to non-technical audiences
• Bachelors or Masters degree in Computer Science Engineering or a related field

Why Capco

A career at Capco is a chance to help reshape the competitive landscape in financial services. We launch new banks transform existing ones and help our clients navigate complex change. As consultants we work on the front-end business design all the way through to technology implementation.

We are the largest Financial Services focused consultancy in the world serving everyone from global banks to emerging FinTechs from strategy through digital transformation design business consulting data and analytics cyber cloud technology architecture and engineering.

Capco is a young and growing firm. We maintain an entrepreneurial spirit and growth mindset and have minimal bureaucracy. We have no internal silos that get in the way of your career opportunities or ability to focus on our clients and make a difference to the business. We offer the opportunity for everyone to learn rapidly take on tough challenges and get promoted quickly. We take pride in our creative collaborative diverse and inclusive culture where everyone can #BYAW.

We offer highly competitive benefits including medical dental and vision insurance a 401(k) plan tuition reimbursement and a work culture focused on innovation and creation of lasting value for our clients and employees

Ready to get started

If this sounds like you we would love to hear from you. This is an opportunity to make a difference and contribute to a highly successful company with a significant growth trajectory.

We have been informed of several recruitment scams targeting the public. We strongly advise you to verify identities before engaging in recruitment related communication. All official Capco communication will be conducted via a Capco recruiter.