Lead Data Engineer (Databricks, SQL)
Chicago, IL - USA
Job Summary
Were building a relationship-oriented bank for the modern world. We need talented passionate professionals who are dedicated to doing whats right for our clients.
At CIBC we embrace your strengths and your ambitions so you are empowered at work. Our team members have what they need to make a meaningful impact and are truly valued for who they are and what they contribute.
To learn more about CIBC please visit
US Technology Infrastructure & Innovation (US TI&I) enables the continuous transformation of our Bank by accelerating the shift to digital strengthening operational resilience simplifying what we do improving CIBCs speed to market and protecting our Banks assets.
The teams work to maximize the investment in resources and technology while building an appropriate balance between high-touch client service and our fiduciary responsibility to protect CIBC our clients and our shareholders from undue risk.
What Youll Be Doing
The Lead Data Engineer (Databricks SQL) will own end-to-end delivery of U.S. Data Strategy capabilities including ETL analytics and data consumption aligned to a multi-year product roadmap. They will translate business and product objectives into secure scalable cloud data solutions in partnership with Product Architecture Data and key stakeholders. Continuously improve SDLC throughput via intake/estimation and KPI management and drive innovation through proofs of concept and continuous modernization. This is a hands-on position.
CIBC we enable the work environment most optimal for you to thrive in your role. Youll have the flexibility to manage your work activities within a hybrid work arrangement where youll spend 2 days per week on-site while other days may be remote.
How Youll Succeed
Strategic Delivery: Set goals aligned to strategy; translate priorities into roadmaps metrics dependencies and release plans; manage capacity and resourcing. Leverage GitHub Copilot in development best practices.
Technical Strategy and Architecture: Define secure scalable architecture; modernize and reduce technical debt. Drive best practice engineering through automation testing CI/CD observability and continuous improvement.
Industry and Domain Leadership: Apply banking/domain expertise to guide platform direction and improve client and operational outcomes.
Risk and Compliance Oversight: Embed risk management and security/privacy by design; ensure regulatory compliance and partner with Compliance/Audit. You oversee risk management activities within their area influence risk culture and align risk management with departmental goals. You also Oversee compliance adherence within their area of responsibility; ensure alignment with regulatory requirements; engage with Compliance and Audit teams as needed.
Lead by Example: Provide Technical Leadership be able to develop solutions based on Databricks/Python/PySpark as well as strong SQL Server experience.
Who You Are
You possess 8-12 years of related experience OR Combination of education and experience ideally within financial services or tech.
You possess Azure/Databricks data engineering expertise (PySpark/Scala ETL Azure SQL REST APIs). Expertise in data ingestions data pipeline development and optimization reporting and advanced analytics using Azure and Databricks (Pyspark/Scala) services and/or SQL Server/SSIS is a must.
Strong SQL Server development experience (required) and SSIS (desired) along with strong pipeline delivery skills (ingestion transformation optimization reporting/analytics).
You bring DevOps/SDLC excellence (CI/CD environment integrity security compliance release management) along with an exposure to Integration and BI Tools such as Tableau Cognos or Power BI. Automation mindset to reduce manual processes and improve operational efficiency is desired.
Agile delivery mastery (Jira/Azure DevOps story writing/pointing velocity management).
Executive-level communication for technical recommendations and governance forums.
Degree/diploma in Computer Science Engineering MIS or related field or relevant certifications and/or completion of a relevant bootcamp
Extensive knowledge of banking products (desired) services and industry regulations; expert understanding of current industry trends and developments; ability to influence strategic decisions using industry knowledge
California residents your privacy rights regarding your actual or prospective employment
At CIBC we offer a competitive total rewards package. This role has an expected salary range of $150000.00 - $170000.00 for the Chicago market based on experience qualifications and location of the position. The successful candidate may be eligible to participate in the relevant business units incentive compensation plan which may also include a discretionary bonus component. CIBC offers a full range of benefits and programs to meet our employees needs; including Medical Dental Vision Health Savings Account Life Insurance Disability and Other Insurance Plans Paid Time Off (including Sick Leave Parental Leave and Vacation) Holidaysand 401(k) in addition to other special perks reserved for our team members.
This position does not offer visa sponsorship.
#LI-TA
What CIBC Offers
At CIBC your goals are a priority. We start with your strengths and ambitions as an employee and strive to create opportunities to tap into your potential. We aspire to give you a career rather than just a paycheck.
We work to recognize you in meaningful personalized ways including a competitive salary incentive pay banking benefits a benefits program* a vacation offering wellbeing support and MomentMakers our social points-based recognition program.
Our spaces and technological toolkit will make it simple to bring together great minds to create innovative solutions that make a difference for our clients.
We cultivate a culture where you can express your ambition through initiatives like Purpose Day; a paid day off dedicated for you to use to invest in your growth and development.
*Subject to plan and program terms and conditions
What you need to know
CIBC is committed to creating an inclusive environment where all team members and clients feel like they belong. We seek applicants with a wide range of abilities and we provide an accessible candidate experience. If you need accommodation please contact
You need to be legally eligible to work at the location(s) specified above and where applicable must have a valid work or study permit.
We may ask you to complete an attribute-based assessment and other skills tests (such as simulation coding MS Office). Our goal for the application process is to get to know more about you all that you have to offer and give you the opportunity to learn more about us.
Job Location
IL-70 W Madison St 8th FlEmployment Type
RegularWeekly Hours
40Skills
Analytical Thinking Application Development Applications Programming Azure API Management Azure App Service Azure Blob Storage Azure Repos Azure Storage Databricks Platform Databricks SQL Databricks Unity Catalog Emerging Technologies Mentoring Staff Microsoft Azure Microsoft Azure Databricks Microsoft Azure Functions PySpark Python Software Development SQL Server Integration Services (SSIS) SSIS Packages Work CollaborativelyRequired Experience:
IC