Engineer II – Senior Data Engineer (Azure Databricks Data Engineering)

Work Location:

Hours:

Line of Business:

Pay Details:

TD is committed to providing fair and equitable compensation opportunities to all colleagues. Growth opportunities and skill development are defining features of the colleague experience at TD. Our compensation policies and practices have been designed to allow colleagues to progress through the salary range over time as they progress in their role. The base pay actually offered may vary based upon the candidates skills and experience job-related knowledge geographic location and other specific business and organizational needs.

As a candidate you are encouraged to ask compensation related questions and have an open dialogue with your recruiter who can provide you more specific details for this role.

Job Description:

Develops and maintains technical solutions that adhere to engineering and architectural design principles while meeting business requirements.

Provides deep technical expertise in data engineering with a focus on Azure Databricks Python notebook development job orchestration API service layers and scalable data platforms across ADLS ADF Azure Databricks (including Unity Catalog and Lakeflow) Azure SQL Airflow and SQL.

Designs builds operationalizes and supports reliable secure and high-performing enterprise-grade data solutions that can scale to process multi-millions of records daily in compliance with enterprise and industry standards.

KEY ACCOUNTABILITIES

CUSTOMER

• Leverage deep technology expertise in data engineering Azure Databricks Python SQL and cloud data platforms for own area of specialization to deliver and ensure that all areas across the organization that provision manage and support various technologies have the necessary tools processes and documentation required to effectively execute on their respective mandates
• Execute on Engineering strategy as it relates to the introduction of tools and the automation of data ingestion transformation notebook execution job scheduling and deployment activities across Azure Databricks ADF Airflow API services and Azure-based data platforms
• Partner with the Operations team to automatically integrate with appropriate tools and processes as part of automated/self-serve data pipeline notebook job and API service releases
• Work with partners across Technology and apply in-depth understanding of relevant business data needs to identify and leverage synergies across the various areas
• Act as the expert or lead innovator and agent of change for the programs and services under management driving modern data engineering practices reusable frameworks and platform standards
• Work with other teams to implement best practices for engineering and management including enterprise-grade software development reusable engineering frameworks and AI integration into the SDLC through reusable prompts skills instructions and agents
• Work with vendor platform providers and engineering peers to keep abreast of trends products frameworks and applications
• Identify and effectively manage stakeholder engagement and impacts across the enterprise
• Interpret client needs assess engineering related requirements and identify solutions to non-standard requests

SHAREHOLDER

• Apply best practices and knowledge of internal / external business issues to improve products or services in own discipline
• Monitor and control costs within own work
• May interact with governance and control groups (e.g. regulatory / operational risk compliance and audit) to provide subject matter expertise and consult on risk issues / items related to Engineering technology and tools
• May develop and/or contribute to negotiations of third party contracts/agreements
• Maintain knowledge and understanding of external development engineering and emerging solutions market conditions and their impact with particular focus on cloud data engineering Databricks capabilities API enablement and scalable data processing patterns
• Proactively identify emerging technologies and innovative solutions for building more robust platform domains including data platforms capable of handling multi-millions of records daily with strong reliability governance and performance

EMPLOYEE / TEAM

• Continuously enhance knowledge/expertise in own area and keep current with emerging industry trends new technologies and best practices in the external market that can contribute to delivering effective client solutions across Azure Databricks ADLS ADF Azure SQL Airflow SQL API service development and modern data engineering tooling
• Prioritize and manage own workload in order to deliver quality results and meet timelines
• Support a positive work environment that promotes service to the business quality innovation and teamwork and ensure timely communication of issues/ points of interest
• Participate in knowledge transfer with senior management the team other technical areas and business units
• Work effectively as a team supporting other members of the team in achieving business objectives and providing client services
• Identify and recommend opportunities to enhance productivity effectiveness and operational efficiency of the business unit and/or team through reusable data engineering components automated orchestration AI-assisted SDLC practices and scalable processing frameworks

BREADTH & DEPTH

• Expert knowledge of specific domain or range of engineering frameworks technology tools processes and procedures as well as organization issues with specialization in Azure Databricks Python notebook development job orchestration SQL API service layers ADLS ADF Azure SQL Airflow Unity Catalog and Lakeflow
• Expert knowledge of TD applications systems networks innovation design activities best practices business / organization Bank standards and may fulfill a governance role across enterprise data ecosystems data governance and scalable cloud platform implementations
• Expert knowledge and experience in own discipline as a senior data engineer building enterprise-grade software reusable frameworks and robust data services; integrates knowledge of business and functional priorities
• Acts as a key contributor in a complex and critical environment delivering scalable data solutions that support processing of multi-millions of records daily
• May provide leadership to teams or projects; shares expertise
• Applies in-depth skills and broad knowledge of the business to address complex problems and non-standard situations involving large-scale data ingestion transformation orchestration API enablement and governed analytics platforms
• Generally reports to a Senior Manager or above

EXPERIENCE & EDUCATION

• University or post-graduate degree
• Strong academic background (e.g. computer science engineering)
• 7 years relevant experience in data engineering including Azure Databricks Python notebooks job orchestration SQL development API service layer implementation and hands-on experience with ADLS ADF Azure Databricks (with Unity Catalog and Lakeflow) Azure SQL and Airflow
• Nice to have: experience integrating AI into the SDLC using reusable prompts skills instructions and agents; building enterprise-grade software and frameworks; and designing scalable solutions capable of handling multi-millions of records daily.

Who We Are:

TD is one of the worlds leading global financial institutions and is the fifth largest bank in North America by branches/stores. Every day we strive to make every interaction product and experience remarkably human and refreshingly simple for over 27 million households and businesses in Canada the United States and around the world. More than 95000 TD colleagues bring their skills talent and creativity to foster deeper relationships ensure disciplined execution and build a simpler faster banking experience. TD is deeply committed to being a leader in client experience that is why we believe that all colleagues no matter where they work are client facing. Together we are reimagining what banking can be for our clients colleagues and communities.

Our Total Rewards Package
Our Total Rewards package reflects the investments we make in our colleagues to help them and their families achieve their financial physical and mental well-being goals. Total Rewards at TD includes a base salary variable compensation and several other key plans such as health and well-being benefits savings and retirement programs paid time off banking benefits and discounts career development and reward and recognition programs. Learn more

Additional Information:
Were delighted that youre considering building a career with TD. Through regular development conversations training programs and a competitive benefits plan were committed to providing the support our colleagues need to thrive both at work and at home.

Please be advised that this job opportunity is subject to provincial regulation for employment purposes. It is imperative to acknowledge that each province or territory within the jurisdiction of Canada may have its own set of regulations requirements.

Colleague Development

If youre interested in a specific career path or are looking to build certain skills we want to help you succeed. Youll have regular career development and performance conversations with your manager as well as access to an online learning platform and a variety of mentoring programs to help you unlock future opportunities.

If youre passionate about helping clients and building deep lasting relationships TD offers diverse career paths where you can grow your expertise and make a meaningful impact.

Were committed to your success and foster a respectful workplace where diverse perspectives are valued everyone has fair opportunities to grow and you can unlock your full potential to achieve your career goals. Here at TD we hire and develop the best.

Training & Onboarding
We will provide training and onboarding sessions to ensure that youve got everything you need to succeed in your new role.

Interview Process
Well reach out to candidates of interest to schedule an interview. We do our best to communicate outcomes to all applicants by email or phone call.

Accommodation
Your accessibility is important to us. Please let us know if youd like accommodations (including accessible meeting rooms captioning for virtual interviews etc.) to help us remove barriers so that you can participate throughout the interview process.

We look forward to hearing from you!

Language Requirement (Quebec only):