Data Engineering Specialist
Data Engineering Specialist
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
We are banking at another level.
Choosing BDC as your employer means working in a healthy inclusive and skilled workplace that puts forward the best conditions to bring together unique teams where employees are empowered to act. It also means being at the centre of ambitious economic and financial projects to see further and to do things differently to fuel the success of Canadian entrepreneurs.
Choosing BDC as your employer also means:
Flexible and competitive benefits including an Employee Savings and Investment Plan where BDC matches part of your voluntary contributions a Defined Benefit Pension Plan a $750 wellness and health care spending account to name a few
In addition to paid vacation each year five personal days sick days as necessary and our offices are closed from December 25 to January 1
A hybrid work model that truly balances work and personal life
Opportunities for learning training and development and much more...
POSITION OVERVIEW
As a Data Engineer you will be working at the data platform team and contribute to enterprisewide best practices processes and platforms for BDCs strategy.
The bulk of the work will be in data exploration data ingestion data transformation data preparation designing building and developing pipelines consolidating streaming and batch data sources into the Enterprise Data Lake.
You will work on the frameworks and libraries that data platform team creates and maintains to progress from data to value.
CHALLENGES TO BE MET
- Participate with data analysts to map data fields to answer business needs
- Ingest curate wrangle and prepare data for use in AAAI models and other systems
- Collaborate with Data Governance Office and participate in data governance practices (data lifecycle management data quality management data cataloging and metadata management)
- Support databricks business users community
- Design build and develop ELT pipelines consolidating streaming and batch data sources into the Data Lake zones
- Design code unit test and integrate new features and functionality to BDCs data engineering libraries
- Develop clean and maintainable code with continuous integration / continuous deployment (CI/CD) best practices to prevent integration problems and ensure the code is releasable at any point in time
- Create and maintain datasets on Azure Data Lake (ADLS) utilizing Azure Data Factory (ADF) and Azure Databricks
- Develop data ingestion transformation and preparation with Scala/Python and Apache Spark
- Contribute to designing and building the infrastructure required for optimal ingestion transformation and loading of data from a wide variety of data sources using Azure big data technologies (ADLS ADF Databricks and Azure Functions) and Power BI technologies
- Participate in scrum meetings and update stories on Azure DevOps
- Participate in the estimation of the stories based on the defined Acceptance Criteria Definition of Ready and Definition of Done
WHAT WE ARE LOOKING FOR
- A bachelors degree in IT Computer Science Statistics Mathematics or related fields
- 3 years of industry experience as a Data Engineer
- 3 years of experience with Databricks platform
- 2 years of experience with Python programming language
- Experience with Azure data factory
- Experience with the Azure DevOps pipelines
- Experience with SQL language and other relational database management systems
- Experience with Agile processes
- Strong interpersonal strong communication and documentation
- Bilingual (French & English)
Proudly one of Canadas Top 100 Employers and one of Canadas Best Diversity Employers we are committed to fostering a diverse equitable inclusive and accessible environment where all employees can thrive and feel empowered to bring their whole selves to work. If you require an accommodation to complete your application please do not hesitate to contact us at .
While we appreciate all applications we advise that only the candidates selected to participate in the recruitment process will be contacted.
Required Experience:
Unclear Seniority
Employment Type
Full-Time
