Data Engineer
Share
Job Location:
Monthly Salary:
Posted on:
30+ days ago
Vacancies:
1 Vacancy
Job Summary
Description
WHAT WE OFFER
Consistently named one of Canadas Best Employers by Forbes we offer a collaborative progressive workplace that takes pride in our organizational culture and is committed to living The 13 Factors of Psychological Health and Safety in the Workplace aligned with our vision to create strong caring and safe communities both within and outside our walls.
- Defined Benefit Pension Program - With the Ontario Municipality Employees Retirement System (OMERS) defined benefit pension plan you can confidently retire knowing that you will have income for life. Eligibility from date of hire as a full-time employee and includes employer-matched contributions.
- Employer of Choice - Recognized as the highest-ranking government employer in Canada and fourth overall among 300 organizations.
- Benefits and Wellness - Employees and their loved ones have access to a comprehensive employer-paid benefits plan that includes extended health dental and life insurance access to a 24/7 Employee and Family Assistance Programand corporate discounts and purchase plans for day-to-day products and services.
- Inclusive and Diverse Workforce - Were committed to fostering an environment that celebrates all dimensions of diversity and ensures everyone can develop to their full potential participate freely in society and live with respect dignity and freedom from discrimination. Our robust Inclusion Diversity Equity and Accessibility program continues to grow and has been recognized by the United Nations and many other organizations for our leadership.
POSITION PURPOSE
Reporting to the Program Manager Data Management & Business Intelligence is responsible for full lifecycle design and development implementation of new data platforms/solutions production support performance tuning of reporting environments including Extract Transform Load (ETL) batch and streaming data processes and for supporting the integration of those systems with other applications; works with internal and external stakeholders Corporate IT and Data Analytics and Visualization Branch to provide technical leadership in the analysis design implementation management and support of data-driven business systems following various departmental technology plans and utilizing approved IT solutions; designs and builds end-to-end solutions that enable business stakeholders to self-serve their business intelligence needs; consults with stakeholders to steer any new or enhancement related requirements to ensure stakeholder business needs are met; develops solution alternatives used to ingest and process data; works with multiple cross functional teams within IT and the business on developing solutions.
Reporting to the Program Manager Data Management & Business Intelligence is responsible for full lifecycle design and development implementation of new data platforms/solutions production support performance tuning of reporting environments including Extract Transform Load (ETL) batch and streaming data processes and for supporting the integration of those systems with other applications; works with internal and external stakeholders Corporate IT and Data Analytics and Visualization Branch to provide technical leadership in the analysis design implementation management and support of data-driven business systems following various departmental technology plans and utilizing approved IT solutions; designs and builds end-to-end solutions that enable business stakeholders to self-serve their business intelligence needs; consults with stakeholders to steer any new or enhancement related requirements to ensure stakeholder business needs are met; develops solution alternatives used to ingest and process data; works with multiple cross functional teams within IT and the business on developing solutions.
MAJOR RESPONSIBILITIES
- Works with ITS and vendors to design develop and provide solutions to support the data needs of applications analysis and support of the departments data management initiatives and related Master Data Management (MDM) processes.
- Assists in developing data centric strategy and department roadmap and obtains stakeholders approval.
- Analyzes business requirements suggests alternative approaches to reporting systems design working in collaboration with data and information architects and prepares a proof of concept for user consultation.
- Translates complex functional and technical requirements into detailed architecture designs logical data models physical databases and high performing software solutions.
- Maintains business systems documentation user licenses and renewal procedures.
- Manages complex data management and reporting projects and leads project teams ensuring timely delivery of products and services; tracks project activities timelines and project deliverables.
- Liaises with internal staff providing systems expertise and support; share information regarding initiatives and other best practices with Branch Department and Corporate staff;
- Performs other duties as assigned in accordance with Branch and Department objectives.
QUALIFICATIONS
- Successful completion of a University Degree in Computer Science Computer Engineering Information Technology or approved equivalent combination of education and experience.
- Minimum five (5) years demonstrated experience as a technology solutions architect/developer/ specialist or similar position/capacity.
- Must have experience in working with data modeling and analyzing large volume of data. Fluent in relational database streaming data processing concepts knowledge of current data management practices.
- Demonstrated experience in writing complex highly-optimized SQL queries across large datasets.
- Demonstrated knowledge and experience of software solutions development lifecycles/methodologies i.e. agile or other rapid application development methods.
- Experience providing project implementation analysis and support in data management systems data integrity and security as it relates to environmental business systems.
- Experience in unified data modelling for relational and NOSQL database and physical database design; programming languages (e.g. PL/SQL Visual Basic SQL JavaScript PHP and other open source languages).
- Web-based user interface design and development experience using advanced DHTML CSS JavaScript AJAX JQuery and Bootstrap; knowledge of ETL and visualization tools; Machine Learning concepts and tools (R Python and JavaScript FME and SSIS).
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
The Regional Municipality of York stretches north from Toronto to Lake Simcoe and includes many hectares of protected Greenbelt. York Region’s diversity is evident in our nine local municipalities, geography, economic development and population. York Region provides residents and bu ... View more
