DataOpsCloud Data Engineer Senior
Share
Job Location:
Monthly Salary:
Posted on:
2 hours ago
Vacancies:
1 Vacancy
Job Summary
Job Summary:
The Senior Data Engineer is responsible for developing and operationalizing analytics-ready data products to support priority projects and system planning needs. This role involves collaborating with analysts methodologists and data scientists to design build and optimize datasets ensuring secure and accurate implementation of data masking cohort logic and patient identification approaches. The Data Engineer will work across diverse data assets adapt pipelines for performance and scalability and partner with Data Architecture ETL and IT Operations to move solutions from sandbox to production.
The Senior Data Engineer is responsible for developing and operationalizing analytics-ready data products to support priority projects and system planning needs. This role involves collaborating with analysts methodologists and data scientists to design build and optimize datasets ensuring secure and accurate implementation of data masking cohort logic and patient identification approaches. The Data Engineer will work across diverse data assets adapt pipelines for performance and scalability and partner with Data Architecture ETL and IT Operations to move solutions from sandbox to production.
Location:Toronto Ontario Canada
Responsibilities:
- Collaborate with analysts and data scientists to develop fit-for-purpose data products.
- Write and manage code for data masking cohort creation and patient identification algorithms.
- Design and build analytics-ready data tables for specific use cases.
- Optimize large datasets for performance processing and querying.
- Work with diverse domain data assets and formats.
- Partner with Data Architecture ETL and IT Operations to support sandboxes and operationalize data assets.
- Apply modern data engineering practices for consistency scalability and reliability.
- Communicate technical approaches and insights to stakeholders at all skill levels.
- Make sound decisions when navigating complex or ambiguous data engineering issues.
- Create reusable data transformation and data provisioning scripts.
- Develop cohort creation and patient matching algorithms.
- Optimize SQL views and performance-tuned data structures.
- Create technical documentation: data dictionaries lineage diagrams architecture notes data information sheets data and Information assets catalogue.
- Support environment setup optimization and support.
- Prepare reports and presentations for technical and non-technical stakeholders.
- Collaborate with analysts and data scientists to develop fit-for-purpose data products.
- Write and manage code for data masking cohort creation and patient identification algorithms.
- Design and build analytics-ready data tables for specific use cases.
- Optimize large datasets for performance processing and querying.
- Work with diverse domain data assets and formats.
- Partner with Data Architecture ETL and IT Operations to support sandboxes and operationalize data assets.
- Apply modern data engineering practices for consistency scalability and reliability.
- Communicate technical approaches and insights to stakeholders at all skill levels.
- Make sound decisions when navigating complex or ambiguous data engineering issues.
- Create reusable data transformation and data provisioning scripts.
- Develop cohort creation and patient matching algorithms.
- Optimize SQL views and performance-tuned data structures.
- Create technical documentation: data dictionaries lineage diagrams architecture notes data information sheets data and Information assets catalogue.
- Support environment setup optimization and support.
- Prepare reports and presentations for technical and non-technical stakeholders.
Required Skills & Certifications:
- 5 years of experience in using SQL Database design and Python.
- Working knowledge of PowerBI.
- Good documenting skills for technical approaches.
- Communicating effectively with stakeholders of varying technical expertise.
- Applying modern data engineering practices to ensure consistency reliability and timely delivery of high-quality data assets.
- Experience working with relational databases including writing SQL queries.
- 5 years of experience in using SQL Database design and Python.
- Working knowledge of PowerBI.
- Good documenting skills for technical approaches.
- Communicating effectively with stakeholders of varying technical expertise.
- Applying modern data engineering practices to ensure consistency reliability and timely delivery of high-quality data assets.
- Experience working with relational databases including writing SQL queries.
Preferred Skills & Certifications:
- Familiarity with SAS and Informatica ETL tool.
- Familiarity with Ontario Healthcare data privacy standards and policies.
- Familiarity with Microsoft Azure product line.
- Familiarity with Federal and provincial health care data.
- Public sector experience.
- Familiarity with SAS and Informatica ETL tool.
- Familiarity with Ontario Healthcare data privacy standards and policies.
- Familiarity with Microsoft Azure product line.
- Familiarity with Federal and provincial health care data.
- Public sector experience.
Special Considerations:
- Up to 2 days onsite (subject to hiring managers discretion).
- Up to 2 days onsite (subject to hiring managers discretion).
Scheduling:
- Not specified
- Not specified
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
