Data Engineer
Job Summary
- Design deploy and maintain a centralized Azure ADLSGen2/Databricks/Synapse (or Snowflake) data lake that serves as the single source of truth
- Create batch & realtime ETL/ELT flows (Azure Event Hubs Kafka Spark Streaming) to ingest EHR data and operational telemetry
- Write and run complex migration scripts using Informatica PowerCenter/IDMC or Azure Data Factory to move data from Epic other EHRs and legacy OLTP stores into the lakehouse and Salesforce Health Cloud
- Build automated validation deduplication masking encryption and columnlevel security to guarantee 100% integrity and PHI compliance
- Build highthroughput pipelines (SOQL Bulk API2.0 Informatica MuleSoft dbt Python) that sync Health Cloud data with the central repository
- Transform HL7 FHIR and EDI messages into clean canonical schemas for storage and analytics
- Design Robust Data Models Perform ER/3NF modeling for OLTP and dimensional (star/snowflake/medallion) modeling for OLAP analytics
Qualifications :
- Bachelors degree in Computer Science Software Engineering Data Analytics or a related technical field
- Experience: 3-7 years of hands-on data engineering experience with a proven track record of executing complex data migration projects and building cloud data lake architectures.
- Expertise in ER (Entity-Relationship) diagramming relational database modeling (3NF for OLTP) and dimensional modeling (Star Schema Snowflake Medallion) for OLAP systems
- Experience with enterprise ETL platforms such as Informatica (Informatica PowerCenter / IDMC) Azure Data Factory SSIS or Talend for legacy data extraction and transformation
- Experience with cloud data architectures (Azure data services: Azure Data Factory ADLS Gen2 Azure Synapse Databricks) and familiarity with streaming/real-time pipelines (Event Hubs Kafka Spark Streaming)
- Experience working with Salesforce data structures SOQL Salesforce Bulk API and data loading tools ( Salesforce Data Loader MuleSoft Fivetran dbt or custom Python scripts)
- Expert-level SQL skills (complex joins CTEs window functions schema design index tuning and database optimization)
- Strong Python skills for data manipulation scripting and pipeline execution using libraries like Pandas PySpark and SQLAlchemy
- Compensation is based on experience (Annual salary range $95000 - $105 000)
#corpIT
Additional Information :
This position is a current vacancy
Spectrum Health Care is thrilled to be named one of Canadas Best Managed Companies. This award recognizes top companies across Canada for overall performance sustained growth strategy capabilities and innovation culture and commitment and leadership. Click here to learn more about this esteemed honour.
We thank all applicants however only those individuals selected for interviews will be contacted.
In accordance with the Accessibility for Ontarians with Disabilities Act 2005 upon request support will be provided for accommodations throughout the recruitment process.
If you require accommodation because of disability through the recruitment process please contact Human Resources at () for assistance.
Spectrum Health Care is committed to fostering cultivating and building a culture of diversity equity and inclusion within our organization. We strive to attract engage and develop a workforce that reflects the diverse communities that we serve and we know a diverse workforce is key to the growth and success of our organization.
Remote Work :
No
Employment Type :
Full-time
About Company
Spectrum Health Care is hiring Social Workers to support clients in Toronto. This role will provide an opportunity that includes both in-home with patients and with Spectrum leadership, further enhancing our ability to provide rehabilitative services in the community. The incumbent wi ... View more