Job Title: Data Engineer
Job Location: Mississauga ON (Need Onsite day 1 hybrid 3 days from office)
Job duration: Long Term
Job Description:
We are seeking a skilled Data Engineer to join our dynamic team. The ideal candidate will possess a strong background in data modeling SQL ETL processes and practical experience working within an Azure cloud environment particularly leveraging this role Candidate will be instrumental in designing developing and maintaining scalable data pipelines contributing to our data strategy initiatives and enabling insightful analytics.
Responsibilities:
- Design develop and optimize data models and schemas to effectively support business requirements.
- Build implement and maintain efficient ETL pipelines utilizing Spark Databricks and other relevant tools.
- Develop complex SQL queries stored procedures and functions to extract transform and load data from multiple sources.
- Collaborate with data analytics data science and business teams to gather requirements and deliver tailored data solutions.
- Leverage Azure Data Services including Azure Data Lake Azure Data Factory and Azure Databricks to create scalable reliable data architectures.
- Ensure adherence to data quality governance security and compliance standards across all data processes.
- Continuously monitor troubleshoot and optimize data pipelines for performance scalability and robustness.
- Document data architecture workflows and procedures; participate in code reviews and establish best practices.
Requirements:
- 3 to 6 years of experience in data engineering with demonstrated expertise in data modeling and SQL.
- Proven experience in developing ETL solutions and orchestrating data pipelines.
- Hands-on experience working with Azure cloud platform specifically Azure Data Factory Data Lake and Databricks.
- Strong programming skills in Spark Python or Scala for data processing tasks.
- Familiarity with data governance security protocols and regulatory compliance requirements.
- Excellent problem-solving skills keen attention to detail and ability to troubleshoot complex data issues.
- Ability to work independently and collaboratively within a team environment.
- Bachelors degree in Computer Science Information Technology or related field.
Preferred but not required:
- Certifications in Azure Data Services or Databricks are a plus.
- Experience working with BI tools and report generation frameworks.
- Knowledge of other cloud platforms (AWS GCP) is advantageous.
- Experience with REST APIs integration.
- Experience with GraphQL.
Job Title: Data Engineer Job Location: Mississauga ON (Need Onsite day 1 hybrid 3 days from office) Job duration: Long Term Job Description: We are seeking a skilled Data Engineer to join our dynamic team. The ideal candidate will possess a strong background in data modeling SQL ETL processes...
Job Title: Data Engineer
Job Location: Mississauga ON (Need Onsite day 1 hybrid 3 days from office)
Job duration: Long Term
Job Description:
We are seeking a skilled Data Engineer to join our dynamic team. The ideal candidate will possess a strong background in data modeling SQL ETL processes and practical experience working within an Azure cloud environment particularly leveraging this role Candidate will be instrumental in designing developing and maintaining scalable data pipelines contributing to our data strategy initiatives and enabling insightful analytics.
Responsibilities:
- Design develop and optimize data models and schemas to effectively support business requirements.
- Build implement and maintain efficient ETL pipelines utilizing Spark Databricks and other relevant tools.
- Develop complex SQL queries stored procedures and functions to extract transform and load data from multiple sources.
- Collaborate with data analytics data science and business teams to gather requirements and deliver tailored data solutions.
- Leverage Azure Data Services including Azure Data Lake Azure Data Factory and Azure Databricks to create scalable reliable data architectures.
- Ensure adherence to data quality governance security and compliance standards across all data processes.
- Continuously monitor troubleshoot and optimize data pipelines for performance scalability and robustness.
- Document data architecture workflows and procedures; participate in code reviews and establish best practices.
Requirements:
- 3 to 6 years of experience in data engineering with demonstrated expertise in data modeling and SQL.
- Proven experience in developing ETL solutions and orchestrating data pipelines.
- Hands-on experience working with Azure cloud platform specifically Azure Data Factory Data Lake and Databricks.
- Strong programming skills in Spark Python or Scala for data processing tasks.
- Familiarity with data governance security protocols and regulatory compliance requirements.
- Excellent problem-solving skills keen attention to detail and ability to troubleshoot complex data issues.
- Ability to work independently and collaboratively within a team environment.
- Bachelors degree in Computer Science Information Technology or related field.
Preferred but not required:
- Certifications in Azure Data Services or Databricks are a plus.
- Experience working with BI tools and report generation frameworks.
- Knowledge of other cloud platforms (AWS GCP) is advantageous.
- Experience with REST APIs integration.
- Experience with GraphQL.
View more
View less