Data Engineer
Share
Job Location:
Monthly Salary:
Posted on:
23 hours ago
Vacancies:
1 Vacancy
Job Summary
Job Title: Data Engineer
Job Location: Vancouver BC (Onsite)
Mode: Contract
Job Description:
We are looking for a Data Engineer with strong expertise in modern data platforms and engineering practices. The ideal candidate will design build and optimize data pipelines and solutions leveraging Snowflake Kafka Azure Data Factory (ADF) PySpark and other cutting-edge technologies. This role requires proficiency in ETL/ELT development data modeling and ensuring data governance and security across cloud environments.
Key Responsibilities:
Design develop and maintain scalable ETL/ELT pipelines for structured and unstructured data.
Implement data integration solutions using ADF Kafka and stream processing frameworks.
Build and optimize data models in Snowflake and other cloud platforms for analytics and reporting.
Ensure data quality (DQT) governance and security compliance across all data processes.
Develop and maintain CI/CD pipelines for data workflows and deployments.
Collaborate with data architects analysts and business teams to deliver high-quality data solutions.
Monitor and troubleshoot data pipelines for performance and reliability.
Document technical designs processes and best practices.
Required Skills & Qualifications:
Strong experience with Snowflake (data warehousing performance tuning security).
Hands-on expertise in Kafka for real-time data streaming and event-driven architectures.
Proficiency in Azure Data Factory (ADF) for orchestration and integration.
Solid knowledge of PySpark for big data processing and transformations.
Advanced SQL skills for query optimization and data manipulation.
Experience in ETL/ELT development and data modeling (star schema normalization).
Familiarity with Cloud Platforms (Azure and Snowflake).
Understanding of Data Governance & Security principles.
Knowledge of stream processing and real-time analytics.
Experience with CI/CD tools (Azure DevOps Git Jenkins).
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
