Senior Data Engineer

VDart Inc

Not Interested
Bookmark
Report This Job

profile Job Location:

Toronto - Canada

profile Monthly Salary: Not Disclosed
Posted on: 30+ days ago
Vacancies: 1 Vacancy

Job Summary

Job Title: Senior Data Engineer

Location: Greater Toronto Area Canada (Hybrid)

Job Type: Full time


Responsibilities:

  • Perform data validation and cross-checking of data across different sources and lines of business to ensure accuracy and consistency following our cloud migration.
  • Validate ETL pipelines and business logic to ensure data is transformed and loaded correctly into our cloud data platform.
  • Design and develop basic ETL flows and data assets using Databricks Python and SQL.
  • Utilize data engineering skills to assist in the design of a summary data layer and other key data assets.
  • Develop and maintain data documentation including metadata and column definitions.
  • Collaborate with business analysts and stakeholders to understand data requirements and translate them into technical solutions.

Skills:

  • Proven experience in data validation and data quality assurance.
  • Proficiency in Databricks Python and SQL for data manipulation and ETL development.
  • Experience in designing and implementing basic ETL processes.
  • Knowledge of cloud-based data platforms (Azure).
  • Strong analytical skills with the ability to identify and resolve data discrepancies.
  • Familiarity with data governance principles and best practices.
Job Title: Senior Data Engineer Location: Greater Toronto Area Canada (Hybrid) Job Type: Full time Responsibilities: Perform data validation and cross-checking of data across different sources and lines of business to ensure accuracy and consistency following our cloud migration. Validate ETL p...
View more view more

Key Skills

  • Apache Hive
  • S3
  • Hadoop
  • Redshift
  • Spark
  • AWS
  • Apache Pig
  • NoSQL
  • Big Data
  • Data Warehouse
  • Kafka
  • Scala