Cloud Data Engineer

Role: Cloud Data Engineer

Location: Canada

Security Clearance Required: Reliability security clearance or Should eligible for security clearance (I.e Candidate should spend 5 years in Canada)

Job Description:

Role & Responsibilities:

Work with cloud engineers and clients to solve big data problems by developing utilities for migration, storage and processing on AWS Cloud
Understand requirements and contribute to planning the development Design and build ETL pipelines
Build tools to ingest and jobs to process several terabytes per day
Design and develop next-gen storage and compute solutions for several large customers
Build advanced tooling for automation, testing, monitoring, administration, and data operations across multiple cloud clusters.

Required Skills:

• Hands-on experience in AWS Cloud with services such as AWS Glue, and other AWS services
• Strong software development skills in Python and Pyspark
• Experience of Hands-on in data structures, spark, SQL,
• Experience in SQL and Query optimization
• Ability to clearly communicate technical roadmap, challenges and mitigation
• Experience building and supporting large-scale systems in a production environment

Technology Stack:
Cloud Platforms AWS
Mandatory High programming skill in Python and Pyspark, Hands-on experience with the AWS services
AWS Cloud with focus on AWS Glue to create ETL pipelines
Design Dimensional Models for Data Warehouse and Data Marts