drjobs
Cloud Data Engineer
drjobs
Cloud Data Engineer
Venus Consultancy
drjobs Cloud Data Engineer العربية

Cloud Data Engineer

Employer Active

1 Vacancy
The job posting is outdated and position may be filled
drjobs

Job Alert

You will be updated with latest job alerts via email
Valid email field required
Send jobs
drjobs

Job Alert

You will be updated with latest job alerts via email

Valid email field required
Send jobs

Job Location

drjobs

- Canada

Monthly Salary

drjobs

Not Disclosed

drjobs

Salary Not Disclosed

Vacancy

1 Vacancy

Job Description

Req ID : 1074195

Role: Cloud Data Engineer

Location: Canada

Security Clearance Required: Reliability security clearance or Should eligible for security clearance (I.e Candidate should spend 5 years in Canada)

Job Description:

Role & Responsibilities:

Work with cloud engineers and clients to solve big data problems by developing utilities for migration, storage and processing on AWS Cloud
Understand requirements and contribute to planning the development Design and build ETL pipelines
Build tools to ingest and jobs to process several terabytes per day
Design and develop next-gen storage and compute solutions for several large customers
Build advanced tooling for automation, testing, monitoring, administration, and data operations across multiple cloud clusters.


Required Skills:

  • Hands-on experience in AWS Cloud with services such as AWS Glue, and other AWS services
  • Strong software development skills in Python and Pyspark
  • Experience of Hands-on in data structures, spark, SQL,
  • Experience in SQL and Query optimization
  • Ability to clearly communicate technical roadmap, challenges and mitigation
  • Experience building and supporting large-scale systems in a production environment

Technology Stack:
Cloud Platforms AWS
Mandatory High programming skill in Python and Pyspark, Hands-on experience with the AWS services
AWS Cloud with focus on AWS Glue to create ETL pipelines
Design Dimensional Models for Data Warehouse and Data Marts

Employment Type

Remote

Department / Functional Area

System Administration / Network Administration / Security (IT Software)

Key Skills

  • Apache Hive
  • S3
  • Hadoop
  • Redshift
  • Spark
  • AWS
  • Apache Pig
  • NoSQL
  • Big Data
  • Data Warehouse
  • Kafka
  • Scala

About Company

Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.