AWS Data Engineer

Toronto - Canada

Monthly Salary: Not Disclosed

Posted on: 10 hours ago

Vacancies: 1 Vacancy

Job Summary

Assignment: RQ10941 - Software Developer - Senior

Job Title: AWS Data Engineer

Requisition (SS): RQ10941

Start Date:

Client: Health Services Cluster

End Date:

Office Location: 5700 Yonge St. Toronto

Organization: Health Services Cluster

Ministry: Ministry of Public and Business Service Delivery and Procurement

# Business Days: 220.00

Assignment Type: This position is listed as Onsite; the resource is expected to work 7.25 hours per calendar day between the standard working hours of 8:00-5:00 PM (excluding lunch breaks) every Monday to Friday inclusive at the identified OPS office location.

MUST HAVES:

Data engineering (pandas pyspark)
Working with XLSX CSV JSON files relational databases cloud storage structured and unstructured data
Experience using AWS Services such as Glue StepFunctions Lambda S3
Extract/Transform/Load data using tools such as Informatica IDMC

Description

Responsibilities

Design develop test implement and troubleshoot:
data pipelines using Python and AWS services (Glue StepFunctions Lambda)
complex data transformation procedures
data models for the efficient storing of data in relational databases as well as in unstructured data repositories
re-useable classes and modules as to enhance the maintainability and ability to deliver solutions quickly.
Review existing code base and assist other more junior team members ensuring a consistent level of quality.
Assess new business requirements and propose adequate technical solutions (using on-prem and on-cloud resources)
Extension/Amendment Attestation:
Extensions are permitted only to the extent of unused contract days and/or remaining contract funds. No additional funds will be added beyond the maximum contract value including any extension options set out in the original SOW.

Experience and Skill Set Requirements

General Development Experience (Python) - 40 points

Data engineering (pandas pyspark)
Working with XLSX CSV JSON files relational databases cloud storage structured and unstructured data
Data processing automation
Linux experience

AWS Cloud Experience - 25 points

Experience using AWS Services such as Glue StepFunctions Lambda S3
Experience with cloud data warehousing and analytics (AWS Redshift or equivalent)

Data Warehouse - 25 points

Data modeling (relational & dimensional) advanced SQL
Extract/Transform/Load data using tools such as Informatica IDMC
Data reporting/visualization

Software Development Life Cycle - 5 points

Full SDLC from requirements gathering design implementation testing to deployment and production support
Familiar with project management (agile/scrum and waterfall)
Change and Incident management

General - 5 points

Communication presentation and negotiation skills
Consulting problem-solving and decision-making skills
Public sector experience

Assignment: RQ10941 - Software Developer - Senior Job Title: AWS Data Engineer Requisition (SS): RQ10941 Start Date: Client: Health Services Cluster End Date: Office Location: 5700 Yonge St. Toronto Organization: Health Services Cluster Ministry: Ministry of Public and Business Service Delivery and ...