Cloud Data Engineer
Cloud Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
This is a remote position.
In this role you will collaborate with cross-functional teams including Cloud Engineering Data Engineering and Product Management to architect and implement end-to-end cloud solutions primarily on AWS. Youll play a key role in designing complex ETL/ELT pipelines enabling ML operations and leading infrastructure automation using modern DevOps practices. If youre passionate about cloud technologies data infrastructure and mentoring others while working on impactful enterprise-scale systems we d love to hear from you.
Location: Toronto ON
Status: Contract; 6 months with potential for extension
Workplace Type: Remote
Responsibilities:
- Working with team of Cloud Engineers focused on designing and building robust infrastructure on AWS
- Working with Development teams to understand technical requirements and then design and provision AWS Platform services required to support complex ETL/ELT data pipelines as well as Machine learning solutions
- Working with Product Managers to develop tools to support experimentation ML model training and production operations
- Solid understanding of provisioning end-to-end Data solution enabled with DevOps
- Architect scalable low-latency systems implement capacity planning framework & design data pipelines & required disaster recovery services
- Promote software development best-practices and conduct rigorous code reviews rigorously identify and solve technical challenges
- Balance and prioritize projects to maximize efficiency and ensure company objectives are achieved
- Lead and mentor a team of talented engineers within the backend distributed systems team make a positive impact on the teams productivity and growth
Requirements
Qualifications Skills and Experience:
- Around 7 years of experience as a Cloud Infrastructure engineer in Data and Data warehousing technologies
- Around 10 relevant experience and post-secondary degree in related field of study or an equivalent combination of education and experience
- Good decision-making and problem-solving skills
- Strong knowledge on Data Lake Data Warehousing Distributed systems and Data infrastructure concepts
- Solid experience with ML infrastructure and ML DevOps
- Experience in migrating data from on-prem Hadoop to AWS/Azure Cloud
- Understanding of core AWS & Azure services & architecture best practices
- Hands-on experience in different domains like database architecture business intelligence machine learning advanced analytics big data etc.
- Solid experience creating CI/CD pipelines to manage infrastructure deployment and code deployment
- Excellent communication skills for providing specialized consulting analytical and technical support to internal team members and external CIO Business teams
- Should have sound experience provisioning the following Cloud Services as well as their design and architecture components:
- CDK & TypeScript NodeJS Python Terraform
- Code pipeline CICD Build/Deploy
- AWS EMR Glue Managed Airflow Lakeformation Athena S3 ELK / OpenSearch
- RDS Redshift DocumentDB Neptune & Data Migration Service
- EC2 S3 IAM Secrets Manager System Manager Cloudwatch
- AWS Sagemaker Studio (ML) Docker & Containers
- AWS QuickSight and Power BI reporting tool
- Azure services for Data & Data warehousing will be a plus
Typically between 5 - 7 years of relevant experience and post-secondary degree in related field of study or an equivalent combination of education and experience. Possesses analytical skills with the ability to collect, organize, analyze, and disseminate significant amounts of information with attention to detail and accuracy. Extensive experience working with large data sets. Any/all financial sector experience is an asset. Demonstrates applied knowledge of one or more analysis and problem decomposition techniques. Understands complete Software Development Life Cycle and can apply the applicable portions of the Feasibility, Requirements, and Analysis phases. Understands and can explain to others the core processes involved in their area of support. Deep knowledge and technical proficiency gained through extensive education and business experience. Analytical and problem-solving skills - In-depth. Data driven decision making - In-depth.
Employment Type
Full Time
Company Industry
Financial Services / Insurance Agencies and Brokerages / Investment Banking
