Principal Data Engineer AWS data platform

Astra North Infoteck Inc.

Job Location:

Toronto - Canada

Monthly Salary: K 10 - 10

Experience Required: 5years

Posted on: Yesterday

Vacancies: 1 Vacancy

Job Summary

Role: Senior Data Engineer AWS (with architecture exposure)

Location: Toronto

Experience: 10 years

Key Responsibilities

Lead the design build and evolution of cloud-native data engineering frameworks on AWS
Architect and optimize end-to-end data pipelines (batch and streaming) for performance reliability and scalability
Drive adoption and experimentation with new and emerging AWS services to improve efficiency and innovation
Establish engineering standards patterns and best practices for data ingestion transformation and storage
Collaborate with analysts and product teams to support analytics
Own data quality monitoring observability and cost optimization strategies
Provide technical leadership and mentorship to mid-level data engineers
Participate in architectural reviews and contribute to enterprise-wide data strategy

Required Qualifications

10 years of experience in data engineering or software engineering with strong & dedicated hands-on AWS experience of 4-5 years
Proven experience designing large-scale production-grade data platforms
Expertise with core AWS data services such as:
- Amazon S3 Glue Redshift EMR
- Lambda Step Functions
- Kinesis / MSK
Strong programming skills in Python Scala or Java
Deep experience with ETL / ELT frameworks and data pipeline orchestration tools (Airflow AWS-native equivalents etc.)
Solid knowledge of data modeling distributed systems and performance tuning
Experience working in CI/CD Infrastructure as Code (Terraform CDK CloudFormation)
Strong communication skills with the ability to translate technical concepts for non-technical stakeholders

Preferred Skills

Experience experimenting with or adopting new AWS services and driving proof-of-concepts
Exposure to real-time streaming architectures
Familiarity with data governance security and compliance in cloud environments
Experience supporting analytics BI or ML platforms
Experience with Agile Frameworks
AWS certifications (e.g. AWS Certified Data Analytics Specialty Solutions Architect)

Required Skills:

Experience (Years): 4-6 Essential Skills: Work with project teams throughout the organization to design implement and manage CDN infrastructure using Akamai to ensure high availability performance and scalability for customer facing applications and business processes. Handle multiple priorities and assignments with excellence and precision. Be a part of a 24/7/365 organization (some after hours support is expected as part of normal on-call rotation). Directly support line of business development teams provide guidance to them on implementation and changes for customer facing applications Develop and maintain security protocols and measures to protect CDN infrastructure from cyber threats. Monitor and analyze network performance identifying and resolving issues to optimize content delivery of critical applications. Collaborate with cross-functional teams to integrate Akamai CDN solutions with existing systems and applications. Collaborate with information security teams to implement DDoS protection strategies and other security measures in the CDN. Provide technical support and guidance to clients and internal teams regarding CDN and security best practices. Work closely with vendor and professional service teams on delivery related activities and strategy. Qualifications: Bachelors degree in Computer Science Information Technology or a related field. OR similar work experience. Strong understanding of network protocols (HTTP/HTTPS DNS TCP/IP). Proven experience as a CDN Engineer or similar role with a strong focus on -depth knowledge of Content Delivery Network technologies including caching load balancing and content optimization. Excellent problem-solving skills and attention to detail. Strong communication and teamwork abilities. Experience supporting 24/7/365 customer facing applications at enterprise scale. Awareness and experience with cybersecurity tools and practices such as firewalls intrusion detection/prevention systems and encryption. Proficiency in scripting and automation (e.g. Python Bash) a plus. Relevant certifications (e.g. CISSP CEH) are a plus but not required.

Role: Senior Data Engineer AWS (with architecture exposure)Location: TorontoExperience: 10 years Key ResponsibilitiesLead the design build and evolution of cloud-native data engineering frameworks on AWSArchitect and optimize end-to-end data pipelines (batch and streaming) for performance reliabili...