Job Type: Contract/Perm (Open) Primary Location: Toronto or Montreal 2 days onsite per week
We currently have an opportunity for a Data Engineer supporting a partner in Insurance sector. Client is expanding the team and the successful resource will help with supporting team and taking on day to day responsibilities.
Job Requirements:
Design develop and maintain scalable efficientdata pipelines and ETL processes
Build and deploydata ingestion transformation and orchestration workflows
Implementdata quality checks observability and errorhandling mechanisms
Collaborate with data scientists analysts and architects to define technical solutions
Work withdistributed data systems(Spark Databricks) and cloud infrastructure (AWS)
Write clean modular productionready code inPython
Ensure CI/CD practices version control and infrastructureascode where relevant
Optimize performance of jobs queries and storage for large data volumes
Monitor troubleshoot and continuously improve pipeline reliability
Candidate requirements: Musthaves (35 max):
5 yearsof experience indata engineeringroles in complex environments
Experience building pipelinesfrom scratchin production environments
Nice to have:
12 years on Snowflake or/and Databricks management is highly recommended
Experience with streaming pipelines (Kafka Spark Streaming etc.)
Familiarity withTerraformor other IaC tools
Tools / software / methodology / certification: Spark Python AWS Snowflake Databricks Soft skills: Being customer driven with great communication and collaboration skills
Not for you Check out our other opportunities at or follow us on LinkedIn. We thank all candidates in advance. Only selected candidates for interviews will be contacted.
About Us QA Consultants is North Americas largest software quality engineering services firm. An awardwinning onshore provider of software testing and quality assurance solutions we are the trusted engineering services company for business industry and government supported by leading practitioners and solutions. For almost 30 years we have successfully delivered 12000 missioncritical projects in the private public and notforprofit sectors. We reduce risk and improve time to market with quality engineering keep applications secure through dedicated application security capabilities and reduce cost of ownership while enabling applications to scale via performance engineering. We are proud of our vision to help clients achieve flawless technology outcomes. QA Consultants also operates a robust emerging technologies practice with a focus on quality engineering solutions for connected and autonomous vehicles artificial intelligence (AI) Internet of Things (IoT) and blockchain. For more information visit Purpose Life continues to evolve and the technology we all rely on daily hinges on impeccable software. QAC understands that safe effective technology is your right it is our right. It is with this understanding that we deliver on our purpose. We support our clients to ensure technology enables flawless productivity and harmony for a Better Brighter and Safer world for all of us.
Whats in it for you
Make a difference every day as you help our clients deliver innovation and technology in a better brighter and safer way
Be part of a smart and dedicated team disrupting quality assurance methodologies and creating something unique
Be involved in challenging and interesting work
Work from anywhere
We are growing faster than we expected and thats humbling and exciting! So for all those on board we guarantee a rewarding journey and were just getting started. Diversity & Inclusion QA Consultants is an equal opportunity employer committed to meeting the needs of all individuals in accordance with the Accessibility of Ontarians with Disabilities Act (AODA) and the Ontario Human Rights Code (OHRC) where we evaluate applicants without regard torace color national origin religion sex age marital status disability veteran status sexual orientation gender identity or other characteristics protected by law. We are committed to the creation of an exceptional work environment wherein we maintain values of mutual respect integrity dignity and inclusivity; and encourage the open exchange of ideas and opinions.
If you require a specific accommodation because of a disability or a medical need please inform the recruiter. This ensures that the appropriate accommodations are in place at time of your interview and before you begin your employment.
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.