Title: Data Engineer
Location: Toronto ON/ London ON Canada (Hybrid)
Duration: Long Term Contract
Job Summary
We are seeking an experienced Data Engineer with 9 to 13 years of experience to join our team. The ideal candidate will have expertise in Databricks SQL Databricks Workflows and PySpark. Experience in the Life and Annuities Insurance domain is a plus. This hybrid role requires a proactive individual who can drive innovation and efficiency in our data solutions contributing to the companys growth and societal impact.
Responsibilities
- Design and implement scalable data architectures using Databricks SQL and PySpark to enhance data processing capabilities.
- Collaborate with cross-functional teams to develop and optimize Databricks Workflows for seamless data integration.
- Analyze complex data sets to identify trends and insights that drive business decisions and improve operational efficiency.
- Ensure data quality and integrity by implementing robust data governance practices and monitoring systems.
- Provide technical guidance and mentorship to junior team members fostering a culture of continuous learning and improvement.
- Develop and maintain comprehensive documentation for data architecture and workflows to support ongoing development and maintenance.
- Work closely with stakeholders to understand business requirements and translate them into technical solutions that align with company objectives.
- Lead efforts to innovate and improve data processing techniques ensuring the company remains at the forefront of industry advancements.
- Conduct regular performance assessments of data systems to identify areas for optimization and implement necessary enhancements.
- Collaborate with IT and business teams to ensure data solutions are aligned with organizational goals and regulatory requirements.
- Drive the adoption of best practices in data engineering and architecture to ensure high-quality deliverables.
- Engage in continuous professional development to stay updated with the latest trends and technologies in data architecture.
- Contribute to the companys mission by leveraging data to create impactful solutions that benefit society.
Qualifications
- Possess strong technical skills in Databricks SQL and PySpark with a proven track record of successful implementations.
- Demonstrate expertise in designing and optimizing Databricks Workflows for efficient data processing.
- Exhibit a deep understanding of data architecture principles and best practices.
- Have experience in the Life and Annuities Insurance domain which is considered an advantage.
- Show proficiency in data governance and quality assurance practices.
- Display excellent problem-solving skills and the ability to work collaboratively with diverse teams.
- Maintain a commitment to continuous learning and professional growth in the field of data architecture