Spark Scala Developer Toronto, ON (Hybrid) Fulltime FTE
Job Summary
Job Summary
We are looking for an experienced Spark Scala Developer to join our growing engineering team in Toronto. The ideal candidate will have strong expertise in building scalable high-performance data processing applications using Apache Spark and Scala. This role requires hands-on experience with distributed data processing backend development and modern software engineering practices.
You will work closely with cross-functional teams to design develop and optimize data-driven solutions while ensuring high-quality maintainable code.
Key Responsibilities-
Design develop and maintain scalable data processing applications using Apache Spark and Scala.
-
Build high-performance batch and distributed data processing pipelines.
-
Write clean efficient maintainable and well-tested code following coding best practices.
-
Develop and consume RESTful web services using Spring Boot.
-
Write optimized SQL queries for data extraction transformation and analysis.
-
Collaborate with business analysts architects QA teams and other developers to deliver enterprise-grade solutions.
-
Participate in code reviews and ensure adherence to coding standards.
-
Troubleshoot production issues and optimize application performance.
-
Contribute to CI/CD pipelines and deployment automation.
-
Work within Agile/Scrum development methodologies.
-
6 8 years of software development experience.
-
Strong programming experience in Scala and Java.
-
Hands-on expertise with:
-
Apache Spark Core
-
Spark SQL
-
DataFrames
-
Datasets
-
-
Strong understanding of distributed data processing concepts.
-
Experience with Spring Boot for developing REST APIs/Web Services.
-
Strong SQL development and query optimization skills.
-
Experience with Maven for dependency and build management.
-
Experience using Git or other version control systems.
-
Working knowledge of the Hadoop ecosystem.
-
Experience working with CI/CD pipelines.
-
Hands-on experience with Helios.
-
Strong analytical debugging and problem-solving skills.
-
Excellent communication and collaboration skills.
-
Experience working in enterprise-scale data platforms.
-
Familiarity with Agile/Scrum development methodologies.
-
Experience with performance tuning and optimization of Spark applications.
-
Exposure to cloud platforms is a plus.
-
Scala
-
Java
-
Apache Spark
-
Spark SQL
-
DataFrames
-
Datasets
-
Spring Boot
-
SQL
-
Maven
-
Git
-
Hadoop
-
CI/CD
-
Helios
-
Excellent communication skills.
-
Strong analytical and troubleshooting abilities.
-
Ability to work independently as well as within cross-functional teams.
-
Detail-oriented with a strong focus on code quality and performance.
-
Adaptable to a fast-paced Agile environment.