Spark Scala Engineer
Share
Job Location:
Brooklyn, NY - USA
Monthly Salary:
Not Disclosed
Posted on:
30+ days ago
Vacancies:
1 Vacancy
Job Summary
Spark Scala Engineer
5 months: Brooklyn NY OR remote
Job Summary
- Build maintain and refactor data pipelines using Scala and Spark
- Develop and manage Airflow DAGs to orchestrate complex workflows
- Support real-time bidding and marketplace optimization data workflows
- Collaborate with cross-functional teams to deliver robust high-quality systems
- Troubleshoot and debug production data pipelines for reliability and performance
- Contribute ideas and improvements for engineering processes and system architecture
- Perform data analysis using Python and other tools as needed
- Ensure data quality testing and observability across workflows
- Leverage domain knowledge in ads forecasting or marketplace systems
- Communicate and collaborate effectively within and across teams
5 months: Brooklyn NY OR remote
Job Summary
- Build maintain and refactor data pipelines using Scala and Spark
- Develop and manage Airflow DAGs to orchestrate complex workflows
- Support real-time bidding and marketplace optimization data workflows
- Collaborate with cross-functional teams to deliver robust high-quality systems
- Troubleshoot and debug production data pipelines for reliability and performance
- Contribute ideas and improvements for engineering processes and system architecture
- Perform data analysis using Python and other tools as needed
- Ensure data quality testing and observability across workflows
- Leverage domain knowledge in ads forecasting or marketplace systems
- Communicate and collaborate effectively within and across teams
