Senior Data Engineer - Scala & Cloud (ID: 3029)
Senior Data Engineer - Scala & Cloud (ID: 3029)
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
8-10years
Not Disclosed
Salary Not Disclosed
1 Vacancy
Job Description
- Design and implement scalable data processing solutions using Scala Apache Spark Structured Streaming and Hadoop.
- Work with MongoDB and Parquet formats applying robust data modeling principles.
- Leverage Google Cloud Platform services particularly BigQuery and Cloud Storage to build efficient data pipelines.
- Write and optimize complex SQL queries to support analytics and reporting needs.
- Use Terraform to script and manage infrastructure as code in a cloud-native environment.
- Collaborate with cross-functional teams to support data science and engineering use cases contributing to overall platform reliability and scalability.
- 8 10 years of professional experience in data engineering or backend development.
- Advanced-level expertise in Scala and Shell scripting.
- Strong knowledge of SQL with the ability to write and optimize complex queries.
- Experience with Infrastructure as Code using Terraform.
- Solid hands-on experience with MongoDB and Parquet including schema design and optimization.
- Familiarity with Google Cloud Platform (BigQuery Cloud Storage) and Apache Kafka.
- Understanding of core data science concepts and how they apply to large-scale data systems.
- Build and optimize robust scalable data pipelines in distributed environments.
- Design clean and efficient data models for both operational and analytical purposes.
- Communicate technical concepts effectively with data scientists engineers and stakeholders.
- Work independently while actively contributing to team-wide initiatives.
- Troubleshoot and optimize performance across the data stack.
- A dynamic environment that encourages innovation and continuous learning.
- Exposure to cutting-edge data technologies and cloud platforms.
- Opportunity to work on impactful large-scale data engineering projects.
- Collaborative and inclusive team culture that values your expertise.
Recruiter: Aswin Dhanvandhar
Phone:; Extn :141
Email:
LinkedIn: As a Senior Data Engineer, you will: Design and implement scalable data processing solutions using Scala, Apache Spark Structured Streaming, and Hadoop. Work with MongoDB and Parquet formats, applying robust data modeling principles. Leverage Google Cloud Platform services, particularly BigQuery and Cloud Storage, to build efficient data pipelines. Write and optimize complex SQL queries to support analytics and reporting needs. Use Terraform to script and manage infrastructure as code in a cloud-native environment. Collaborate with cross-functional teams to support data science and engineering use cases, contributing to overall platform reliability and scalability. What You Bring to the Table: 8 10 years of professional experience in data engineering or backend development. Advanced-level expertise in Scala and Shell scripting. Strong knowledge of SQL, with the ability to write and optimize complex queries. Experience with Infrastructure as Code using Terraform. Solid hands-on experience with MongoDB and Parquet, including schema design and optimization. Familiarity with Google Cloud Platform (BigQuery, Cloud Storage) and Apache Kafka. Understanding of core data science concepts and how they apply to large-scale data systems. You should possess the ability to: Build and optimize robust, scalable data pipelines in distributed environments. Design clean and efficient data models for both operational and analytical purposes. Communicate technical concepts effectively with data scientists, engineers, and stakeholders. Work independently while actively contributing to team-wide initiatives. Troubleshoot and optimize performance across the data stack. What We Bring to the Table: A dynamic environment that encourages innovation and continuous learning. Exposure to cutting-edge data technologies and cloud platforms. Opportunity to work on impactful, large-scale data engineering projects. Collaborative and inclusive team culture that values your expertise.
Employment Type
Full Time
