Senior Data Engineer

Job Title: Senior Data Engineer

Location: Remote

Job Description:

We are seeking a highly skilled Senior Data Engineer to join our remote team. As a Senior Data Engineer you will be responsible for designing building and maintaining scalable data pipelines and analytics solutions. This is a remote position offering the flexibility to work from anywhere.

Responsibilities:

1. Design and implement robust data pipelines using Apache Airflow for orchestration.
2. Develop data processing jobs using Apache Spark for largescale data analysis and transformation.
3. Utilize BigQuery for data warehousing and querying large datasets.
4. Collaborate with crossfunctional teams to gather requirements and design data solutions that meet business needs.
5. Implement and manage infrastructure on Google Cloud Platform (GCP) using Terraform.
6. Write clean efficient and maintainable code in Scala.
7. Optimize data pipelines for performance and scalability.
8. Monitor pipeline health and troubleshoot issues as they arise.
9. Stay updated on industry best practices and emerging technologies in data engineering.

Requirements:

1. Bachelors degree in Computer Science Engineering or a related field.
2. Proven experience as a Data Engineer or similar role.
3. Strong expertise in Google Cloud Platform (GCP) services and infrastructure.
4. Experience in designing and implementing data pipelines for ecommerce platforms.
5. Proficiency in Apache Spark using Scala for data processing and analysis.
6. Handson experience with Apache Airflow for workflow orchestration.
7. Familiarity with BigQuery for data warehousing and analytics.
8. Experience with infrastructure as code using Terraform.
9. Excellent problemsolving and analytical skills.
10. Strong communication and collaboration skills.
11. Ability to work independently and efficiently in a remote environment.

Required Skills:

• Strong experience with Google Cloud Platform (GCP)
• Experience in ecommerce data pipelines
• Proficiency in Apache Spark using Scala

Must Have:

• Apache Airflow
• Apache Spark
• BigQuery
• GCP/Google Cloud/Terraform
• Scala