Job Title: Senior GCP Data Engineer
Location: Sunnyvale CA 5 Days Onsite
Long Term
About the Role:
We re seeking a Senior Data Engineer to power the data backbone of one of the world s largest retail enterprises. You will work hands-on with GCP Python Scala and SQL to build high-performance data pipelines architect advanced big data platforms and deliver solutions at multi-terabyte/petabyte scale.
Key Responsibilities:
- Design and develop next-generation big data applications using open-source technologies.
- Build and optimize scalable data pipelines using GCP Dataproc GCS BigQuery Hive Spark and Kafka.
- Automate workflows with Apache Airflow to streamline data operations.
- Model and tune data lakes and warehouse schemas for performance and scalability.
- Lead daily standups mentor junior engineers and take ownership of your business domain.
- Collaborate with cross-functional teams to align data solutions with business needs.
Required Qualifications:
- 2 years recent hands-on experience with Google Cloud Platform (Dataproc GCS BigQuery).
- 5 years building large-scale data solutions with Hadoop Spark Hive and Airflow.
- Strong programming skills in Python Java and/or Scala plus scripting (Shell Perl).
- Experience with Agile methodologies and excellent communication skills.
- Bachelor s degree in Computer Science or related field (or equivalent experience).
Preferred Skills:
- Experience with Gitflow and Atlassian tools (BitBucket JIRA Confluence).
- CI/CD expertise with Bamboo Jenkins or TFS.
- Proven ability to manage multiple priorities in fast-paced environments.
GCP