GCP Data Engineer

Programmers.io


Job Location:

Santa Clara County, CA - USA

Monthly Salary: Not Disclosed
Posted on: 9 days ago
Vacancies: 1 Vacancy

Job Summary

Domain

- Cloud Platform Expertise (GCP Focus): Extensive hands-on experience working in dynamic cloud environments with a strong preference for Google Cloud Platform (GCP) services specifically:

    • BigQuery: Expert-level skills in data ingestion performance optimization and data modeling within a petabyte-scale environment.
    • Experience with other relevant GCP services like Cloud Storage Cloud Dataflow/Beam or Pub/Sub

-Programming & Querying:

    • Python: Expert-level programming proficiency in Python including experience with relevant data engineering libraries
    • SQL: A solid command of advanced SQL for complex querying data processing and performance tuning.

-Data Pipeline Orchestration: Prior experience using workflow management and orchestration tools (e.g. Apache Airflow Cloud Composer AirflowDagster or similar).

-DevOps/CI/CD: Experience with version control (Git) and familiarity with CI/CD practices and tools (e.g. GitLab GitHub Actions) to automate deployment and testing processes.

Soft Skills

- Excellent communication

- Team collaboration

- Documentation and knowledge sharing

Education Requirements

Bachelors/Masters in Computer Science or equivalent (can be marked optional or flexible)

Certifications

GCP Data Engineer

Domain - Cloud Platform Expertise (GCP Focus): Extensive hands-on experience working in dynamic cloud environments with a strong preference for Google Cloud Platform (GCP) services specifically: BigQuery: Expert-level skills in data ingestion performance optimization and data modeling...