GCP Data Engineer

TalentOla

Not Interested
Bookmark
Report This Job

profile Job Location:

Pune - India

profile Monthly Salary: Not Disclosed
Posted on: 2 hours ago
Vacancies: 1 Vacancy

Job Summary

  • Design and develop data pipelines on GCP

  • Build and manage data solutions using BigQuery Cloud Storage and Cloud SQL

  • Develop pipelines using Dataflow (Apache Beam) and Dataproc (Spark)

  • Ingest data from multiple sources (APIs databases files)

  • Optimize BigQuery performance and cost

  • Ensure data quality security and governance

  • Work closely with data analysts data scientists and stakeholders

  • Automate workflows using Cloud Composer (Airflow)

  • Monitor pipelines and resolve data issues

Design and develop data pipelines on GCP Build and manage data solutions using BigQuery Cloud Storage and Cloud SQL Develop pipelines using Dataflow (Apache Beam) and Dataproc (Spark) Ingest data from multiple sources (APIs databases files) Optimize BigQuery performance and cost Ensu...
View more view more

Key Skills

  • Apache Hive
  • S3
  • Hadoop
  • Redshift
  • Spark
  • AWS
  • Apache Pig
  • NoSQL
  • Big Data
  • Data Warehouse
  • Kafka
  • Scala