GCP Data Engineer

Not Interested
Bookmark
Report This Job

profile Job Location:

Bengaluru - India

profile Monthly Salary: Not Disclosed
Posted on: 2 hours ago
Vacancies: 1 Vacancy

Job Summary

Job Description:
  • Design develop and maintain data pipelines and ETL processes on GCP.

  • Build and optimize BigQuery data models and queries for performance and scalability.

  • Develop automation scripts and data processing logic using Python.

  • Integrate data from various sources (APIs flat files databases streaming systems) into the cloud data warehouse.

  • Ensure data quality reliability and governance through validation and monitoring mechanisms.

  • Collaborate with data analysts data scientists and business stakeholders to deliver clean well-structured datasets.

  • Optimize storage and compute costs in GCP while maintaining performance efficiency.

  • Maintain documentation for data models workflows and transformations.

Job Description: Design develop and maintain data pipelines and ETL processes on GCP. Build and optimize BigQuery data models and queries for performance and scalability. Develop automation scripts and data processing logic using Python. Integrate data from various sources (APIs fl...
View more view more

Key Skills

  • Apache Hive
  • S3
  • Hadoop
  • Redshift
  • Spark
  • AWS
  • Apache Pig
  • NoSQL
  • Big Data
  • Data Warehouse
  • Kafka
  • Scala