Job Description

Position: Big Data GCP Engineer (GKE & FastAPI)

Location : Gurgaon
Experience Required: 6 Years

Work Model: Fulltime - Hybrid–3 days/week from the client office in Gurgaon

Job Summary

We are looking for an energetic high-performing and highly skilled Big Data GCP Engineer with strong expertise in Google Cloud Platform (GCP) Big Data technologies GKE and FastAPI. The ideal candidate should have hands-on experience in designing developing and deploying scalable cloud-native applications using Java PySpark and modern data engineering technologies.

The candidate must possess strong experience in Big Data processing cloud infrastructure containerized deployments API development and database optimization. Exposure to Kubernetes-based deployments and modern microservices architecture is highly preferred.

Key Responsibilities

• Design develop and deploy scalable applications on Google Cloud Platform (GCP).

• Develop robust and high-performance data processing pipelines using PySpark and Big Data technologies.

• Build and maintain RESTful APIs and microservices using FastAPI.

• Work with large-scale distributed data processing frameworks such as Spark Hive MapReduce and HBase.

• Deploy and manage containerized applications using Google Kubernetes Engine (GKE).

• Develop cloud-native solutions using GCP services such as Compute Engine App Engine Cloud Functions BigQuery Cloud SQL Dataproc and Dataflow.

• Optimize database queries indexing strategies and overall application performance.

• Collaborate with cross-functional teams including data engineering DevOps and application development teams.

• Perform troubleshooting debugging and root cause analysis for production issues.

• Create reusable components automation scripts and deployment pipelines.

• Ensure best practices in scalability security reliability and maintainability.

Mandatory Skills

• 6 years of overall IT experience.

• Strong hands-on experience with Google Cloud Platform (GCP).

• Strong programming expertise in Java 8 and PySpark.

• Hands-on experience in Big Data technologies:

  • Apache Spark

  • Hive

  • MapReduce

  • HBase

• Strong experience with FastAPI development.

• Hands-on experience with Google Kubernetes Engine (GKE).

• Strong understanding of distributed data processing and cloud architecture.

• Experience with GCP services:

  • Compute Engine

  • App Engine

  • Cloud Functions

  • BigQuery

  • Cloud SQL

  • Dataproc

  • Dataflow

• Experience in UNIX Shell scripting Python or Perl scripting.

• Strong knowledge of relational databases such as PostgreSQL MySQL or DB2.

• Experience in query optimization and database indexing.

• Good understanding of CI/CD and containerization concepts.

• Strong analytical problem-solving and debugging skills.

Educational Qualification

• Bachelor’s or Master’s degree in Computer Science Information Technology or related field.

Required Skills:

bigdata gcp gke fast api Google Kubernetes Engine Compute Engine App Engine Cloud Functions BigQuery Cloud SQL Dataproc Dataflow UNIX shell scripting Python Perl scripting postgresql mysql db2 query optimization database indexing CI/CD problem-solving debugging analytical skill Java 8 java PySpark Big Data technologies Apache Spark Hive MapReduce HBase