GCP Data Engineer
GCP Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
We are seeking a hands-on GCP Data Engineer/Lead/Architect with deep expertise in real-time streaming data architectures to help design build and optimize data pipelines in our Google Cloud Platform (GCP) environment. The ideal candidate will have strong architectural vision and be comfortable rolling up their sleeves to build scalable low-latency streaming data pipelines using Pub/Sub Dataflow (Apache Beam) and BigQuery.
Tasks
Key Responsibilities
- Architect and implement end-to-end streaming data solutions on GCP using Pub/Sub Dataflow and BigQuery.
- Design real-time ingestion enrichment and transformation pipelines for high-volume event data.
- Work closely with stakeholders to understand data requirements and translate them into scalable designs.
- Optimize streaming pipeline performance latency and throughput.
- Build and manage orchestration workflows using Cloud Composer (Airflow).
- Drive schema design partitioning and clustering strategies in BigQuery for both real-time and batch datasets.
- Define SLAs monitoring logging and alerting for streaming jobs using Cloud Monitoring Error Reporting and Stackdriver.
- Experience with the data modeling.
- Ensure robust security encryption and access controls across all data layers.
- Collaborate with DevOps for CI/CD automation of data workflows using Terraform Cloud Build and Git.
- Document streaming architecture data lineage and deployment runbooks.
Requirements
Required Skills & Experience
5 years of experience in data engineering or architecture.
3 years of hands-on GCP data engineering experience.
Strong expertise in:
Google Pub/Sub
Dataflow (Apache Beam)
BigQuery (including streaming inserts)
Cloud Composer (Airflow)
Cloud Storage (GCS)
Solid understanding of streaming design patterns exactly-once delivery and event-driven architecture.
Deep knowledge of SQL and NoSQL data modeling.
Hands-on experience with monitoring and performance tuning of streaming jobs.
Experience using Terraform or equivalent for infrastructure as code.
Familiarity with CI/CD pipelines for data workflows.
Benefits
Benefits
Great work takes place when people feel appreciated and supported. Thats why Techmango believes in shaping an environment where you can bloom stay inspired and benefit from a healthy work-life balance. Because youre not just an employee but a part of something greater.
Badminton Ground
Free Accommodation
Cab Facility for Female Employees
Insurance
GYM
Subsidised Food
Awards and Recognition
Medical Checkup
Join TechMango as a GCP Data Engineer to innovate and drive data excellence. Leverage cutting-edge technology in a dynamic team environment. Apply now for an exciting career opportunity!
Employment Type
Full Time
