drjobs GCP Lead Engineer

GCP Lead Engineer

Employer Active

1 Vacancy
drjobs

Job Alert

You will be updated with latest job alerts via email
Valid email field required
Send jobs
Send me jobs like this
drjobs

Job Alert

You will be updated with latest job alerts via email

Valid email field required
Send jobs
Job Location drjobs

Bengaluru - India

Yearly Salary drjobs

₹ 1000000 - 4000000

Vacancy

1 Vacancy

Job Description

Functional Title: Lead GCP Engineer

Location: MG Road

Start Date: ASAP

Work mode: 2 days/week in office


Job Description:

About the Role: We are seeking a Lead GCP Data Engineer who can demonstrate a broad range of technical skills across Google Cloud Platform (GCP) and thirdparty technologies. As a pivotal member of our team you will be responsible for designing robust data architectures developing efficient data pipelines and optimizing data processing workflows on GCP. Your expertise will be instrumental in driving our data engineering initiatives forward ensuring scalability reliability and performance.


Key Responsibilities:

  • Data Architecture Design: Design scalable and efficient data architectures on GCP that meet the organizations data processing and analysis requirements. Collaborate closely with data scientists business analysts and stakeholders to define effective data models and structures.
  • Data Pipeline Development: Develop and implement data pipelines using GCP services such as Google Cloud Storage Big Query Dataflow and Pub/Sub. Ensure data quality reliability and governance throughout the data lifecycle.
  • Data Transformation and Integration: Utilize technologies like Apache Beam Apache Spark and Cloud Dataproc to transform and integrate data from diverse sources. Perform data cleansing aggregation enrichment and normalization to support downstream applications and analytics.
  • Performance Optimization: Optimize data processing workflows to enhance performance and efficiency. Monitor pipelines identify bottlenecks and implement optimizations such as improved data partitioning sharding and leveraging GCPs autoscaling capabilities.
  • Continuous Improvement: Stay abreast of advancements in data engineering and cloud technologies. Explore and implement new GCP features and services to enhance data processing capabilities and drive innovation within the team.
  • Research and Innovation: Conduct research on emerging data engineering technologies tools and best practices. Evaluate new methodologies to improve data engineering processes and bring innovative solutions to the organization.
  • Task Automation: Automate data engineering tasks using scripting workflows or tools like Cloud Composer and Cloud Functions. Streamline data ingestion transformation monitoring and other operational processes to improve efficiency and reduce manual effort.


Attributes & Competencies:

  • Education: BE/BTech MTech or MCA.
  • Experience: Minimum 7 years in development/migration projects with at least 3 years focused on GCP. Experience in GCPbased Big Data deployments (batch/realtime) using Big Query Bigtable Google Cloud Storage Pub/Sub Data Fusion Dataflow Dataproc and Airflow.


Technical Skills:

  • Google Certified Professional Cloud Architect with experience automating and orchestrating workloads on GCP or other public clouds.
  • Proficiency in at least one configuration management system (Chef Puppet Ansible Salt etc..
  • Strong programming skills in Python Go with expertise in Git and Git workflows.
  • Demonstrated proficiency in CI/CD tools such as Jenkins TeamCity or Spinnaker.


Interested candidates can directly share at

Employment Type

Full-Time

Company Industry

Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.