Fix and enhance Dataflow and/or Dataproc Data ingestion pipelines (batch & Streaming) . Have Good Understanding of GCP Composer (Apache Airflow) environments. Manage Airflow DAGs and troubleshoot Airflow-related issues. Monitor and optimize Composer performance and scalability. Maintain GCP infrastructure including services like: o Google Cloud Storage (GCS) o BigQuery (BQ) o Cloud Dataflow ( Apache Beam ) o Cloud Dataproc o Cloud Functions o Cloud Run Have Good Understanding of: o IAM and service account permissions o Secret Manager Monitor GCP usage and quotas and proactively prevent quota-related issues. Set up and manage alerting logging and monitoring using tools like Stackdriver (Cloud Monitoring & Logging). DB design experience (with Excellent RDBS-PLSQL knowledge ) Design Springboot APIs Analyze design create Dockerfile Knowledge on Angular ( Good to Have ) Design and implement infrastructure as code using Terraform for provisioning and managing GCP resources. Collaborate with DevOps and development teams to manage CI/CD pipelines using Jenkins and other automation tools. Ensure security compliance and cost-efficiency across the cloud environment. Document system configurations procedures and best practices. Proficient in either Java or Python programming languages. Knowledge on DNS and SSO configuration setup
Job Title: Sr. GCP Developer Job Location: Hanover VA (100% Remote) Job Duration: 12 months Minimum years of experience required: Type of Hire: w2 contract JOB DETAILS: Fix and enhance Dataflow and/or Dataproc Data ingestion pipelines (batch & Streaming) . Have Good Understanding of ...
Job Title: Sr. GCP Developer
Job Location: Hanover VA (100% Remote)
Job Duration: 12 months
Minimum years of experience required:
Type of Hire: w2 contract
JOB DETAILS:
Fix and enhance Dataflow and/or Dataproc Data ingestion pipelines (batch & Streaming) . Have Good Understanding of GCP Composer (Apache Airflow) environments. Manage Airflow DAGs and troubleshoot Airflow-related issues. Monitor and optimize Composer performance and scalability. Maintain GCP infrastructure including services like: o Google Cloud Storage (GCS) o BigQuery (BQ) o Cloud Dataflow ( Apache Beam ) o Cloud Dataproc o Cloud Functions o Cloud Run Have Good Understanding of: o IAM and service account permissions o Secret Manager Monitor GCP usage and quotas and proactively prevent quota-related issues. Set up and manage alerting logging and monitoring using tools like Stackdriver (Cloud Monitoring & Logging). DB design experience (with Excellent RDBS-PLSQL knowledge ) Design Springboot APIs Analyze design create Dockerfile Knowledge on Angular ( Good to Have ) Design and implement infrastructure as code using Terraform for provisioning and managing GCP resources. Collaborate with DevOps and development teams to manage CI/CD pipelines using Jenkins and other automation tools. Ensure security compliance and cost-efficiency across the cloud environment. Document system configurations procedures and best practices. Proficient in either Java or Python programming languages. Knowledge on DNS and SSO configuration setup