Google Cloud Data Engineer
Share
Job Location:
New York City, NY - USA
Monthly Salary:
Not Disclosed
Posted on:
30+ days ago
Vacancies:
1 Vacancy
Job Summary
Description
We are seeking an experienced Google Cloud Data Engineer to join our team in New York NY. The ideal candidate will have 10-15 years of extensive experience in data architecture data ingestion transformation modeling and analytics within the Google Cloud Platform (GCP). You will play a crucial role in designing and implementing scalable data solutions that enable our organization to leverage data for business insights and strategic decisions.
Responsibilities
- Design and implement scalable data ingestion pipelines using Cloud Dataflow Pub/Sub Datastream or BigQuery Data Transfer Service.
- Migrate data from on-premises and other cloud platforms to GCP using Cloud Storage Transfer Service and BigQuery.
- Build and orchestrate ETL/ELT workflows using Cloud Composer (Airflow) Dataform or Dataflow.
- Transform structured semi-structured and unstructured data into analytics-ready formats.
- Design efficient data models and partitioning strategies in BigQuery for high performance and cost optimization.
- Implement best practices for schema evolution materialized views clustering and federated queries.
- Optimize BigQuery queries and pipelines for performance and cost.
- Implement monitoring and alerting using Cloud Monitoring Cloud Logging and Data Catalog.
- Enforce data governance lineage and security policies using IAM Data Catalog DLP API and VPC Service Controls.
- Ensure compliance with enterprise security and privacy standards.
Requirements
- 10-15 years of experience in data engineering or related fields.
- Strong understanding of data architecture principles and best practices.
- Proficient in Google Cloud services including BigQuery Cloud Dataflow Cloud Storage Cloud Composer (Airflow).
- Experience with data ingestion and migration tools like Pub/Sub Datastream and BigQuery Data Transfer Service.
- Expertise in ETL/ELT processes and data transformation techniques.
- Knowledge of data modeling and analytics best practices.
- Familiarity with data governance lineage and security policies in the cloud.
- Strong analytical and problem-solving skills.
- Excellent communication and teamwork abilities.
Company Industry
IT Services and IT Consulting
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
