GCP Data Engineer
GCP Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Not Disclosed
Salary Not Disclosed
1 Vacancy
Job Description
Requirements
- Handson experience with the Google Cloud Platform (GCP) tech stack including BigQuery Vertex AI and Dataflow.
- Proven experience leading data engineering projects and fostering crossteam collaboration.
- Expertise in designing building and maintaining scalable data pipelines using Kafka Databricks or similar tools.
- Strong background in modern data architectures (SQL NoSQL cloudbased and realtime streaming platforms).
- Experience developing feature engineering pipelines for ML workflows using Vertex AI BigQuery ML and Python.
- Proficiency in automated unit integration and performance testing to ensure data quality and compliance.
- Ability to optimize data workflows for performance cost efficiency and scalability.
- Skilled in mentoring teams on data engineering best practices and principles.
- Experience creating architectural diagrams and technical documentation.
- Strong analytical skills for cost/benefit analysis and guiding data architecture decisions.
Nice to Have
- Experience with additional data streaming tools and hybrid/multicloud environments.
- Familiarity with infrastructureascode tools like Terraform.
- Knowledge of data governance privacy and compliance frameworks.
Focus: Google Tech Stack experience is highly preferred
Prescreening: 5 customized questions (must be completed)
Pillar: Customer Experience (CX/MX)
Interview Process: Initial touch base with the manager Technical round
As a Sr. Data Engineer you will have the opportunity to lead the development of innovative data solutions enabling the effective use of data across the organization. You will be responsible for designing building and maintaining robust data pipelines and platforms to meet business objectives focusing on data as a strategic asset. Your role will involve collaboration with crossfunctional teams leveraging cuttingedge technologies and ensuring scalable efficient and secure data engineering practices. A strong emphasis will be placed on expertise in GCP Vertex AI and advanced feature engineering techniques.
Typical Duties
- Offer technical leadership to ensure clarity between ongoing projects and facilitate collaboration across teams to solve complex data engineering challenges
- Design build and maintain scalable efficient and reliable data pipelines to support data ingestion transformation and integration across diverse sources and destinations using tools such as Kafka Databricks and similar toolsets
- Leverage innovative technologies and approaches to modernize and extend core data assets including SQLbased NoSQLbased cloudbased and realtime streaming data platforms
- Develop and manage feature engineering pipelines for machine learning workflows utilizing tools like Vertex AI BigQuery ML and custom Python libraries
- Design and implement automated unit integration and performance testing frameworks to ensure data quality reliability and compliance with organizational standards
- Optimize data workflows for performance cost efficiency and scalability across large datasets and complex environments
- Mentor team members in data principles patterns processes and practices to promote best practices and improve team capabilities
- Draft and review architectural diagrams interface specifications and other design documents to ensure clear communication of data solutions and technical requirements
- Present opportunities with cost/benefit analysis to leadership guiding sound architectural decisions for scalable and efficient data solutions
Employment Type
Full Time
