GCP Data Engineer

GCP Data Engineer: (Direct Applicants Only) - Full-Time

The Senior Staff Data Engineer - API serves as a primary development resource for design writing code test implementation document functionality and maintain of NextGen solutions for the GCP Cloud enterprise data initiatives. The role requires working closely with data teams frequently in a matrixed environment as part of a broader project team. Due to the emerging and fast-evolving nature of GCP technology and practice the position requires that one stay well-informed of technological advancements and be proficient at putting new innovations into effective practice.

As a Senior Staff Data Engineer you will collaborate closely with all team members to create a modular scalable solution that addresses current needs but will also serve as a foundation for future success. The position will be critical in building the teams API engineering practices in test driven development continuous integration and automated deployment and is a hands-on team member who actively coaches the team to solve complex problems.

This role will provide application development for specific business environments. Focus on setting technical direction on groups of applications and similar technologies as well as taking responsibility for technically robust solutions encompassing all business architecture and technology constraints.

Work with data engineers data architects data scientists and other internal stakeholders to understand product requirements and then design build and monitor data platforms and pipelines that meet todays requirements but can gracefully scale.
Implement automated workflows that lower manual/operational costs define and uphold SLAs for timely delivery of data and move the company closer to democratizing data.

Enable a self-service data architecture supporting query exploration dashboards data catalog and rich data discovery.
Promote a collaborative team environment that prioritizes effective communication team member growth and success of the team over success of the individual.
Design and create APIs that accelerate the time from idea to insight.
Adheres to and supports API best practices processes and standards.
Produce high quality modular reusable code that incorporates best practices and serves as an example for less experienced engineers.
Help mentor team members on complex data projects and following the Agile process.
Responsible for building and supporting a GCP based ecosystem designed for enterprise-wide analysis of structured semi-structured and unstructured data.
Analyze requirements design AI/ML based solutions and integrate those solutions for customer environments.

A successful candidate will have:

Strong understanding of best practices and standards for GCP Data process design and implementation.
2 years hands-on experience with GCP platform and experience with many of the following components:
o Postman Dynatraceo Cloud Run GKE Cloud Functions
o Bigtable Cloud SQL Cloud Spanner
o BigQuery Cloud Function
o Cloud Run CI/CD Cloud Logging
o Vertex AI NLP GitHub
4 Years of hands-on experience with many of the following components:
o API Development
o Apigee
o Python FastAPI Framework
o Spark Streaming Kafka
o SQL JSON Avro Parquet
o Java Python or Scala

Certifications (a plus but not required):
GCP Cloud Professional Data Engineer