Senior Lead Data Engineering

We are seeking a highly skilled and motivated Senior Lead Data Engineer with a strong focus on Google Cloud Platform (GCP) services. The ideal candidate will possess advanced proficiency in Python and a deep understanding of data engineering principles including the design and implementation of data pipelines ETL/ELT frameworks and distributed systems. This role requires a proactive individual who can leverage their expertise to drive data solutions that meet business needs.

• Design develop and maintain scalable data pipelines using GCP services such as Dataflow Cloud Functions and Cloud Composer.
• Implement data processing workflows and ensure data quality and integrity throughout the ETL/ELT processes.
• Utilize BigQuery for data analysis and reporting optimizing queries for performance and cost efficiency.
• Collaborate with cross-functional teams to understand data requirements and deliver solutions that support business objectives.
• Develop and maintain REST APIs and microservices to facilitate data access and integration.
• Implement CI/CD practices using tools like Cloud Build GitHub Actions and Jenkins to streamline deployment processes.
• Monitor and troubleshoot data pipelines and services to ensure high availability and performance.
• Stay updated with the latest trends and technologies in data engineering and GCP services.

• Strong knowledge of Google Cloud Platform (GCP) services specifically Dataflow Cloud Functions Cloud DLP Cloud Composer (Airflow) Pub/Sub GCS and BigQuery.
• Advanced proficiency in Python including object-oriented programming (OOP) asynchronous programming multithreading and relevant libraries.
• Experience with data pipelines ETL/ELT frameworks and distributed systems.
• Strong understanding of REST APIs and microservices architecture.
• Familiarity with CI/CD tools such as Cloud Build GitHub Actions and Jenkins.
• Deal breaker skill: Google Cloud Data Analyst.

• Familiarity with Terraform or other infrastructure automation tools.
• Proficiency with Docker and container-based deployment.

A degree in Computer Science Information Technology or a related field is preferred. Relevant certifications in Google Cloud Data Engineering or related areas will be considered a plus.

If you are passionate about data engineering and have a strong background in Google Cloud technologies we encourage you to apply and join our dynamic team.