GCP Data Engineer

Job Description:

We are seeking a highly skilled and motivated ETL/ELT GCP Pipeline Engineer to join our team and contribute to the development of a brandnew product/application. As an ETL/ELT Pipeline Engineer you will be responsible for designing and building efficient data integration pipelines using GCP native tools or opensource technologies such as Python and PySpark. A candidate with expertise in building APIs would be advantageous.

Responsibilities:

• Designing and developing robust ETL/ELT pipelines to extract transform and load data from various sources into our new product/application.
• Collaborating with crossfunctional teams to understand data requirements and translate them into effective pipeline designs.
• Implementing data quality checks and ensuring the accuracy completeness and consistency of data throughout the pipeline process.
• Optimizing and tuning pipeline performance to ensure efficient data processing and delivery.
• Working experience in Airflow DAG
• Working with cloudbased technologies particularly Google Cloud Platform (GCP) and leveraging its native tools for data integration.
• Integrating data from diverse sources and formats including structured semistructured and unstructured data.
• Identifying and resolving data integration and transformation issues ensuring the smooth and reliable flow of data.
• Staying up to date with industry trends and emerging technologies in the ETL/ELT space to continuously improve pipeline efficiency and effectiveness.

Requirements:

• Strong experience in designing and building ETL/ELT pipelines using GCP native tools or opensource technologies such as Python and PySpark.
• Familiarity with ETL tools like Ab Initio is a plus but not a must.
• Proven ability to work on a brandnew product/application demonstrating adaptability and problemsolving skills in a dynamic environment.
• Solid understanding of data integration concepts data modeling and database systems.
• Proficiency in SQL and experience working with various databases and data formats.
• Excellent analytical and problemsolving skills with the ability to troubleshoot and resolve complex datarelated issues.
• Strong communication and collaboration skills to effectively work with crossfunctional teams and stakeholders.
• Detailoriented with a focus on delivering highquality results within project timelines.
• Bachelors or masters degree in computer science Engineering or a related field.
• If you are a motivated and talented ETL/ELT Pipeline Engineer looking to join a dynamic team working on an exciting new product we would love to hear from you. Apply now and be part of our journey in revolutionizing data integration and analytics.