drjobs GCP Data Engineer

GCP Data Engineer

Employer Active

The job posting is outdated and position may be filled
drjobs

Job Alert

You will be updated with latest job alerts via email
Valid email field required
Send jobs
Send me jobs like this
drjobs

Job Alert

You will be updated with latest job alerts via email

Valid email field required
Send jobs
Job Location drjobs

Hamala - USA

Monthly Salary drjobs

Not Disclosed

drjobs

Salary Not Disclosed

Job Description

Job Description:

We are seeking a highly skilled and motivated ETL/ELT GCP Pipeline Engineer to join our team and contribute to the development of a brandnew product/application. As an ETL/ELT Pipeline Engineer you will be responsible for designing and building efficient data integration pipelines using GCP native tools or opensource technologies such as Python and PySpark. A candidate with expertise in building APIs would be advantageous.

Responsibilities:

  • Designing and developing robust ETL/ELT pipelines to extract transform and load data from various sources into our new product/application.
  • Collaborating with crossfunctional teams to understand data requirements and translate them into effective pipeline designs.
  • Implementing data quality checks and ensuring the accuracy completeness and consistency of data throughout the pipeline process.
  • Optimizing and tuning pipeline performance to ensure efficient data processing and delivery.
  • Working experience in Airflow DAG
  • Working with cloudbased technologies particularly Google Cloud Platform (GCP) and leveraging its native tools for data integration.
  • Integrating data from diverse sources and formats including structured semistructured and unstructured data.
  • Identifying and resolving data integration and transformation issues ensuring the smooth and reliable flow of data.
  • Staying up to date with industry trends and emerging technologies in the ETL/ELT space to continuously improve pipeline efficiency and effectiveness.

Requirements:

  • Strong experience in designing and building ETL/ELT pipelines using GCP native tools or opensource technologies such as Python and PySpark.
  • Familiarity with ETL tools like Ab Initio is a plus but not a must.
  • Proven ability to work on a brandnew product/application demonstrating adaptability and problemsolving skills in a dynamic environment.
  • Solid understanding of data integration concepts data modeling and database systems.
  • Proficiency in SQL and experience working with various databases and data formats.
  • Excellent analytical and problemsolving skills with the ability to troubleshoot and resolve complex datarelated issues.
  • Strong communication and collaboration skills to effectively work with crossfunctional teams and stakeholders.
  • Detailoriented with a focus on delivering highquality results within project timelines.
  • Bachelors or masters degree in computer science Engineering or a related field.
  • If you are a motivated and talented ETL/ELT Pipeline Engineer looking to join a dynamic team working on an exciting new product we would love to hear from you. Apply now and be part of our journey in revolutionizing data integration and analytics.

Employment Type

Full Time

Company Industry

Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.