Shift Time: 129 pm / 110 pm IST
Job Description:
Please find below the highlevel responsibilities (not just limited to below). This is a migration project from Snowflake to GCP Big Query however the components in Azure need to be migrated to equivalent GCP components as well.
Experience: 6 years
Key Responsibilities:
Work closely with the data engineering and analytics teams to understand the existing data infrastructure data models and business requirements
Need to work with the application teams to understand the existing Azure infrastructure and how that will be translated into Google Cloud products and services
Update the Snowflake pipelines and codes to Big Queryspecific pipelines & codes.
Knowledge and experience in Cloud composer (or Airflow) for Orchestration in GCP
Design and optimize data pipelines to extract transform and load data from various sources into Big Query.
Develop and maintain data models in Big Query to support reporting and analytics requirements
Collaborate with the infrastructure team to ensure the scalability reliability and security of the Big Query environment
Provide technical guidance and support to the data engineering and analytics teams on using Big Query effectively.
Stay uptodate with the latest trends and best practices in GCP and Big Query to continuously improve our data infrastructure.
snowflake,gcp,azure,airflow,cloud