AWS,Pyspark, Redshift, Airflow, IceBergIndia

Trigent Software Private Limited

Job Location:

Bengaluru - India

Monthly Salary: Not Disclosed

Posted on: 13 hours ago

Vacancies: 1 Vacancy

Job Summary

Exp-10 Years
Detailed jd:

Design develop and maintain robust ETL pipelines using PySpark and Airflow.
Architect and manage data infrastructure on AWS using services like S3 Redshift Glue Lambda EMR.
Implement and optimize SQL queries and database schemas for efficient data storage and retrieval.
Ensure data quality through unit testing and validation frameworks.
Monitor and troubleshoot data pipeline performance and reliability.

Mandatory skills:
AWS Pyspark Redshift Airflow Lambda With Knowledge of IceBerg

Exp-10 Years Detailed jd: Design develop and maintain robust ETL pipelines using PySpark and Airflow. Architect and manage data infrastructure on AWS using services like S3 Redshift Glue Lambda EMR. Implement and optimize SQL queries and database schemas for efficient data storage and retrieval. En...