System Engineer ETL
Job Location:
Monthly Salary:
Experience Required:
Posted on:
Vacancies:
Job Summary
- Strong handson experience with the ETL(Informatica Power Center) and Teradata based ETL development similarly Hadoop ecosystem (Hive Impala Spark Kafka Iceberg Ranger Atlas Nifi Flink etc.) and data pipeline orchestration.
- Create EDW ETL/ELT codes using Teradata SQL Informatica apache Spark QueryGrid Trino to perform various transformation and load into Teradata based data warehouse or datamarts
- Performance tuning of highly complex applications to reduce resource usage
- Create framework using GCFR shell scripts BTEQ and shell scripts to automate end to end. Also to integrate with control
- Build in-house CDC framework using Java to process OLR logs from SAP(Oracle) and ingestion the data into Teradata. Create framework around this CDC ingestion to make it configurable
- Install and build Master Data Management(MDM) application for various user uploads along with data validations and approval workflow
Required Skills:
Strong hands on experience with the ETL(Informatica Power Center) and Teradata based ETL development similarly Hadoop ecosystem (Hive Impala Spark Kafka Iceberg Ranger Atlas Nifi Flink etc.) and data pipeline orchestration. Create EDW ETL/ELT codes using Teradata SQL Informatica apache Spark QueryGrid Trino to perform various transformation and load into Teradata based data warehouse or datamarts Performance tuning of highly complex applications to reduce resource usage Create framework using GCFR shell scripts BTEQ and shell scripts to automate end to end. Also to integrate with control Build in-house CDC framework using Java to process OLR logs from SAP(Oracle) and ingestion the data into Teradata. Create framework around this CDC ingestion to make it configurable Install and build Master Data Management(MDM) application for various user uploads along with data validations and approval workflow
Required Education:
Graduate
