JOB PURPOSE:
Designing & Development of Data Pipelines in Informatica BDM and Azure Cloud
KEY ACCOUNTABILITIES:
Requirement Gathering and planning for New Business requirements and designing data pipelines in Informatica DEI.
Creating efficient data workflows to extract data from various sources transform it into a usable format and load it into target systems in Big Data Hadoop Ecosystem and its platforms.
Creating and managing ETL processes using Informatica DEI or similar tools to extract transform and load data from various sources.
Development of mappings workflows and application for project requirements in Informatica DEI in lower env and deploying them in Production post business signoffs.
Responsible to debug production issues post production deployment.
Very well verse in Hadoop and Bigdata ecosystem and scripting to design efficient data pipelines to complex Business requirements.
Documentation: Documenting the entire data flow processes including workflows configurations and any customizations created for New projects for handover to Production Support team.
Implementing data quality checks audits and governance policies to ensure data accuracy consistency and security.
Must have Unix scripting Knowledge.
Collaboration: Work closely with other ETL developers Production Support Team Data Architects and Business Analysts to ensure alignment and Required support.
Requirements
QUALIFICATIONS & EXPERIENCE:
Graduation(BE/Btech) with 57 Years
Must have Minimum 5 years of exp in Informatica Data Engineering tool in Hadoop environment and Big Data Ecosystem.
Must have Minimum 5 years of experience in designing Data Pipeline in Azure Cloud Data Lake and Informatica Data Engineering.
Must have a understanding of Azure Stack (Azure Data Bricks Azure streaming Analytics & Azure Synapse)
Must Have Unix knowledge for writing shell scripts and troubleshoot of existing shell scripts.
Experience in any programming language like Python/Scala.
Must have SQL knowledge of writing & tuning complex query/script in RDBMS/Hive.
Understanding of informatica components/services/Repository.
Good understanding of informatica different type of connectors
Experience in Financial & Banking domain will added advantage.