AB initio Developer
AB initio Developer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Not Disclosed
Salary Not Disclosed
1 Vacancy
Job Description
Role: AB initio Developer
Location: Jersey City NJ
Mode of Hire: Contract
Job Description:
Mandatory Skills: Python Java Ansi SQL Abinitio Spark
- Experience in building data integration solutions using the AB initio ETL .
- Creating efficient and scalable data processing pipelines and applications using Apache spark
- Proficient in understanding distributed computing principles.
- Creating optimizing and maintaining directed acyclic graphs(DAGs) in Python to define and orchestrate data pipelines and automated tasks.
- Implementing scheduling and monitoring complex data workflows ensuring timely and accurate data processing.
- Identifying diagnosing and resolving issues within airflow work flows and optimizing DAGs for performance scalability and resource efficiency.
- Good understanding of cloud technology. Must have strong technical experience in Desing Mapping Specifications HLD LLD.
- Must have the ability to relate to both business and technical members of the team and possess excellent communication skills.
- Leverage internal tools and SDKs utilize AWS services such as S3 Athena and Glue EMR and integrate witho our internal Archival Service Platform for efficeient data purging and LifeCycle management.
- Collaborate with the data engineering team to continuously improve data integration pipelines ensuring adaptability to evolving business needs.
- Building data integration solutions using the Ab initio ETL .
- Creating efficient and scalable data processing pipelines and applications using Apache spark.
- Implementing scheduling and monitoring complex data workflows ensuring timely and accurate data processing.
- Implement and manage agents for monitoring logging and automation within aws environments
- Handling migration from Pyspark to AWS
Employment Type
Full-time
