Senior ETL Developer – DataStage & AWS Data Engineering
Columbus, NE - USA
Job Summary
Role Summary
Seeking an experienced ETL Developer to modernize and support enterprise ETL pipelines across IBM DataStage and AWS. The role involves building scalable AWS data pipelines enhancing legacy ETLs and supporting Finance/Regulatory reporting workloads.
Key Responsibilities- Develop scalable ETL pipelines using AWS Glue PySpark Python.
- Enhance existing IBM DataStage jobs and build new Python-based ETLs.
- Transform data into Parquet/Avro and manage S3 Bronze Silver Gold data lake.
- Build AWS Lambda scripts for automation validation and event-driven triggers.
- Implement CloudWatch dashboards monitoring and alerts.
- Optimize Spark jobs and SQL queries for performance and cost.
- Troubleshoot upstream/downstream failures and provide production support.
- Support ETL across Dev QA Stage Prod environments.
- Maintain IBM InfoSphere Information Server (IIS) platform health.
- Promote DSX/ISX across environments and support upgrades/patching.
- Manage access workflows and coordinate with IAM teams.
- Strong SQL Snowflake and Oracle experience.
- Hands-on: DataStage AWS Glue S3 Lambda CloudWatch PySpark Python.
- ETL performance tuning & parallelism expertise.
- Experience supporting Finance/Regulatory Reporting.
- Production support monitoring and incident management experience.