Data Engineer ETL Developer

Job Title: Data Engineer / ETL Developer (AWS Snowflake/Python Stack)

Location: Jersey City NJ

Role Summary

Key Responsibilities

1. Scope & Impact Analysis

• Collaborate with business and stakeholders to define solution scope.
• Analyze and document impacts on upstream/downstream systems business logic and workflows.
• Ensure traceability across applications and data flows.

2. Agile Delivery & Estimation

• Participate in Agile ceremonies and contribute to product backlog refinement.
• Perform story point estimation for JIRA stories and align with Client validation.
• Deliver sprint commitments as per defined timelines.

3. Development & Coding

• Design and develop scalable data solutions using:
  • Data Warehousing ETL PL/SQL
  • Python PySpark Snowpark Streamlit
  • AWS (S3 Glue Lambda EMR)
• Follow Test-Driven Development (TDD) practices; ensure all components meet TDD criteria before completion.
• Maintain high coding standards reusability and performance optimization.

4. Documentation & Technical Governance

• Document technical designs architecture decisions and development approaches.
• Ensure proper documentation of all major technical decisions taken during implementation.

5. Testing & Quality Assurance

• Support SIT (System Integration Testing) by resolving identified defects.
• Ensure successful migration from Dev SIT UAT environments post unit testing.
• Collaborate with business stakeholders during UAT and resolve defects promptly.
• Adhere to defined UAT timelines aligned with release schedules.

6. Production Support & Continuous Improvement

• Analyze and resolve existing/past production defects in collaboration with Client .
• Prioritize fixes based on business input and include in sprint deliverables.
• Continuously enhance system stability and performance.

7. Governance & Stakeholder Communication

• Participate in monthly status meetings with Program Managers (Client & Supplier).
• Provide updates on progress risks and issue resolutions.
• Ensure transparency and alignment with program objectives.

Required Skills & Experience

• Strong experience in Data Warehousing & ETL development
• Proficiency in:
  • Python PySpark Snowpark Streamlit
  • PL/SQL
  • AWS (S3 Glue Lambda EMR)
• Hands-on experience with Agile (Scrum) methodologies
• Strong expertise in test-driven development (TDD) practices
• Experience in end-to-end data pipeline implementation and support

Preferred Skills

• Experience working in banking/financial services environments
• Strong understanding of data flow integration patterns and large-scale systems
• Exposure to production support and release management

Key Success Metrics

• On-time sprint delivery with quality outputs
• Defect reduction and faster resolution cycles
• Adherence to TDD and coding standards
• Effective stakeholder communication and alignment