Senior AWS Data Engineer

Fort Mill, SC - USA

Monthly Salary: Not Disclosed

Posted on: 30+ days ago

Vacancies: 1 Vacancy

Job Summary

Role: Senior AWS Data Engineer

Location: Fort Mill SC Hybrid from day one

Type: Contract

Our Challenge:

Contribute to building state-of-the-art data platforms in AWS leveraging Python and Spark. Be part of a dynamic team building data solutions in a supportive and hybrid work environment. This role is ideal for an experienced data engineer looking to step into a leadership position while remaining hands-on with cutting-edge technologies. You will design implement and optimize ETL workflows using Python and Spark contributing to our robust data Lakehouse architecture on AWS. Success in this role requires technical expertise strong problem-solving skills and the ability to collaborate effectively within an agile team.

The Role

Responsibilities:

Provides guidance on best practices in design development and implementation ensuring solutions meet business requirements and technical standards.

Works closely with architects Product Owners and Dev team members to decompose solutions into Epics leading design and planning of these components.
Drive the migration of existing data processing workflows to the Lakehouse architecture leveraging Iceberg capabilities.

Communicates complex technical information clearly tailoring messages to the appropriate audience to ensure alignment.

Requirements:

Bachelors degree in computer science Software Engineering or related field essential.
Over 10 years of AWS Data Engineering experience
Financial Services expertise preferred working with Equity and Fixed Income asset classes and a working knowledge of Indices.
Expert in Python and Spark with a deep focus on ETL data processing and data engineering practices.
Experience of implementing data pipelines using tools like EMR AWS Glue AWS Lambda AWS Step Functions API Gateway Athena
Experience with data services in a Lakehouse architecture.

Deep technical knowledge of data engineering solutions and practices. Implementation of data pipelines using AWS data services and Lakehouse capabilities.
Highly proficient in Python Spark and familiar with a variety of development technologies. This knowledge enables the Senior Data Engineer to adapt solutions to project-specific needs.

Skilled in decomposing solutions into components (Epics stories) to streamline development.
Proficient in creating clear comprehensive documentation. Ensures that documentation supports knowledge sharing and compliance making it accessible and valuable for future reference
Proficient in quality assurance practices including code reviews automated testing and best practices for data validation.
Experience in leveraging automation tools and Continuous Integration/Continuous Deployment (CI/CD) pipelines to streamline development testing and deployment.

Preferred but not required:

Experience in solution architecture and technical design allowing for the creation of scalable reliable data architectures that meet both technical and business requirements
A masters degree or relevant certifications (e.g. AWS Certified Solutions Architect Certified Data Analytics) is advantageous.

Role: Senior AWS Data Engineer Location: Fort Mill SC Hybrid from day one Type: Contract Our Challenge: Contribute to building state-of-the-art data platforms in AWS leveraging Python and Spark. Be part of a dynamic team building data solutions in a supportive and hybrid work environment. Thi...