Software Developer/Data Engineer 12 Month Contract
Educational Qualifications
- BSc Computer Science / BEng
Professional Qualifications
- AWS Professional Certification
Years of Experience
- 4 to 8 years of Data Engineering or Software Development experience working on DataDriven ecosystems
Skills / Requirements
- 4 to 8 years of Data Engineering or Software Development experience working on DataDriven ecosystems
- Required to code complex transformations using loader specifications provided by the BA
- Experience working with Big Data sets and solving datarelated challenges
- Ability to automate ingestion by building ingestion pipelines using AWS Lambda or Glue
- Proficiency in coding languages: PySpark Python SQL
- Handson experience with AWS services including S3 Athena Lambda Functions GLUE EC2
- AWS experience and AWS certification required
- Experience in data modeling and data architecture design
Key Responsibilities
- Implement scalable data pipelines and architectures using PySpark Python SQL
- Build distributed data pipelines and compute tiers operating on AWS Lambda and Glue
- Serve as a technical resource for team members and mentor junior engineers
- Collaborate with the team to deliver highquality solutions that meet business requirements
- Ensure code is welldesigned maintainable and follows best practices and standards
- Play a key role in shaping engineering practices by working in a scrum team to ensure sprint deliverables are met
- Utilize project development tools such as JIRA Confluence and GIT
- Assist DEVOPS Engineer in automation and CI/CD practices
- Evaluate and recommend new technologies to improve performance scalability and reliability of software systems.