Senior Cloud Data Engineer (AWS)
Job Summary
Responsibilities
Data Solution Design and Development:
- Design develop and implement complex and scalable data solutions on the AWS cloud platform.
- Design build and optimize data pipelines to ensure efficiency and reliability.
Programming & Scripting:
- Write clean efficient and maintainable SQL and Python code.
- Develop and maintain shell scripts to support automation.
DevOps & Automation:
- Utilize Docker containers for containerizing applications and data pipelines.
- Establish and maintain CI/CD pipelines (e.g. GitHub Actions GitLab CI/CD) for rapid and reliable deployments.
- Automate data pipeline processes.
Cloud Data Services:
- Deliver solutions on AWS data services (e.g. S3 Redshift Glue EMR Lambda).
- Design and implement data modeling and data warehousing solutions.
Project and Team Management:
- Own and manage the technical aspects of deliveries (at least at the component level).
- Participate in project planning task estimation testing and liaising with business stakeholders.
- Provide technical leadership to smaller teams.
- Create technical documentation.
Qualifications :
Requirements
Programming & Scripting
- Must have Proficiency in both SQL and at least one imperative programming language particularly in Python emphasizing clean efficient and maintainable code.
- Experience with shell scripting.
Devops & Automation:
- Familiarity with Docker and at least one CI/CD tool (e.g. Github Actions GitLab CI/CD) to streamline deployment and manage data pipelines.
Cloud Data Services
- A minimum of 5 years of hands-on experience in data engineering with a strong focus on cloud-based solutions.
- Has delivered at least one complex and scalable data solution on at least one cloud platforms data services (Primary AWS data engineering skills required GCP/Azure experience beneficial.)
- Experience in working with dbt or SQLMesh is a plus.
Soft and other skills
- Strong team player with a proactive mindset eager to take on challenges and drive solutions.
- Great problem-solving skills analytical thinking and a structured approach to decision-making.
- Excellent written and verbal communication skills in English
Additional Information :
Why us
- Diverse projects: In each assignment there is always something new either on the technical or on the business side that helps you grow.
- Cutting edge technology: We work with many of the most up-to-date technologies and tools.
- Strong and motivating team: We stress the importance of working together in tight-knit cohesive teams in which members help each other to reach the common goal.
- Work-life balance: We help you to feel good individually as well and coordinate work so as it should align with your leisure activities.
- Professional development: There are team gatherings on a regular schedule where colleagues can share their knowledge and have deep technical discussions.
- Focus on company culture: In addition to our business and professional achievements we are proud of the social bonding in the company which is based on mutual respect and helping one another.
- Personal mentoring: You will have your own mentor (just like everybody at Hiflylabs) who you can turn to with professional issues as well as with personal ones.
Remote Work :
No
Employment Type :
Full-time
About Company
We're Hiflylabs, a vibrant team of 200+ data and tech enthusiasts based in Budapest, Hungary and also build a Hub in Brasil. From data engineering to data science, artificial intelligence and application development, we work on a wide range of projects around the world. Over a Decade ... View more