Senior Data Engineer
Share
Job Location:
Monthly Salary:
Posted on:
3 hours ago
Vacancies:
1 Vacancy
Job Summary
Join our team where you can participate delivering data driven solutions based on Medallion data design pattern.
Introducing Medallion Architecture with its Raw Silver and Gold layers we expect to extend existing toolset for data management increase flexibility and governance as well as reduce complexity of organizing and processing data across organization.
Our solution will be delivered as a self-service framework to various teams owning data sources.
We are working in fully AWS cloud environment using latest services to build our framework and platform solutions from Proof of Concept to Production usage stage.
By joining our teamyou will be playing a vital role in changing mindset for data management approach!
Your responsibilities:
Architectural leadership lead the design and evolution of the Medallion Architecture framework ensuring scalability governance and best practices.
Cross-team collaboration partner with development teams and stakeholders to drive architecture decisions and maintain technical excellence.
CI/CD & deployment support contribute to building and maintaining CI/CD processes for deployment testing and production troubleshooting.
Mentorship & code quality mentor mid-level engineers and lead design/code reviews to promote best practices.
Data platform optimization identify opportunities to improve data platforms and influence long-term data strategy.
Qualifications :
Programming expertise strong experience in Java (Spring) and/or Python with a proven track record in delivering large-scale solutions.
Cloud & Big Data proficiency hands-on experience with AWS services (Lambda S3 Glue ECS DMS EventBridge Lake Formation MSK) and Big Data tools like Spark Iceberg and Kafka Streams.
Data architecture & database knowledge ability to design and optimize scalable governed data architectures; strong understanding of relational (MySQL Postgres MS SQL) and NoSQL (DynamoDB MongoDB) databases.
Infrastructure & automation experience with Infrastructure as Code (Terraform) CI/CD pipelines and large-scale automation.
Mentorship & technical leadership guiding mid-level engineers conducting code/design reviews and influencing architecture decisions aligned with business goals.
Additional Information :
Were a community here that cares as much about your life outside work as how you feel when youre with us. Because your job shouldnt take over your life it should enrich it. Here are some of the benefits we offer:
- Premium medical and dental care
- Life insurance
- Flex Benefits - Worksmile Cafeteria System (Multisport vouchers tickets etc.)
- Employee Referral Program
- Hackathons Knowledge Sharing Hours In-house projects
- Tech and sport communities
- Events and integration parties
- Charity initiatives 2 extra volunteer days
- English/German classes
- Game room and chillout zone
Our commitment
Equal opportunities are important to us. We believe that diversity and inclusion at The Stepstone Group are critical to our success as a global company so we want to recruit develop and keep the best talent. We encourage applications from everyone regardless of background gender identity sexual orientation disability status ethnicity belief age family or parental status and any other characteristic.
Remote Work :
No
Employment Type :
Full-time
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
At The Stepstone Group, we have a simple yet very important mission: The right job for everyone. Using our data, platform, and technology, we create opportunities for jobseekers and companies around the world to find a perfect match in fair and equitable way. With over 20 brands acros ... View more
