Senior Data Engineer (GCP and AWS)
Share
Job Location:
Monthly Salary:
Posted on:
30+ days ago
Vacancies:
1 Vacancy
Job Summary
We are seeking an experienced Data Engineer to join our dynamic team in a fast-paced financial trading environment. You will be responsible for designing developing and maintaining data pipelines and infrastructure across GCP AWS and Oracle-based systems ensuring high-performance data flows that support trading risk and compliance functions.
This role requires a deep understanding of cloud architecture large-scale data processing and a strong grasp of agile delivery practices.
Key Responsibilities
- Design and implement scalable and secure data pipelines across multi-cloud (GCP & AWS) environments
- Develop integration and transformation workflows between cloud data services and on-prem Oracle databases
- Work closely with trading risk and analytics teams to understand data requirements and deliver real-time and batch data solutions
- Optimize and monitor performance of data systems to support latency-sensitive trading applications
- Collaborate with cross-functional teams using Agile/Scrum methodologies to deliver business-critical data projects
- Ensure robust data governance lineage and compliance (including MiFID II FCA and other regulatory standards)
- Automate data workflows using Terraform CI/CD pipelines and containerization tools (Docker/Kubernetes)
Qualifications :
What we look for
- At least 3 years of experience working in data engineering domain
- Strong experience with cloud data services on both Google Cloud Platform (GCP) and Amazon Web Services (AWS) (e.g. BigQuery Pub/Sub Dataflow S3 Glue Redshift)
- Expertise in Oracle SQL PL/SQL and working with complex stored procedures and large datasets
- Proficiency in programming languages such as Python Java or Scala
- Experience with streaming and messaging systems (e.g. Kafka Pub/Sub)
- Hands-on experience with Terraform CI/CD tools (e.g. Jenkins GitLab) and container orchestration (Kubernetes)
- Deep understanding of data modeling data warehousing and ETL/ELT design patterns
- Familiarity with Agile development practices (Scrum Kanban Jira)
- Exposure to financial markets trading systems or related high-performance environments is a strong plus
- Desire and eagerness to contribute to the success of the company and grow along with it
- Excellent communication skills in verbal and written English
- Willingness to work based on a full-time employment contract (UoP) only
- Willingness to come to one of our offices in Kraków Warszawa or Gdańsk twice a week
Bonus points for
- Knowledge of regulatory reporting market data or trade surveillance systems
- Experience with Apache Airflow DBT or similar orchestration tools
- Understanding of data security practices and compliance frameworks
Additional Information :
Discover some of the global benefits that empower our people to become the best version of themselves:
- Finance: Competitive salary package share plan company performance bonuses value-based recognition awards referral bonus;
- Career Development: Career coaching global career opportunities non-linear career paths internal development programmes for management and technical leadership;
- Learning Opportunities: Complex projects rotations internal tech communities training certifications coaching online learning platforms subscriptions pass-it-on sessions workshops conferences;
- Work-Life Balance: Hybrid work and flexible working hours employee assistance programme;
- Health: Global internal wellbeing programme access to wellbeing apps;
- Community: Global internal tech communities hobby clubs and interest groups inclusion and diversity programmes events and celebrations.
At Endava were committed to creating an open inclusive and respectful environment where everyone feels safe valued and empowered to be their best. We welcome applications from people of all backgrounds experiences and perspectivesbecause we know that inclusive teams help us deliver smarter more innovative solutions for our customers. Hiring decisions are based on merit skills qualifications and potential. If you need adjustments or support during the recruitment process please let us know.
Remote Work :
No
Employment Type :
Full-time
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
For over two decades, we have been harnessing technology to drive meaningful change. By combining world-class engineering, industry expertise and a people-centric mindset, we consult and partner with our customers to create technological solutions that drive?innovation and transfor ... View more
