Data Engineer AWS Snowflake
Share
Job Location:
Monthly Salary:
Posted on:
4 hours ago
Vacancies:
1 Vacancy
Job Summary
Data Engineer
Madrid Office - 3 days per week
Our client are hiring a Data Engineer to join their growing global team as their grow out their new technology hub in this role you will design build and maintain scalable systems and infrastructure to process and analyse complex high-volume datasets.
You will be working closely with data scientists analysts product managers and other stakeholders you will translate business needs into robust technical solutions that power innovative data products and services across our business and for our customers.
Key Responsibilities
Design build and maintain performant batch and streaming data pipelines to support both real-time market data and large-scale batch processing (Apache Airflow Apache Kafka Apache Flink).
Develop scalable data warehousing solutions using Snowflake and other modern platforms.
Architect and manage cloud-based infrastructure (AWS or GCP) to ensure resilience scalability and efficiency.
Enhance and optimise CI/CD pipelines (Jenkins GitLab) to streamline development testing and deployment.
Monitor and maintain the health and performance of data applications pipelines and databases using observability tools (Prometheus Grafana CloudWatch).
Partner with stakeholders across functions to deliver reliable data services and enable analytical product development.
Contribute actively in agile ceremonies (stand-ups sprint planning retrospectives)
Experience & Competencies
Essential:
Experience in Data Engineering.
Hands-on experience with AWS Snowflake Kubernetes and Airflow.
Experience building and scaling API-driven data platforms (FastAPI).
Expertise in Python (with frameworks such as Pandas Dask PySpark) and strong SQL skills.
Strong understanding of ETL processes and event streaming (Kafka Flink etc.).
Knowledge of monitoring and alerting systems (Prometheus Grafana CloudWatch).
Comfortable with Linux and command-line operations.
Desired:
Exposure to Financial markets data or capital markets environments.
To apply please submit your CV to the role.
CLOUD BRIDGE TECH RECRUITMENT are the experts in AWS recruitment across the global if you are looking for a new role in the AWS ecosystem or looking to hire the best AWS talent (Permanent/Contract/SoW) contact for more information.
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
Recognised as AWSs Rising Star Partner of the Year for 2023 in EMEA and 2022 in the UK&I were expanding globally with new offices in South Africa and Dubai a strong presence in the Philippines and our HQ in the UK.If youre ready to join a high-growth AWS partner and take your career t ... View more
