Data EngineerSenior Data Engineer
Share
Job Location:
Kuala Lumpur - Malaysia
Monthly Salary:
Not Disclosed
Posted on:
14 hours ago
Vacancies:
1 Vacancy
Job Summary
ABOUT US
Were the worlds leading provider of secure financial messaging services headquartered in Belgium. We are the way the world moves value across borders through cities and overseas. No other organisation can address the scale precision pace and trust that this demands and were proud to support the global economy.
Were unique too. We were established to find a better way for the global financial community to move value a reliable safe and secure approach that the community can trust completely. Were always striving to be better and are constantly evolving in an ever-changing landscape without undermining that trust. Five decades on our vibrant community reflects the complexity and diversity of the financial ecosystem. We innovate diligently test exhaustively then implement a connected and exciting era our mission has never been more relevant. Swift now has a presence in 200 countries and legal territories to serve a community of more than 12000 banks and financial institutions.
SWIFT is a member-owned cooperative that provides a communications platform products and services connecting more than 10000 banking organizations securities institutions and corporate customers across 211 countries. As part of its Instant Frictionless payments strategy SWIFT is rapidly expanding its Data & Analytics capabilities to enhance customer understanding of payments processes.
Role Overview
The Data and Common Application Platform tribe is seeking a Data Engineer/Senior Data Engineer who possesses strong technical abilities leadership qualities and a sense of responsibility. Working collaboratively with the team the successful candidate will help establish the foundations of the new Data Management Platform (DMP) and take part in designing developing testing and deploying features and components to create new Data Products.
The squad is based in both Malaysia (Kuala Lumpur) and Belgium (La Hulpe).
Role Responsibilities
This position requires a Software Developer who will contribute to the design and implementation of the Bronze and Silver layers of Swifts Data Platform using the Medallion Architecture. The ideal candidate should have hands-on experience with Apache Spark Nifi Kafka a solid grasp of data engineering principles and ETL concepts and an interest or background in the payments domain. The role involves collaborating closely with technical and business teams to deliver a reliable enriched and integrated common set of tables to enable the creation of business-ready datasets in the Gold layer.
Build develop test install and support Kafka/Nifi/Spark data pipelines for the Bronze and Silver layers.
Apply best practices for quality performance and scalability to ensure accuracy consistency and reliability of datasets.
Work with data analysts to deliver quality-checked enriched and integrated datasets and implement transformations and business rules per requirements.
Support pipeline monitoring and troubleshooting to maintain operational stability.
Follow established data governance security and coding standards to ensure compliance and maintainability.
Contribute to documentation and continuous improvement efforts including process refinement and knowledge sharing.
Education
Minimum of 5 to 10 years of relevant software development experience in an international setting.
Proven expertise in data engineering and software development practices.
Technical Skills Requirements
Must Have:
Hands-on experience in programming languages particularly Java and their design patterns.
Hands-on experience with one or more data management tools such as: Spark Kafka Nifi Airflow.
Experience with large-scale object storage services (Amazon S3 or equivalent is a plus).
Understanding of Data Engineering data hub data lake and data warehousing concepts.
Experience with continuous integration and delivery build environments including GIT Jenkins Maven and coverage and static/dynamic code analysis tools.
Familiarity with Agile tools like JIRA Confluence and Bitbucket.
Good to Have:
Understanding of containerization technologies such as OpenShift and Kubernetes.
Knowledge of Red Hat Linux.
Experience with Elasticsearch/Kibana.
Competency Profile
Adaptability and responsiveness to change.
Accountability for delivering results.
Strong written and oral communication skills.
Time management planning and organizing abilities.
Ability to thrive in both multi-cultural team and individual environments.
Quality-oriented approach.
Engaged and team-oriented attitude.
Open communication style.
Ready to perform on-call support.
Fluent in English.
What we offer
We put you in control of career
We give you a competitive package
We help you perform at your best
We give you the freedom to be yourself
We give you the freedom to be yourself. We are creating an environment of unique individuals like you with different perspectives on the financial industry and the world. A diverse and inclusive environment in which everyones voice counts and where you can reach your full potential.
We are committed to an inclusive and accessible recruitment process. If you require a reasonable accommodation related to accessibility during your application or interview please contact or indicate this in your application.
Please note that this mailbox is not monitored for general recruitment enquiries and should only be used for accessibility or accommodation-related requests (for example related to vision hearing or neurodiversity).
All requests are confidential and will not affect your candidacy.
Dont meet every single requirement At Swift we are dedicated to building a workplace where people can bring their full selves and ideas to the team so if you are excited about this role we encourage you to apply even if you do not meet every single qualification.
Required Experience:
Senior IC
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
SWIFT is a global member-owned cooperative and the world’s leading provider of secure financial messaging services. We provide our community with a platform for messaging and standards for communicating, and we offer products and services to facilitate access and integration, identifi ... View more
