Senior Data Engineer
Share
Job Location:
Kuala Lumpur - Malaysia
Monthly Salary:
Not Disclosed
Posted on:
Yesterday
Vacancies:
1 Vacancy
Job Summary
ABOUT US
Were the worlds leading provider of secure financial messaging services headquartered in Belgium. We are the way the world moves value across borders through cities and overseas. No other organisation can address the scale precision pace and trust that this demands and were proud to support the global economy.
Were unique too. We were established to find a better way for the global financial community to move value a reliable safe and secure approach that the community can trust completely. Were always striving to be better and are constantly evolving in an ever-changing landscape without undermining that trust. Five decades on our vibrant community reflects the complexity and diversity of the financial ecosystem. We innovate diligently test exhaustively then implement a connected and exciting era our mission has never been more relevant. Swift now has a presence in 200 countries and legal territories to serve a community of more than 12000 banks and financial institutions.
The Data and Common Application Platform tribe is seeking a Data Engineer/Senior Data Engineer who possesses strong technical abilities leadership qualities and a sense of responsibility. Working collaboratively with the team the successful candidate will help establish the foundations of the new Data Management Platform (DMP) and take part in designing developing testing and deploying features and components to create new Data Products.
The squad is based in both Malaysia (Kuala Lumpur) and Belgium (La Hulpe).
Education and Experience
Minimum of 8 years of relevant software development experience in an international setting.
Proven expertise in data engineering and software development practices.
Hands-on experience on a Data Management Platform.
Role Responsibilities
The candidate will join the Data Management Platform foundation team and will collaborate to deliver a secure scalable and reliable Data Management Platform (DMP) providing the foundational services and shared libraries that enable product squads across the organization to focus on delivering meaningful business value.
Design develop test deploy components and common libraries for the Data Management Platform.
Ensure the platform is stable monitored secure and up to date with a recent version of the COTS.
Design and support pipeline monitoring and troubleshooting to maintain operational stability.
Follow established data governance security and coding standards to ensure compliance and maintainability.
Define and apply best practices for quality performance and scalability to ensure accuracy consistency and reliability of the platform.
Evaluate and recommend technical feasibility and estimates of the proposed systems solutions.
Contribute to documentation and continuous improvement efforts including process refinement and knowledge sharing.
Provide technical assistance to other colleagues and assist in resolving problems reported by less senior team members
Coordinate and monitor the activities of a small project team.
Technical Skills
Must Have:
Advanced hands-on expertise with Java 11 and Java 17.
Strong scripting skills (Unix Shell or Python).
Solid understanding of containerization technologies (OpenShift or Kubernetes).
Experience with Helm for configuration management and containerized deployments.
Experience with large-scale object storage such as Amazon S3 or equivalent solutions.
Proven experience with at least one of the data management tools such as Spark or Kafka
Understanding of Data Engineering Data lake Data Warehousing and Medallion architecture concept.
Hands-on experience in CI/CD environments (Git Jenkins Maven) and tools for code coverage and static/dynamic analysis.
Practical experience with Agile/Scrum methodologies and collaboration tools (JIRA Confluence Bitbucket GitHub).
Good To Have:
Experience with Apache Airflow as a job orchestration and workflowmanagement tool
Experience with Elasticsearch/Kibana.
Experience with Infrastructure as code as such Argo CD Terraform is a plus
Experience with PKI/SSL for secure communications and certificate-based authentication.
Competency profile
Strong written and verbal communication skills.
Ability to lead coach and support junior team members.
Passion for continuous improvement and innovation.
Team-oriented mindset and comfort working in a multicultural environment.
Quick learner with a strong appetite for new technologies.
Ability to translate business needs into technical solutions.
Strong interpersonal skills and customer-centric approach.
Ability to thrive in a fast-paced deadline-driven environment.
What we offer
We give you a competitive package
We help you perform at your best
We give you the freedom to be yourself
We give you the freedom to be yourself. We are creating an environment of unique individuals like you with different perspectives on the financial industry and the world. A diverse and inclusive environment in which everyones voice counts and where you can reach your full potential.
We are committed to an inclusive and accessible recruitment process. If you require a reasonable accommodation related to accessibility during your application or interview please contact or indicate this in your application.
Please note that this mailbox is not monitored for general recruitment enquiries and should only be used for accessibility or accommodation-related requests (for example related to vision hearing or neurodiversity).
All requests are confidential and will not affect your candidacy.
Dont meet every single requirement At Swift we are dedicated to building a workplace where people can bring their full selves and ideas to the team so if you are excited about this role we encourage you to apply even if you do not meet every single qualification.
Required Experience:
Senior IC
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
SWIFT is a global member-owned cooperative and the world’s leading provider of secure financial messaging services. We provide our community with a platform for messaging and standards for communicating, and we offer products and services to facilitate access and integration, identifi ... View more
