Senior Data Engineer
Share
Job Location:
Monthly Salary:
Posted on:
11 hours ago
Vacancies:
1 Vacancy
Job Summary
3-5 sentence summary about the role considering these questions: what is the opportunity How is this role contributing to our mission What will they get from this opportunity
Position Responsibilities:
The Asia Data Office is looking for an experienced Senior Data Engineer to join our team to support our regional partners. If you have passion for data and a desire to drive quality data solutions within a data driven culture then read on to learn more about this opportunity!
We are looking for the right individual who would be interested and enjoy the opportunity to support data operations strong willingness to learn and build data operations skills through team collaboration desire to drive and execute on our data strategy willing to help mature our agile practices and is looking for an opportunity to embrace technical operational and informal leadership roles on the team.
Duties
Selecting and integrating any Big Data tools and frameworks required providing requested capabilities
Implement ETL/ELT flows via Big Data Solutions i.e. Spark Python Azure Data Factory Azure Synapse Azure Databricks etc.
To be able to monitor the performance and advice necessary infrastructure changes or performance tuning in codes.
Support business users in use of the Enterprise Data Lake (EDL) as part of BAU
Perform POC on new integration patterns and solutions.
Maintain and monitor platform stability and performance of EDL
Attends to Incidents and change requests
Write and maintain technical documentation
Perform unit tests and system integration tests
Executes updates patches and other activities required to maintain and enhance the operations of the EDL
Supports the Agile delivery squads when required
Required Qualifications:
Skills and Qualifications
Proficient understanding of distributed computing principles
Good Knowledge of Hadoop cluster Azure with all included services
Ability to solve any ongoing issues with operating the cluster
Experience with Azure ADLS Data Factory Databricks Event Hubs
Experience with data engineering projects
i.e. integration of data from multiple data sources to a target system
Good knowledge of data querying tools Azure Synapse Analytics Databricks SQL Warehouse
Knowledge in data streaming (e.g. Event Hubs Spark)
Knowledge in Python and Spark
Knowledge in any Change Data Capture (CDC) solutions (e.g. Debezium)
Experience in working on Agile projects is an advantage.
Experience on Azure Cloud and/or other Cloud platforms
Database development and management (e.g. Azure SQL Cosmos)
Education and experience
Bachelors degree preferably in Computer Science or Data/Engineering related courses
Recognized qualification in Service Management helpful
ITIL certification helpful
10 years in one or more of the following
oData Engineer
oPlatform Engineer
oDevOps Engineer
oSoftware Engineer
Project management experience is an advantage.
Understanding of the insurance and/or financial industry is an asset
Experience with Alibaba Cloud AI/BI and/or GenAI is an advantage.
Preferred Qualifications:
When you join our team:
Well empower you to learn and grow the career you want.
Well recognize and support you in a flexible environment where well-being and inclusion are more than just words.
As part of our global team well support you in shaping the future you want to see.
About Manulife and John Hancock
Manulife Financial Corporation is a leading international financial services provider helping people make their decisions easier and lives better. To learn more about us visit is an Equal Opportunity Employer
At Manulife/John Hancock we embrace our diversity. We strive to attract develop and retain a workforce that is as diverse as the customers we serve and to foster an inclusive work environment that embraces the strength of cultures and individuals. We are committed to fair recruitment retention advancement and compensation and we administer all of our practices and programs without discrimination on the basis of race ancestry place of origin colour ethnic origin citizenship religion or religious beliefs creed sex (including pregnancy and pregnancy-related conditions) sexual orientation genetic characteristics veteran status gender identity gender expression age marital status family status disability or any other ground protected by applicable law.
It is our priority to remove barriers to provide equal access to employment. A Human Resources representative will work with applicants who request a reasonable accommodation during the application process. All information shared during the accommodation request process will be stored and used in a manner that is consistent with applicable laws and Manulife/John Hancock policies. To request a reasonable accommodation in the application process contact .
Working Arrangement
Required Experience:
Senior IC
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
Manulife is a leading financial services group. We provide financial advice, insurance, as well as wealth and asset management solutions for individuals, groups and institutions.
