Senior Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Brief Description
We are seeking a highly skilled Senior Data Engineer to join our team . This is an exciting
opportunity to build and develop Banking big data use cases using most recent big data
technologies enabling data-driven decision-making across the Digital channels in Banking
Industry. You will play a key role in designing and implementing robust scalable and secure data
use cases to ensure delivering high-quality data that powers our analytics machine learning and
development efforts.
Tasks
Documenting data use cases requirements
Designing implementing and maintaining a best -in-class data platform (centered on
Cloudera and Denodo) to support current and future business needs.
Creating efficient and scalable ETL/ELT Spark PySpark Airflow Informatica BDM pipelines to
ingest process and store data from various sources.
Defining and implementing data models Hive / Denodo optimized for analytics and
machine learning.
Planning and executing the scaling of the data pipelines
Implementing processes for data monitoring error handling and system performance
optimization.
Collaborating with Product Engineering and Product Analytics teams to improve data
models increase data accessibility and support A/B tests.
Documenting data models source to target mapping pipeline designs and operational
procedures while communicating effectively with both technical and non-technical
stakeholders.
Qualifications and Requirements
7 years of experience in data engineering with a proven track record in building large-scale
data systems.
Experience and has Banking Industry Knowledge
Strong expertise in Cloudera services PySpark Spark Informatica Big data Management
Employment Type
Full Time
