Data Engineer
Share
Job Location:
Monthly Salary:
Posted on:
21 days ago
Vacancies:
1 Vacancy
Job Summary
Job Summary: The Data Engineer will be responsible for leveraging the data platform to create data products for business. This role involves the development of data products data pipelines data transformation data cleansing data normalization deployment & support for various functions within EGIS.
Technologies: Azure Data Bricks Azure DevOps Azure ADO Gitlab Github & Snow
Key Responsibilities:
- Plan design and execute tenant-to-tenant migrations in Azure without any disruption to business operations.
- Conduct detailed discovery and assessment of external Azure tenants (source) to understand current configurations services and dependencies.
- Design and develop automated data injestion pipeline which fetch data from legacy ERP systems
- Ability to build the transformation logic based on business & regional team need
- Ability to conduct pre & post automated data validation check
- Optimize the workflow execution and implement parallel processing to handle high data volume
- Address and resolve data issues including failures in ETL pipelines system performance problems and data inconsistencies
- Propose solution to automate & optimise the process
- Proficiency in data mapping and data governance between Legacy system & Oracle ERP Cloud FBDI
- Propose & implement best practices for data ingestion & data transformation
Qualifications :
Qualifications:
- Bachelors degree in B.E in Computer Science Data Management or a related field.
- Proficiency in coding skill such as Python Pyspark & Azure SQL
- Proficiency in Oracle ERP Cloud FBDI
- Strong business analysis & communication skills
- Strong understanding of data management automation & optimization.
- Excellent analytical troubleshooting and problem-solving skills.
- Years of Experience 6-7 years in a similar role.
Additional Information :
Data Migration & Azure Tenant to Tenant Migration
Remote Work :
No
Employment Type :
Full-time
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
Egis is a leading global architecture, consulting, construction engineering and operating firm. We work side by side with clients to build a more balanced, sustainable and resilient world.
