Data Engineer - Lead

Mumbai - India

Monthly Salary: Not Disclosed

Posted on: 30+ days ago

Vacancies: 1 Vacancy

The job posting is outdated and position may be filled

Job Summary

Description

Key Responsibilities:

Building and maintaining data pipelines for data integration and processing ensuring data security and privacy prerequisites are followed. Create monitor and maintain data pipeline architecture.
Understand business requirement and actively provide inputs from Data perspective.
Understand the underlying data and flow of data.
Ensure data quality and accuracy through testing and validation
Optimize data processing performance through tuning and monitoring. Design and implement optimized data sets.
Maintains and enhances systems by fixing complicated errors raising risks and escalating issues where necessary
Designs high-quality solutions in accordance with timelines and specifications to meet user requirements.
Ensures all activities adhere to the relevant processes procedures standards and technical design.
Proactively identifies and leads the implementation of continuous improvement items with the support of the Team Lead and Manager.
Adheres to the development coding standards the operational framework and WTW Excellence guidelines.
Works closely with QA Product/Business Analysts and other Software Engineering functions to ensure high quality on-time delivery
Demonstrate learning adaptability understanding of the implications of technical issues on business requirements and / or operations.
Create reports and visualizations providing insight into data sets.
Troubleshoot and resolve data pipeline and reporting performance issues.

Knowledge and Experience:

A Bachelors/College Degree would be beneficial and extensive experience in a technology related discipline such as IT or Engineering is required
7 years experience as a Data Engineer.
Knowledge in code quality performance and security
Experience on source code control systems
Familiarity on continuous delivery and continuous integration practices
Willingness to work in a fast-paced collaborative team environment that has tight deadlines.
Ability to learn and evaluate new tools concepts and challenges quickly.
Client service focus and flexibility in supporting client requests.
Strong analytical and problem-solving skills.
Commitment to quality and continuous improvement.
Strong written and verbal communication skills.
Proficient in Azure Data Factory. Experience building and optimising data pipelines architectures and data sets
Experience with Azure data storage solutions such as Azure SQL Database Azure Cosmos DB and Azure Data Lake Storage
Basic understanding of data modeling- OLTP vs dimensional modeling is preferred
Experience creating reports using Power BI.
Experience with relational databases and proficiency using SQL

Qualifications

A Bachelors/College Degree would be beneficial and extensive experience in a technology related discipline such as IT or Engineering is required

DescriptionKey Responsibilities:Building and maintaining data pipelines for data integration and processing ensuring data security and privacy prerequisites are followed. Create monitor and maintain data pipeline architecture.Understand business requirement and actively provide inputs from Data pers...

Description

Key Responsibilities:

Building and maintaining data pipelines for data integration and processing ensuring data security and privacy prerequisites are followed. Create monitor and maintain data pipeline architecture.
Understand business requirement and actively provide inputs from Data perspective.
Understand the underlying data and flow of data.
Ensure data quality and accuracy through testing and validation
Optimize data processing performance through tuning and monitoring. Design and implement optimized data sets.
Maintains and enhances systems by fixing complicated errors raising risks and escalating issues where necessary
Designs high-quality solutions in accordance with timelines and specifications to meet user requirements.
Ensures all activities adhere to the relevant processes procedures standards and technical design.
Proactively identifies and leads the implementation of continuous improvement items with the support of the Team Lead and Manager.
Adheres to the development coding standards the operational framework and WTW Excellence guidelines.
Works closely with QA Product/Business Analysts and other Software Engineering functions to ensure high quality on-time delivery
Demonstrate learning adaptability understanding of the implications of technical issues on business requirements and / or operations.
Create reports and visualizations providing insight into data sets.
Troubleshoot and resolve data pipeline and reporting performance issues.

Knowledge and Experience:

A Bachelors/College Degree would be beneficial and extensive experience in a technology related discipline such as IT or Engineering is required
7 years experience as a Data Engineer.
Knowledge in code quality performance and security
Experience on source code control systems
Familiarity on continuous delivery and continuous integration practices
Willingness to work in a fast-paced collaborative team environment that has tight deadlines.
Ability to learn and evaluate new tools concepts and challenges quickly.
Client service focus and flexibility in supporting client requests.
Strong analytical and problem-solving skills.
Commitment to quality and continuous improvement.
Strong written and verbal communication skills.
Proficient in Azure Data Factory. Experience building and optimising data pipelines architectures and data sets
Experience with Azure data storage solutions such as Azure SQL Database Azure Cosmos DB and Azure Data Lake Storage
Basic understanding of data modeling- OLTP vs dimensional modeling is preferred
Experience creating reports using Power BI.
Experience with relational databases and proficiency using SQL

Qualifications

A Bachelors/College Degree would be beneficial and extensive experience in a technology related discipline such as IT or Engineering is required

Key Skills

Apache Hive
S3
Hadoop
Redshift
Spark
AWS
Apache Pig
NoSQL
Big Data
Data Warehouse
Kafka
Scala

Apply Now

About Company

WTW

WTWH Media LLC is an integrated b2b media company serving the electronics, design engineering, hospitality, life sciences, renewable energy, retail and robotics markets with more than 45+ web sites, 12 events, 7 print publications and custom digital marketing services.

View Profile View Profile

AI AutoApply

Apply to 100+ jobs with one click