Microsoft Azure Databricks

Project Role : Data Engineer
Project Role Description : Design develop and maintain data solutions for data generation collection and processing. Create data pipelines ensure data quality and implement ETL (extract transform and load) processes to migrate and deploy data across systems.
Must have skills : Microsoft Azure Databricks
Good to have skills : NA
Minimum 7.5 year(s) of experience is required
Educational Qualification : 15 years full time education
Summary:
As a Data Engineer you will design develop and maintain data solutions that facilitate data generation collection and processing. Your typical day will involve creating data pipelines ensuring data quality and implementing ETL processes to migrate and deploy data across various systems. You will collaborate with cross-functional teams to understand data requirements and provide innovative solutions to enhance data accessibility and usability.

Roles and Responsibilities:
The Senior Data Engineer is the one who designs and builds data foundations and end to end solutions for the Shell Business to maximize value from data. The role helps create a data-driven thinking within the organization not just within IT teams but also in the wider Business stakeholder community. A Senior Data engineer is expected to be a subject matter expert who design & build data solutions and mentor junior engineers. They are also the key drivers to convert Vison and Data Strategy for IT solutions and deliver.
Key Characteristics
Technology expert who constantly pursues knowledge enhancement and has inherent curiosity to understand work from multiple dimensions.
Deep data focus with expertise in technology domain
A skilled communicator capable of speaking to both technical developers and business managers. Respected and trusted by leaders and staff.
Actively delivers the roll-out and embedding of Data Foundation initiatives in support of the key business programmers.
Coordinate the change management process incident management and problem management process.
Present reports and findings to key stakeholders and be the subject matter expert on Data Analysis & Design.
Drive implementation efficiency and effectiveness across the pilots and future projects to minimize cost increase speed of implementation and maximize value delivery.
Contributes to community building initiatives like CoE CoP.

Mandatory skills:
AWS/Azure/SAP - Master
ELT - Master
Data Modeling - Master
Data Integration & Ingestion
Data Manipulation and Processing
GITHUB Action Azure DevOps Data factory Databricks SQL DB Synapse Stream Analytics Glue Airflow Kinesis Redshift
Minimum: 6- 8 year(s) of experience is required
Educational Qualification: 15 years full time education