Detailed JD (Roles and Responsibilities) -
Design and implement data storage solutions.
Create and maintain data storage solutions including Azure SQL Database Azure Data Lake and Azure Blob Storage.
Design implement and maintain data pipelines for data ingestion processing and transformation in Azure Create data models for analytics purposes
Utilizing Azure Data Factory or comparable technologies create and maintain ETL (Extract Transform Load) operations
Use Azure Data Factory and Databricks to assemble large complex data sets
Implementing data validation and cleansing procedures will ensure the quality integrity and dependability of the data.
Ensure data security and compliance
Optimize Azure SQL databases for efficient query performance
Collaborate with data engineers and other stakeholders to understand requirements and translate them into scalable and reliable data platform architectures
Participate in all scrum ceremonies
Required skills:
Blend of technical expertise analytical problem-solving and collaboration with cross-functional teams
Azure DevOps
Apache Spark Python
SQL proficiency
Data modeling
ETL processes
Azure Databricks knowledge
Familiarity with data warehousing
Big data technologies
Data governance principles
Total Experience - 10 yrs.
Relevant Experience - 5 yrs.
Mandatory skills -- Azure stack experience SQL python Databricks
Desired skills - ETL processess
Domain (Industry) - Energy Oil & Gas
WFO / WFH / Hybrid - Hybrid
Shift Details (Time) - UK Shift
Role Type - Contract to Hire
To apply kindy share your CV to