Responsibilities:
Design and implement Data Storage including all layers of Data Architecture (ingestion storage serving layer) in Azure cloud
Design and develop Data Processing by using various ETL tools for data ingesting cleansing transforming and job orchestration
Design and implement Data Security by role based access control as well as masking and encrypting sensitive data
Monitor and optimize Data Storage and Data Processing using Monitoring Tools as well by implementing archive concept and query tuning
Very good handson experience working with Synapse Pipelines (ADF knowledge is also good) Spark Pools Synapse SQL pools and SQL Managed Instance
Manage stakeholders and drive timely execution of projects using agile methodologies
Build reliable and scalable technology solutions in a fastpaced work environment
Lead and coach other team members on technical skills and best practices
Desired Skillset:
University degree in Computer Sciences or a similar field of studies
At least 6 to 8 years of relevant experience in data engineering team with 46 years handson experience in Azure cloud technologies
Deep understanding of cloud technologies and delivery highquality large size projects on time
Very good knowledge in Azure Synapse Data Pipelines (ADF knowledge is also good)
Deep knowledge in PySpark Spark SQL T SQL tabular cubes
Good to have knowledge in Azure functions App (coded in Python)
Very good understanding of Agile to deliver consistent project outcome
Very high data affinity and strong analytical skills
Ideally Certification in DP203 (Microsoft Certified: Azure Data Engineer Associate Learn Microsoft Docs
data encrypting,team management,job orchestration,spark sql,data masking,data security,spark pools,analytical skills,azure cloud,monitoring tools,university degree,data transforming,technical skills coaching,data engineering,adf knowledge,data cleansing,tabular cubes,agile,t sql,azure functions app,azure synapse,archive concept,agile methodologies,pyspark,etl tools,sql managed instance,data affinity,data architecture,synapse pipelines,synapse sql pools,python,azure cloud technologies,role-based access control,data ingesting,query tuning,computer sciences,azure synapse data pipelines,dp-203 certification,cloud technologies,data storage,technology solutions,large size projects,stakeholder management
