Azure Data Engineer

JD

• Hands on experience as an Azure data engineer which includes.
• Design and implement highly available and scalable Azure cloud data solutions that meet business requirements.
• Developing and maintaining data lake and data warehouse schematics layouts architectures and relational/nonrelational databases for data access and Advanced Analytics.

• Strong experience with Azure cloud technologies including Azure Data Factory Azure Data Bricks Cosmos DB.
• Experience with data transformation and manipulation using Azure Databricks.
• Indepth technical knowledge of tools like Azure Data Factory Databricks Azure Synapse SQL DB ADLS etc.
• Working knowledge of Azure DevOps CI/CD tools and concepts Azure Pipelines GitHub Workflow
• Architect data ingestion solutions such as ETL ELT on a wide set of data storage solutions.
• Scripting experience with Python and Rest API Experience with Python Fast API.
• Troubleshooting skills to drive to root cause.
• Experience working in an Agile development environment.
• Demonstrates strong written and oral communications skills. Ability desire and focus to meet deadlines.

Skills Required:

• 1) Python
• 2) Spark PySpark
• 3) ADF (Azure Data Factory)
• 4) ADB (Azure Data Bricks)
• 5) SQL
• 6) Azure Cloud Infrastructure.

Nice to Have:

• Experience in data integration with APIs.
• Exposure to Azure Functions.
• Working knowledge with Azure Infrastructure security token management.
• Working knowledge with: Azure DevOps /CICD
• Python Fast API Knowledge
• Working Knowledge on Rest APIs.
• Working knowledge on using Postman for Rest APIs.
• Working Knowledge on Cosmos DB.