Azure Data Engineer R
Share
Job Location:
Monthly Salary:
Posted on:
22 hours ago
Vacancies:
1 Vacancy
Job Summary
Lead Data Engineer
Primary Skills
- AKS Event Hub Azure DevOps Cosmos DB Azure Functions
Specialization
- Azure Data Engineering Advanced: Senior Data Engineer
Job requirements
- Azure Data Engineer:- 1. At least 4 to 6 years of relevant experience in data engineering team with 2-3 years hands-on experience in supporting Azure cloud technologies 2. Hands-on Expertise in Azure Data Engineering tool stack primarily Azure Data Factory Azure Data Lake logic Apps and Azure SQLMPP (Azure Synapse) 3. Deep knowledge and hands-on on creating Azure Databricks notebooks (Good knowledge on PySpark Databricks SQL Delta Lake concepts) or Synapse Spark understanding and exposure to Production Support of data integration and ETL systems with an understanding of SLAs cross team collaboration and expectation setting. understanding and experience around Data Warehousing ETL/ELT process Relational Databases Slowly changing dimension considerations etc. be familiar with Azure Synapse Workspace and good understanding of the Best practices for Data Loading to various target systems like Azure Synapse data lake etc from various source systems and able to build complex data transformation logic using Azure Databricks Pyspark for structured semistructured data with different formats understanding of No-SQL databases and experience with the same understanding of SQL Can write stored procedures CTE queries functions understanding of normalization of data loading from different source file formats (parquet xml json csv etc) Experience with data Extraction from different data sources (Relational FTP SAP etc) understanding of security requirements of different Azure components in best practices to resolve issues due to ingestion of varied data volumes by code related changes optimal usage of clusters partitioning and other methods on 1-2 projects involving migration of large scale projects from On-Prem to cloud and also having a decent understanding of remediation of performance issues of Devops (CICD processes for automated deployments) and as applicable for data engineering (ADF ADB SQL deployments) good understanding of Agile to deliver consistent project outcome high data affinity and strong analytical skills understanding of data modelling concepts and translating business needs into long-term solution data models and analysis (reverse engineering) of existing data systems. of Conceptual data models and data flows Physical data models and data strategies to have:- Certification in DP-203 (Microsoft Certified: Azure Data Engineer Associate) Databricks Data Engineering Certification
We may use artificial intelligence (AI) tools to support parts of the hiring process such as reviewing applications analyzing resumes or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed please contact us.
Required Experience:
IC
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
Brillio is a global leader in Enterprise Digital Transformation Solutions, providing strategic consulting services and solutions using emerging technologies.
