Azure Data Engineer
Share
Job Location:
Monthly Salary:
Posted on:
30+ days ago
Vacancies:
1 Vacancy
Job Summary
AZure Python SQL Factory (ADF): For orchestrating and automating data movement and transformation.
Databricks/Apache Spark: For big data processing and large-scale ETL/ELT.
Synapse Analytics: For data warehousing and analytics.
Data Lake Storage (ADLS Gen2): For scalable and secure data storage.
Azure SQL Database/Cosmos DB: For relational and NoSQL data storage.
Programming/Scripting:
SQL: Essential for querying and data manipulation.
Python/PySpark/Scala: Common languages for data processing and scripting.
Data Concepts: Strong understanding of data modeling schema design and ETL/ELT principles.
DevOps: Experience with CI/CD version control (Git) and infrastructure as code (e.g. ARM Templates Terraform) is often required.
Databricks/Apache Spark: For big data processing and large-scale ETL/ELT.
Synapse Analytics: For data warehousing and analytics.
Data Lake Storage (ADLS Gen2): For scalable and secure data storage.
Azure SQL Database/Cosmos DB: For relational and NoSQL data storage.
Programming/Scripting:
SQL: Essential for querying and data manipulation.
Python/PySpark/Scala: Common languages for data processing and scripting.
Data Concepts: Strong understanding of data modeling schema design and ETL/ELT principles.
DevOps: Experience with CI/CD version control (Git) and infrastructure as code (e.g. ARM Templates Terraform) is often required.
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
