Senior Data Engineer
Share
Job Location:
Monthly Salary:
Posted on:
2 hours ago
Vacancies:
1 Vacancy
Job Summary
Bachelor/Masters degree in Computer Science Engineering or a related field.
7 years of working experience in the field of Data & Analytics preferably in the CPG
industry
7 years of working experience in the field of Data & Analytics preferably in the CPG
industry
7 years of proficient coding experience with Python for data engineering including SQL
and PySpark (DataFrame API Spark SQL MLlib) with hands-on experience in various
databases (SQL/NoSQL) key libraries (e.g. pandas SQLAlchemy) parallel processing
and advanced data transformation and performance optimization techniques.
Excellent data engineering & technology knowledge (Azure Data Lake Gen2 Azure
Synapse and Databricks as well as data management knowhow (data cataloguing data
quality management)
Solid understanding of data modeling ETL processing and lakehouse concepts.
and PySpark (DataFrame API Spark SQL MLlib) with hands-on experience in various
databases (SQL/NoSQL) key libraries (e.g. pandas SQLAlchemy) parallel processing
and advanced data transformation and performance optimization techniques.
Excellent data engineering & technology knowledge (Azure Data Lake Gen2 Azure
Synapse and Databricks as well as data management knowhow (data cataloguing data
quality management)
Solid understanding of data modeling ETL processing and lakehouse concepts.
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
