Data Engineer – Spark, Databricks & Snowflake (Energy) DESDSAS
Posted on:
6 days ago
Vacancies:
1 Vacancy
Job Summary
Job Title : Data Engineer Spark Databricks & Snowflake(Energy)
Industry
Energy & Utilities
Position Overview
We are seeking an experienced Data Engineer to design build and optimize large-scale data platforms supporting operational customer asset and energy market analytics. The ideal candidate will have strong expertise in Databricks Spark Snowflake and cloud-based data engineering solutions.
Responsibilities
- Develop scalable ETL/ELT pipelines using Spark and Databricks.
- Build enterprise data solutions on Snowflake.
- Integrate data from SCADA IoT sensors smart meters ERP CRM and trading systems.
- Design batch and real-time data ingestion frameworks.
- Optimize data performance reliability and scalability.
- Implement data quality and monitoring processes.
- Support predictive maintenance and asset performance analytics initiatives.
Required Skills
- Apache Spark (PySpark Spark SQL)
- Databricks
- Snowflake
- Python SQL
- Azure Data Factory AWS Glue or GCP Dataflow
- Kafka/Event Streaming
- Delta Lake
- CI/CD and DevOps practices
Preferred Skills
- Smart Grid Analytics
- Energy Trading Data
- Renewable Energy Operations
- IoT and Time-Series Data Management
Mandatory Experience
- 5 years of Data Engineering experience.
- Must have prior experience working within the Energy Utilities Oil & Gas Renewable Energy or Energy Trading sector.
For more details reach at
Required Experience:
IC