Senior Data Engineer - Ftc - Immediately Available
Senior Data Engineer - Ftc - Immediately Available
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Not Disclosed
Salary Not Disclosed
1 Vacancy
Job Description
Job Specification
We are seeking a highly skilled Data Engineer with expertise in Python and SQL to develop and maintain data solutions for ourclient mining industry. The successful candidate will work with geologists engineers and data scientists to optimise data pipelines process large datasets from IoT sensors and mining equipment and support realtime analytics.
In order to be considered for this role you must meetthe following requirements:
- Matric
- BSc in engineering and/or sciences with demonstrable experience in machine learning. MSc degree is a plus
- Microsoft Certification in SQL Development
You must be an expert in:
Knowledge of ETL/ELT processes and tools
Experience designing deploying code in cloudbased data platforms and agile environment
Programming languages: Python & SQL (advanced)
Experience settingup and maintaining Azure cloud services: Azure Data Factory Blob Storage & Databricks
Big Data Knowledge is a plus: Spark Hadoop or MapReduce
Experience in communication across systems (e.g. API)
Experience with sensor data ingestion and IoT data processing.
Strong understanding of geospatial data processing (GIS PostGIS QGIS or ArcGIS).
Knowledge of realtime data streaming technologies for monitoring mining operations.
Ability to work with unstructured data from geological surveys drone imagery and seismic sensors.
Strong background in data warehousing concepts for mining analytics and reporting.
Experience with version control (Git) and CI/CD for data pipelines.
Key Responsibilities (not limited to):
Design build and maintain ETL/ELT pipelines to process data from mining equipment IoT devices and operational systems.
Develop and optimise SQL queries stored procedures and data models for efficient mining data analysis.
Write efficient Python scripts for data extraction transformation and integration from diverse sources.
Manage largescale relational databases (PostgreSQL MySQL SQL Server) and NoSQL databases for unstructured geological and sensor data.
Work with realtime data streaming from mining equipment GPS trackers and environmental sensors using Kafka Kinesis or similar tools.
Ensure data quality integrity and governance for compliance with mining regulations and safety standards.
Collaborate with geologists mining engineers and operations teams to provide insights from data.
Implement predictive maintenance solutions by analyzing historical sensor and equipment data.
Work with GIS data and geospatial databases to support mine planning and exploration.
Deploy and maintain cloudbased data solutions (AWS Azure or GCP) for scalable data storage and processing.
WILL SUIT SOMEONE IMMEDIATELY AVAILABLE 6 MONTHS CONTRACT WITH THE POSSIBILITY OF EXTENDING
Should you meet ALL of the above requirements please send your CV to
Disclaimer: Should you not hear from us within 2 weeks please consider your application unsuccessful.
Required Experience:
Senior IC
Employment Type
Full-Time
