Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Job Responsibilities:
Data Engineering Infrastructure
* Implement robust and scalable ETL/ELT pipelines using Python R or Spark for processing structured and unstructured datasets across sectors.
* Implement technical activities in support of the development of data lake architecture integrating multiple sources into a unified data environment for analytics and AI workflows.
* Develop guidelines for metadatadriven systems ensuring lineage traceability and semantic enrichment.
API Development & System Integration
* Implement RESTful APIs and backend services using Python C# or to ensure secure performant data access and integration with external and internal platforms.
* Implement the integration of cloud services (Azure) with internal data systems and external partner APIs for realtime data exchange.
DevOps and CI/CD Enablement
* Automate CI/CD pipelines using GitHub Actions Docker and Kubernetes ensuring efficient delivery testing and deployment processes.
* Implement DevOps best practices to support continuous innovation scalability and system monitoring.
Semantic Data Modeling & Graph Technologies
* Implement knowledge graphs and ontologies using Neo4j or equivalent tools embedding NLP pipelines and SDG classifications to power semantic search and policy simulations.
* Develop custom ontologies and metadata standards tailored to thematic data domains relevant to the organizations mandate.
Data Infrastructure Optimization
* Optimization of databases (e.g. SQL Server Redis Solr) and data pipelines for enterprisescale analytics and reporting.
* Implement performance tuning and data partitioning strategies for highthroughput environments.
AI/ML Data Enablement and Technical Administration Support
* Set up and maintain environments for interactive analytics and modeling (e.g. Jupyter Zeppelin) supporting AI/ML experimentation and visualization pipelines.
* Provide training and documentation to enhance the capacity of internal teams to leverage data pipelines and APIs effectively.
Remote Work :
No
Employment Type :
Contract
Employment Type
Contract
