Data Engineer

A Data Engineer with experience on Azure and Google Cloud products with a background in supply chain

Responsibilities:

• Creating maintaining and enhancing data pipelines for extracting data via RESTbased APIs to enable near realtime reporting for Warehouse Operations on Azure
  
• Creating maintaining and enhancing reports and datasets on PowerBI to enable historical and realtime reporting
  
• Maintaining and enhancing an existing Product (SKU) classification solution based on Azure App Services and Databricks (Data Extraction Model Logic UI)
  
• Implementing a New product classification solution based on Dataiku
  
• Working with adhoc data integrations (files received via email etc) and serving the data for reporting
  
• Adhoc data analysis as required by stakeholders
  
• Helping out with resource creation for the new Data Foundation for SAP BW data on GCP
  
  

Requirements

• Databricks (Pyspark)
  
• CI/CD via Azure Devops
  
• Python for UI and integrations
  
• Azure App Services
  
• Azure Service Bus
  
• Dataiku
  
• PowerBI
  
• Azure Data Factory
  
• Azure SQL
  
• Google BigQuery
  
• Cloud Functions
  
• Azure Functions
  
• Logic Apps
  
• Terraform for resource deployment
  
• SAP EWM data and processes (general)
  
• Odata Services