Data Platform Engineer

San Jose, CA - USA

Monthly Salary: Not Disclosed

Posted on: 3 hours ago

Vacancies: 1 Vacancy

Job Summary

MW Partners is currently seeking a Data Platform Engineer to work for our client who is a global leader in multimedia and creativity software products.

Responsibilities and duties:

Setup and maintain production-scale Databricks environments on public cloud platforms such as Microsoft Azure and AWS

Handle production-scale data storage platforms like ADLS and S3 for multiple tenant teams within our Data Platform

Coordinate production-scale microservices that support the daily operations of our data platform including job scheduling security financial and administrative services

Maintain enterprise-scale SQL Server and SSAS environments

Provide triage and mentorship to the team on various support issues raised by our tenants

Develop tools and automation solutions for configuration management service deployments monitoring and alerting

Ensure security and privacy compliance implementing Client Security & Compliance solutions to secure data in our data lake

Explore GenAI technologies to integrate technical improvements and improve user experience

Collaborate with various 3rd party vendors to resolve issues conduct proof of concepts and improve our product

Requirements:

Cloud Infrastructure Administration and Automation: AWS Azure
Proficiency in Storage Technologies: ADLS Gen2 S3 MongoDB Vector Databases
AI Agent Development and Maintenance: Langchain
Setup and Operation: Databricks SQL Server & SSAS Airflow Azure Kubernetes Service or Elastic Kubernetes Service
Monitoring and Alerting: DBX System Tables Prometheus Splunk MLFlow
Maintenance: Linux Servers Kubernetes Environment
Operational Tools: Jira Service Now

For a confidential discussion or to find out more contact Amit Kumar on or apply now.

MW Partners is currently seeking a Data Platform Engineer to work for our client who is a global leader in multimedia and creativity software products. Responsibilities and duties: Setup and maintain production-scale Databricks environments on public cloud platforms such as Microsoft Azure and AWS ...