AI Architect with Databricks

Los Angeles, CA - USA

Monthly Salary: Not Disclosed

Posted on: 4 hours ago

Vacancies: 1 Vacancy

Job Summary

Job Description: AI/ML Architect with Databricks
Experience: 10 yrs

Role Overview
We are seeking a skilled AI/ML Architect with hands-on experience in Databricks to join our team. The ideal candidate has strong analytical capabilities experience building scalable data pipelines and machine learning models and the ability to collaborate with cross functional teams to drive data driven decision making.

This role involves working with large datasets advanced analytics and modern data engineering and ML frameworks-primarily using Databricks on Azure/AWS.

Key Responsibilities
Data Science & Machine Learning
* Develop train and optimize machine learning and statistical models using Databricks Python PySpark and MLflow.

* Perform exploratory data analysis (EDA) to identify trends patterns and insights in large datasets.
* Deploy ML models into production using Databricks MLflow Delta Live Tables or other MLOps pipelines.
* Conduct A/B testing forecasting segmentation anomaly detection or recommendation systems as required by the business.

Data Engineering & Databricks Platform
* Build scalable high performance ETL/ELT pipelines using PySpark SQL and Databricks workflows.
* Work with Delta Lake to ensure high-quality reliable and performant data.
* Optimize cluster usage and job performance within the Databricks environment.
* Collaborate with data engineers to ensure high-quality data availability for modeling.

Business Collaboration
* Translate business problems into analytical solutions and present findings to non technical stakeholders.
* Partner with product engineering and business teams to drive data-informed decisions.
* Communicate complex statistical concepts in a clear and concise manner.

Skills & Qualifications
Required
* Bachelors degree or higher in Computer Science Data Science Mathematics Statistics Engineering or related field.

* 3 years of experience in data science or machine learning roles.
* Advanced knowledge of Databricks including:
* PySpark / Spark SQL
* Databricks notebooks
* Delta Lake
* MLflow
* Databricks Jobs & Workflows
* Strong programming skills in Python (pandas numpy scikit learn).
* Experience working with large-scale data processing.
* Solid understanding of machine learning algorithms and statistical techniques.
Preferred
* Experience deploying models in production using MLOps frameworks.
* Knowledge of Azure Databricks or AWS Databricks environments.
* Understanding of CICD pipelines and DevOps concepts (Azure DevOps GitHub Actions etc.)
* Familiarity with deep learning frameworks (TensorFlow PyTorch) is a plus.

Key Competencies
* Strong analytical and problem solving skills
* Ability to work in a fast-paced collaborative environment
* Excellent communication and presentation skills
* Self-driven with high attention to detail

Job Description: AI/ML Architect with Databricks Experience: 10 yrs Role Overview We are seeking a skilled AI/ML Architect with hands-on experience in Databricks to join our team. The ideal candidate has strong analytical capabilities experience building scalable data pipelines and machine learning...

Job Description: AI/ML Architect with Databricks
Experience: 10 yrs

This role involves working with large datasets advanced analytics and modern data engineering and ML frameworks-primarily using Databricks on Azure/AWS.

Key Responsibilities
Data Science & Machine Learning
* Develop train and optimize machine learning and statistical models using Databricks Python PySpark and MLflow.