Manager
Manager
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
We are looking for an experienced MLOPs Engineer with expertise in Spark/PySpark MLOps/LLMops/DLOps CI/CD Kafka Python distributed computing GitHub data pipelines cloud hosting Azure services Microsoft services various data connectors and more. This role will involve designing implementing and optimizing data science pipelines deploying machine learning models and ensuring smooth operation in production environments.
Responsibilities:
- Design develop and maintain data science pipelines for model training evaluation and deployment.
- Manage and optimize infrastructure resources (e.g. cloud services containers) to support model deployment and inference
- Collaborate with data scientists software engineers and DevOps teams to deploy machine learning models using best practices in MLOps.
- Automate endtoend ML workflows including data preprocessing model training evaluation and deployment using tools like Kubeflow or Apache Airflow
- Implement CI/CD pipelines for automated model deployment testing and monitoring.
- Utilize Kafka and other messaging systems for realtime data processing and streaming analytics.
- Optimize distributed computing infrastructure for scalability performance and cost efficiency.
- Manage GitHub repositories for version control and collaboration on machine learning projects.
- Utilize various data connectors and integration tools to access and process data from different sources.
- Develop and maintain documentation for data science pipelines infrastructure and processes.
- Stay up to date on emerging technologies and best practices in machine learning operations and data engineering.
Qualifications:
- 5 Years of prior experience in Data Engineering and MLOPs.
- 3 Years of strong exposure in deploying and managing data science pipelines in production environments.
- Strong proficiency in Python programming language.
- Experience with Spark/PySpark and distributed computing frameworks.
- Handson experience with CI/CD pipelines and automation tools.
- Exposure in deploying a use case in production leveraging Generative AI involving prompt engineering and RAG Framework
- Familiarity with Kafka or similar messaging systems.
- Strong problemsolving skills and the ability to iterate and experiment to optimize AI model behavior.
- Excellent problemsolving skills and attention to detail.
- Ability to communicate effectively with diverse clients/stakeholders.
Education Background:
- Bachelors or masters degree in computer science Engineering or a related field.
- Tier I/II candidates preferred.
Folks with shorter notice period to be preferred.
Required Experience:
Manager
Employment Type
Full-Time
