Java Spark ML Developer - Remote - 12 Months

Role: Java Spark ML Developer

Mode: Remote

Duration: 12 Months

Job Description:

We are seeking a highly skilled and experienced Senior Data Engineer with a strong background mainly in Java microservices Apache Spark with little experience of Machine Learning and expertise in deploying and operationalizing Java based Data through cloud platforms.

Responsibilities:

• Design develop and maintain Java microservices to support Data Engineering/Machine Learning applications and data pipelines.
• Implement and optimize Apache Spark code for largescale data processing and analytics.
• Work collaboratively with data scientists architects and crossfunctional teams to deploy scale and maintain LLM models.
• Architect and build scalable and efficient systems for handling and processing machine learning workloads.
• Work with vector databases to efficiently store and retrieve vector representations of data. Optimize vector database operations for enhanced performance.
• Collaborate with DevOps teams to ensure smooth deployment and operation of ML models in production.
• Stay updated on industry best practices and advancements in machine learning Java and Spark technologies.

Qualifications:

• Bachelors or masters degree in computer science Data Engineering Machine Learning or a related field.
• Minimum of 3 to 5 years of professional experience in Data engineering and machine learning with a strong emphasis on Java microservices and Spark.
• Experience in deploying and maintaining machine learning models preferably Large Language Models.
• Proficiency in Java programming with a focus on microservices architecture. Extensive handson experience with Apache Spark for data processing and analytics.
• Strong understanding of machine learning concepts and workflows.
• Excellent problemsolving skills and the ability to work in a fastpaced collaborative environment.
• Effective communication skills with the ability to convey technical concepts to both technical and nontechnical stakeholders.

Nice to Have:

• Exposure to OpenAIs GPT or other Large Language Models.
• Experience with writing Spark code in languages like Scala or Java.
• Knowledge of containerization technologies such as Docker and orchestration tools like Kubernetes.