LLM-Generative Ai

• Develop construct test and maintain sophisticated datasets and benchmarking systems for LLMs and generative AI tasks.
• Design implement and manage benchmarking frameworks for large language models. 3. Implement largescale data ecosystems including data management governance and the integration of structured and unstructured data to generate insights leveraging cloudbased platforms.
• Enhance data foundational procedures guidelines and standards ensuring the highest level of data integrity.
• Collect clean and transform data from diverse sources making it accessible and ready for analysis.
• Work closely with the AI team to understand their needs and provide them with relevant data and benchmarks.
• Stay updated with the latest developments in the field of AI and machine learning and incorporate them into our benchmarking systems

Mandatory Requirements:

• bachelors degree with 5 years of experience in a relevant field.
• Familiarity with Large Language Models and their evaluation 3. Proficient in relevant programming languages such as Python.
• Experience with cloud services: AWS S3 AWS Batch GCP equivalents (such as Google Cloud Storage Google DataProc or Google Compute Engine).
• Strong analytical and problemsolving skills.

artificial intelligence,machine learning,aws,data science