The Role:
We are seeking a highly skilled and motivated Data Science Quality Engineer to join our team for the OPEN Q & QUBED software applications. The ideal candidate will have a strong background in quality assurance data science and software engineering with a focus on generative AI and machine learning operations.
Responsibilities:
- Develop and implement quality assurance processes for data science projects.
- Collaborate with data scientists and software engineers to ensure the accuracy and reliability of AI models.
- Conduct API testing including NFT calls to OpenAI.
- Manage CICD pipelines using GitHub Actions with a focus on staging and development environments.
- Perform Docker containerization and AWS cloud deployment.
- Apply statistical and mathematical techniques to test machine learning models.
- Provide insights and recommendations for improving the quality of AI models and software applications.
Requirements:
- Knowledge of Generative AI.
- Experience with CICD GitHub Actions with a focus on staging and development environments and quarterly production releases.
- Strong API testing skills including NFT calls to OpenAI.
- Proficiency in Docker.
- Experience with AWS.
- Expertise in ML Ops including statistical and mathematical testing of machine learning models.
- Background in software engineering.
Optional Skills:
- Experience with guardrails from a QA perspective particularly in dealing with LLM GI.
Tech Stack:
- Python FastAPI OpenAI/AWS Bedrock Pytest
- Next.js React Typescript (Front end subject to change)
C LSK
Wakapi Web