LLM QA
Share
Job Location:
Monthly Salary:
Posted on:
2 days ago
Vacancies:
1 Vacancy
Job Summary
Test Strategy PlanningDefine QA strategy for AI/ML services microservices and APIs across requirements and ML acceptance criteria into test plans and traceable test performance baselines and SLOs for models and Design ExecutionUnit testing (PyTest/unittest) for data transformations feature engineering utilities and model testing for pipelines (data ingestion training validation deployment) and testing (REST/GraphQL) for inference endpoints auth flows and rate load testing to validate latency throughput and p95/p99 automated test suites in Python and integrate them into CI/ Quality ValidationValidate model outputs against ground truth statistical thresholds and confidence scoring for model regression across versions; maintain golden datasets and baseline metrics (accuracy F1 ROC-AUC precision/recall calibration).Perform data quality checks (schema drift leakage) and monitor post-deployment explainability artifacts SHAP/feature importance) where Defect ManagementInstrument tests with logs/metrics/traces; create dashboards for quality defects conduct root cause analysis and drive Skills QualificationsPython proficiency for test automation and data validation (PyTest/unittest requests/httpx)..
Key Skills
- Change Management
- Corporate Communications
- Apache Commons
- Compensation
- Civil Quality Control
About Company
At Virtusa, we are builders, makers, and doers. Digital engineering is in our DNA. It’s at the heart of everything we do.
