We are looking for a Senior QA Engineer to own quality assurance for a next-generation Intelligent Document Processing (IDP) platform a system that combines OCR AI/LLM-based extraction and modern backend/cloud architecture to automatically process and classify documents at scale.
This is a role for someone who can think beyond test cases and actually architect a QA strategy from the ground up someone whos tested complex multi-layered systems before (web cloud database and AI-driven components) and knows how to bring order rigor and best practices to a system where not every output is simply right or wrong. Youll be defining what quality even means for an AI-powered pipeline not just executing a checklist.
What Youll Do
Test Strategy & Leadership
Define and own the overall QA strategy and test vision for the platform from unit level up through full end-to-end system validation.
Introduce and champion QA best practices testing standards and a quality-first culture across the engineering team.
Build a testing roadmap that scales with the product balancing manual automated and AI-specific evaluation approaches.
Act as the quality gatekeeper for releases with clear go/no-go criteria backed by data.
Testing Coverage
Unit Testing Partner with developers to ensure adequate unit test coverage and quality at the code level.
Integration Testing Validate interactions between services APIs databases and third-party components (OCR engines AI/LLM services storage queues).
End-to-End Testing Design and execute E2E test scenarios that simulate real document-processing workflows from ingestion to final output.
Regression Testing Build and maintain a reliable regression suite to catch breakages introduced by code model or prompt changes.
Smoke Testing Establish fast lightweight smoke test suites for quick health checks after every deployment.
Database Testing Validate data integrity schema correctness migrations and data transformations across the pipeline; write and optimize SQL queries to verify stored/processed data.
Automation Testing Design and build scalable automation frameworks; identify what to automate vs. test manually for maximum ROI.
AI/Model Output Evaluation Design evaluation approaches for probabilistic outputs (OCR/AI extraction) including accuracy benchmarking consistency checks and handling of non-deterministic results going beyond simple pass/fail assertions.
Quality Ownership
Define meaningful quality metrics (accuracy precision/recall defect leakage test coverage etc.) and report on them clearly to stakeholders.
Own test planning test case design bug tracking/triage and release sign-off.
Build and maintain a reusable test data corpus (documents expected outputs edge cases) to support ongoing regression and evaluation.
Collaborate closely with engineering and product teams to catch issues early shifting quality left in the development lifecycle.
Mentor and guide other QA resources as the team grows setting the tone for testing rigor and craftsmanship.
What Were Looking For
Must-Haves:
6 years of QA experience with a strong track record testing complex web and cloud-based applications end-to-end.
Proven experience owning full-spectrum testing unit integration system/E2E regression and smoke testing not just one layer.
Strong hands-on database testing skills comfortable writing SQL queries validating data integrity and testing data pipelines/transformations.
Solid experience with test automation frameworks and building automation strategy from scratch.
Experience testing AI ML or NLP-powered systems or systems with non-deterministic/probabilistic outputs understands that traditional pass/fail testing isnt enough for these.
Demonstrated ability to define test strategy and vision not just execute existing test plans has built or matured a QA function/process before.
Strong experience with API testing and modern CI/CD-integrated testing pipelines.
Excellent analytical and root-cause/bug triage skills across multi-layered systems.
Strong communication skills able to represent quality status and risk clearly to technical and non-technical stakeholders.
Nice-to-Haves:
Experience testing OCR or document-processing systems.
Experience testing LLM/GenAI-integrated applications or prompt-based pipelines.
Scripting ability (any language) to build custom test tools/harnesses.
Experience with performance/load testing for high-volume batch-processing systems.
Background in regulated or document-heavy industries.
What Success Looks Like
A mature well-structured test strategy covering every layer of the system from unit to end-to-end.
A regression and smoke suite the team trusts to catch issues before every release.
Clear data-backed quality metrics that give leadership confidence in whats shipping.
A QA culture and set of best practices that elevate how the whole engineering team thinks about quality not just a person running test cases.
We are looking for a Senior QA Engineer to own quality assurance for a next-generation Intelligent Document Processing (IDP) platform a system that combines OCR AI/LLM-based extraction and modern backend/cloud architecture to automatically process and classify documents at scale. This is a role for...
We are looking for a Senior QA Engineer to own quality assurance for a next-generation Intelligent Document Processing (IDP) platform a system that combines OCR AI/LLM-based extraction and modern backend/cloud architecture to automatically process and classify documents at scale.
This is a role for someone who can think beyond test cases and actually architect a QA strategy from the ground up someone whos tested complex multi-layered systems before (web cloud database and AI-driven components) and knows how to bring order rigor and best practices to a system where not every output is simply right or wrong. Youll be defining what quality even means for an AI-powered pipeline not just executing a checklist.
What Youll Do
Test Strategy & Leadership
Define and own the overall QA strategy and test vision for the platform from unit level up through full end-to-end system validation.
Introduce and champion QA best practices testing standards and a quality-first culture across the engineering team.
Build a testing roadmap that scales with the product balancing manual automated and AI-specific evaluation approaches.
Act as the quality gatekeeper for releases with clear go/no-go criteria backed by data.
Testing Coverage
Unit Testing Partner with developers to ensure adequate unit test coverage and quality at the code level.
Integration Testing Validate interactions between services APIs databases and third-party components (OCR engines AI/LLM services storage queues).
End-to-End Testing Design and execute E2E test scenarios that simulate real document-processing workflows from ingestion to final output.
Regression Testing Build and maintain a reliable regression suite to catch breakages introduced by code model or prompt changes.
Smoke Testing Establish fast lightweight smoke test suites for quick health checks after every deployment.
Database Testing Validate data integrity schema correctness migrations and data transformations across the pipeline; write and optimize SQL queries to verify stored/processed data.
Automation Testing Design and build scalable automation frameworks; identify what to automate vs. test manually for maximum ROI.
AI/Model Output Evaluation Design evaluation approaches for probabilistic outputs (OCR/AI extraction) including accuracy benchmarking consistency checks and handling of non-deterministic results going beyond simple pass/fail assertions.
Quality Ownership
Define meaningful quality metrics (accuracy precision/recall defect leakage test coverage etc.) and report on them clearly to stakeholders.
Own test planning test case design bug tracking/triage and release sign-off.
Build and maintain a reusable test data corpus (documents expected outputs edge cases) to support ongoing regression and evaluation.
Collaborate closely with engineering and product teams to catch issues early shifting quality left in the development lifecycle.
Mentor and guide other QA resources as the team grows setting the tone for testing rigor and craftsmanship.
What Were Looking For
Must-Haves:
6 years of QA experience with a strong track record testing complex web and cloud-based applications end-to-end.
Proven experience owning full-spectrum testing unit integration system/E2E regression and smoke testing not just one layer.
Strong hands-on database testing skills comfortable writing SQL queries validating data integrity and testing data pipelines/transformations.
Solid experience with test automation frameworks and building automation strategy from scratch.
Experience testing AI ML or NLP-powered systems or systems with non-deterministic/probabilistic outputs understands that traditional pass/fail testing isnt enough for these.
Demonstrated ability to define test strategy and vision not just execute existing test plans has built or matured a QA function/process before.
Strong experience with API testing and modern CI/CD-integrated testing pipelines.
Excellent analytical and root-cause/bug triage skills across multi-layered systems.
Strong communication skills able to represent quality status and risk clearly to technical and non-technical stakeholders.
Nice-to-Haves:
Experience testing OCR or document-processing systems.
Experience testing LLM/GenAI-integrated applications or prompt-based pipelines.
Scripting ability (any language) to build custom test tools/harnesses.
Experience with performance/load testing for high-volume batch-processing systems.
Background in regulated or document-heavy industries.
What Success Looks Like
A mature well-structured test strategy covering every layer of the system from unit to end-to-end.
A regression and smoke suite the team trusts to catch issues before every release.
Clear data-backed quality metrics that give leadership confidence in whats shipping.
A QA culture and set of best practices that elevate how the whole engineering team thinks about quality not just a person running test cases.