Software Engineer in Test (AI-Driven Functional and Automation)
Philadelphia, PA - USA
Job Summary
Job Title: Software Engineer in Test (AI-Driven Functional and Automation)
Location & Presence: This is a hybrid role. The selected candidate must be able to
work from the office 3 to 4 days a week. * Primary Office Locations: Mount Laurel
NJ or West Chester PA.
Role Overview
We are seeking a high-caliber Senior Automation & Quality Engineer to lead the evolution of
testing ecosystem. In this role you will move beyond traditional automation by pioneering
AI-assisted test generation and agentic workflows. You will be responsible for designing
robust scalable test cases to be judged by LLM-based evaluation to drastically reduce manual
authoring time while maintaining elite-level system reliability.
Core Responsibilities
AI-Driven Testing Innovation: Design and implement LLM-assisted test scaffolding
(using tools like Claude Code GitHub Copilot or Vertex AI) to automate the creation of
complex test suites.
Hybrid Testing Strategy: Demonstrate a high degree of flexibility by performing
manual exploratory testing when necessary and transitioning those insights into highperformance functional automation using Python pytest and TypeScript.
Cross-Project Contribution: Act as a versatile quality consultant across multiple
workstreams. You must thrive in a high-paced delivery environment balancing
competing priorities across different project teams.
Agentic Frameworks: Maintain a strong understanding of Agentic AI frameworks and
Agent Evaluations to ensure the reliability of AI-driven products.
Performance Engineering: Conduct deep-dive performance analysis latency profiling
and bottleneck identification using Locust or Apache JMeter.
Backend Validation: Perform deep integration and contract testing for distributed
systems built on Fast API Spring Boot Kafka and REST APIs.
Required Technical Expertise
Languages: Expert-level proficiency in Python Java or Go.
Testing Frameworks: Deep experience with pytest (fixtures parametrize mocking) or
TypeScript frameworks like Playwright or WebDriver IO.
Messaging & Data: Experience testing event-driven architectures involving Apache
Kafka or Pulsar and validating data across MongoDB PostgreSQL or Redis.
Observability: Ability to leverage Grafana or the ELK Stack for advanced test
monitoring and alerting.
Qualifications & Work Environment
Experience: 5 to 15 years of experience in software quality engineering or automation
development.
Adaptability: Proven track record of contributing to various projects simultaneously
under tight deadlines.
Methodology: Strong background in Agile/Scrum environments with a focus on
TDD/BDD and Shift-Left testing practice