Lead Software Engineer Test Frameworks and Tooling Team

Why You Should Join the Test Frameworks and Tooling Team

Engineering confidence is our primary product. We are not testers but rather infrastructure architects building the sophisticated automation and CI/CD frameworks that make deploying to production a non-event. As the Lead for this team you will define the technical roadmap for our automated guardrails and repository standards empowering every engineer in the company to ship at terminal velocity with total confidence. By architecting the foundational tools that guarantee production readiness you will play a pivotal role in driving Sev-1 incidents toward zero and ensuring our organization can move fast without the fear of breaking things.

What Youll Achieve: Key Responsibilities

As the technical leader for this team you will drive the evolution of our testing ecosystem and mentor other engineers in the craft of quality engineering:

• Define Architectural Vision: Lead the long-term strategy for our integration and E2E testing frameworks across both backend and frontend stacks. You will ensure these systems are not just reliable but world-class in their ease of adoption.
• CI/CD Strategy: Architect how we execute tests within our CI system. You will focus on radically optimizing feedback loops so that engineers receive actionable high-fidelity results in minutes.
• Set Engineering Standards: Establish the golden paths for our repositories. You will define the benchmarks for unit testing code quality metrics and systemic reliability that all teams will follow.
• Scalable Tooling & Coverage: Design and build the next generation of tools that simplify complex testing scenarios. You will lead efforts to backfill testing gaps at scale through advanced data mocking and service isolation.
• AI-Driven Quality Strategy: Spearhead our efforts to leverage AI within the testing lifecycle. You will identify and implement AI-powered solutions for automated regression detection flaky test analysis and intelligent test generation.
• Cross-Functional Leadership: Act as a consultant to feature teams to solve their most complex stability challenges. You will use root-cause analysis from major incidents to propose and implement pillar-wide safety improvements.
• Operational Excellence: Oversee the health and performance of our entire CI/CD pipeline taking ultimate responsibility for the stability of the environment that hundreds of engineers rely on daily.
• Youve already experimented with AI in work or personal projects and youre excited to dive in and learn fast. Youre hungry to responsibly explore new AI tools and workflows finding ways to make your work smarter and more efficient.

What Makes This Role Exciting

• High-Leverage Leadership: You are not just building features; you are building the platform that defines the developer experience for the entire company.
• Innovation at the Edge: You will have the autonomy to experiment with emerging technologies like AI and LLMs to solve the age-old problems of flakiness and slow feedback loops.
• Pillar-Wide Influence: As a Lead your decisions on testing standards and infrastructure will directly impact the speed and quality of every shipping team in the organization.

Who You Are:

• Seasoned Technical Leader: You have 7 years of software engineering experience with a history of leading complex high-impact technical projects. You are a hands-on lead who stays close to the code while steering the broader vision.
• Master of Root-Cause Analysis: You dont just fix symptoms; you hunt down systemic failures. You excel at debugging deep-stack issues and transforming those lessons into automated preventions.
• Full-Stack Architect: You are comfortable designing systems across the stack. Whether it is a React-based quality dashboard or a Python service for data seeding you understand how to build for scale.
• AI Visionary: You are passionate about the intersection of AI and Software Quality. You have a clear perspective on how AI can automate the mundane parts of testing and accelerate the SDLC.
• Extreme Ownership: You take pride in the end-to-end health of the platform. You are proactive in identifying technical debt and are a relentless advocate for engineering excellence.
• CI/CD Expert: You have deep experience with modern CI/CD tools and a sophisticated understanding of how to integrate automated testing into high-frequency deployment pipelines.

Technologies we use (not exhaustive):

• Backend: Python Django Go
• Frontend: React TypeScript JavaScript
• Testing Frameworks: Playwright Cypress Pytest Jest
• Infrastructure and CI: AWS Kubernetes Terraform Helm Buildkite
• Data: MySQL Redis Kafka
• AI Tools: Integration with Claude Cursor Copilot or internal AI enablement frameworks

We use Covey as part of our hiring and / or promotional process. For jobs or candidates in NYC certain features may qualify it as an AEDT. As part of the evaluation process we provide Covey with job requirements and candidate submitted applications. We began using Covey Scout for Inbound on April 3 2025.

Please see the independent bias audit report covering our use of Covey here

Required Experience:

IC