SDETPerformance Engineer

Project Scope:

• Own the performance test program (strategy plans assets runs reporting) for PTAS while providing shared coverage for Elections and other named systems.
• Integrate automated load/stress tests into CI/CD; deliver repeatable non prod scale runs that mirror production traffic patterns.
• Validate Dataverse/OData API and backend (SQL/Dataverse) performance for PTAS; document baselines and thresholds.
• Produce management ready reports (findings RCAs remediation tracking) and readiness sign offs leading to go/no go decisions.
• Coordinate with Network/F5 CloudOps/Azure Security/IAM and application teams; schedule change windows and after hours runs as needed.

Work Description:

1. Lead Performance Engineering: Manage the end-to-end performance testing process from establishing baseline reports during development to lead-testing system capacity under peak loads.
2. Performance Baseline Reports (During Development & Unit Testing)
3. These reports establish expected response times throughput and resource utilization under normal conditions. They serve as a benchmark for future comparisons and help developers identify regressions early.
4. Load and Stress Test Results (During System Testing)
5. These deliverables simulate varying levels of user traffic to evaluate how the application performs under peak load and beyond capacity. They help uncover scalability issues memory leaks or infrastructure limitations.
6. Bottleneck Analysis and Recommendations (During Integration & Pre-Production)
7. Detailed diagnostics pinpoint slow database queries inefficient code paths or misconfigured servers. This analysis includes actionable insights for tuning application and infrastructure components.
8. Continuous Performance Monitoring Dashboards (During Deployment & Maintenance)
9. Integrated with CI/CD pipelines these dashboards provide real-time visibility into performance trends across builds and environments. They support ongoing optimization and ensure SLAs are consistently met post-deployment.
10. Technical Authority: Lead the design and execution of high-scale orchestration (simulating 250000 concurrent users) and the technical approach for bypassing MFA in automated environments.

Expectations

A. Strategy & Planning

• System specific Performance Test Strategy and Master Test Schedule covering PTAS plus Elections Metro M5/Yard JHS eMAR TRUECredentials PAO. (Update quarterly.)
• Pre test readiness checklist (data identities quotas observability rollback).

B. Test Assets & Automation

• Author/maintain scripts/configs in Azure Load Testing (Azure Test Cloud) and one of K6/JMeter/Gatling for top workflows; parameterize data; model ramp profiles and failover.
• Build synthetic/anonymized datasets; provision non prod test identities under Security/IAM approved guardrails (no production MFA changes).

C. Scale Execution & Reporting

• Run controlled peak load tests; deliver run report 5 business days post execution; publish RCA remediation plan 7 business days for defects; update dashboards.

D. Cross Layer Troubleshooting & Remediation

• Diagnose bottlenecks across application/API DB/cache F5 (VIPs/pools/iRules) and Azure (autoscale/quotas); open/track remediation tickets to closure.

E. Readiness Certificates

• Issue system readiness sign off with thresholds met (response times error rates throughput resilience/failover).

F. Knowledge Transfer

• Maintain evergreen runbooks/playbooks (operations troubleshooting incident response); store in County repository.

Mandatory Skills:

1. Proficiency in Performance Testing Tools (5 Years of Experience): Must have mastery of these tools to simulate realistic user loads configure test scenarios and generate actionable performance metrics. Must have

• Apache JMeter
• StressStimulus
• Azure Test Cloud
• BlazeMeter

1. Strong Programming and Scripting Abilities (8 Years of Experience): Custom scripting experience is required.

Key Skills:

• C# Python JavaScript
• Shell scripting
• Regular expressions
• Data parameterization and correlation

1. Deep Understanding of Web Architecture and Protocols (8 Years of Experience): Resource must have a solid grasp of how web applications function and experience in designing accurate test scenarios and diagnosing performance issues at the network server or application layer.

Key Skills:

• HTTP/HTTPS
• RESTful APIs
• WebSockets
• Browser rendering and caching behavior
• DNS CDN and load balancing

1. Experience with CI/CD and DevOps Integration (5 Years of Experience): Must have experience integrating performance tests into the CI/CD pipeline.

Key Skills:

• Jenkins GitHub Actions GitLab CI Azure DevOps
• Docker and Kubernetes
• Infrastructure as Code (IaC)
• Test automation frameworks

1. Analytical Thinking and Monitoring Tool Proficiency (5 Years of Experience)

Must have analytical skills and familiarity with monitoring tools to help identify bottlenecks correlate metrics and provide actionable insights for optimization to the County.

Key Skills:

• Grafana Prometheus
• New Relic Dynatrace AppDynamics
• Log analysis (e.g. ELK stack)
• Root cause analysis

1. Occasional after-hours testing is required

• Testing hours 8pm PT to 10 pm PT
• After hours testing will still be within the 40 hours per week work schedule.