Senior AI Engineer Regression Evaluation

About Zscaler

Zscaler accelerates digital transformation so our customers can be more agile efficient resilient and secure. Our cloud native Zero Trust Exchange platform protects thousands of customers from cyberattacks and data loss by securely connecting users devices and applications in any location.

Here impact in your role matters more than title and trust is built on results. We believe in transparency and value constructive honest debatewere focused on getting to the best ideas faster. We build high-performing teams that can make an impact quickly and with high quality. To do this we are building a culture of execution centered on customer obsession collaboration ownership and accountability.

We value high-impact high-accountability with a sense of urgency where youre enabled to do your best work and embrace your potential. If youre driven by purpose thrive on solving complex challenges and want to make a positive difference on a global scale we invite you to bring your talents to Zscaler and help shape the future of cybersecurity.

Our Engineering team built the worlds largest cloud security platform from the ground up and we keep building. With more than 100 patents and big plans for enhancing services and increasing our global footprint the team has made us and our multitenant architecture todays cloud security leader with more than 15 million users in 185 countries. Bring your vision and passion to our team of cloud architects software engineers security experts and more who are enabling organizations worldwide to harness speed and agility with a cloud-first strategy.

We are seeking highly skilled and experienced AI/ML engineers with a strong foundation in regression modeling evaluation systems and AI infrastructure to join our team. You will be reporting to the Senior Manager Data Science. You will be responsible for:

• Designing and automating regression-based evaluation systems for large language models and predictive ML services
• Developing statistical pipelines to monitor model drift bias and performance trends and analyzing outputs to drive actionable insights for improvements
• Collaborating with ML and product teams to benchmark and fine-tune models for generative AI anomaly detection and customer analytics
• Partnering with DevOps to deploy evaluation and monitoring tools on AWS or GCP infrastructure and building dashboards to visualize regression performance metrics (e.g. RMSE R² stability indices)
• Documenting evaluation methodologies standardizing validation frameworks and staying updated on advances in regression evaluation and scalable ML performance measurement

What Were Looking for (Minimum Qualifications)

• Bachelors or Masters in Computer Science with 5 years in AI/ML engineering or model evaluation focused on regression analysis and reliability
• Proficient in Python (pandas NumPy scikit-learn PyTorch/TensorFlow) with expertise in performance metrics A/B testing and model drift analysis
• Experience with AWS/GCP and deploying evaluation systems using EKS ECS SageMaker or Vertex AI familiarity with LLM frameworks is a plus
• Proven ability to develop automated regression testing and monitoring systems for production ML pipelines

What Will Make You Stand Out (Preferred Qualifications)

• Experience with MLOps CI/CD for ML pipelines and monitoring tools (MLflow Weights & Biases Prometheus) with expertise in time-series regression and causal inference
• Proficient in data visualization tools (Plotly Streamlit Power BI) with strong collaboration and communication skills for cross-functional work
• Passionate about building reliable explainable and measurable AI systems

#LI-Hybrid

#LI-NT1

At Zscaler we are committed to building a team that reflects the communities we serve and the customers we work with. We foster an inclusive environment that values all backgrounds and perspectives emphasizing collaboration and belonging. Join us in our mission to make doing business seamless and secure.

Our Benefits program is one of the most important ways we support our employees. Zscaler proudly offers comprehensive and inclusive benefits to meet the diverse needs of our employees and their families throughout their life stages including:

By applying for this role you adhere to applicable laws regulations and Zscaler policies including those related to security and privacy standards and guidelines.

Zscaler is committed to providing equal employment opportunities to all individuals. We strive to create a workplace where employees are treated with respect and have the chance to succeed. All qualified applicants will be considered for employment without regard to race color religion sex (including pregnancy or related medical conditions) age national origin sexual orientation gender identity or expression genetic information disability status protected veteran status or any other characteristic protected by federal state or local laws. See more information by clicking on the Know Your Rights: Workplace Discrimination is Illegal link.

Pay Transparency

Zscaler complies with all applicable federal state and local pay transparency rules.

Zscaler is committed to providing reasonable support (called accommodations or adjustments) in our recruiting processes for candidates who are differently abled have long term conditions mental health conditions or sincerely held religious beliefs or who are neurodivergent or require pregnancy-related support.