Data Engineer (DataOps & Infrastructure Focus)
San Mateo, CA - USA
Job Summary
Summary
You will join Guidewires Product organization working at the intersection of data AI and cloud infrastructure to power our industry-leading P&C insurance platform. Our team focuses on building secure scalable and governed data capabilities that enable AI-infused products and analytics for customers worldwide. We collaborate across Product Development Security and Finance to ensure our data platform is robust reliable and ready for rapid innovation.In this role you will design and automate modern data infrastructure on AWS to support Guidewires AI-first Product strategy including Agentic AI Platform initiatives and next-generation analytics experiences. You will lead DataOps practicesCI/CD observability and governancefor critical pipelines and data products that power our Claims Underwriting and pricing solutions globally. If you are excited by GenAI large-scale data systems and building the backbone that helps insurers operate more efficiently this role puts you at the center of Guidewires mission to transform how the worlds P&C insurers do business.
Job Description
What youll do
Architect automate and maintain production-grade data infrastructure on AWS (e.g. S3 EMR Glue Lambda Redshift) using Terraform or CDK with a focus on high availability security and consistent environments across the SDLC.
Integrate Claude Code and other LLM-based agents into the engineering workflow to accelerate infrastructure provisioning refactoring and generation of technical documentation embedding AI into daily development practices.
Design build and optimize CI/CD pipelines that test deploy and monitor dbt models and AWS Glue/Spark jobs ensuring reliable repeatable delivery of governed data assets.
Implement agentic operations for DataOpsconfiguring AI agents to triage and perform root-cause analysis of pipeline failures surface cost-optimization signals and proactively detect schema drift or data quality regressions.
Engineer scalable well-governed data pipelines and tables using Apache Iceberg Airflow (MWAA) and Redshift emphasizing simplicity reusability and clear ownership of data products.
Operationalize security and compliance best practices in a regulated insurance environment including IAM automation encryption audit-ready logging and alignment with enterprise RBAC/MFA standards.
Partner with Product Strategy PDO and data science teams to ensure data platforms and features can support AI-heavy products like the Agentic AI Platform Claim Summary and Underwriting Assistant at scale.
At Guidewire we foster a culture of curiosity innovation and responsible use of AIempowering our teams to continuously leverage emerging technologies and data-driven insights to enhance productivity and outcomes.
What youll bring
Required
Demonstrated ability to embrace AI and apply it to your current role as well as data-driven insights to drive innovation productivity and continuous improvement.
5 years of experience in Data Engineering Data Operations or Platform Engineering building and operating cloud data infrastructure.
Deep proficiency with AWS (e.g. S3 EMR Glue Lambda Redshift) and infrastructure-as-code (Terraform strongly preferred; CDK a plus) including designing secure resilient architectures.
Strong experience with dbt in production (modeling testing documentation deployment) and modern table formats such as Apache Iceberg for large-scale analytics.
Advanced SQL skills (performance tuning complex joins and window functions) and solid Python experience for automation orchestration and data engineering tasks.
Hands-on experience with Apache Spark for large-scale batch or streaming workloads ideally on AWS EMR or Glue.
Proven track record of building or maintaining CI/CD pipelines (Git-based workflows automated testing deployment and monitoring) for data and analytics workloads.
Strong systems thinking and data modeling skills (e.g. Kimball Data Vault) and familiarity with integrating RDBMS data via CDC patterns.
Clear collaborative communication style with the ability to work across product security and business stakeholders in a distributed environment.
Preferred
Experience leveraging Claude Code LLM-based agents or other agentic AI tools to automate infrastructure provisioning refactoring or documentation workflows.
Background working with MLOps platforms such as SageMaker especially around feature stores and data contracts between data engineering and ML teams.
Experience in a regulated environment (Finance Insurance or similar) and familiarity with P&C insurance data concepts (policies claims billing rating underwriting).
Exposure to Redshift performance tuning workload management and cost optimization in enterprise settings.
Bachelors or Masters degree in Computer Science Engineering or a related technical field or equivalent practical experience.
Your Impact
We believe in clarity and setting you up for your first six months you will take ownership of key AWS-based data environments stabilize and enhance existing dbt/Glue/Spark pipelines and introduce AI-augmented workflows that reduce operational toil and improve developer productivity. You will help Product Strategy and PDO deliver reliable trusted data for AI-powered products like the Agentic AI Platform and Claim Summary while aligning with security and governance priorities for a global P&C customer base. Over time your work will shape how Guidewires customers access trust and use datadirectly influencing product quality operational excellence and our mission to transform how insurers serve their policyholders worldwide.
Whats in it for you
The people we employ give their all and in return we offer flexibility wherever we can such as:
Flexible work environment
Health and Wellness benefits
Paid time off programs including volunteer time off
Market-competitive pay and incentive programs
Continual development and internal career growth opportunities
All new hires participate in our in-person orientation where youll connect with colleagues learn about our culture of inclusive collaboration and innovation and see how your work contributes to transforming the way the worlds P&C insurers do business.
The US base salary range for this full-time position is $124000 - $186000 . Your base pay will depend on your experience skills education training and location among other factors. All full-time positions or part-time roles working 30 hours or more a week at Guidewire are eligible for benefits that support their health and well-being including health dental and vision insurance paid time off and a company sponsored retirement addition some roles may be eligible for the annual company bonus plan commissions and/or long term incentive awards which are contingent on a variety of factors including but not limited to company and employee performance.Disability Accommodations and Guidewires Appeals Process. Guidewire provides accommodations to the hiring process to create a fair opportunity for candidates with disabilities to contend for open positions. Accommodation requests should be directed to If things do not go as hoped we invite you to use our appeals process. Guidewire promises to independently review any denied accommodation and any decision not to offer you the position. The appeals process is the same in either case. Within five business days of receiving a notice of denial of an accommodation or receiving a notice of your non-selection for a vacancy e-mail to make an appeal. Guidewire will assign a new decision-maker to review the request and/or hiring decision who will then notify you in writing of a decision within 10 business days.
About Guidewire
Guidewire is the platform P&C insurers trust to engage innovate and grow efficiently. We combine digital core analytics and AI to deliver our platform as a cloud service. More than 540 insurers in 40 countries from new ventures to the largest and most complex in the world run on Guidewire.
As a partner to our customers we continually evolve to enable their success. We are proud of our unparalleled implementation track record with 1600 successful projects supported by the largest R&D team and partner ecosystem in the industry. Our Marketplace provides hundreds of applications that accelerate integration localization and innovation.
For more information please visit and follow us on Twitter: @GuidewirePandC.
Guidewire Software Inc. is proud to be an equal opportunity and affirmative action employer. We are committed to an inclusive workplace and believe that a diversity of perspectives abilities and cultures is a key to our success. Qualified applicants will receive consideration without regard to race color ancestry religion sex national origin citizenship marital status age sexual orientation gender identity gender expression veteran status or disability. All offers are contingent upon passing a criminal history and other background checks where its applicable to the position.
Required Experience:
IC