Lead Data Engineering Platform Architect

Title:

Company:

Job Category:

Job Description:

About Everest:

Everest is a global leader in risk management rooted in a rich 50 year heritage of enabling businesses to survive and thrive and economies to function and flourish. We are underwriters of risk growth progress and opportunity. We are a global team focused on disciplined capital allocation and long-term value creation for all stakeholders who care deeply about our impact on communities and the wider world.

About the role:

As a Lead Data Engineering Platform Architect at Everest youll take ownership of designing building and managing a modern data and analytics platform that powers our global insurance business. Youll work with cutting-edge technologies like Databricks Azure Data services Airflow and Kafka and collaborate closely with Data Domain Delivery Cloud Engineering DevOps and Information Security teams to deliver a platform thats secure scalable and built for performance.

Youll drive automation observability and governance across the platform while mentoring teams and shaping Everests data architecture standards. Youll also partner with data engineering and analytics teams to deliver reusable frameworks MLOps pipelines and semantic layers that support enterprise-wide insights.

This hybrid role is based in our Warren NJ headquarters (3 days onsite / 2 remote).

Key Responsibilities:

• Platform Leadership

  • Architect and manage Everests Azure-based data platform using Databricks and cloud-native tools

  • Define and enforce data architecture standards blueprints and best practices

  • Lead adoption of emerging technologies through PoCs and pilot implementations

  • Translate business and technical requirements into an architectural blueprints roadmaps and solution designs adhering to enterprise standards.

  • Provide technology leadership to delivery teams to build and operate data products effectively

• Engineering & Automation

  • Design and develop reusable components including data ingestion for structured and unstructured data data transformation logging and observability

  • Drive MLOps and self-service analytics frameworks for model lifecycle management

  • Design end-to-end observability of all cloud resources and components including performance optimization and FinOps alignment

  • Automate infrastructure and security using IaC DevOps RBAC/ABAC

• Collaboration & Governance

  • Partner with cross-functional teams to deliver scalable resilient data solutions

  • Mentor engineering teams and elevate technical capabilities across the organization

  • Implement enterprise-wide governance privacy and FinOps-aligned performance monitoring

  • Stay updated with the latest trends tools and technologies in the field of data engineering. Proactively identify opportunities to improve data engineering practices and contribute to the evolution of data infrastructure.

Qualifications:

• A bachelors (required) or masters (preferred) in Computer Science Information Systems or related field

• 10 years in data engineering and architecture with deep experience in Azure and Databricks

• In-depth experience in Medallion/Delta Lake Architecture ML/AI and Azure cloud services Azure Data technologies such as ADLS ADF Fabric SQL Synapse PowerBI etc.

• Strong experience in implementing in IaC automation DevOps RBAC/ABAC MLOPS etc.

• Strong experience with orchestration tools such as Airflow and Event Driven data integration tools such as Kafka etc.

• Strong experience with programming languages and tools such as Python PySpark SQL etc.

• Proven success building scalable platforms in complex global environments

• Experience deploying pipelines via Azure DevOps with code review and branching strategies

• Insurance industry knowledge (especially P&C) is a strong plus

• Strong communication leadership and stakeholder engagement skills

• Certifications in Azure and Databricks preferred

The base salary range for this position is $152000 - $199100 annually. The offered rate of compensation will be based on individual education experience qualifications and work location. All offers include access to a variety of benefits to employees including health insurance coverage an employee wellness program life and disability insurance 401k match retirement savings plan paid holidays and paid time off (PTO).

What if I dont meet every requirement At Everest we are dedicated to building an inclusive and authentic workplace. So if you are excited about this role but your past experience doesnt align perfectly with every element in the job description we still encourage you to apply. You may be just the right candidate for this or other roles. Please let us know if you need any accommodations throughout the application or interview process.

Our Culture

At Everest our purpose is to provide the world with protection. We help clients and businesses thrive fuel global economies and create sustainable value for our colleagues shareholders and the communities that we serve. We also pride ourselves on having a unique and inclusive culture which is driven by a unified set of values and behaviors. Clickhereto learn more about our culture.

• Our Valuesare the guiding principles that inform our decisions actions and behaviors. They are an expression of our culture and an integral part of how we work: Talent. Thoughtful assumption of risk. Execution. Efficiency. Humility. Leadership. Collaboration. Inclusion and Belonging.
• Our Colleague Behaviorsdefine how we operate and interact with each other no matter our location level or function: Respect everyone. Pursue better. Lead by example. Own our outcomes. Win together.

All colleagues are held accountable to upholding and supporting our values and behaviors across the company. This includes day to day interactions with fellow colleagues and the global communities we serve.

Type:

Everest U.S. Privacy Notice Everest ()