Data Engineer

The Data Engineer is responsible for designing building and optimizing reliable scalable and auditable data systems on our modern Databricks Lakehouse platform hosted in Microsoft this role you will be on the cutting edge of data engineeringthinking designing and documenting data marts.

We are looking for a dynamic forward-thinking engineer who is passionate about the latest developments in the data ecosystem and places the utmost importance on data quality and governance. You will work closely with your team and peers to drive the evolution of continuous delivery automated quality frameworks and agile data products.

This position is open across the United States with a preference for those in Seattle or the East Coast time zone. Seattle candidates will have a hybrid remote/in-office schedule where you will work from our casual pet-friendly office at least 3 days a week. 

What you will do

• Data Ingestion & Pipeline Reliability: Responsible for ensuring continuous accurate data availability by monitoring troubleshooting and optimizing batch and real-time streaming pipelines across the Medallion architecture to deliver stable high-availability data feeds with minimal downtime.
• Data Mart Delivery & Business Modeling: Responsible for delivering query-ready Gold-layer data marts dimensional models and aggregate tables by partnering directly with Data Analytics and Data Science teams to map business requirements into high-performance user-facing schemas.
• Data Contract Validation & Ingestion Quality: Responsible for protecting the integrity of the Lakehouse by configuring automated validation gates and alerts at the ingestion stage to catch and block corrupt or non-compliant source data
• Data Quality Frameworks & Precision: Responsible for maintaining flawless data integrity and trust across all data products by writing deploying and maintaining automated data quality test suites and expectations for key transformation stages.
• Data Governance & Asset Discoverability: Responsible for ensuring all data assets are easily discoverable by documenting schemas applying metadata tags
• Cross-Functional Collaboration & Autonomy: Responsible for serving as an autonomous data engineering partner to downstream teams by proactively investigating data discrepancies resolving support tickets and aligning business definitions to unblock analysts and data scientists.

Experience you have:  

• Education: Bachelors level degree or higher in Computer Science Engineering or equivalent practical experience.
• Core Data Engineering: Minimum 2 years of experience designing building and enhancing high-performance pipelines (ETL/ELT) and building optimized Data Marts across the enterprise.
• Databricks Ecosystem: Minimum 2 years of deep technical experience within a Databricks-centric environment leveraging:
  • Delta Lake & Apache Spark (PySpark / SparkSQL)
  • Unity Catalog for data governance lineage and documentation
  • Delta Live Tables (DLT) or similar orchestration tools
• Data Quality First: Proven experience implementing robust data quality testing and monitoring frameworks (e.g. Great Expectations Databricks Expectations or custom data quality gates) to ensure flawless data integrity.
• DevOps & Lifecycle: Experience required with software and infrastructure change management CI/CD pipelines (Azure DevOps/GitHub Actions) and source code control.

What youll bring:  

• Modern Lakehouse Architecture: Passion for the latest industry trends including the Medallion Architecture (Bronze/Silver/Gold) Data Contracts and decentralized data design.
• Design & Documentation: Strong conceptual thinker who doesnt just build but actively designs and documents data assets schemas and definitions directly within Unity Catalog.
• Pipeline Versatility: Hands-on experience implementing data pipelines for a variety of flows including batch data integrations real-time streaming analytics (Structured Streaming) and big data analytics.
• Observability: Experience setting up comprehensive logging alerting and monitoring solutions for Spark jobs and data pipelines.
• Agile & Dynamic Mindset: Thrives in a fast-paced Agile software development environment with a strong proactive drive to learn and adopt new tools and features as the Databricks ecosystem evolves.
   

Compensation: 

• Thebasesalaryrange for this position is$130000 - $150000 on a full-time schedule. 
• Along with base compensation Trupanion employees are currently eligible for monthly bonuses.
• We want all employees to be invested inTrupanionssuccess so we grant Restricted Stock Units to all new team members. Our new hire grants vest over 4 years. 

Additional Information :

Benefits and Perks:

• Full medical dental and vision benefits at no cost to the employee
• Four weeks of paid time off and 9 paid float holidays (you can decide which days are most important to you!)
• Five-week sabbatical after five years of employment
• Open casual pet-friendly and fun office environment
• Free medical health insurance for your pet (1 dog or cat)
• Paid time off to volunteer at nonprofit organizations
• Seattle Office Amenities: Free on-site gym free dog walking services for office pets during business hours free parking and paid ORCA cards.

For more information about Trupanion visit more about how Trupanion has revolutionized our industry and the reimbursement model: is an equal-opportunity employer and embraces diversity. We are committed to building a team that represents a variety of backgrounds abilities perspectives and skills.

We will ensure that individuals are provided reasonable accommodation to participate in the job application or interview process perform essential job functions and receive other benefits and privileges of employment. Please contact us to request accommodations.

Applicants must be authorized to work for any employer in the U.S. We are unable to sponsor or take over sponsorship of an employment visa at this time.

Remote Work :

No

Employment Type :

Full-time