Data Platform Engineering Lead

The opportunity
Unity iAds is looking for a hands-on data infrastructure and platform engineer with proven leadership skills to lead and evolve our self-service data platform that powers petabyte-scale batch and streaming near-real-time analytics experimentation and the feature platform. Youll guide an already excellent team of senior engineers own reliability and cost efficiency and be the focal point for pivotal company-wide data initiatives- feature platform lakehouse and streaming.

Own the lakehouse backbone: Mature Iceberg at high scalepartitioning compaction retention metadataand extend our IcebergManager in-house product to automate the lakehouse management in a self serve fashion.

Unify online/offline for features: Drive Flink adoption and patterns that keep features consistent and low-latency for experimentation and production.

Make self-serve real: Build golden paths templates and guardrails so product/analytics/DS engineers can move fast safely.

Run multi-tenant compute efficiently: EMR on EKS powered by Karpenter on Spot instances; right-size Trino/Spark/Druid for performance and cost.

Cross-cloud interoperability: BigQuery BigLake/Iceberg interop where it makes sense (analytics experimentation partnership).

What youll be doing

• Leading a senior Data Platform team: setting clear objectives unblocking execution and raising the engineering bar.
• Owning SLOs on-call incident response and postmortems for core data services.
• Designing and operating EMR on EKS capacity profiles autoscaling policies and multi-tenant isolation.
• Tuning Trino (memory/spill CBO catalogs) Spark/Structured Streaming jobs and Druid ingestion/compaction for sub-second analytics.
• Extending Flink patterns for the feature platform (state backends checkpointing watermarks backfills).
• Driving FinOps work: CUR-based attribution S3 Inventory-driven retention/compaction Reservations/Savings Plans strategy OpenCost visibility.
• Partnering with product engineering analytics and data science & ML engineers on roadmap schema evolution and data product SLAs.
• Leveling up observability (Prometheus/VictoriaMetrics/Grafana) data quality checks and platform self-service tooling.

What were looking for

• 2 years leading engineers (team lead or manager) building/operating large-scale data platforms; 5 years total in Data Infrastructure/DataOps roles.
• Proven ownership of cloud-native data platforms on AWS: S3 EMR (preferably EMR on EKS) IAM Glue/Data Catalog Athena.
• Production experience with Apache Iceberg (schema evolution compaction retention metadata ops) and columnar formats (Parquet/Avro).
• Hands-on depth in at least two of: Trino/Presto Apache Spark/Structured Streaming Apache Druid Apache Flink.
• Strong conceptual understanding of Kubernetes (EKS) including autoscaling isolation quotas and observability
• Strong SQL skills and extensive experience with performance tuning with solid proficiency in Python/Java.
• Solid understanding of Kafka concepts hands-on experience is a plus
• Experience running on-call for data platforms and driving measurable SLO-based improvements.

You might also have

• Experience building feature platforms (feature definitions materialization serving and online/offline consistency).
• Airflow (or similar) at scale; Argo experience is a plus.
• Familiarity with BigQuery (and ideally BigLake/Iceberg interop) and operational DBs like Aurora MySQL.
• Experience with Clickhouse / Snowflake / Databricks / Starrocks.
• FinOps background (cost attribution/showback Spot strategies).
• Data quality lineage and cataloging practices in large orgs.
• IaC (Terraform/CloudFormation)

Additional information

• Relocation support is not available for this position.
• Work visa/immigration sponsorship is not available for this position

Life at Unity
Unity NYSE: U is the leading platform to create and grow games and interactive experiences. Creators ranging from game developers to artists architects automotive designers infrastructure experts filmmakers and more use Unity to bring their imaginations to life across multiple platforms from mobile PC and console to spatial computing.

As of the third quarter of 2024 more than 70% of the top 1000 mobile games were made with Unity and in 2024 Made with Unity applications had an average of 3.7 billion downloads per month. For more information please visit Unity.

Unity is a proud equal opportunity employer. We are committed to fostering an inclusive innovative environment and celebrate our employees across age race color ancestry national origin religion disability sex gender identity or expression sexual orientation or any other protected status in accordance with applicable law. Our differences are strengths that enable us to support the growing and evolving needs of our customers partners and collaborators. If you have a disability that means there are preparations or accommodations we can make to help ensure you have a comfortable and positive interview experience please fill out this form to let us know.

This position requires the incumbent to have a sufficient knowledge of English to have professional verbal and written exchanges in this language since the performance of the duties related to this position requires frequent and regular communication with colleagues and partners located worldwide and whose common language is English.

Headhunters and recruitment agencies may not submit resumes/CVs through this website or directly to managers. Unity does not accept unsolicited headhunter and agency resumes. Unity will not pay fees to any third-party agency or company that does not have a signed agreement with Unity.

Your privacy is important to us. Please take a moment to review our Prospect Privacy Policy and Applicant Privacy Policy. Should you have any concerns about your privacy please contact us at

#SEN #LI-SC1