Software Engineer Systems
Location
San Francisco CA. On site. Full time.
About the job
Advantra is partnering with a Series A AI infrastructure startup in San Francisco to hire a Software Engineer Systems to build core capabilities of their distributed data engine.
About the role
You will design and implement key components of a distributed query engine for multimodal data. You will improve query optimization execution scheduling and storage integrations. You will work closely with a small team to solve challenging systems problems and help shape the product architecture.
Responsibilities
-
Design and implement query planning and optimization for distributed workloads.
-
Improve execution engine performance and memory stability using streaming computation.
-
Enhance distributed scheduler for resource utilization task scheduling and fault tolerance.
-
Develop integrations with modern data lake technologies such as Parquet Iceberg and Delta Lake.
-
Contribute to core architectural design of the distributed engine.
-
Troubleshoot system-level issues and implement scalable solutions.
-
Collaborate with the team on product design and infrastructure improvements.
-
Participate in early-stage engineering tasks including customer support and prototyping.
Core requirements
-
3 years of experience building distributed data systems or databases.
-
Strong fundamentals in systems programming using C Rust or C.
-
Experience with Linux-based development and deployment.
-
Familiarity with cloud technologies such as AWS S3.
-
Experience with query planning scheduling and fault-tolerant pipelines.
-
Knowledge of memory management and efficient data structures.
-
Experience integrating with modern data storage formats and lakes.
-
Track record of solving complex technical challenges autonomously.
-
Ability to work effectively in small high-autonomy teams.
-
Comfort working in a fast-iteration early-stage startup environment.
Nice to have
-
Experience with Hadoop Spark Dask Ray or BigQuery.
-
Knowledge of distributed systems networking and scheduling techniques.
-
Exposure to large-scale multimodal data pipelines.
-
Open-source contributions to data engineering or query engines.
-
Experience with performance profiling and optimization.
How to apply
Email with links to shipped work and a short note on what you owned. Company name shared after the intro.
About Us
Advantra-Upstart Crew is a search program inside Advantra Consulting. We partner with early stage and high growth startups to hire the top 2% in Tech and GTM. We run end to end searches from single role headhunts to full team build outs using domain experts and a vetted network to deliver tight shortlists. We stay close to founders and candidates so the relationship lasts beyond the first hire.
Software Engineer Systems Location San Francisco CA. On site. Full time. About the job Advantra is partnering with a Series A AI infrastructure startup in San Francisco to hire a Software Engineer Systems to build core capabilities of their distributed data engine. About the role You will de...
Software Engineer Systems
Location
San Francisco CA. On site. Full time.
About the job
Advantra is partnering with a Series A AI infrastructure startup in San Francisco to hire a Software Engineer Systems to build core capabilities of their distributed data engine.
About the role
You will design and implement key components of a distributed query engine for multimodal data. You will improve query optimization execution scheduling and storage integrations. You will work closely with a small team to solve challenging systems problems and help shape the product architecture.
Responsibilities
-
Design and implement query planning and optimization for distributed workloads.
-
Improve execution engine performance and memory stability using streaming computation.
-
Enhance distributed scheduler for resource utilization task scheduling and fault tolerance.
-
Develop integrations with modern data lake technologies such as Parquet Iceberg and Delta Lake.
-
Contribute to core architectural design of the distributed engine.
-
Troubleshoot system-level issues and implement scalable solutions.
-
Collaborate with the team on product design and infrastructure improvements.
-
Participate in early-stage engineering tasks including customer support and prototyping.
Core requirements
-
3 years of experience building distributed data systems or databases.
-
Strong fundamentals in systems programming using C Rust or C.
-
Experience with Linux-based development and deployment.
-
Familiarity with cloud technologies such as AWS S3.
-
Experience with query planning scheduling and fault-tolerant pipelines.
-
Knowledge of memory management and efficient data structures.
-
Experience integrating with modern data storage formats and lakes.
-
Track record of solving complex technical challenges autonomously.
-
Ability to work effectively in small high-autonomy teams.
-
Comfort working in a fast-iteration early-stage startup environment.
Nice to have
-
Experience with Hadoop Spark Dask Ray or BigQuery.
-
Knowledge of distributed systems networking and scheduling techniques.
-
Exposure to large-scale multimodal data pipelines.
-
Open-source contributions to data engineering or query engines.
-
Experience with performance profiling and optimization.
How to apply
Email with links to shipped work and a short note on what you owned. Company name shared after the intro.
About Us
Advantra-Upstart Crew is a search program inside Advantra Consulting. We partner with early stage and high growth startups to hire the top 2% in Tech and GTM. We run end to end searches from single role headhunts to full team build outs using domain experts and a vetted network to deliver tight shortlists. We stay close to founders and candidates so the relationship lasts beyond the first hire.
View more
View less