Job Title: Data Analyst-II
Client: DoorDash
Location: Remote
About the Role
DoorDash is seeking a highly motivated Data Analyst contractor to support our Search & Discovery teams. This role is ideal for early-career analysts who are proactive with LLMs comfortable working with data and eager to grow in a fast-paced high-accountability environment. The position includes hands-on evaluation work cross-functional collaboration and the opportunity to build foundational experience in applied large language model workflows.
Key Responsibilities
LLM Evaluations & Insight Generation
- Conduct end-to-end evaluations of large language models (LLMs).
- Develop evaluation rubrics and write prompts for LLM testing.
- Scrape and prepare datasets using internal tools.
- Collect annotate and maintain high-quality golden label datasets.
- Collaborate with engineering teams to calibrate model quality and performance.
- Run evaluations regularly and maintain dashboards and reporting.
- Analyze results to uncover insights that improve evaluation quality and processes.
Third-Party Vendor Coordination
- Serve as the primary point of contact between DoorDash and external vendor teams.
- Assign tasks manage deadlines and perform QA on vendor evaluator outputs.
- Provide clear instructions feedback and clarifications to ensure consistent quality.
Internal Team Support & Triage
- Act as the first point of contact for inbound questions related to evaluation tasks.
- Route questions to appropriate stakeholders and track open issues.
- Ensure timely follow-up and smooth communication across teams.
Required Skills & Experience
- Prior experience in data analysis or a similar analytical role.
- Demonstrated interest and proactive engagement with LLMs and modern AI tools.
- Strong attention to detail and the ability to work independently.
- Excellent written and verbal communication skills.
- Comfort operating in a fast-paced high-accountability environment.
Tools & Technical Skills
- Proficiency with Google Workspace especially Google Sheets.
- Basic SQL skills (ability to write simple queries and troubleshoot results).
- Familiarity with Google Drive and documentation best practices.
- Bonus: Experience with prompt engineering or LLM prompt design.
What Were Looking For
- A self-starter who is curious resourceful and motivated to learn.
- Someone who enjoys solving ambiguous or open-ended problems.
- A collaborative team player comfortable working with product engineering and vendor partners.
A candidate hungry to grow and potentially convert into a full-time position.
Job Title: Data Analyst-II Client: DoorDash Location: Remote About the Role DoorDash is seeking a highly motivated Data Analyst contractor to support our Search & Discovery teams. This role is ideal for early-career analysts who are proactive with LLMs comfortable working with data and eager t...
Job Title: Data Analyst-II
Client: DoorDash
Location: Remote
About the Role
DoorDash is seeking a highly motivated Data Analyst contractor to support our Search & Discovery teams. This role is ideal for early-career analysts who are proactive with LLMs comfortable working with data and eager to grow in a fast-paced high-accountability environment. The position includes hands-on evaluation work cross-functional collaboration and the opportunity to build foundational experience in applied large language model workflows.
Key Responsibilities
LLM Evaluations & Insight Generation
- Conduct end-to-end evaluations of large language models (LLMs).
- Develop evaluation rubrics and write prompts for LLM testing.
- Scrape and prepare datasets using internal tools.
- Collect annotate and maintain high-quality golden label datasets.
- Collaborate with engineering teams to calibrate model quality and performance.
- Run evaluations regularly and maintain dashboards and reporting.
- Analyze results to uncover insights that improve evaluation quality and processes.
Third-Party Vendor Coordination
- Serve as the primary point of contact between DoorDash and external vendor teams.
- Assign tasks manage deadlines and perform QA on vendor evaluator outputs.
- Provide clear instructions feedback and clarifications to ensure consistent quality.
Internal Team Support & Triage
- Act as the first point of contact for inbound questions related to evaluation tasks.
- Route questions to appropriate stakeholders and track open issues.
- Ensure timely follow-up and smooth communication across teams.
Required Skills & Experience
- Prior experience in data analysis or a similar analytical role.
- Demonstrated interest and proactive engagement with LLMs and modern AI tools.
- Strong attention to detail and the ability to work independently.
- Excellent written and verbal communication skills.
- Comfort operating in a fast-paced high-accountability environment.
Tools & Technical Skills
- Proficiency with Google Workspace especially Google Sheets.
- Basic SQL skills (ability to write simple queries and troubleshoot results).
- Familiarity with Google Drive and documentation best practices.
- Bonus: Experience with prompt engineering or LLM prompt design.
What Were Looking For
- A self-starter who is curious resourceful and motivated to learn.
- Someone who enjoys solving ambiguous or open-ended problems.
- A collaborative team player comfortable working with product engineering and vendor partners.
A candidate hungry to grow and potentially convert into a full-time position.
View more
View less