Data Scientist - LLM Pipeline focus
Data Scientist - LLM Pipeline focus
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Gorgias is the conversational AI platform for ecommerce that drives sales and resolves support inquiries. Trusted by over 15000 ecommerce brands Gorgias supports growing independent shops to globally recognizable brands.
Built for Shopify and powered by advanced ecommerce integrations Gorgiass conversational AI understands your brand tools policies and customers to drive personalized 1to1 conversations from editing orders and initiating returns to making product recommendations. Gorgias where every customer interaction feels personal support becomes sales and conversations shape success.
About the Team
Youll be joining our dynamic Automate team a crossfunctional group dedicated to revolutionizing customer support in the ecommerce space. Our mission is to seamlessly automate interactions between merchants and shoppers creating effortless experiences for both sides. The Automate team consists of talented Software Engineers Machine Learning Engineers Product Managers and Designers all working collaboratively to push the boundaries of AIdriven customer support. Our primary focus is developing and refining an innovative AI Agent capable of automatically answering customer requests with accuracy and efficiency.
What you will do
Role Overview: As a Data Scientist focused on LLM at Gorgias you will play a crucial role in developing refining and enabling our AI Agent designed to automatically address and resolve shopper requests for our merchant clients. Beyond prompt engineering youll be instrumental in scaling the AI Agents capabilities by developing the right LLM strategies to enable our services. You will work closely with our ML Engineers Product Managers and Software Engineers to create optimize and implement solutions that enhance the efficiency accuracy and functionality of our AIdriven customer support solutions.
Key Responsibilities:
Engineering: Think as an Engineer to develop systems that can scale and allow for fast reliable and trusted iterations. Apply scientific and engineering principles to prompt design LLM evaluation processes and technical integrations with ecommerce platforms and tools.
LLM pipelines: Design develop and refine prompts to guide the AI Agent in generating accurate and contextually relevant responses to shopper inquiries. Identify patterns and drive improvements in both prompt design and overall AI Agent performance.
Data Analysis: Analyze largescale data from LLM evaluations to derive insights Identify heuristics to sample improvement and nonregression dataset. Build reliable estimators for ongoing AB tests analyse optimal experiment stoping time and mitigate cross AB test contamination.
Testing & Evaluation: Conduct extensive testing of prompts to ensure they perform well in diverse scenarios. Design and implement robust methodologies for assessing LLM performance at scale. Evaluate prompts rationally via systematic testing protocols(offline train/test splits online with AB tests).
Collaboration: Work product managers to understand requirements incorporate feedback into prompt design and improvement and integrate findings from largescale evaluations into the AI Agents development. Work with ML engineers to build and finetune inhouse LLMs that outperform state of the art.
Documentation: Maintain comprehensive documentation for prompt design usage best practices and evaluation methodologies to ensure clarity and consistency across the team.
Continuous Improvement: Stay uptodate with advancements in AI natural language processing (NLP) and prompt engineering techniques. Incorporate cuttingedge methodologies into prompt engineering and LLM evaluation processes.
User Experience: Analyze and interpret user interactions and largescale performance data to identify areas for enhancement and ensure the AI Agent provides a seamless and positive experience for shoppers.
Performance Metrics: Develop and refine metrics for evaluating prompt and LLM performance at scale ensuring that improvements can be quantifiably measured and validated.
Technical Enablement: Develop and scale connections between AI Agents and the ecommerce ecosystem allowing the AI to perform a wide range of actions. Collaborate with Software Engineers to identify integration opportunities and implement scalable solutions that expand the AI Agents capabilities across various platforms and tools used in ecommerce.
Who you are
Experience: 2 years of experience in statistics prompt engineering and LLM pipelines.
Technical Skills: Proficiency in programming languages such as Python/SQL largescale data analysis and prompt engineering tools and frameworks.
Analytical Skills: Strong problemsolving abilities with a keen eye for detail and an understanding of how to work with AI to create a system with business impact.
Communication: Excellent written and verbal communication skills with the ability to articulate complex concepts to both technical and nontechnical stakeholders.
Education: Masters degree in STEM science technology engineering and mathematics) or a related field.
Benefits and Perks
5week vacation plus 2 weeks RTT (We follow each countrys appropriate PTO Laws)
Paid sick leave
Paid parental leave 16 weeks)
MacBook Pro
Personal credit card to buy lunches (we use Swile
We provide private health insurance (we use Alan
Get up to 700 to set up your workstation at home (working from home should feel breezy)
Get up to 2000 of learning material and wellness support per year! This includes 1500 for learning material (such as books courses and individual coaching sessions) directly linked to your job scope as well as a 500 wellness budget. Take advantage of these resources to grow in your role and prioritize your personal development and wellness.
Every quarter we organize an online companywide summit to discuss where were going and strengthen social bonds. Once per year we organize offsite team retreats and company retreats!
Diversity & Inclusion at Gorgias
We celebrate diversity and are committed to creating an inclusive environment for all employees. We welcome applicants of all backgrounds experiences and perspectives. At Gorgias we believe that diverse teams drive innovation and better decisionmaking. We do not discriminate based on race color religion gender identity sexual orientation disability age or any other protected status.
If you need accommodations to participate in the application or interview process perform essential job functions or access other employment benefits please contact us at . Lets grow together!
Employment Type
Full-Time
