AI Agent Engineer
Charlotte, NC - USA
Job Summary
Here at Scout Motors were carrying forward the heritage of one of the most iconic American vehicles in history. A vehicle dating back to 1960. One that forged the path for future generations of rugged SUVs and trucks and will do so once again.
But Scout is more than just a brand its a legacy steeped in a culture of exploration caretaking and hard work.
The Scout brand is all about respect. Respect for the past and the future by taking an iconic American brand that hasnt been around for a while electrifying it digitizing it and loading it with American innovation. Respect for communities by creating a company that stands for its people and its customers. Respect for both work and play with vehicles that are equally at home at a camp site a job site or on a Tuesday commute. And respect for our customers by developing two powertrains that meet their requirements an all-electric powertrain as well as the Harvester range extender powertrain which includes a built-in gas-powered generator with an estimated 500 miles of combined range.
At Scout Motors we empower our talented inclusive and entrepreneurial teams to innovate. What makes a Scout employee Someone who is a visionary and a leader who seeks new paths and shares lessons learned. A knowledgeable doer who collaborates across the company to build better. A go-getter with unrivaled passion.
Join us at Scout Motors and be part of shaping the future of transportation. If youre ready to drive change and make history apply now!
Become part of an iconic brand that is set to revolutionize the electric pick-up truck & rugged SUV marketplace by achieving the following:
- Design develop and deploy AI agentson Databricks owning the full lifecycle from prototyping to production including versioning monitoring and maintenance of multiple agents running in parallel
- Build and maintain robust evaluation frameworksusing MLflows evaluation suite implementing and customizing judges (built-in guideline-based and custom) to systematically assess agent quality across correctness safety and business-specific criteria
- Drive continuous quality improvementof AI agents through structured offline evaluation pipelines (curated datasets benchmarks) and online production monitoring leveraging MLflow tracing to understand agent execution patterns
- Collect structure and incorporate human feedbackfrom diverse stakeholder groups (engineering quality business) into evaluation workflows and agent improvement cycles
- Collaborate with Data Engineers IT and R&Dto define data configurations and pipelines that feed AI agents with reliable high-quality inputs
- Leverage and combine multiple data sources(on-site off-site connected vehicle data) to build agents that identify trends anomalies and quality signals at scale
- Surface agent outputs and quality insightsto Quality business stakeholders through dashboards and visual reporting tools translating complex model behavior into understandable and actionable information
- Identify and close data quality gaps ensuring that data feeding into agents is clean consistent and continuously improving through well-defined requirements and automated checks
Location & Travel Expectations:
- This role may be based out of theScout Motors corporate headquarters in Charlotte NC.
- This role requires 4-5 days per week in the office with regular in-person meetings and events.
- Applicants should expect that the role will require the ability to convene with Scout colleagues in person and travel to participate in events on behalf of the companyfrom time to time.
We expect all Scout employees to have integrity curiosity resourcefulness and strive to exhibit a positive attitude as well as a growth mindset. Youll be comfortable with change and flexible in a fast-paced high-growth environment. Youll take a collaborative approach to achieve ambitious goals. Heres what else youll bring:
- Bachelors Degreein Computer Science Software Engineering Data Science Artificial Intelligence or a related field or equivalent practical experience
- 4 years of experienceinMLOps AI/ML engineering or data engineering in production environments
- Experience designing and executing evaluation workflowsfor non-deterministic AI systems including both offline (dataset-based) and online (production monitoring) evaluation strategies
- Solid understanding of LLM conceptsrelevant to agent quality: hallucination grounding retrieval quality tool use reliability safety
Technical Skills
- Hands-on experience developing and deploying AI agentson Databricks (Mosaic AI / Databricks Agent Framework) including multi-agent architectures and agent lifecycle management
- Deep expertise in MLflow: Tracking Model Registry Deployments Evaluation framework (built-in guideline & custom judges) and Tracing for agent observability
- Strong proficiency in Pythonand agent development frameworks (e.g. LangChain LlamaIndex AutoGen or similar)
- Proficiency inSQLand cloud-based storage systems (Delta Lake Unity Catalog or equivalent)
- Familiarity withCI/CD practicesfor ML systems (model versioning automated testing pipelines deployment gates)
- Experience withBI tools( PowerBI)(nice to have)
- Experience buildingRAG pipelinesincluding Vector Store integration (e.g. Databricks Vector Search) embedding models and chunking strategies(nice to have)
- Familiarity withStreamlit or Gradiofor lightweight internal tooling(nice to have)
- Knowledge ofresponsible AI / AI governanceframeworks(nice to have)
Soft Skills & Ways of Working
- Strongcommunication skills able to translate technical evaluation results into clear business-relevant insights for quality and engineering stakeholders
- Structured problem-solving mindsetwith the ability to define methodologies prioritize independently and drive assignments to completion with minimal supervision
- Comfortable operating inmultidisciplinary fast-moving environmentswith ambiguous requirements
- Growth mindset eager to stay current with the rapidly evolving AI agent and LLMOps landscape
The benefits of joining Scout include the chance to build products and a company from the ground up. This is a chance to create something new and lasting with an iconic brand at its foundation. In addition Scout provides competitive compensation and benefits to support your physical mental and financial wellbeing. Program specifics are detailed in company policies and employee benefit guides select highlights:
- Competitive insurance including:
- Medical dental vision and income protection plans
- 401(k) program with:
- An employer match and immediate vesting
- Generous Paid Time Off including:
- 20 days planned PTO as accrued
- 40 hours of unplanned PTO and 14 company or floating holidays annually
- Up to 16 weeks of paid parental leave for biological and adoptive parents of all genders
- Paid leave for circumstances related to bereavement jury duty voting time or military leave
This is a full-time exempt position eligible to receive a base salary and to participate in an annual performance bonus program. Final salary offered will be determined based on factors including but not limited to the candidates skills and experience. The annual performance bonus program is preset and not candidate dependent.
Initial Base Salary Range: $95000.00 - $120000.00
Internal Leveling Code: IC9
Notice to applicants:
- To be considered for career opportunities at Scout Motors applicants must be 18 years of age or older.
- Residing in San Francisco:Pursuant to the San Francisco Fair Chance Ordinance Scout Motors will consider for employment qualified applicants with arrest and conviction records.
- Residing inLos Angeles:Scout Motors will consider for employment qualified applicants with criminal histories in a manner consistent with the Los Angeles Fair Chance Initiative for Hiring Ordinance.
- Residing inNew York City:This role is not eligible for remote work in New York City.
Equal Opportunity
Scout Motors is committed to employing a diverse workforce and is proud to be an Equal Opportunity Employer.Qualified applicants will receive consideration without regard to race color religion sex national origin age sexual orientation gender identity gender expression veteran status disability pregnancyor anyother characteristicsprotected by law.Scout Motors is committed to compliance with allapplicablefairemploymentpractice laws.If you require reasonable accommodation to complete a job application pre-employment testing or a job interview or to otherwise participate in the hiring process please contact
Required Experience:
Unclear Seniority
About Company
We're designing, engineering, and building the next generation of electric trucks and rugged SUVs for the doers, makers, and explorers. The new Scout® Traveler™ and Terra™ models are here, born from the original legend, retooled for a new era.