Product Manager, AI Agent & Harness
Job Summary
About the Role
Were building the core Agent capabilities and Skill ecosystem for Binance Agentic. Were looking for a Product Manager with a strong AI and Web3 background to drive Agent product design the Harness evaluation framework end-to-end task validation and continuous iteration.
Youll need to understand both the capability boundaries of AI Agents and the nuances of Web3 / exchange business scenarios and proactively rally engineering business operations and partner teams to ship Agent-powered products.
- Agent Product Design: Own the design of Agent-related capabilities across Binance Agentic including task flows user interaction patterns capability boundaries failure fallbacks and result feedback loops.
- Harness & Evaluation: Build and maintain the Harness framework design test scenarios define evaluation criteria curate task sets analyze performance and drive actionable iteration recommendations.
- Cross-functional Delivery: Partner closely with Tech Owners frontend engineers and Skill design leads to break down business requirements into shippable testable production-ready product specs.
- Web3 Use Case Discovery: Map high-value deployable Agent use cases across Web3 Wallet Account Payment Trading and other Binance business lines.
- Industry Tracking: Stay current on AI Agent MCP tool-calling prompt engineering and automated evaluation developments and translate them into executable product initiatives for the team.
- Metrics & Quality: Define and track Agent performance metrics including task success rate user satisfaction error rate response quality and tool-calling accuracy.
- Continuous Improvement: Proactively identify issues from real-world Agent usage and drive improvements across product engineering and operations.
- Experience in AI products Agent products AIGC applications automation tools or developer tooling.
- Background in Web3 exchanges wallets payments on-chain transactions DeFi or crypto assets.
Hands-on understanding of how AI Agents work tool-calling task planning context management and evaluation frameworks.
Strong ownership and learning agility; able to define problems decompose workstreams and drive execution in ambiguous environments. - Solid product fundamentals clear PRDs flow diagrams test cases acceptance criteria and iteration plans.
- Excellent cross-team collaboration and communication skills across engineering design operations and business stakeholders.
- Experience with exchanges Web3 wallets on-chain trading payments or fintech products.
- Experience with AI Agent Harness Eval Benchmarking automated testing platforms or prompt evaluation.
- Familiarity with MCP Function Calling RAG multi-Agent orchestration or workflow automation.
- Knowledge of the Binance ecosystem or mainstream Web3 user scenarios.
- Strong English reading and writing skills with the ability to keep up with global AI / Web3 product and technical materials.
Required Experience:
IC
About Company
Binance is a blockchain ecosystem comprised of Exchange, Labs, Launchpad, Info, Academy, Trust Wallet, and Blockchain Charity Foundation (BCF). Binance Exchange is one of the fastest and most popular cryptocurrency exchange platforms in the world, capable of processing over 1.4 millio ... View more