Papers · arXiv 2508.16279
AgentScope 1.0: A Developer-Centric Framework for Building Agentic Applications
Summary in three lines
- 🎯 LLM agents require flexible, safe, and efficient tool interactions, structured coordination, and production-grade engineering rather than toy prototypes.
- 🔧 Introduces AgentScope 1.0: modular abstractions (Msg, Model, Memory, Tool), ReAct loops supporting real-time steering and dynamic tool provisioning, built-in specialized agents, and an execution runtime with isolated sandboxes.
- 📈 Provides an industrial-grade open-source system supporting stateful/stateless MCP clients, distributed evaluation via Ray, and native Agent-to-Agent (A2A) protocol deployment.
Abstract
Driven by rapid advancements of Large Language Models (LLMs), agents are empowered to combine intrinsic knowledge with dynamic tool use, greatly enhancing their capacity to address real-world tasks. In line with such an evolution, AgentScope introduces major improvements in a new version (1.0), towards comprehensively supporting flexible and efficient tool-based agent-environment interactions for building agentic applications. Specifically, we abstract foundational components essential for agentic applications and provide unified interfaces and extensible modules, enabling developers to easily leverage the latest progress, such as new models and MCPs. Furthermore, we ground agent behaviors in the ReAct paradigm and offer advanced agent-level infrastructure based on a systematic asynchronous design, which enriches both human-agent and agent-agent interaction patterns while improving execution efficiency. Building on this foundation, we integrate several built-in agents tailored to specific practical scenarios. AgentScope also includes robust engineering support for developer-friendly experiences. We provide a scalable evaluation module with a visual studio interface, making the development of long-trajectory agentic applications more manageable and easier to trace. In addition, AgentScope offers a runtime sandbox to ensure safe agent execution and facilitates rapid deployment in production environments. With these enhancements, AgentScope provides a practical foundation for building scalable, adaptive, and effective agentic applications.
Reading guide
Problem and motivation
While modern Large Language Models (LLMs) excel at reasoning and natural language generation, real-world utility requires grounded interactions with the external environment through APIs, databases, and dynamic tools. Early agent architectures often rely on rigid sequential tool execution, lack robust asynchronous handling, struggle with tool overabundance ("paradox of choice"), and lack developer-centric infrastructure for debugging long trajectories, distributed evaluation, and secure execution. AgentScope 1.0 addresses these gaps by transitioning from intrinsic reasoning frameworks toward an extensible, developer-centric agentic framework centered on tool perception and environment interaction.
Key ideas
AgentScope 1.0 is organized into three core pillars:
- Foundational Components: Decoupled abstractions including
Msg(multimodal blocks, tool calls, and thinking traces), unifiedModelinterfaces with asynchronous streaming and OpenTelemetry instrumentation, hierarchicalMemory(in-memory short-term buffers and developer/agent-controlled long-term memory via Mem0), and an extensibleToolkit. - Agent-level Infrastructure: Centered on the ReAct (
Reasoning + Acting) paradigm, supporting non-blocking parallel tool calls, user interruptions (real-time steering), dynamic tool provisioning (group activation/deactivation), and hierarchical state persistence viaStateModule. - Developer-Friendly Experience: Integrated evaluation suites (supporting sequential
GeneralEvaluatorand distributedRayEvaluator), a visualStudiowith bootstrap-derived confidence intervals and trajectory comparison, a built-in copilot (Friday), and an isolated executionRuntimewith sandboxing.
Method (with the key equations)
The system structures execution around standardized abstractions:
- Message Architecture: Information packets are unified as
Msgobjects containingname,role,content(a list of typed blocks likeTextBlock,ToolUseBlock,ThinkingBlock), andmetadata. Provider-specific formatters (ChatFormatterandMultiAgentFormatter) convert these blocks into provider-specific schemas. - Tool Execution and Grouping: Tools are registered in
Toolkitwith automated JSON schema extraction from docstrings. To mitigate search-space degradation from excessive tools, tools are managed into groups . Usingupdate_tool_groupsor the agent-invokedreset_equipped_tools(group_names), the active tool subset is dynamically adapted per workflow step: - MCP Integration: Distinguishes between Stateful Clients (persistent session lifecycle for state-critical tools like browser sessions) and Stateless Clients (ephemeral connection per call to minimize overhead).
- Asynchronous Execution & Steering: Asynchronous agent execution uses non-blocking generators. If an asyncio cancellation signal occurs, the ReAct loop interrupts gracefully, yields partial execution states, and appends interruption tokens to memory as observable events.
- Multi-Agent Coordination: Supports "Agent as a Tool" invocation patterns alongside conversational orchestration via
Pipelinestructures (sequential, branching, and looping) andMsgHubbroadcasting.
Results (with the most important numbers)
The paper provides concrete framework implementations and architectural validations across three built-in specialized agents:
- Deep Research Agent: Implements query expansion (tree-structured decomposition), multi-source web search via Tavily MCP, low-level reflection (tool/parameter corrections), and high-level reflection (re-planning subtasks).
- Browser-use Agent: Employs Playwright MCP via a stateful standard I/O client (
StdIOStatefulClient), featuring visual HTML processing, multi-tab coordination, and chunk-wise webpage segmentation for long pages. - Meta Planner Agent: Orchestrates complex workflows through
RoadmapManagerandWorkerManager, supporting dual-mode switching between basic ReAct for simple tasks and roadmap-driven multi-agent execution for complex tasks. - Engineering Infrastructure: Native integration of FastAPI deployment, OpenTelemetry tracing with Arize-Phoenix and Langfuse compatibility, and Ray-based parallel distributed task evaluation with persistent checkpoints.
Limitations and open questions
- The paper presents a system architecture report rather than standard benchmark accuracy comparisons (e.g., benchmark numbers like SWE-bench or GAIA are omitted from the main text).
- Dynamic tool provisioning and planning overhead in the Meta Planner require sufficient context-window capacity and strong underlying LLM tool-calling fidelity.
- Multi-agent coordination overhead and sandbox isolation costs under large-scale concurrency are not benchmarked with raw throughput numbers in this paper.
Key terms
- AgentScope 1.0
- A developer-centric framework designed for building scalable, adaptive, and tool-integrated LLM-based agent applications.
- ReAct Paradigm
- An agent architecture combining reasoning and acting in a closed loop to decompose queries, execute tool actions, observe results, and refine plans.
- Model Context Protocol (MCP)
- An open protocol standardizing how LLMs interface with external services and data sources, supported in AgentScope via stateful and stateless clients.
- Toolkit
- A core AgentScope module providing tool registration, automated JSON schema generation, group-wise tool management, and unified asynchronous generator execution.
- Real-time Steering
- The mechanism allowing users or systems to interrupt, redirect, or guide an ongoing agent ReAct loop via non-blocking cancellation and interruption event logging.
- Dynamic Tool Provisioning
- A feature enabling agents to autonomously activate or deactivate specific subsets of tools during runtime to reduce cognitive load and conserve context.
- StateModule
- A base class enabling automatic nested state serialization and restoration via state_dict and load_state_dict methods for agents and memory.
- MsgHub
- A centralized broadcast mechanism in AgentScope that facilitates multi-agent group conversations by disseminating new messages across all participants.
Questions
What is the difference between stateful and stateless MCP clients in AgentScope?
A stateful client maintains a persistent session (e.g., maintaining browser cookies and context across actions), whereas a stateless client creates an ephemeral connection per tool call and disconnects immediately to minimize resource overhead.
How does AgentScope handle long context limitations during browser automation?
The Browser-use Agent segments long webpages into smaller chunks, observes content chunk by chunk, and manages cross-chunk context to stay within LLM context limitations.
How does the evaluation system support both local debugging and large-scale testing?
AgentScope implements GeneralEvaluator for sequential, step-by-step local process debugging, and RayEvaluator for parallel, distributed execution across multi-worker clusters using the Ray framework.
How does AgentScope prevent agent confusion when hundreds of tools are available?
It uses group-wise tool management, allowing developers or agents to dynamically activate and deactivate logical tool groups (such as 'browser tools'), limiting the active search space to what is relevant for the current subtask.
The overview on this page was written by AI from the paper and may contain mistakes. Read the paper for the details.