yao/agent/context/JSAPI.md
Max 2e19ccc914 Enhance JSAPI documentation for hooks and context management
- Updated the `Create` and `Next` hook documentation to clarify their execution flow and usage, including new optional parameters for customization.
- Added detailed examples demonstrating the hooks' functionality, including error handling and tool processing.
- Introduced new notes on resource management, emphasizing the correct usage of `ctx.Release()` for manually created contexts.
- Enhanced overall clarity and guidance for developers on the agent execution lifecycle and context API features.
2025-12-09 20:12:46 +08:00

2088 lines
56 KiB
Markdown

# Context JavaScript API Documentation
## Overview
The Context JavaScript API provides a comprehensive interface for interacting with the Yao Agent system from JavaScript/TypeScript hooks (Create, Next). The Context object exposes agent state, configuration, messaging capabilities, trace operations, and MCP (Model Context Protocol) integrations.
## Context Object
The Context object is automatically passed to hook functions and provides access to the agent's execution environment.
### Basic Properties
```typescript
interface Context {
// Identifiers
chat_id: string; // Current chat session ID
assistant_id: string; // Assistant identifier
// Configuration
locale: string; // User locale (e.g., "en", "zh-cn")
theme: string; // UI theme preference
accept: string; // Output format ("standard", "cui-web", "cui-native", etc.)
route: string; // Request route path
referer: string; // Request referer
// Client Information
client: {
type: string; // Client type
user_agent: string; // User agent string
ip: string; // Client IP address
};
// Dynamic Data
metadata: Record<string, any>; // Custom metadata (empty object if not set)
authorized: Record<string, any>; // Authorization data (empty object if not set)
// Objects
space: Space; // Shared data space for passing data between requests
trace: Trace; // Trace object for debugging and monitoring
mcp: MCP; // MCP object for external tool/resource access
}
```
## Methods
### Send Messages
The Context provides several methods for sending messages to the client:
| Method | Description | Auto `message_end` | Updatable |
| ------------------------------------ | --------------------------- | ------------------ | --------- |
| `Send(message, block_id?)` | Send a complete message | ✅ Yes | ❌ No |
| `SendStream(message, block_id?)` | Start a streaming message | ❌ No | ✅ Yes |
| `Append(message_id, content, path?)` | Append content to a message | - | - |
| `Replace(message_id, message)` | Replace message content | - | - |
| `Merge(message_id, data, path?)` | Merge data into message | - | - |
| `Set(message_id, data, path)` | Set a field in message | - | - |
| `End(message_id, final_content?)` | Finalize streaming message | ✅ Yes | - |
| `EndBlock(block_id)` | End a message block | - | - |
| `MessageID()` | Generate unique message ID | - | - |
| `BlockID()` | Generate unique block ID | - | - |
| `ThreadID()` | Generate unique thread ID | - | - |
> **Note:** `Append`, `Replace`, `Merge`, and `Set` only work with messages started via `SendStream()`. Messages sent via `Send()` are immediately finalized and cannot be updated.
#### `ctx.Send(message, block_id?): string`
Sends a message to the client and automatically flushes the output.
**Parameters:**
- `message`: Message object or string
- `block_id`: String (optional) - Block ID to send this message in. If omitted, no block ID is assigned.
**Returns:**
- `string`: The message ID (auto-generated if not provided in the message object)
**Message Object Structure:**
```typescript
interface Message {
// Required
type: string; // Message type: "text", "tool", "image", etc.
// Common fields
props?: Record<string, any>; // Message properties (passed to frontend component)
message_id?: string; // Message ID (auto-generated if omitted)
block_id?: string; // Block ID (NOT auto-generated, has priority over block_id parameter)
thread_id?: string; // Thread ID (auto-set from Stack for nested agents)
// Metadata (optional)
metadata?: Record<string, any>; // Custom metadata
}
```
**Examples:**
```javascript
// Send text message (object format) and capture message ID
const message_id = ctx.Send({
type: "text",
props: { content: "Hello, World!" },
});
console.log("Sent message:", message_id);
// Send text message (shorthand) - no block ID by default
const text_id = ctx.Send("Hello, World!");
// Send multiple messages in the same block (same bubble/card in UI)
const block_id = ctx.BlockID(); // Generate block ID first
const msg1 = ctx.Send("Step 1: Analyzing...", block_id);
const msg2 = ctx.Send("Step 2: Processing...", block_id);
const msg3 = ctx.Send("Step 3: Complete!", block_id);
// Specify block_id in message object (highest priority)
const msg4 = ctx.Send({
type: "text",
props: { content: "In specific block" },
block_id: "B2", // This takes priority over second parameter
});
// Send tool message with custom IDs
const tool_id = ctx.Send({
type: "tool",
message_id: "custom-tool-msg-1",
block_id: "B_tools",
props: {
name: "calculator",
result: { sum: 42 },
},
});
// Send image message
const image_id = ctx.Send({
type: "image",
props: {
url: "https://example.com/image.png",
alt: "Example Image",
},
});
```
**Block Management:**
```javascript
// Scenario 1: Simple message (most common)
function Next(ctx, payload) {
const { completion } = payload;
// Send a complete message
ctx.Send({
type: "text",
props: { content: completion.content },
});
}
// Scenario 2: Loading indicator before slow operation
function Next(ctx, payload) {
// Start a streaming message for loading
const loading_id = ctx.SendStream({
type: "loading",
props: { message: "Fetching data..." },
});
// Do slow operation (e.g., external API call)
const result = fetchExternalData();
// Replace loading with result
ctx.Replace(loading_id, {
type: "text",
props: { content: result },
});
ctx.End(loading_id);
}
// Scenario 3: Grouping messages in one block (special case)
function Create(ctx, messages) {
// Generate a block ID for grouping
const block_id = ctx.BlockID(); // "B1"
ctx.Send("# Analysis Results", block_id);
ctx.Send("- Finding 1: ...", block_id);
ctx.Send("- Finding 2: ...", block_id);
ctx.Send("- Finding 3: ...", block_id);
// All messages appear in the same card/bubble in the UI
}
// Scenario 4: LLM response + follow-up card in same block
function Next(ctx, payload) {
const { completion } = payload;
const block_id = ctx.BlockID();
// LLM response
ctx.Send({
type: "text",
props: { content: completion.content },
block_id: block_id,
});
// Action card (grouped with LLM response)
ctx.Send({
type: "card",
props: {
title: "Related Actions",
actions: ["action1", "action2"],
},
block_id: block_id,
});
}
```
**Notes:**
- **Message ID** is automatically generated if not provided
- **Block ID** is NOT auto-generated by default (remains empty unless manually specified)
- Most messages don't need a Block ID (each message is independent)
- Only specify Block ID in special cases (e.g., grouping LLM output with a follow-up card)
- **Block ID priority**: message.block_id > block_id parameter > empty
- **Thread ID** is automatically set from Stack for non-root calls (nested agents)
- Returns the message ID for reference in subsequent operations
- Output is automatically flushed after sending
- Throws exception on failure
- `Send()` automatically sends `message_end` event - the message is complete and cannot be updated
- **For updatable messages**, use `ctx.SendStream()` instead (see below)
#### `ctx.SendStream(message, block_id?): string`
Sends a streaming message that can be appended to later. Unlike `Send()`, this does NOT automatically send `message_end` event. Use `ctx.Append()` to add content, then `ctx.End()` to finalize.
**Parameters:**
- `message`: Message object or string
- `block_id`: String (optional) - Block ID to send this message in
**Returns:**
- `string`: The message ID (for use with `Append` and `End`)
**Examples:**
```javascript
// Start a streaming message
const msg_id = ctx.SendStream({
type: "text",
props: { content: "# Title\n\n" },
});
// Append content in chunks (simulating streaming)
ctx.Append(msg_id, "First paragraph. ");
ctx.Append(msg_id, "Second sentence. ");
ctx.Append(msg_id, "Third sentence.\n\n");
// Finalize the message (sends message_end event)
ctx.End(msg_id);
```
**String Shorthand:**
```javascript
// SendStream with string shorthand
const msg_id = ctx.SendStream("Starting analysis...");
ctx.Append(msg_id, " processing...");
ctx.Append(msg_id, " done!");
ctx.End(msg_id);
// Final content: "Starting analysis... processing... done!"
```
**With Block ID:**
```javascript
const block_id = ctx.BlockID();
const msg_id = ctx.SendStream("Step 1: ", block_id);
ctx.Append(msg_id, "Analyzing data...");
ctx.End(msg_id);
```
**Notes:**
- Returns the message ID immediately for use with `Append` and `End`
- Sends `message_start` event but NOT `message_end` (unlike `Send`)
- Must call `ctx.End(msg_id)` to finalize the message
- Content appended via `ctx.Append()` is accumulated for storage
- Ideal for streaming text output where you control the timing
#### `ctx.End(message_id, final_content?): string`
Finalizes a streaming message started with `SendStream()`. Sends `message_end` event with the complete accumulated content.
**Parameters:**
- `message_id`: String - The message ID returned by `SendStream()`
- `final_content`: String (optional) - Final content to append before ending
**Returns:**
- `string`: The message ID
**Examples:**
```javascript
// Basic usage
const msg_id = ctx.SendStream("Hello");
ctx.Append(msg_id, " World");
ctx.End(msg_id);
// Final: "Hello World"
// End with final content
const msg_id2 = ctx.SendStream("Processing");
ctx.Append(msg_id2, "...");
ctx.End(msg_id2, " Complete!");
// Final: "Processing... Complete!"
```
**Notes:**
- Must be called after `SendStream()` to send `message_end` event
- Optional `final_content` is appended before sending `message_end`
- The complete accumulated content is included in `message_end.extra.content`
- Throws exception if `message_id` is not a string
**Send vs SendStream Comparison:**
| Feature | `Send()` | `SendStream()` |
| --------------------- | ----------------- | ------------------- |
| `message_start` event | ✅ Auto | ✅ Auto |
| `message_end` event | ✅ Auto | ❌ Manual (`End()`) |
| Use case | Complete messages | Streaming output |
| Content accumulation | N/A | Via `Append()` |
| Storage | Immediate | On `End()` |
**Streaming Workflow Example:**
```javascript
function Create(ctx, messages) {
// Start streaming output
const msg_id = ctx.SendStream({
type: "text",
props: { content: "# Analysis Report\n\n" },
});
// Simulate streaming chunks
ctx.Append(msg_id, "## Section 1\n");
ctx.Append(msg_id, "Processing data...\n\n");
// Do some work
const result = analyzeData();
ctx.Append(msg_id, "## Section 2\n");
ctx.Append(msg_id, `Found ${result.count} items.\n\n`);
// Finalize with conclusion
ctx.End(msg_id, "## Conclusion\nAnalysis complete.");
return { messages };
}
```
#### `ctx.Replace(message_id, message): string`
Replaces the content of a streaming message. **Only works with messages started via `SendStream()`**.
**Parameters:**
- `message_id`: String - The ID of the streaming message (returned by `SendStream()`)
- `message`: Message object or string - The new message content
**Returns:**
- `string`: The message ID (same as the provided message_id)
**Examples:**
```javascript
// Start a streaming message
const msg_id = ctx.SendStream({
type: "loading",
props: { message: "Loading..." },
});
// Replace with new content
ctx.Replace(msg_id, {
type: "text",
props: { content: "Data loaded successfully!" },
});
// Finalize the message
ctx.End(msg_id);
```
**Use Cases:**
```javascript
// Progress updates with replacement
function Next(ctx, payload) {
const msg_id = ctx.SendStream("Step 1/3: Starting...");
// ... do work ...
ctx.Replace(msg_id, "Step 2/3: Processing...");
// ... do more work ...
ctx.Replace(msg_id, "Step 3/3: Finalizing...");
// ... finish ...
ctx.Replace(msg_id, "Complete! ✓");
ctx.End(msg_id);
}
// Loading to result transition
function Next(ctx, payload) {
const msg_id = ctx.SendStream({
type: "loading",
props: { message: "Fetching results..." },
});
const results = fetchData();
ctx.Replace(msg_id, {
type: "text",
props: { content: `Found ${results.length} results` },
});
ctx.End(msg_id);
}
```
**Notes:**
- **Only works with `SendStream()` messages** - `Send()` messages cannot be replaced
- Replaces the entire message content, not just specific fields
- Must call `ctx.End(msg_id)` after all updates to finalize the message
- Output is automatically flushed after replacing
- Throws exception on failure
#### `ctx.Append(message_id, content, path?): string`
Appends content to a streaming message. **Only works with messages started via `SendStream()`**.
**Parameters:**
- `message_id`: String - The ID of the streaming message (returned by `SendStream()`)
- `content`: Message object or string - The content to append
- `path`: String (optional) - The delta path to append to (e.g., "props.content", "props.data")
**Returns:**
- `string`: The message ID (same as the provided message_id)
**Examples:**
```javascript
// Start a streaming message
const msg_id = ctx.SendStream("Starting");
// Append more text (default path)
ctx.Append(msg_id, "... processing");
ctx.Append(msg_id, "... done!");
// Finalize the message
ctx.End(msg_id);
// Final content: "Starting... processing... done!"
// Append to specific path
const data_id = ctx.SendStream({
type: "data",
props: {
content: "Item 1\n",
status: "loading",
},
});
ctx.Append(data_id, "Item 2\n", "props.content");
ctx.Append(data_id, "Item 3\n", "props.content");
ctx.End(data_id);
// Final: props.content = "Item 1\nItem 2\nItem 3\n"
```
**Use Cases:**
```javascript
// Streaming text output (simulating LLM-like output)
function Create(ctx, messages) {
const msg_id = ctx.SendStream("");
ctx.Append(msg_id, "The");
ctx.Append(msg_id, " quick");
ctx.Append(msg_id, " brown");
ctx.Append(msg_id, " fox");
ctx.End(msg_id);
// Final: "The quick brown fox"
return { messages };
}
// Progress logs
function Next(ctx, payload) {
const log_id = ctx.SendStream({
type: "log",
props: { content: "Starting process\n" },
});
// Step 1
doStep1();
ctx.Append(log_id, "Step 1 complete\n", "props.content");
// Step 2
doStep2();
ctx.Append(log_id, "Step 2 complete\n", "props.content");
// Finish
ctx.Append(log_id, "All done!\n", "props.content");
ctx.End(log_id);
}
```
**Notes:**
- **Only works with `SendStream()` messages** - `Send()` messages cannot be appended to
- Uses delta append operation (adds to existing content, doesn't replace)
- If `path` is omitted, appends to the default content location (`props.content`)
- Must call `ctx.End(msg_id)` after all appends to finalize the message
- Output is automatically flushed after appending
- Throws exception on failure
- block_id and ThreadID are inherited from the original message
#### `ctx.Merge(message_id, data, path?): string`
Merges data into a streaming message object. **Only works with messages started via `SendStream()`**.
**Parameters:**
- `message_id`: String - The ID of the streaming message (returned by `SendStream()`)
- `data`: Object - The data to merge (should be an object)
- `path`: String (optional) - The delta path to merge into (e.g., "props", "props.metadata")
**Returns:**
- `string`: The message ID (same as the provided message_id)
**Examples:**
```javascript
// Start a streaming message with object data
const msg_id = ctx.SendStream({
type: "status",
props: {
status: "running",
progress: 0,
started: true,
},
});
// Merge updates into props (adds/updates fields, keeps others unchanged)
ctx.Merge(msg_id, { progress: 50 }, "props");
// Result: props = { status: "running", progress: 50, started: true }
ctx.Merge(msg_id, { progress: 100, status: "completed" }, "props");
// Result: props = { status: "completed", progress: 100, started: true }
// Finalize the message
ctx.End(msg_id);
```
**Use Cases:**
```javascript
// Updating task progress
function Next(ctx, payload) {
const task_id = ctx.SendStream({
type: "task",
props: {
name: "Data Processing",
status: "pending",
progress: 0,
},
});
ctx.Merge(task_id, { status: "running" }, "props");
doStep1();
ctx.Merge(task_id, { progress: 25 }, "props");
doStep2();
ctx.Merge(task_id, { progress: 50 }, "props");
doStep3();
ctx.Merge(task_id, { progress: 100, status: "completed" }, "props");
ctx.End(task_id);
}
// Building metadata incrementally
function Create(ctx, messages) {
const data_id = ctx.SendStream({
type: "data",
props: { content: "Result data" },
});
ctx.Merge(data_id, { metadata: { source: "api" } }, "props");
ctx.Merge(data_id, { metadata: { timestamp: Date.now() } }, "props");
// metadata fields are merged together
ctx.End(data_id);
return { messages };
}
```
**Notes:**
- **Only works with `SendStream()` messages** - `Send()` messages cannot be merged into
- Uses delta merge operation (merges objects, doesn't replace)
- Only works with object data (for merging key-value pairs)
- Existing fields not in the merge data remain unchanged
- If `path` is omitted, merges into the default object location
- Must call `ctx.End(msg_id)` after all merges to finalize the message
- Output is automatically flushed after merging
- Throws exception on failure
- block_id and ThreadID are inherited from the original message
#### `ctx.Set(message_id, data, path): string`
Sets a new field or value in a streaming message. **Only works with messages started via `SendStream()`**.
**Parameters:**
- `message_id`: String - The ID of the streaming message (returned by `SendStream()`)
- `data`: Any - The value to set
- `path`: String (required) - The delta path where to set the value (e.g., "props.newField", "props.metadata.key")
**Returns:**
- `string`: The message ID (same as the provided message_id)
**Examples:**
```javascript
// Start a streaming message
const msg_id = ctx.SendStream({
type: "result",
props: {
content: "Initial content",
},
});
// Set a new field
ctx.Set(msg_id, "success", "props.status");
// Result: props.status = "success"
// Set a nested object
ctx.Set(msg_id, { duration: 1500, cached: true }, "props.metadata");
// Result: props.metadata = { duration: 1500, cached: true }
// Finalize the message
ctx.End(msg_id);
```
**Use Cases:**
```javascript
// Adding computed metadata after initial send
function Next(ctx, payload) {
const result_id = ctx.SendStream({
type: "search_result",
props: { results: search_results },
});
ctx.Set(result_id, search_results.length, "props.count");
ctx.Set(result_id, Date.now(), "props.timestamp");
ctx.Set(result_id, "relevance", "props.sort_by");
ctx.End(result_id);
}
// Conditionally adding fields
function Create(ctx, messages) {
const msg_id = ctx.SendStream({
type: "operation",
props: { name: "Process Data" },
});
try {
const result = processData();
ctx.Set(msg_id, "success", "props.status");
ctx.Set(msg_id, result, "props.data");
} catch (e) {
ctx.Set(msg_id, e.message, "props.error");
ctx.Set(msg_id, "error", "props.status");
}
ctx.End(msg_id);
return { messages };
}
```
**Notes:**
- **Only works with `SendStream()` messages** - `Send()` messages cannot be modified
- Uses delta set operation (creates/sets new fields)
- The `path` parameter is **required** (must specify where to set the value)
- Creates the path if it doesn't exist
- Use for adding new fields or completely replacing a field's value
- For updating existing object fields, consider using `Merge` instead
- Must call `ctx.End(msg_id)` after all sets to finalize the message
- Output is automatically flushed after setting
- Throws exception on failure
- block_id and ThreadID are inherited from the original message
### ID Generators
These methods generate unique IDs for manual message management. Useful when you need to specify IDs before sending messages or for advanced Block/Thread management.
#### `ctx.MessageID(): string`
Generates a unique message ID.
**Returns:**
- `string`: Message ID in format "M1", "M2", "M3"...
**Example:**
```javascript
// Generate IDs manually
const id_1 = ctx.MessageID(); // "M1"
const id_2 = ctx.MessageID(); // "M2"
// Use custom ID
ctx.Send({
type: "text",
message_id: id_1,
props: { content: "Hello" },
});
```
#### `ctx.BlockID(): string`
Generates a unique block ID for grouping messages.
**Returns:**
- `string`: Block ID in format "B1", "B2", "B3"...
**Example:**
```javascript
// Generate block ID for grouping messages
const block_id = ctx.BlockID(); // "B1"
// Send multiple messages in the same block
ctx.Send("Step 1: Analyzing...", block_id);
ctx.Send("Step 2: Processing...", block_id);
ctx.Send("Step 3: Complete!", block_id);
// All three messages appear in the same card/bubble in UI
```
**Use Cases:**
```javascript
// Scenario: LLM output + follow-up card in same block
const block_id = ctx.BlockID();
// LLM response
const llm_result = Process("llms.chat", {...});
ctx.Send({
type: "text",
props: { content: llm_result.content },
block_id: block_id,
});
// Follow-up action card (grouped with LLM output)
ctx.Send({
type: "card",
props: {
title: "Related Actions",
actions: [...]
},
block_id: block_id,
});
```
#### `ctx.ThreadID(): string`
Generates a unique thread ID for concurrent operations.
**Returns:**
- `string`: Thread ID in format "T1", "T2", "T3"...
**Example:**
```javascript
// For advanced parallel processing scenarios
const thread_id = ctx.ThreadID(); // "T1"
// Send messages in a specific thread
ctx.Send({
type: "text",
props: { content: "Parallel task 1" },
thread_id: thread_id,
});
```
**Notes:**
- IDs are generated sequentially within each context
- Each context has its own ID counter (starts from 1)
- IDs are guaranteed to be unique within the same request/stream
- ThreadID is usually auto-managed by Stack, manual generation is for advanced use cases
### Lifecycle Management
#### `ctx.EndBlock(block_id): void`
Manually sends a `block_end` event for the specified block. Use this to explicitly mark the end of a block.
**Parameters:**
- `block_id`: String - The block ID to end
**Returns:**
- `void`
**Example:**
```javascript
// Create a block for grouped messages
const block_id = ctx.BlockID(); // "B1"
// Send messages in the block
ctx.Send("Analyzing data...", block_id);
ctx.Send("Processing results...", block_id);
ctx.Send("Complete!", block_id);
// Manually end the block
ctx.EndBlock(block_id);
```
**Block Lifecycle Events:**
When you send messages with a `block_id`:
1. **First message**: Automatically sends `block_start` event
2. **Subsequent messages**: No additional block events
3. **Manual end**: Call `ctx.EndBlock(block_id)` to send `block_end` event
**block_end Event Format:**
```json
{
"type": "event",
"props": {
"event": "block_end",
"message": "Block ended",
"data": {
"block_id": "B1",
"timestamp": 1764483531624,
"duration_ms": 1523,
"message_count": 3,
"status": "completed"
}
}
}
```
**Notes:**
- `block_start` is sent automatically when the first message with a new `block_id` is sent
- `block_end` must be called manually via `ctx.EndBlock()`
- You can track multiple blocks simultaneously (each has independent lifecycle)
- Automatically flushes output after sending the event
**Use Cases:**
```javascript
// Use case 1: Progress reporting in a block
function Create(ctx, messages) {
const block_id = ctx.BlockID();
ctx.Send("Step 1: Analyzing data...", block_id);
// ... analysis logic ...
ctx.Send("Step 2: Processing results...", block_id);
// ... processing logic ...
ctx.Send("Step 3: Complete!", block_id);
// Mark the block as complete
ctx.EndBlock(block_id);
return { messages };
}
// Use case 2: Multiple parallel blocks
function Create(ctx, messages) {
const llm_block = ctx.BlockID(); // "B1"
const mcp_block = ctx.BlockID(); // "B2"
// LLM output block
ctx.Send("Thinking...", llm_block);
const response = callLLM();
ctx.Send(response, llm_block);
ctx.EndBlock(llm_block);
// MCP tool call block
ctx.Send("Fetching data...", mcp_block);
const data = ctx.mcp.CallTool("tool", "method", {});
ctx.Send(`Found ${data.length} results`, mcp_block);
ctx.EndBlock(mcp_block);
return { messages };
}
```
### Resource Cleanup
#### `ctx.Release()`
Manually releases Context resources.
> **Note:** In Hook functions (`Create`, `Next`), you do **NOT** need to call `Release()` - the system handles cleanup automatically. Only call `Release()` when you create a new Context manually (e.g., via `new Context()`).
**Example (only for manually created Context):**
```javascript
// Only needed when creating Context manually, NOT in hooks
const ctx = new Context(options);
try {
ctx.Send("Processing...");
} finally {
ctx.Release(); // Required for manually created Context
}
```
## Trace API
The `ctx.trace` object provides tracing capabilities for:
1. **User Transparency** - Expose the agent's working and thinking process to users. The frontend will render these trace nodes to show users what the agent is doing.
2. **Developer Debugging** - Help developers debug agent execution by recording detailed steps and data.
> **Note:** Trace is primarily designed for developers to expose the agent's process to users. The frontend has corresponding UI components to render these trace nodes.
### Properties
- `ctx.trace.id`: String - The unique identifier of the trace
### Methods Summary
| Method | Description |
| ------------------------- | ------------------------------- |
| `Add(input, option)` | Create a sequential trace node |
| `Parallel(inputs)` | Create parallel trace nodes |
| `Info(message)` | Add info log to current node |
| `Debug(message)` | Add debug log to current node |
| `Warn(message)` | Add warning log to current node |
| `Error(message)` | Add error log to current node |
| `SetOutput(output)` | Set output for current node |
| `SetMetadata(key, value)` | Set metadata for current node |
| `Complete(output?)` | Mark current node as completed |
| `Fail(error)` | Mark current node as failed |
| `MarkComplete()` | Mark entire trace as complete |
| `IsComplete()` | Check if trace is complete |
| `CreateSpace(option)` | Create a visual space container |
| `GetSpace(id)` | Get a trace space by ID |
| `Release()` | Release trace resources |
### Node Operations
#### `ctx.trace.Add(input, options)`
Creates a new trace node (sequential step).
**Parameters:**
- `input`: Input data for the node
- `options`: Node configuration object
**Options Structure:**
```typescript
interface TraceNodeOption {
label: string; // Display label in UI
type?: string; // Node type identifier
icon?: string; // Icon identifier
description?: string; // Node description
metadata?: Record<string, any>; // Additional metadata
autoCompleteParent?: boolean; // Auto-complete parent node(s) when this node is created (default: true)
}
```
**Example:**
```javascript
const search_node = ctx.trace.Add(
{ query: "What is AI?" },
{
label: "Search Query",
type: "search",
icon: "search",
description: "Searching for AI information",
}
);
```
#### `ctx.trace.Parallel(inputs)`
Creates multiple parallel trace nodes for concurrent operations.
**Parameters:**
- `inputs`: Array of parallel input objects
**Input Structure:**
```typescript
interface ParallelInput {
input: any; // Input data
option: TraceNodeOption; // Node configuration
}
```
**Example:**
```javascript
const parallel_nodes = ctx.trace.Parallel([
{
input: { url: "https://api1.com" },
option: {
label: "API Call 1",
type: "api",
icon: "cloud",
description: "Fetching from API 1",
},
},
{
input: { url: "https://api2.com" },
option: {
label: "API Call 2",
type: "api",
icon: "cloud",
description: "Fetching from API 2",
},
},
]);
```
### Logging Methods
Add log entries to the current trace node. Each method takes a single string message and returns the trace object for chaining.
```javascript
// Information logs
ctx.trace.Info("Processing started");
// Debug logs
ctx.trace.Debug("Variable value: 42");
// Warning logs
ctx.trace.Warn("Deprecated feature used");
// Error logs
ctx.trace.Error("Operation failed: timeout");
```
### Trace-Level Operations
These methods operate on the current trace node (managed by the trace manager).
#### `ctx.trace.SetOutput(output)`
Sets the output data for the current trace node.
```javascript
ctx.trace.SetOutput({ result: "success", data: [...] });
```
#### `ctx.trace.SetMetadata(key, value)`
Sets metadata for the current trace node.
```javascript
ctx.trace.SetMetadata("duration", 1500);
ctx.trace.SetMetadata("source", "cache");
```
#### `ctx.trace.Complete(output?)`
Marks the current trace node as completed (optionally with output).
```javascript
ctx.trace.Complete({ status: "done" });
```
#### `ctx.trace.Fail(error)`
Marks the current trace node as failed with an error message.
```javascript
ctx.trace.Fail("Connection timeout");
```
### Node Object
The `ctx.trace.Add()` and `ctx.trace.Parallel()` methods return Node objects. Each node has the following properties and methods:
#### Properties
- `id`: String - The unique identifier of the node
#### `node.Add(input, option)`
Creates a child node under this node.
```javascript
const parent_node = ctx.trace.Add({ step: "process" }, { label: "Process" });
const child_node = parent_node.Add(
{ action: "validate" },
{ label: "Validate Input", type: "validation" }
);
```
#### `node.Parallel(inputs)`
Creates multiple parallel child nodes under this node.
```javascript
const parent_node = ctx.trace.Add({ step: "fetch" }, { label: "Fetch Data" });
const child_nodes = parent_node.Parallel([
{ input: { source: "db" }, option: { label: "Database Query" } },
{ input: { source: "api" }, option: { label: "API Call" } },
]);
```
#### `node.Info(message)`, `node.Debug(message)`, `node.Warn(message)`, `node.Error(message)`
Add log entries to the node. All methods return the node for chaining.
```javascript
const search_node = ctx.trace.Add({ query: "search" }, { label: "Search" });
search_node
.Info("Starting search")
.Debug("Query parameters validated")
.Warn("Cache miss, fetching from source");
```
#### `node.SetOutput(output)`
Sets the output data for a node. Returns the node for chaining.
```javascript
const search_node = ctx.trace.Add({ query: "search" }, { label: "Search" });
search_node.SetOutput({ results: [...], count: 10 });
```
#### `node.SetMetadata(key, value)`
Sets metadata for a node. Returns the node for chaining.
```javascript
search_node.SetMetadata("duration", 1500).SetMetadata("cache_hit", true);
```
#### `node.Complete(output?)`
Marks a node as completed (optionally with output). Returns the node for chaining.
```javascript
search_node.Complete({ status: "success", data: [...] });
```
#### `node.Fail(error)`
Marks a node as failed with an error message. Returns the node for chaining.
```javascript
try {
// Operation
} catch (error) {
search_node.Fail(error.message);
}
```
### Trace Lifecycle
#### `ctx.trace.IsComplete()`
Checks if the trace is complete.
```javascript
if (ctx.trace.IsComplete()) {
console.log("Trace completed");
}
```
#### `ctx.trace.MarkComplete()`
Marks the entire trace as complete.
```javascript
ctx.trace.MarkComplete();
```
#### `ctx.trace.Release()`
Releases trace resources.
> **Note:** In Hook functions, you do **NOT** need to call `Release()` - the system handles cleanup automatically. Only call this when you create a Trace manually (e.g., via `new Trace()`).
### Trace Space Operations
Trace spaces are visual containers for organizing trace nodes in the frontend UI. They help group related operations together for better presentation to users.
> **Note:** Trace spaces are purely for visual organization and presentation. They do not store data - use `ctx.space` for data storage between hooks.
#### `ctx.trace.CreateSpace(option)`
Creates a visual space container for grouping trace nodes.
**Option Structure:**
```typescript
interface TraceSpaceOption {
label: string; // Display label in UI
type?: string; // Space type identifier
icon?: string; // Icon identifier
description?: string; // Space description
ttl?: number; // Time to live in seconds (for display only)
metadata?: Record<string, any>; // Additional metadata
}
```
**Example:**
```javascript
const visual_space = ctx.trace.CreateSpace({
label: "Search Results",
type: "search",
icon: "search",
description: "Knowledge base search operations",
});
```
#### `ctx.trace.GetSpace(id)`
Retrieves a trace space by ID.
```javascript
const search_space = ctx.trace.GetSpace("search-space-id");
```
## Space API
The `ctx.space` object provides a shared data space for passing data between requests and agent calls. This is useful for storing temporary data that needs to be accessed across different hooks or nested agent calls.
### Methods Summary
| Method | Description |
| ----------------- | ------------------------------------- |
| `Get(key)` | Get a value from the space |
| `Set(key, value)` | Set a value in the space |
| `Delete(key)` | Delete a key from the space |
| `GetDel(key)` | Get a value and immediately delete it |
### Methods
#### `ctx.space.Get(key): any`
Gets a value from the space.
**Parameters:**
- `key`: String - The key to retrieve
**Returns:**
- `any`: The value, or `null` if not found
**Example:**
```javascript
const user_data = ctx.space.Get("user_data");
if (user_data) {
console.log("Found user:", user_data.name);
}
```
#### `ctx.space.Set(key, value): void`
Sets a value in the space.
**Parameters:**
- `key`: String - The key to set
- `value`: Any - The value to store
**Example:**
```javascript
ctx.space.Set("user_data", { name: "John", id: 123 });
ctx.space.Set("processing_status", "started");
```
#### `ctx.space.Delete(key): void`
Deletes a key from the space.
**Parameters:**
- `key`: String - The key to delete
**Example:**
```javascript
ctx.space.Delete("temp_data");
```
#### `ctx.space.GetDel(key): any`
Gets a value and immediately deletes it. Convenient for one-time use data.
**Parameters:**
- `key`: String - The key to retrieve and delete
**Returns:**
- `any`: The value, or `null` if not found
**Example:**
```javascript
// Store file metadata in parent agent
ctx.space.Set("file_metadata", { name: "report.pdf", size: 1024 });
// In child agent, get and consume the data
const metadata = ctx.space.GetDel("file_metadata");
// metadata is now deleted from space
```
### Use Cases
```javascript
// Use case 1: Pass data between hooks
function Create(ctx, messages) {
// Store data for later use
ctx.space.Set("original_query", messages[0].content);
return { messages };
}
function Next(ctx, payload) {
// Retrieve data from Create hook
const query = ctx.space.Get("original_query");
console.log("Original query was:", query);
}
// Use case 2: Pass data to nested agent calls
function Create(ctx, messages) {
// Prepare context for child agent
ctx.space.Set("parent_context", {
user_id: ctx.authorized.user_id,
session_start: Date.now(),
});
// Call child agent...
}
// Use case 3: One-time data consumption
function Next(ctx, payload) {
// Get and delete in one operation
const temp_data = ctx.space.GetDel("temp_processing_data");
if (temp_data) {
// Process and discard
}
}
```
**Notes:**
- Space is shared across all hooks within the same request
- Space persists across nested agent calls (A2A)
- Values can be any JSON-serializable data
- Use `GetDel` for data that should only be consumed once
## MCP API
The `ctx.mcp` object provides access to Model Context Protocol operations for interacting with external tools, resources, and prompts.
### Methods Summary
| Method | Description |
| ------------------------------------ | -------------------------------- |
| `ListResources(client, cursor?)` | List available resources |
| `ReadResource(client, uri)` | Read a specific resource |
| `ListTools(client, cursor?)` | List available tools |
| `CallTool(client, name, args?)` | Call a single tool |
| `CallTools(client, tools)` | Call multiple tools sequentially |
| `CallToolsParallel(client, tools)` | Call multiple tools in parallel |
| `ListPrompts(client, cursor?)` | List available prompts |
| `GetPrompt(client, name, args?)` | Get a specific prompt |
| `ListSamples(client, type, name)` | List samples for a tool/resource |
| `GetSample(client, type, name, idx)` | Get a specific sample by index |
### Resource Operations
#### `ctx.mcp.ListResources(client, cursor?)`
Lists available resources from an MCP client.
**Parameters:**
- `client`: String - MCP client ID
- `cursor`: String (optional) - Pagination cursor
```javascript
const resources = ctx.mcp.ListResources("echo", "");
console.log(resources.resources); // Array of resources
```
#### `ctx.mcp.ReadResource(client, uri)`
Reads a specific resource.
**Parameters:**
- `client`: String - MCP client ID
- `uri`: String - Resource URI
```javascript
const info = ctx.mcp.ReadResource("echo", "echo://info");
console.log(info.contents); // Array of content items
```
### Tool Operations
#### `ctx.mcp.ListTools(client, cursor?)`
Lists available tools from an MCP client.
**Parameters:**
- `client`: String - MCP client ID
- `cursor`: String (optional) - Pagination cursor
```javascript
const tools = ctx.mcp.ListTools("echo", "");
console.log(tools.tools); // Array of tools
```
#### `ctx.mcp.CallTool(client, name, arguments?)`
Calls a single tool.
**Parameters:**
- `client`: String - MCP client ID
- `name`: String - Tool name
- `arguments`: Object (optional) - Tool arguments
```javascript
const result = ctx.mcp.CallTool("echo", "ping", { count: 3 });
console.log(result.content); // Tool result content
```
#### `ctx.mcp.CallTools(client, tools)`
Calls multiple tools sequentially.
**Parameters:**
- `client`: String - MCP client ID
- `tools`: Array - Array of tool call objects
```javascript
const results = ctx.mcp.CallTools("echo", [
{ name: "ping", arguments: { count: 1 } },
{ name: "status", arguments: { verbose: true } },
]);
console.log(results.results); // Array of results
```
#### `ctx.mcp.CallToolsParallel(client, tools)`
Calls multiple tools in parallel.
**Parameters:**
- `client`: String - MCP client ID
- `tools`: Array - Array of tool call objects
```javascript
const results = ctx.mcp.CallToolsParallel("echo", [
{ name: "ping", arguments: { count: 1 } },
{ name: "status", arguments: { verbose: false } },
]);
console.log(results.results); // Array of results (order may vary)
```
### Prompt Operations
#### `ctx.mcp.ListPrompts(client, cursor?)`
Lists available prompts from an MCP client.
**Parameters:**
- `client`: String - MCP client ID
- `cursor`: String (optional) - Pagination cursor
```javascript
const prompts = ctx.mcp.ListPrompts("echo", "");
console.log(prompts.prompts); // Array of prompts
```
#### `ctx.mcp.GetPrompt(client, name, arguments?)`
Retrieves a specific prompt with optional arguments.
**Parameters:**
- `client`: String - MCP client ID
- `name`: String - Prompt name
- `arguments`: Object (optional) - Prompt arguments
```javascript
const prompt = ctx.mcp.GetPrompt("echo", "test_connection", {
detailed: "true",
});
console.log(prompt.messages); // Array of prompt messages
```
### Sample Operations
#### `ctx.mcp.ListSamples(client, type, name)`
Lists available samples for a tool or resource.
**Parameters:**
- `client`: String - MCP client ID
- `type`: String - Sample type ("tool" or "resource")
- `name`: String - Tool or resource name
```javascript
const samples = ctx.mcp.ListSamples("echo", "tool", "ping");
console.log(samples.samples); // Array of samples
```
#### `ctx.mcp.GetSample(client, type, name, index)`
Gets a specific sample by index.
**Parameters:**
- `client`: String - MCP client ID
- `type`: String - Sample type ("tool" or "resource")
- `name`: String - Tool or resource name
- `index`: Number - Sample index (0-based)
```javascript
const sample = ctx.mcp.GetSample("echo", "tool", "ping", 0);
console.log(sample.name, sample.input); // Sample name and input data
```
## Hooks
The Agent system supports two hooks that can be defined in the assistant's `index.ts` file: `Create` and `Next`.
### Agent Execution Lifecycle
```mermaid
flowchart TD
A[User Input] --> B[Load History]
B --> C{Create Hook?}
C -->|Yes| D[Execute Create Hook]
C -->|No| E{Has Prompts/MCP?}
D --> E
E -->|Yes| F[Build LLM Request]
E -->|No| K
F --> G[LLM Stream Call]
G --> H{Tool Calls?}
H -->|Yes| I[Execute Tools]
I --> J{Tool Errors?}
J -->|Yes, Retry| G
J -->|No| K
H -->|No| K
K{Next Hook?}
K -->|Yes| L[Execute Next Hook]
K -->|No| M[Return Response]
L --> N{Delegate?}
N -->|Yes| O[Call Target Agent]
O --> M
N -->|No| M
M --> P[End]
style D fill:#e1f5fe
style L fill:#e1f5fe
style G fill:#fff3e0
style I fill:#f3e5f5
```
> **Note:** LLM call is optional. If the assistant has no prompts and no MCP servers configured, the LLM call is skipped. Hooks can be used independently to implement custom logic without LLM involvement.
### Create Hook
Called at the beginning of agent execution, before any LLM call. Use this to preprocess messages, add context, configure the request, or implement custom logic.
**Signature:**
```typescript
function Create(
ctx: Context,
messages: Message[],
options?: Record<string, any>
): HookCreateResponse | null;
```
**Parameters:**
- `ctx`: Context object
- `messages`: Array of input messages (including chat history if enabled)
- `options`: Optional call-level options (see below)
**Options Structure:**
```typescript
interface Options {
skip?: {
history?: boolean; // Skip loading/saving chat history
trace?: boolean; // Skip trace recording
output?: boolean; // Skip output to client (for internal A2A calls that only need response data)
};
connector?: string; // Override LLM connector ID
disable_global_prompts?: boolean; // Disable global prompts for this request
search?: boolean; // Enable/disable search mode
mode?: string; // Agent mode (default: "chat")
}
```
**Return Value (`HookCreateResponse`):**
```typescript
interface HookCreateResponse {
// Messages to be sent to the assistant (can modify/replace input messages)
messages?: Message[];
// Audio configuration (for models that support audio output)
audio?: AudioConfig;
// Generation parameters (override assistant defaults)
temperature?: number;
max_tokens?: number;
max_completion_tokens?: number;
// MCP configuration - add/override MCP servers for this request
mcp_servers?: MCPServerConfig[];
// Prompt configuration
prompt_preset?: string; // Select prompt preset (e.g., "chat.friendly", "task.analysis")
disable_global_prompts?: boolean; // Temporarily disable global prompts for this request
// Context adjustments - allow hook to modify context fields
connector?: string; // Override connector (call-level)
locale?: string; // Override locale (session-level)
theme?: string; // Override theme (session-level)
route?: string; // Override route (session-level)
metadata?: Record<string, any>; // Override or merge metadata (session-level)
// Uses configuration - allow hook to override wrapper configurations
uses?: UsesConfig; // Override wrapper configurations for vision, audio, search, and fetch
force_uses?: boolean; // Force using Uses tools regardless of model capabilities
}
// Audio output configuration
interface AudioConfig {
voice: string; // Voice to use (e.g., "alloy", "echo", "fable", "onyx", "nova", "shimmer")
format: string; // Audio format (e.g., "wav", "mp3", "flac", "opus", "pcm16")
}
// MCP server configuration
interface MCPServerConfig {
server_id: string; // MCP server ID (required)
tools?: string[]; // Tool name filter (empty = all tools)
resources?: string[]; // Resource URI filter (empty = all resources)
}
// Uses wrapper configuration
interface UsesConfig {
vision?: string; // Vision processing tool. Format: "agent" or "mcp:server_id"
audio?: string; // Audio processing tool. Format: "agent" or "mcp:server_id"
search?: string; // Search tool. Format: "agent" or "mcp:server_id"
fetch?: string; // Fetch/retrieval tool. Format: "agent" or "mcp:server_id"
}
```
**Example:**
```javascript
function Create(ctx, messages) {
// Store data for Next hook
ctx.space.Set("user_query", messages[0]?.content);
// Modify messages
const enhanced_messages = messages.map((msg) => ({
...msg,
content: msg.content + "\n\nPlease be concise.",
}));
// Return configuration
return {
messages: enhanced_messages,
temperature: 0.7,
max_tokens: 2000,
};
}
```
### Next Hook
Called after the LLM response and tool calls (if any), or directly after Create Hook if no LLM call is configured. Use this to post-process the response, send custom messages, delegate to another agent, or implement custom response logic.
**Signature:**
```typescript
function Next(
ctx: Context,
payload: NextHookPayload,
options?: Record<string, any>
): NextHookResponse | null;
```
**Parameters:**
- `ctx`: Context object
- `payload`: Object containing:
- `options`: Optional call-level options (same structure as Create Hook options)
```typescript
interface NextHookPayload {
messages: Message[]; // Messages sent to the assistant
completion?: CompletionResponse; // LLM response
tools?: ToolCallResponse[]; // Tool call results (if any)
error?: string; // Error message if LLM call failed
}
interface CompletionResponse {
content: string; // LLM text response
tool_calls?: ToolCall[]; // Tool calls requested by LLM
usage?: UsageInfo; // Token usage statistics
}
interface ToolCallResponse {
toolcall_id: string;
server: string; // MCP server name
tool: string; // Tool name
arguments?: any; // Arguments passed to tool
result?: any; // Tool execution result
error?: string; // Error if tool failed
}
```
**Return Value (`NextHookResponse`):**
```typescript
interface NextHookResponse {
// Delegate to another agent (recursive call)
// If provided, the current agent will call the target agent
delegate?: {
agent_id: string; // Required: target agent ID
messages: Message[]; // Messages to send to target agent
options?: Record<string, any>; // Optional: call-level options for delegation
};
// Custom response data
// Will be placed in Response.next field and returned to user
// If both delegate and data are null/undefined, standard Response is returned
data?: any;
// Metadata for debugging and logging
metadata?: Record<string, any>;
}
```
**Agent Response Structure:**
The agent's `Stream()` method returns a `Response` object:
```typescript
interface Response {
request_id: string; // Request ID
context_id: string; // Context ID
trace_id: string; // Trace ID
chat_id: string; // Chat ID
assistant_id: string; // Assistant ID
create?: HookCreateResponse; // Create hook response
next?: any; // See below for what this contains
completion?: CompletionResponse; // LLM completion response
}
```
**Response.next field logic:**
- If `NextHookResponse.data` is provided → `Response.next` = custom data
- If `NextHookResponse.data` is null/undefined → `Response.next` = entire `NextHookResponse` object
- If no Next hook defined → `Response.next` = null
**Example:**
```javascript
/**
* Next Hook - Process LLM response
* @param {Context} ctx - Agent context
* @param {NextHookPayload} payload - Contains messages, completion, tools, error
* @returns {NextHookResponse | null} - Return null for standard response
*/
function Next(ctx, payload) {
const { messages, completion, tools, error } = payload;
// Handle errors gracefully
if (error) {
return {
data: {
status: "error",
message: error,
recovery: "Please try again",
},
metadata: { error_handled: true },
};
}
// Process tool results if any
if (tools && tools.length > 0) {
const successful = tools.filter((t) => !t.error);
const failed = tools.filter((t) => t.error);
return {
data: {
status: "tools_processed",
total: tools.length,
successful: successful.length,
failed: failed.length,
results: successful.map((t) => t.result),
},
metadata: { has_failures: failed.length > 0 },
};
}
// Return custom data based on completion
if (completion && completion.content) {
return {
data: {
status: "success",
response: completion.content,
processed: true,
},
metadata: { source: "next_hook" },
};
}
// Return null to use standard response
return null;
}
```
### Hook Execution Flow
See the [Agent Execution Lifecycle](#agent-execution-lifecycle) diagram above for a visual representation.
**Key Points:**
- **Hooks are optional** - if not defined, the agent uses default behavior
- **LLM call is optional** - only executed if the assistant has prompts or MCP servers configured
- **Return `null` or `undefined`** from hooks to use default behavior
- **Hooks can send messages directly** via `ctx.Send()`, `ctx.SendStream()`, etc.
- **Create Hook** runs before LLM call (if any), can modify messages and configure the request
- **Next Hook** runs after LLM call and tool execution (if any), can post-process or delegate
- Use `ctx.space` to pass data between Create and Next hooks
## Complete Example
Here's a comprehensive example demonstrating Create and Next hooks with various Context API features:
```javascript
/**
* Create Hook - Preprocess messages and configure the request
*
* @param {Context} ctx - Agent context object
* @param {Message[]} messages - Input messages (including history if enabled)
* @returns {HookCreateResponse | null} - Configuration for LLM call, or null for defaults
*/
function Create(ctx, messages) {
// Extract user query from the last message
const user_query = messages[messages.length - 1]?.content || "";
// Store data in space for use in Next hook
ctx.space.Set("original_query", user_query);
ctx.space.Set("request_time", Date.now());
// Add trace node to show processing in UI
const create_node = ctx.trace.Add(
{ query: user_query },
{
label: "Create Hook",
type: "preprocessing",
icon: "play",
description: "Analyzing user request",
}
);
// Check if user needs search functionality
const needs_search =
user_query.toLowerCase().includes("search") ||
user_query.toLowerCase().includes("find");
if (needs_search) {
create_node.Info("Search mode enabled");
// Configure MCP servers for search
return {
messages: messages,
mcp_servers: [{ server_id: "search_engine" }],
prompt_preset: "search.assistant",
metadata: { mode: "search" },
};
}
create_node.Complete({ mode: "standard" });
// Return modified messages or configuration
return {
messages: messages,
temperature: 0.7,
max_tokens: 2000,
};
}
/**
* Next Hook - Process LLM response and optionally customize output
*
* @param {Context} ctx - Agent context object
* @param {NextHookPayload} payload - Contains messages, completion, tools, error
* @returns {NextHookResponse | null} - Custom response, delegation, or null for standard
*/
function Next(ctx, payload) {
const { messages, completion, tools, error } = payload;
// Retrieve data from Create hook via space
const original_query = ctx.space.Get("original_query");
const request_time = ctx.space.Get("request_time");
const duration = Date.now() - request_time;
// Create trace node for Next hook processing
const next_node = ctx.trace.Add(
{ completion_length: completion?.content?.length || 0 },
{
label: "Next Hook",
type: "postprocessing",
icon: "check",
description: "Processing LLM response",
}
);
// Handle errors
if (error) {
next_node.Fail(error);
return {
data: {
status: "error",
message: "An error occurred while processing your request",
error: error,
},
};
}
// Process tool call results
if (tools && tools.length > 0) {
next_node.Info(`Processing ${tools.length} tool results`);
const successful = tools.filter((t) => !t.error);
const results = successful.map((t) => ({
tool: t.tool,
server: t.server,
result: t.result,
}));
// Send streaming message with results
const msg_id = ctx.SendStream("## Tool Results\n\n");
results.forEach((r, i) => {
ctx.Append(msg_id, `**${i + 1}. ${r.tool}**\n`);
ctx.Append(msg_id, `${JSON.stringify(r.result, null, 2)}\n\n`);
});
ctx.End(msg_id);
next_node.SetMetadata("tools_processed", tools.length);
next_node.Complete({ status: "tools_processed" });
return {
data: {
status: "success",
tool_results: results,
duration_ms: duration,
},
metadata: { processed_by: "next_hook" },
};
}
// Check if delegation is needed based on completion content
if (completion?.content?.toLowerCase().includes("delegate to specialist")) {
next_node.Info("Delegating to specialist agent");
return {
delegate: {
agent_id: "specialist.agent",
messages: [
{ role: "system", content: "Handle this specialized request" },
{ role: "user", content: original_query },
],
options: { priority: "high" },
},
metadata: { reason: "specialist_needed" },
};
}
// Standard processing - add metadata and return
next_node.SetMetadata("duration_ms", duration);
next_node.Complete({ status: "success" });
// Return null to use standard LLM response
// Or return custom data to override
return null;
}
```
## Best Practices
1. **Error Handling**: Always wrap Context operations in try-catch blocks
2. **Resource Cleanup**: Only call `ctx.Release()` for manually created Context, not in hooks
3. **Trace Organization**: Create meaningful trace nodes with descriptive labels
4. **Logging Levels**: Use appropriate log levels (Debug for development, Info for progress, Error for failures)
5. **Message IDs**: Let the system auto-generate message IDs unless you need specific tracking
6. **Parallel Operations**: Use `Trace.Parallel()` for concurrent operations to maintain trace clarity
7. **Space Usage**: Use `ctx.space` for passing data between hooks and nested agent calls
8. **Streaming Messages**: Use `SendStream()` + `Append()` + `End()` for streaming output; use `Send()` for complete messages
9. **Block Grouping**: Only use Block IDs when you need to group multiple messages together (e.g., LLM output + follow-up card)
## Error Handling
All Context methods throw exceptions on failure. Always handle errors appropriately:
```javascript
try {
ctx.Send(message);
} catch (error) {
ctx.trace.Error("Failed to send message", { error: error.message });
throw error;
}
```
## TypeScript Support
For TypeScript projects, the Context types are automatically inferred. You can also import explicit types:
```typescript
import { Context, Message, TraceNodeOption } from "@yao/runtime";
interface NextPayload {
messages: Message[];
completion: any;
tools: any[];
error?: string;
}
function Next(
ctx: Context,
payload: NextHookPayload,
options?: Record<string, any>
): NextHookResponse | null {
// Your code with full type checking
const { messages, completion, tools, error } = payload;
// ...
}
```
## See Also
- [Agent Hooks Documentation](../hooks/README.md)
- [MCP Protocol Specification](../mcp/README.md)
- [Trace System Documentation](../../trace/README.md)
- [Message Format Specification](../message/README.md)