# Context JavaScript API Documentation ## Overview The Context JavaScript API provides a comprehensive interface for interacting with the Yao Agent system from JavaScript/TypeScript hooks (Create, Next). The Context object exposes agent state, configuration, messaging capabilities, trace operations, and MCP (Model Context Protocol) integrations. ## Context Object The Context object is automatically passed to hook functions and provides access to the agent's execution environment. ### Basic Properties ```typescript interface Context { // Identifiers chat_id: string; // Current chat session ID assistant_id: string; // Assistant identifier // Configuration locale: string; // User locale (e.g., "en", "zh-cn") theme: string; // UI theme preference accept: string; // Output format ("standard", "cui-web", "cui-native", etc.) route: string; // Request route path referer: string; // Request referer // Client Information client: { type: string; // Client type user_agent: string; // User agent string ip: string; // Client IP address }; // Dynamic Data metadata: Record; // Custom metadata (empty object if not set) authorized: Record; // Authorization data (empty object if not set) // Objects memory: Memory; // Agent memory with four namespaces: user, team, chat, context trace: Trace; // Trace object for debugging and monitoring mcp: MCP; // MCP object for external tool/resource access } ``` ## Methods ### Send Messages The Context provides several methods for sending messages to the client: | Method | Description | Auto `message_end` | Updatable | | ------------------------------------ | --------------------------- | ------------------ | --------- | | `Send(message, block_id?)` | Send a complete message | ✅ Yes | ❌ No | | `SendStream(message, block_id?)` | Start a streaming message | ❌ No | ✅ Yes | | `Append(message_id, content, path?)` | Append content to a message | - | - | | `Replace(message_id, message)` | Replace message content | - | - | | `Merge(message_id, data, path?)` | Merge data into message | - | - | | `Set(message_id, data, path)` | Set a field in message | - | - | | `End(message_id, final_content?)` | Finalize streaming message | ✅ Yes | - | | `EndBlock(block_id)` | End a message block | - | - | | `MessageID()` | Generate unique message ID | - | - | | `BlockID()` | Generate unique block ID | - | - | | `ThreadID()` | Generate unique thread ID | - | - | > **Note:** `Append`, `Replace`, `Merge`, and `Set` only work with messages started via `SendStream()`. Messages sent via `Send()` are immediately finalized and cannot be updated. #### `ctx.Send(message, block_id?): string` Sends a message to the client and automatically flushes the output. **Parameters:** - `message`: Message object or string - `block_id`: String (optional) - Block ID to send this message in. If omitted, no block ID is assigned. **Returns:** - `string`: The message ID (auto-generated if not provided in the message object) **Message Object Structure:** ```typescript interface Message { // Required type: string; // Message type: "text", "tool", "image", etc. // Common fields props?: Record; // Message properties (passed to frontend component) message_id?: string; // Message ID (auto-generated if omitted) block_id?: string; // Block ID (NOT auto-generated, has priority over block_id parameter) thread_id?: string; // Thread ID (auto-set from Stack for nested agents) // Metadata (optional) metadata?: Record; // Custom metadata } ``` **Examples:** ```javascript // Send text message (object format) and capture message ID const message_id = ctx.Send({ type: "text", props: { content: "Hello, World!" }, }); console.log("Sent message:", message_id); // Send text message (shorthand) - no block ID by default const text_id = ctx.Send("Hello, World!"); // Send multiple messages in the same block (same bubble/card in UI) const block_id = ctx.BlockID(); // Generate block ID first const msg1 = ctx.Send("Step 1: Analyzing...", block_id); const msg2 = ctx.Send("Step 2: Processing...", block_id); const msg3 = ctx.Send("Step 3: Complete!", block_id); // Specify block_id in message object (highest priority) const msg4 = ctx.Send({ type: "text", props: { content: "In specific block" }, block_id: "B2", // This takes priority over second parameter }); // Send tool message with custom IDs const tool_id = ctx.Send({ type: "tool", message_id: "custom-tool-msg-1", block_id: "B_tools", props: { name: "calculator", result: { sum: 42 }, }, }); // Send image message const image_id = ctx.Send({ type: "image", props: { url: "https://example.com/image.png", alt: "Example Image", }, }); ``` **Block Management:** ```javascript // Scenario 1: Simple message (most common) function Next(ctx, payload) { const { completion } = payload; // Send a complete message ctx.Send({ type: "text", props: { content: completion.content }, }); } // Scenario 2: Loading indicator before slow operation function Next(ctx, payload) { // Start a streaming message for loading const loading_id = ctx.SendStream({ type: "loading", props: { message: "Fetching data..." }, }); // Do slow operation (e.g., external API call) const result = fetchExternalData(); // Replace loading with result ctx.Replace(loading_id, { type: "text", props: { content: result }, }); ctx.End(loading_id); } // Scenario 3: Grouping messages in one block (special case) function Create(ctx, messages) { // Generate a block ID for grouping const block_id = ctx.BlockID(); // "B1" ctx.Send("# Analysis Results", block_id); ctx.Send("- Finding 1: ...", block_id); ctx.Send("- Finding 2: ...", block_id); ctx.Send("- Finding 3: ...", block_id); // All messages appear in the same card/bubble in the UI } // Scenario 4: LLM response + follow-up card in same block function Next(ctx, payload) { const { completion } = payload; const block_id = ctx.BlockID(); // LLM response ctx.Send({ type: "text", props: { content: completion.content }, block_id: block_id, }); // Action card (grouped with LLM response) ctx.Send({ type: "card", props: { title: "Related Actions", actions: ["action1", "action2"], }, block_id: block_id, }); } ``` **Notes:** - **Message ID** is automatically generated if not provided - **Block ID** is NOT auto-generated by default (remains empty unless manually specified) - Most messages don't need a Block ID (each message is independent) - Only specify Block ID in special cases (e.g., grouping LLM output with a follow-up card) - **Block ID priority**: message.block_id > block_id parameter > empty - **Thread ID** is automatically set from Stack for non-root calls (nested agents) - Returns the message ID for reference in subsequent operations - Output is automatically flushed after sending - Throws exception on failure - `Send()` automatically sends `message_end` event - the message is complete and cannot be updated - **For updatable messages**, use `ctx.SendStream()` instead (see below) #### `ctx.SendStream(message, block_id?): string` Sends a streaming message that can be appended to later. Unlike `Send()`, this does NOT automatically send `message_end` event. Use `ctx.Append()` to add content, then `ctx.End()` to finalize. **Parameters:** - `message`: Message object or string - `block_id`: String (optional) - Block ID to send this message in **Returns:** - `string`: The message ID (for use with `Append` and `End`) **Examples:** ```javascript // Start a streaming message const msg_id = ctx.SendStream({ type: "text", props: { content: "# Title\n\n" }, }); // Append content in chunks (simulating streaming) ctx.Append(msg_id, "First paragraph. "); ctx.Append(msg_id, "Second sentence. "); ctx.Append(msg_id, "Third sentence.\n\n"); // Finalize the message (sends message_end event) ctx.End(msg_id); ``` **String Shorthand:** ```javascript // SendStream with string shorthand const msg_id = ctx.SendStream("Starting analysis..."); ctx.Append(msg_id, " processing..."); ctx.Append(msg_id, " done!"); ctx.End(msg_id); // Final content: "Starting analysis... processing... done!" ``` **With Block ID:** ```javascript const block_id = ctx.BlockID(); const msg_id = ctx.SendStream("Step 1: ", block_id); ctx.Append(msg_id, "Analyzing data..."); ctx.End(msg_id); ``` **Notes:** - Returns the message ID immediately for use with `Append` and `End` - Sends `message_start` event but NOT `message_end` (unlike `Send`) - Must call `ctx.End(msg_id)` to finalize the message - Content appended via `ctx.Append()` is accumulated for storage - Ideal for streaming text output where you control the timing #### `ctx.End(message_id, final_content?): string` Finalizes a streaming message started with `SendStream()`. Sends `message_end` event with the complete accumulated content. **Parameters:** - `message_id`: String - The message ID returned by `SendStream()` - `final_content`: String (optional) - Final content to append before ending **Returns:** - `string`: The message ID **Examples:** ```javascript // Basic usage const msg_id = ctx.SendStream("Hello"); ctx.Append(msg_id, " World"); ctx.End(msg_id); // Final: "Hello World" // End with final content const msg_id2 = ctx.SendStream("Processing"); ctx.Append(msg_id2, "..."); ctx.End(msg_id2, " Complete!"); // Final: "Processing... Complete!" ``` **Notes:** - Must be called after `SendStream()` to send `message_end` event - Optional `final_content` is appended before sending `message_end` - The complete accumulated content is included in `message_end.extra.content` - Throws exception if `message_id` is not a string **Send vs SendStream Comparison:** | Feature | `Send()` | `SendStream()` | | --------------------- | ----------------- | ------------------- | | `message_start` event | ✅ Auto | ✅ Auto | | `message_end` event | ✅ Auto | ❌ Manual (`End()`) | | Use case | Complete messages | Streaming output | | Content accumulation | N/A | Via `Append()` | | Storage | Immediate | On `End()` | **Streaming Workflow Example:** ```javascript function Create(ctx, messages) { // Start streaming output const msg_id = ctx.SendStream({ type: "text", props: { content: "# Analysis Report\n\n" }, }); // Simulate streaming chunks ctx.Append(msg_id, "## Section 1\n"); ctx.Append(msg_id, "Processing data...\n\n"); // Do some work const result = analyzeData(); ctx.Append(msg_id, "## Section 2\n"); ctx.Append(msg_id, `Found ${result.count} items.\n\n`); // Finalize with conclusion ctx.End(msg_id, "## Conclusion\nAnalysis complete."); return { messages }; } ``` #### `ctx.Replace(message_id, message): string` Replaces the content of a streaming message. **Only works with messages started via `SendStream()`**. **Parameters:** - `message_id`: String - The ID of the streaming message (returned by `SendStream()`) - `message`: Message object or string - The new message content **Returns:** - `string`: The message ID (same as the provided message_id) **Examples:** ```javascript // Start a streaming message const msg_id = ctx.SendStream({ type: "loading", props: { message: "Loading..." }, }); // Replace with new content ctx.Replace(msg_id, { type: "text", props: { content: "Data loaded successfully!" }, }); // Finalize the message ctx.End(msg_id); ``` **Use Cases:** ```javascript // Progress updates with replacement function Next(ctx, payload) { const msg_id = ctx.SendStream("Step 1/3: Starting..."); // ... do work ... ctx.Replace(msg_id, "Step 2/3: Processing..."); // ... do more work ... ctx.Replace(msg_id, "Step 3/3: Finalizing..."); // ... finish ... ctx.Replace(msg_id, "Complete! ✓"); ctx.End(msg_id); } // Loading to result transition function Next(ctx, payload) { const msg_id = ctx.SendStream({ type: "loading", props: { message: "Fetching results..." }, }); const results = fetchData(); ctx.Replace(msg_id, { type: "text", props: { content: `Found ${results.length} results` }, }); ctx.End(msg_id); } ``` **Notes:** - **Only works with `SendStream()` messages** - `Send()` messages cannot be replaced - Replaces the entire message content, not just specific fields - Must call `ctx.End(msg_id)` after all updates to finalize the message - Output is automatically flushed after replacing - Throws exception on failure #### `ctx.Append(message_id, content, path?): string` Appends content to a streaming message. **Only works with messages started via `SendStream()`**. **Parameters:** - `message_id`: String - The ID of the streaming message (returned by `SendStream()`) - `content`: Message object or string - The content to append - `path`: String (optional) - The delta path to append to (e.g., "props.content", "props.data") **Returns:** - `string`: The message ID (same as the provided message_id) **Examples:** ```javascript // Start a streaming message const msg_id = ctx.SendStream("Starting"); // Append more text (default path) ctx.Append(msg_id, "... processing"); ctx.Append(msg_id, "... done!"); // Finalize the message ctx.End(msg_id); // Final content: "Starting... processing... done!" // Append to specific path const data_id = ctx.SendStream({ type: "data", props: { content: "Item 1\n", status: "loading", }, }); ctx.Append(data_id, "Item 2\n", "props.content"); ctx.Append(data_id, "Item 3\n", "props.content"); ctx.End(data_id); // Final: props.content = "Item 1\nItem 2\nItem 3\n" ``` **Use Cases:** ```javascript // Streaming text output (simulating LLM-like output) function Create(ctx, messages) { const msg_id = ctx.SendStream(""); ctx.Append(msg_id, "The"); ctx.Append(msg_id, " quick"); ctx.Append(msg_id, " brown"); ctx.Append(msg_id, " fox"); ctx.End(msg_id); // Final: "The quick brown fox" return { messages }; } // Progress logs function Next(ctx, payload) { const log_id = ctx.SendStream({ type: "log", props: { content: "Starting process\n" }, }); // Step 1 doStep1(); ctx.Append(log_id, "Step 1 complete\n", "props.content"); // Step 2 doStep2(); ctx.Append(log_id, "Step 2 complete\n", "props.content"); // Finish ctx.Append(log_id, "All done!\n", "props.content"); ctx.End(log_id); } ``` **Notes:** - **Only works with `SendStream()` messages** - `Send()` messages cannot be appended to - Uses delta append operation (adds to existing content, doesn't replace) - If `path` is omitted, appends to the default content location (`props.content`) - Must call `ctx.End(msg_id)` after all appends to finalize the message - Output is automatically flushed after appending - Throws exception on failure - block_id and ThreadID are inherited from the original message #### `ctx.Merge(message_id, data, path?): string` Merges data into a streaming message object. **Only works with messages started via `SendStream()`**. **Parameters:** - `message_id`: String - The ID of the streaming message (returned by `SendStream()`) - `data`: Object - The data to merge (should be an object) - `path`: String (optional) - The delta path to merge into (e.g., "props", "props.metadata") **Returns:** - `string`: The message ID (same as the provided message_id) **Examples:** ```javascript // Start a streaming message with object data const msg_id = ctx.SendStream({ type: "status", props: { status: "running", progress: 0, started: true, }, }); // Merge updates into props (adds/updates fields, keeps others unchanged) ctx.Merge(msg_id, { progress: 50 }, "props"); // Result: props = { status: "running", progress: 50, started: true } ctx.Merge(msg_id, { progress: 100, status: "completed" }, "props"); // Result: props = { status: "completed", progress: 100, started: true } // Finalize the message ctx.End(msg_id); ``` **Use Cases:** ```javascript // Updating task progress function Next(ctx, payload) { const task_id = ctx.SendStream({ type: "task", props: { name: "Data Processing", status: "pending", progress: 0, }, }); ctx.Merge(task_id, { status: "running" }, "props"); doStep1(); ctx.Merge(task_id, { progress: 25 }, "props"); doStep2(); ctx.Merge(task_id, { progress: 50 }, "props"); doStep3(); ctx.Merge(task_id, { progress: 100, status: "completed" }, "props"); ctx.End(task_id); } // Building metadata incrementally function Create(ctx, messages) { const data_id = ctx.SendStream({ type: "data", props: { content: "Result data" }, }); ctx.Merge(data_id, { metadata: { source: "api" } }, "props"); ctx.Merge(data_id, { metadata: { timestamp: Date.now() } }, "props"); // metadata fields are merged together ctx.End(data_id); return { messages }; } ``` **Notes:** - **Only works with `SendStream()` messages** - `Send()` messages cannot be merged into - Uses delta merge operation (merges objects, doesn't replace) - Only works with object data (for merging key-value pairs) - Existing fields not in the merge data remain unchanged - If `path` is omitted, merges into the default object location - Must call `ctx.End(msg_id)` after all merges to finalize the message - Output is automatically flushed after merging - Throws exception on failure - block_id and ThreadID are inherited from the original message #### `ctx.Set(message_id, data, path): string` Sets a new field or value in a streaming message. **Only works with messages started via `SendStream()`**. **Parameters:** - `message_id`: String - The ID of the streaming message (returned by `SendStream()`) - `data`: Any - The value to set - `path`: String (required) - The delta path where to set the value (e.g., "props.newField", "props.metadata.key") **Returns:** - `string`: The message ID (same as the provided message_id) **Examples:** ```javascript // Start a streaming message const msg_id = ctx.SendStream({ type: "result", props: { content: "Initial content", }, }); // Set a new field ctx.Set(msg_id, "success", "props.status"); // Result: props.status = "success" // Set a nested object ctx.Set(msg_id, { duration: 1500, cached: true }, "props.metadata"); // Result: props.metadata = { duration: 1500, cached: true } // Finalize the message ctx.End(msg_id); ``` **Use Cases:** ```javascript // Adding computed metadata after initial send function Next(ctx, payload) { const result_id = ctx.SendStream({ type: "search_result", props: { results: search_results }, }); ctx.Set(result_id, search_results.length, "props.count"); ctx.Set(result_id, Date.now(), "props.timestamp"); ctx.Set(result_id, "relevance", "props.sort_by"); ctx.End(result_id); } // Conditionally adding fields function Create(ctx, messages) { const msg_id = ctx.SendStream({ type: "operation", props: { name: "Process Data" }, }); try { const result = processData(); ctx.Set(msg_id, "success", "props.status"); ctx.Set(msg_id, result, "props.data"); } catch (e) { ctx.Set(msg_id, e.message, "props.error"); ctx.Set(msg_id, "error", "props.status"); } ctx.End(msg_id); return { messages }; } ``` **Notes:** - **Only works with `SendStream()` messages** - `Send()` messages cannot be modified - Uses delta set operation (creates/sets new fields) - The `path` parameter is **required** (must specify where to set the value) - Creates the path if it doesn't exist - Use for adding new fields or completely replacing a field's value - For updating existing object fields, consider using `Merge` instead - Must call `ctx.End(msg_id)` after all sets to finalize the message - Output is automatically flushed after setting - Throws exception on failure - block_id and ThreadID are inherited from the original message ### ID Generators These methods generate unique IDs for manual message management. Useful when you need to specify IDs before sending messages or for advanced Block/Thread management. #### `ctx.MessageID(): string` Generates a unique message ID. **Returns:** - `string`: Message ID in format "M1", "M2", "M3"... **Example:** ```javascript // Generate IDs manually const id_1 = ctx.MessageID(); // "M1" const id_2 = ctx.MessageID(); // "M2" // Use custom ID ctx.Send({ type: "text", message_id: id_1, props: { content: "Hello" }, }); ``` #### `ctx.BlockID(): string` Generates a unique block ID for grouping messages. **Returns:** - `string`: Block ID in format "B1", "B2", "B3"... **Example:** ```javascript // Generate block ID for grouping messages const block_id = ctx.BlockID(); // "B1" // Send multiple messages in the same block ctx.Send("Step 1: Analyzing...", block_id); ctx.Send("Step 2: Processing...", block_id); ctx.Send("Step 3: Complete!", block_id); // All three messages appear in the same card/bubble in UI ``` **Use Cases:** ```javascript // Scenario: LLM output + follow-up card in same block const block_id = ctx.BlockID(); // LLM response const llm_result = Process("llms.chat", {...}); ctx.Send({ type: "text", props: { content: llm_result.content }, block_id: block_id, }); // Follow-up action card (grouped with LLM output) ctx.Send({ type: "card", props: { title: "Related Actions", actions: [...] }, block_id: block_id, }); ``` #### `ctx.ThreadID(): string` Generates a unique thread ID for concurrent operations. **Returns:** - `string`: Thread ID in format "T1", "T2", "T3"... **Example:** ```javascript // For advanced parallel processing scenarios const thread_id = ctx.ThreadID(); // "T1" // Send messages in a specific thread ctx.Send({ type: "text", props: { content: "Parallel task 1" }, thread_id: thread_id, }); ``` **Notes:** - IDs are generated sequentially within each context - Each context has its own ID counter (starts from 1) - IDs are guaranteed to be unique within the same request/stream - ThreadID is usually auto-managed by Stack, manual generation is for advanced use cases ### Lifecycle Management #### `ctx.EndBlock(block_id): void` Manually sends a `block_end` event for the specified block. Use this to explicitly mark the end of a block. **Parameters:** - `block_id`: String - The block ID to end **Returns:** - `void` **Example:** ```javascript // Create a block for grouped messages const block_id = ctx.BlockID(); // "B1" // Send messages in the block ctx.Send("Analyzing data...", block_id); ctx.Send("Processing results...", block_id); ctx.Send("Complete!", block_id); // Manually end the block ctx.EndBlock(block_id); ``` **Block Lifecycle Events:** When you send messages with a `block_id`: 1. **First message**: Automatically sends `block_start` event 2. **Subsequent messages**: No additional block events 3. **Manual end**: Call `ctx.EndBlock(block_id)` to send `block_end` event **block_end Event Format:** ```json { "type": "event", "props": { "event": "block_end", "message": "Block ended", "data": { "block_id": "B1", "timestamp": 1764483531624, "duration_ms": 1523, "message_count": 3, "status": "completed" } } } ``` **Notes:** - `block_start` is sent automatically when the first message with a new `block_id` is sent - `block_end` must be called manually via `ctx.EndBlock()` - You can track multiple blocks simultaneously (each has independent lifecycle) - Automatically flushes output after sending the event **Use Cases:** ```javascript // Use case 1: Progress reporting in a block function Create(ctx, messages) { const block_id = ctx.BlockID(); ctx.Send("Step 1: Analyzing data...", block_id); // ... analysis logic ... ctx.Send("Step 2: Processing results...", block_id); // ... processing logic ... ctx.Send("Step 3: Complete!", block_id); // Mark the block as complete ctx.EndBlock(block_id); return { messages }; } // Use case 2: Multiple parallel blocks function Create(ctx, messages) { const llm_block = ctx.BlockID(); // "B1" const mcp_block = ctx.BlockID(); // "B2" // LLM output block ctx.Send("Thinking...", llm_block); const response = callLLM(); ctx.Send(response, llm_block); ctx.EndBlock(llm_block); // MCP tool call block ctx.Send("Fetching data...", mcp_block); const data = ctx.mcp.CallTool("tool", "method", {}); ctx.Send(`Found ${data.length} results`, mcp_block); ctx.EndBlock(mcp_block); return { messages }; } ``` ### Resource Cleanup #### `ctx.Release()` Manually releases Context resources. > **Note:** In Hook functions (`Create`, `Next`), you do **NOT** need to call `Release()` - the system handles cleanup automatically. Only call `Release()` when you create a new Context manually (e.g., via `new Context()`). **Example (only for manually created Context):** ```javascript // Only needed when creating Context manually, NOT in hooks const ctx = new Context(options); try { ctx.Send("Processing..."); } finally { ctx.Release(); // Required for manually created Context } ``` ## Trace API The `ctx.trace` object provides tracing capabilities for: 1. **User Transparency** - Expose the agent's working and thinking process to users. The frontend will render these trace nodes to show users what the agent is doing. 2. **Developer Debugging** - Help developers debug agent execution by recording detailed steps and data. > **Note:** Trace is primarily designed for developers to expose the agent's process to users. The frontend has corresponding UI components to render these trace nodes. ### Properties - `ctx.trace.id`: String - The unique identifier of the trace ### Methods Summary | Method | Description | | ------------------------- | ------------------------------- | | `Add(input, option)` | Create a sequential trace node | | `Parallel(inputs)` | Create parallel trace nodes | | `Info(message)` | Add info log to current node | | `Debug(message)` | Add debug log to current node | | `Warn(message)` | Add warning log to current node | | `Error(message)` | Add error log to current node | | `SetOutput(output)` | Set output for current node | | `SetMetadata(key, value)` | Set metadata for current node | | `Complete(output?)` | Mark current node as completed | | `Fail(error)` | Mark current node as failed | | `MarkComplete()` | Mark entire trace as complete | | `IsComplete()` | Check if trace is complete | | `CreateSpace(option)` | Create a visual space container | | `GetSpace(id)` | Get a trace space by ID | | `Release()` | Release trace resources | ### Node Operations #### `ctx.trace.Add(input, options)` Creates a new trace node (sequential step). **Parameters:** - `input`: Input data for the node - `options`: Node configuration object **Options Structure:** ```typescript interface TraceNodeOption { label: string; // Display label in UI type?: string; // Node type identifier icon?: string; // Icon identifier description?: string; // Node description metadata?: Record; // Additional metadata autoCompleteParent?: boolean; // Auto-complete parent node(s) when this node is created (default: true) } ``` **Example:** ```javascript const search_node = ctx.trace.Add( { query: "What is AI?" }, { label: "Search Query", type: "search", icon: "search", description: "Searching for AI information", } ); ``` #### `ctx.trace.Parallel(inputs)` Creates multiple parallel trace nodes for concurrent operations. **Parameters:** - `inputs`: Array of parallel input objects **Input Structure:** ```typescript interface ParallelInput { input: any; // Input data option: TraceNodeOption; // Node configuration } ``` **Example:** ```javascript const parallel_nodes = ctx.trace.Parallel([ { input: { url: "https://api1.com" }, option: { label: "API Call 1", type: "api", icon: "cloud", description: "Fetching from API 1", }, }, { input: { url: "https://api2.com" }, option: { label: "API Call 2", type: "api", icon: "cloud", description: "Fetching from API 2", }, }, ]); ``` ### Logging Methods Add log entries to the current trace node. Each method takes a single string message and returns the trace object for chaining. ```javascript // Information logs ctx.trace.Info("Processing started"); // Debug logs ctx.trace.Debug("Variable value: 42"); // Warning logs ctx.trace.Warn("Deprecated feature used"); // Error logs ctx.trace.Error("Operation failed: timeout"); ``` ### Trace-Level Operations These methods operate on the current trace node (managed by the trace manager). #### `ctx.trace.SetOutput(output)` Sets the output data for the current trace node. ```javascript ctx.trace.SetOutput({ result: "success", data: [...] }); ``` #### `ctx.trace.SetMetadata(key, value)` Sets metadata for the current trace node. ```javascript ctx.trace.SetMetadata("duration", 1500); ctx.trace.SetMetadata("source", "cache"); ``` #### `ctx.trace.Complete(output?)` Marks the current trace node as completed (optionally with output). ```javascript ctx.trace.Complete({ status: "done" }); ``` #### `ctx.trace.Fail(error)` Marks the current trace node as failed with an error message. ```javascript ctx.trace.Fail("Connection timeout"); ``` ### Node Object The `ctx.trace.Add()` and `ctx.trace.Parallel()` methods return Node objects. Each node has the following properties and methods: #### Properties - `id`: String - The unique identifier of the node #### `node.Add(input, option)` Creates a child node under this node. ```javascript const parent_node = ctx.trace.Add({ step: "process" }, { label: "Process" }); const child_node = parent_node.Add( { action: "validate" }, { label: "Validate Input", type: "validation" } ); ``` #### `node.Parallel(inputs)` Creates multiple parallel child nodes under this node. ```javascript const parent_node = ctx.trace.Add({ step: "fetch" }, { label: "Fetch Data" }); const child_nodes = parent_node.Parallel([ { input: { source: "db" }, option: { label: "Database Query" } }, { input: { source: "api" }, option: { label: "API Call" } }, ]); ``` #### `node.Info(message)`, `node.Debug(message)`, `node.Warn(message)`, `node.Error(message)` Add log entries to the node. All methods return the node for chaining. ```javascript const search_node = ctx.trace.Add({ query: "search" }, { label: "Search" }); search_node .Info("Starting search") .Debug("Query parameters validated") .Warn("Cache miss, fetching from source"); ``` #### `node.SetOutput(output)` Sets the output data for a node. Returns the node for chaining. ```javascript const search_node = ctx.trace.Add({ query: "search" }, { label: "Search" }); search_node.SetOutput({ results: [...], count: 10 }); ``` #### `node.SetMetadata(key, value)` Sets metadata for a node. Returns the node for chaining. ```javascript search_node.SetMetadata("duration", 1500).SetMetadata("cache_hit", true); ``` #### `node.Complete(output?)` Marks a node as completed (optionally with output). Returns the node for chaining. ```javascript search_node.Complete({ status: "success", data: [...] }); ``` #### `node.Fail(error)` Marks a node as failed with an error message. Returns the node for chaining. ```javascript try { // Operation } catch (error) { search_node.Fail(error.message); } ``` ### Trace Lifecycle #### `ctx.trace.IsComplete()` Checks if the trace is complete. ```javascript if (ctx.trace.IsComplete()) { console.log("Trace completed"); } ``` #### `ctx.trace.MarkComplete()` Marks the entire trace as complete. ```javascript ctx.trace.MarkComplete(); ``` #### `ctx.trace.Release()` Releases trace resources. > **Note:** In Hook functions, you do **NOT** need to call `Release()` - the system handles cleanup automatically. Only call this when you create a Trace manually (e.g., via `new Trace()`). ### Trace Space Operations Trace spaces are visual containers for organizing trace nodes in the frontend UI. They help group related operations together for better presentation to users. > **Note:** Trace spaces are purely for visual organization and presentation. They do not store data - use `ctx.memory` for data storage between hooks. #### `ctx.trace.CreateSpace(option)` Creates a visual space container for grouping trace nodes. **Option Structure:** ```typescript interface TraceSpaceOption { label: string; // Display label in UI type?: string; // Space type identifier icon?: string; // Icon identifier description?: string; // Space description ttl?: number; // Time to live in seconds (for display only) metadata?: Record; // Additional metadata } ``` **Example:** ```javascript const visual_space = ctx.trace.CreateSpace({ label: "Search Results", type: "search", icon: "search", description: "Knowledge base search operations", }); ``` #### `ctx.trace.GetSpace(id)` Retrieves a trace space by ID. ```javascript const search_space = ctx.trace.GetSpace("search-space-id"); ``` ## Memory API The `ctx.memory` object provides a four-level hierarchical memory system for agent state management. Each level has different persistence and scope characteristics. ### Memory Namespaces | Namespace | Scope | Persistence | Use Case | | -------------------- | ------------------- | ----------- | ------------------------------------------- | | `ctx.memory.user` | Per user | Persistent | User preferences, settings, long-term state | | `ctx.memory.team` | Per team | Persistent | Team-wide settings, shared configurations | | `ctx.memory.chat` | Per chat session | Persistent | Chat-specific context, conversation state | | `ctx.memory.context` | Per request context | Temporary | Request-scoped data, cleared on release | ### Namespace Interface Each namespace (`user`, `team`, `chat`, `context`) provides the same interface: ```typescript interface MemoryNamespace { // Basic KV operations Get(key: string): any; // Get a value Set(key: string, value: any, ttl?: number): void; // Set a value with optional TTL (seconds) Del(key: string): void; // Delete a key (supports wildcards: "prefix:*") Has(key: string): boolean; // Check if key exists GetDel(key: string): any; // Get and delete atomically // Collection operations Keys(): string[]; // Get all keys Len(): number; // Get number of keys Clear(): void; // Delete all keys // Atomic counter operations Incr(key: string, delta?: number): number; // Increment (default delta=1) Decr(key: string, delta?: number): number; // Decrement (default delta=1) // List operations Push(key: string, values: any[]): number; // Append to list, returns new length Pop(key: string): any; // Remove and return last element Pull(key: string, count: number): any[]; // Remove and return last N elements PullAll(key: string): any[]; // Remove and return all elements AddToSet(key: string, values: any[]): number; // Add unique values to set // Array access operations ArrayLen(key: string): number; // Get array length ArrayGet(key: string, index: number): any; // Get element at index ArraySet(key: string, index: number, value: any): void; // Set element at index ArraySlice(key: string, start: number, end: number): any[]; // Get slice ArrayPage(key: string, page: number, size: number): any[]; // Paginated access ArrayAll(key: string): any[]; // Get all elements // Metadata id: string; // Namespace ID space: string; // Space type: "user", "team", "chat", or "context" } ``` ### Basic KV Operations #### `Get(key): any` Gets a value from the namespace. ```javascript // User preferences const theme = ctx.memory.user.Get("theme"); if (theme) { console.log("User prefers:", theme); } // Chat context const topic = ctx.memory.chat.Get("current_topic"); ``` #### `Set(key, value, ttl?): void` Sets a value with optional TTL (time-to-live in seconds). ```javascript // Persistent user setting ctx.memory.user.Set("language", "en"); // Team configuration ctx.memory.team.Set("api_key", "sk-xxx"); // Chat state ctx.memory.chat.Set("last_query", "What is AI?"); // Temporary context data with 5 minute TTL ctx.memory.context.Set("temp_result", { data: "..." }, 300); ``` #### `Del(key): void` Deletes a key. Supports wildcard patterns with `*`. ```javascript // Delete single key ctx.memory.user.Del("old_setting"); // Delete with wildcard pattern ctx.memory.chat.Del("cache:*"); // Deletes all keys starting with "cache:" ``` #### `Has(key): boolean` Checks if a key exists. ```javascript if (ctx.memory.user.Has("onboarding_complete")) { // Skip onboarding } ``` #### `GetDel(key): any` Atomically gets and deletes a value. Useful for one-time tokens. ```javascript const token = ctx.memory.context.GetDel("one_time_token"); if (token) { // Use token (it's now deleted) } ``` ### Collection Operations #### `Keys(): string[]` Returns all keys in the namespace. ```javascript const userKeys = ctx.memory.user.Keys(); console.log("User has", userKeys.length, "stored values"); ``` #### `Len(): number` Returns the number of keys. ```javascript const count = ctx.memory.chat.Len(); console.log("Chat has", count, "stored values"); ``` #### `Clear(): void` Deletes all keys in the namespace. ```javascript // Clear temporary context data ctx.memory.context.Clear(); ``` ### Atomic Counter Operations #### `Incr(key, delta?): number` Atomically increments a counter. Returns the new value. ```javascript // Simple counter const views = ctx.memory.user.Incr("page_views"); console.log("Total views:", views); // Increment by custom amount const points = ctx.memory.user.Incr("points", 10); ``` #### `Decr(key, delta?): number` Atomically decrements a counter. Returns the new value. ```javascript const remaining = ctx.memory.user.Decr("credits"); if (remaining < 0) { throw new Error("Insufficient credits"); } ``` ### List Operations #### `Push(key, values): number` Appends values to a list. Returns new length. ```javascript const len = ctx.memory.chat.Push("history", [ { role: "user", content: "Hello" }, { role: "assistant", content: "Hi there!" }, ]); ``` #### `Pop(key): any` Removes and returns the last element. ```javascript const lastItem = ctx.memory.chat.Pop("pending_tasks"); ``` #### `Pull(key, count): any[]` Removes and returns the last N elements. ```javascript const recentItems = ctx.memory.chat.Pull("notifications", 5); ``` #### `PullAll(key): any[]` Removes and returns all elements. ```javascript const allTasks = ctx.memory.context.PullAll("batch_queue"); // Process all tasks, queue is now empty ``` #### `AddToSet(key, values): number` Adds unique values to a set (no duplicates). Returns new size. ```javascript ctx.memory.user.AddToSet("visited_pages", ["/home", "/about"]); ctx.memory.user.AddToSet("visited_pages", ["/home", "/contact"]); // "/home" not added again ``` ### Array Access Operations #### `ArrayLen(key): number` Gets the length of an array. ```javascript const historyLen = ctx.memory.chat.ArrayLen("messages"); ``` #### `ArrayGet(key, index): any` Gets an element at a specific index. ```javascript const firstMessage = ctx.memory.chat.ArrayGet("messages", 0); const lastMessage = ctx.memory.chat.ArrayGet("messages", -1); // Negative index ``` #### `ArraySet(key, index, value): void` Sets an element at a specific index. ```javascript ctx.memory.chat.ArraySet("messages", 0, { role: "system", content: "Updated" }); ``` #### `ArraySlice(key, start, end): any[]` Gets a slice of the array. ```javascript const recent = ctx.memory.chat.ArraySlice("messages", -10, -1); // Last 10 messages ``` #### `ArrayPage(key, page, size): any[]` Gets a page of elements (1-indexed pages). ```javascript const page1 = ctx.memory.chat.ArrayPage("messages", 1, 20); // First 20 messages const page2 = ctx.memory.chat.ArrayPage("messages", 2, 20); // Next 20 messages ``` #### `ArrayAll(key): any[]` Gets all elements of the array. ```javascript const allMessages = ctx.memory.chat.ArrayAll("messages"); ``` ### Use Cases ```javascript // Use case 1: User preferences (persistent across sessions) function Create(ctx, messages) { // Load user preferences const locale = ctx.memory.user.Get("preferred_locale") || "en"; const style = ctx.memory.user.Get("response_style") || "concise"; return { messages, locale: locale, metadata: { style: style }, }; } // Use case 2: Chat context (persistent within chat session) function Next(ctx, payload) { // Track conversation topics const topics = ctx.memory.chat.Get("discussed_topics") || []; const newTopic = extractTopic(payload.completion.content); if (newTopic && !topics.includes(newTopic)) { topics.push(newTopic); ctx.memory.chat.Set("discussed_topics", topics); } } // Use case 3: Request-scoped data (cleared on context release) function Create(ctx, messages) { // Store temporary processing data ctx.memory.context.Set("request_start", Date.now()); ctx.memory.context.Set("original_query", messages[0]?.content); return { messages }; } function Next(ctx, payload) { // Retrieve temporary data const startTime = ctx.memory.context.Get("request_start"); const duration = Date.now() - startTime; console.log("Request took", duration, "ms"); // context memory is automatically cleared when ctx.Release() is called } // Use case 4: Team-wide settings function Create(ctx, messages) { // Check team quota const used = ctx.memory.team.Incr("monthly_requests"); const limit = ctx.memory.team.Get("monthly_limit") || 10000; if (used > limit) { throw new Error("Team quota exceeded"); } return { messages }; } // Use case 5: Rate limiting with counters function Create(ctx, messages) { const key = `rate:${new Date().toISOString().slice(0, 13)}`; // Hourly bucket const count = ctx.memory.user.Incr(key); if (count > 100) { throw new Error("Rate limit exceeded"); } return { messages }; } ``` ### Memory Lifecycle | Namespace | Created When | Cleared When | | --------- | ---------------- | --------------- | | `user` | First access | Manual only | | `team` | First access | Manual only | | `chat` | First access | Manual only | | `context` | Context creation | `ctx.Release()` | **Notes:** - `user`, `team`, `chat` namespaces are persistent (backed by database) - `context` namespace is temporary and cleared when the request context is released - All namespaces support TTL for automatic expiration - Wildcard deletion (`Del("prefix:*")`) works on all namespaces - Counter operations (`Incr`, `Decr`) are atomic ## MCP API The `ctx.mcp` object provides access to Model Context Protocol operations for interacting with external tools, resources, and prompts. ### Methods Summary | Method | Description | | ------------------------------------ | -------------------------------- | | `ListResources(client, cursor?)` | List available resources | | `ReadResource(client, uri)` | Read a specific resource | | `ListTools(client, cursor?)` | List available tools | | `CallTool(client, name, args?)` | Call a single tool | | `CallTools(client, tools)` | Call multiple tools sequentially | | `CallToolsParallel(client, tools)` | Call multiple tools in parallel | | `ListPrompts(client, cursor?)` | List available prompts | | `GetPrompt(client, name, args?)` | Get a specific prompt | | `ListSamples(client, type, name)` | List samples for a tool/resource | | `GetSample(client, type, name, idx)` | Get a specific sample by index | ### Resource Operations #### `ctx.mcp.ListResources(client, cursor?)` Lists available resources from an MCP client. **Parameters:** - `client`: String - MCP client ID - `cursor`: String (optional) - Pagination cursor ```javascript const resources = ctx.mcp.ListResources("echo", ""); console.log(resources.resources); // Array of resources ``` #### `ctx.mcp.ReadResource(client, uri)` Reads a specific resource. **Parameters:** - `client`: String - MCP client ID - `uri`: String - Resource URI ```javascript const info = ctx.mcp.ReadResource("echo", "echo://info"); console.log(info.contents); // Array of content items ``` ### Tool Operations #### `ctx.mcp.ListTools(client, cursor?)` Lists available tools from an MCP client. **Parameters:** - `client`: String - MCP client ID - `cursor`: String (optional) - Pagination cursor ```javascript const tools = ctx.mcp.ListTools("echo", ""); console.log(tools.tools); // Array of tools ``` #### `ctx.mcp.CallTool(client, name, arguments?)` Calls a single tool. **Parameters:** - `client`: String - MCP client ID - `name`: String - Tool name - `arguments`: Object (optional) - Tool arguments ```javascript const result = ctx.mcp.CallTool("echo", "ping", { count: 3 }); console.log(result.content); // Tool result content ``` #### `ctx.mcp.CallTools(client, tools)` Calls multiple tools sequentially. **Parameters:** - `client`: String - MCP client ID - `tools`: Array - Array of tool call objects ```javascript const results = ctx.mcp.CallTools("echo", [ { name: "ping", arguments: { count: 1 } }, { name: "status", arguments: { verbose: true } }, ]); console.log(results.results); // Array of results ``` #### `ctx.mcp.CallToolsParallel(client, tools)` Calls multiple tools in parallel. **Parameters:** - `client`: String - MCP client ID - `tools`: Array - Array of tool call objects ```javascript const results = ctx.mcp.CallToolsParallel("echo", [ { name: "ping", arguments: { count: 1 } }, { name: "status", arguments: { verbose: false } }, ]); console.log(results.results); // Array of results (order may vary) ``` ### Prompt Operations #### `ctx.mcp.ListPrompts(client, cursor?)` Lists available prompts from an MCP client. **Parameters:** - `client`: String - MCP client ID - `cursor`: String (optional) - Pagination cursor ```javascript const prompts = ctx.mcp.ListPrompts("echo", ""); console.log(prompts.prompts); // Array of prompts ``` #### `ctx.mcp.GetPrompt(client, name, arguments?)` Retrieves a specific prompt with optional arguments. **Parameters:** - `client`: String - MCP client ID - `name`: String - Prompt name - `arguments`: Object (optional) - Prompt arguments ```javascript const prompt = ctx.mcp.GetPrompt("echo", "test_connection", { detailed: "true", }); console.log(prompt.messages); // Array of prompt messages ``` ### Sample Operations #### `ctx.mcp.ListSamples(client, type, name)` Lists available samples for a tool or resource. **Parameters:** - `client`: String - MCP client ID - `type`: String - Sample type ("tool" or "resource") - `name`: String - Tool or resource name ```javascript const samples = ctx.mcp.ListSamples("echo", "tool", "ping"); console.log(samples.samples); // Array of samples ``` #### `ctx.mcp.GetSample(client, type, name, index)` Gets a specific sample by index. **Parameters:** - `client`: String - MCP client ID - `type`: String - Sample type ("tool" or "resource") - `name`: String - Tool or resource name - `index`: Number - Sample index (0-based) ```javascript const sample = ctx.mcp.GetSample("echo", "tool", "ping", 0); console.log(sample.name, sample.input); // Sample name and input data ``` ## Hooks The Agent system supports two hooks that can be defined in the assistant's `index.ts` file: `Create` and `Next`. ### Agent Execution Lifecycle ```mermaid flowchart TD A[User Input] --> B[Load History] B --> C{Create Hook?} C -->|Yes| D[Execute Create Hook] C -->|No| E{Has Prompts/MCP?} D --> E E -->|Yes| F[Build LLM Request] E -->|No| K F --> G[LLM Stream Call] G --> H{Tool Calls?} H -->|Yes| I[Execute Tools] I --> J{Tool Errors?} J -->|Yes, Retry| G J -->|No| K H -->|No| K K{Next Hook?} K -->|Yes| L[Execute Next Hook] K -->|No| M[Return Response] L --> N{Delegate?} N -->|Yes| O[Call Target Agent] O --> M N -->|No| M M --> P[End] style D fill:#e1f5fe style L fill:#e1f5fe style G fill:#fff3e0 style I fill:#f3e5f5 ``` > **Note:** LLM call is optional. If the assistant has no prompts and no MCP servers configured, the LLM call is skipped. Hooks can be used independently to implement custom logic without LLM involvement. ### Create Hook Called at the beginning of agent execution, before any LLM call. Use this to preprocess messages, add context, configure the request, or implement custom logic. **Signature:** ```typescript function Create( ctx: Context, messages: Message[], options?: Record ): HookCreateResponse | null; ``` **Parameters:** - `ctx`: Context object - `messages`: Array of input messages (including chat history if enabled) - `options`: Optional call-level options (see below) **Options Structure:** ```typescript interface Options { skip?: { history?: boolean; // Skip loading/saving chat history trace?: boolean; // Skip trace recording output?: boolean; // Skip output to client (for internal A2A calls that only need response data) }; connector?: string; // Override LLM connector ID disable_global_prompts?: boolean; // Disable global prompts for this request search?: boolean; // Enable/disable search mode mode?: string; // Agent mode (default: "chat") } ``` **Return Value (`HookCreateResponse`):** ```typescript interface HookCreateResponse { // Messages to be sent to the assistant (can modify/replace input messages) messages?: Message[]; // Audio configuration (for models that support audio output) audio?: AudioConfig; // Generation parameters (override assistant defaults) temperature?: number; max_tokens?: number; max_completion_tokens?: number; // MCP configuration - add/override MCP servers for this request mcp_servers?: MCPServerConfig[]; // Prompt configuration prompt_preset?: string; // Select prompt preset (e.g., "chat.friendly", "task.analysis") disable_global_prompts?: boolean; // Temporarily disable global prompts for this request // Context adjustments - allow hook to modify context fields connector?: string; // Override connector (call-level) locale?: string; // Override locale (session-level) theme?: string; // Override theme (session-level) route?: string; // Override route (session-level) metadata?: Record; // Override or merge metadata (session-level) // Uses configuration - allow hook to override wrapper configurations uses?: UsesConfig; // Override wrapper configurations for vision, audio, search, and fetch force_uses?: boolean; // Force using Uses tools regardless of model capabilities } // Audio output configuration interface AudioConfig { voice: string; // Voice to use (e.g., "alloy", "echo", "fable", "onyx", "nova", "shimmer") format: string; // Audio format (e.g., "wav", "mp3", "flac", "opus", "pcm16") } // MCP server configuration interface MCPServerConfig { server_id: string; // MCP server ID (required) tools?: string[]; // Tool name filter (empty = all tools) resources?: string[]; // Resource URI filter (empty = all resources) } // Uses wrapper configuration interface UsesConfig { vision?: string; // Vision processing tool. Format: "agent" or "mcp:server_id" audio?: string; // Audio processing tool. Format: "agent" or "mcp:server_id" search?: string; // Search tool. Format: "agent" or "mcp:server_id" fetch?: string; // Fetch/retrieval tool. Format: "agent" or "mcp:server_id" } ``` **Example:** ```javascript function Create(ctx, messages) { // Store data for Next hook ctx.memory.context.Set("user_query", messages[0]?.content); // Modify messages const enhanced_messages = messages.map((msg) => ({ ...msg, content: msg.content + "\n\nPlease be concise.", })); // Return configuration return { messages: enhanced_messages, temperature: 0.7, max_tokens: 2000, }; } ``` ### Next Hook Called after the LLM response and tool calls (if any), or directly after Create Hook if no LLM call is configured. Use this to post-process the response, send custom messages, delegate to another agent, or implement custom response logic. **Signature:** ```typescript function Next( ctx: Context, payload: NextHookPayload, options?: Record ): NextHookResponse | null; ``` **Parameters:** - `ctx`: Context object - `payload`: Object containing: - `options`: Optional call-level options (same structure as Create Hook options) ```typescript interface NextHookPayload { messages: Message[]; // Messages sent to the assistant completion?: CompletionResponse; // LLM response tools?: ToolCallResponse[]; // Tool call results (if any) error?: string; // Error message if LLM call failed } interface CompletionResponse { content: string; // LLM text response tool_calls?: ToolCall[]; // Tool calls requested by LLM usage?: UsageInfo; // Token usage statistics } interface ToolCallResponse { toolcall_id: string; server: string; // MCP server name tool: string; // Tool name arguments?: any; // Arguments passed to tool result?: any; // Tool execution result error?: string; // Error if tool failed } ``` **Return Value (`NextHookResponse`):** ```typescript interface NextHookResponse { // Delegate to another agent (recursive call) // If provided, the current agent will call the target agent delegate?: { agent_id: string; // Required: target agent ID messages: Message[]; // Messages to send to target agent options?: Record; // Optional: call-level options for delegation }; // Custom response data // Will be placed in Response.next field and returned to user // If both delegate and data are null/undefined, standard Response is returned data?: any; // Metadata for debugging and logging metadata?: Record; } ``` **Agent Response Structure:** The agent's `Stream()` method returns a `Response` object: ```typescript interface Response { request_id: string; // Request ID context_id: string; // Context ID trace_id: string; // Trace ID chat_id: string; // Chat ID assistant_id: string; // Assistant ID create?: HookCreateResponse; // Create hook response next?: any; // See below for what this contains completion?: CompletionResponse; // LLM completion response } ``` **Response.next field logic:** - If `NextHookResponse.data` is provided → `Response.next` = custom data - If `NextHookResponse.data` is null/undefined → `Response.next` = entire `NextHookResponse` object - If no Next hook defined → `Response.next` = null **Example:** ```javascript /** * Next Hook - Process LLM response * @param {Context} ctx - Agent context * @param {NextHookPayload} payload - Contains messages, completion, tools, error * @returns {NextHookResponse | null} - Return null for standard response */ function Next(ctx, payload) { const { messages, completion, tools, error } = payload; // Handle errors gracefully if (error) { return { data: { status: "error", message: error, recovery: "Please try again", }, metadata: { error_handled: true }, }; } // Process tool results if any if (tools && tools.length > 0) { const successful = tools.filter((t) => !t.error); const failed = tools.filter((t) => t.error); return { data: { status: "tools_processed", total: tools.length, successful: successful.length, failed: failed.length, results: successful.map((t) => t.result), }, metadata: { has_failures: failed.length > 0 }, }; } // Return custom data based on completion if (completion && completion.content) { return { data: { status: "success", response: completion.content, processed: true, }, metadata: { source: "next_hook" }, }; } // Return null to use standard response return null; } ``` ### Hook Execution Flow See the [Agent Execution Lifecycle](#agent-execution-lifecycle) diagram above for a visual representation. **Key Points:** - **Hooks are optional** - if not defined, the agent uses default behavior - **LLM call is optional** - only executed if the assistant has prompts or MCP servers configured - **Return `null` or `undefined`** from hooks to use default behavior - **Hooks can send messages directly** via `ctx.Send()`, `ctx.SendStream()`, etc. - **Create Hook** runs before LLM call (if any), can modify messages and configure the request - **Next Hook** runs after LLM call and tool execution (if any), can post-process or delegate - Use `ctx.memory.context` to pass data between Create and Next hooks within a request ## Complete Example Here's a comprehensive example demonstrating Create and Next hooks with various Context API features: ```javascript /** * Create Hook - Preprocess messages and configure the request * * @param {Context} ctx - Agent context object * @param {Message[]} messages - Input messages (including history if enabled) * @returns {HookCreateResponse | null} - Configuration for LLM call, or null for defaults */ function Create(ctx, messages) { // Extract user query from the last message const user_query = messages[messages.length - 1]?.content || ""; // Store data in context memory for use in Next hook ctx.memory.context.Set("original_query", user_query); ctx.memory.context.Set("request_time", Date.now()); // Add trace node to show processing in UI const create_node = ctx.trace.Add( { query: user_query }, { label: "Create Hook", type: "preprocessing", icon: "play", description: "Analyzing user request", } ); // Check if user needs search functionality const needs_search = user_query.toLowerCase().includes("search") || user_query.toLowerCase().includes("find"); if (needs_search) { create_node.Info("Search mode enabled"); // Configure MCP servers for search return { messages: messages, mcp_servers: [{ server_id: "search_engine" }], prompt_preset: "search.assistant", metadata: { mode: "search" }, }; } create_node.Complete({ mode: "standard" }); // Return modified messages or configuration return { messages: messages, temperature: 0.7, max_tokens: 2000, }; } /** * Next Hook - Process LLM response and optionally customize output * * @param {Context} ctx - Agent context object * @param {NextHookPayload} payload - Contains messages, completion, tools, error * @returns {NextHookResponse | null} - Custom response, delegation, or null for standard */ function Next(ctx, payload) { const { messages, completion, tools, error } = payload; // Retrieve data from Create hook via context memory const original_query = ctx.memory.context.Get("original_query"); const request_time = ctx.memory.context.Get("request_time"); const duration = Date.now() - request_time; // Create trace node for Next hook processing const next_node = ctx.trace.Add( { completion_length: completion?.content?.length || 0 }, { label: "Next Hook", type: "postprocessing", icon: "check", description: "Processing LLM response", } ); // Handle errors if (error) { next_node.Fail(error); return { data: { status: "error", message: "An error occurred while processing your request", error: error, }, }; } // Process tool call results if (tools && tools.length > 0) { next_node.Info(`Processing ${tools.length} tool results`); const successful = tools.filter((t) => !t.error); const results = successful.map((t) => ({ tool: t.tool, server: t.server, result: t.result, })); // Send streaming message with results const msg_id = ctx.SendStream("## Tool Results\n\n"); results.forEach((r, i) => { ctx.Append(msg_id, `**${i + 1}. ${r.tool}**\n`); ctx.Append(msg_id, `${JSON.stringify(r.result, null, 2)}\n\n`); }); ctx.End(msg_id); next_node.SetMetadata("tools_processed", tools.length); next_node.Complete({ status: "tools_processed" }); return { data: { status: "success", tool_results: results, duration_ms: duration, }, metadata: { processed_by: "next_hook" }, }; } // Check if delegation is needed based on completion content if (completion?.content?.toLowerCase().includes("delegate to specialist")) { next_node.Info("Delegating to specialist agent"); return { delegate: { agent_id: "specialist.agent", messages: [ { role: "system", content: "Handle this specialized request" }, { role: "user", content: original_query }, ], options: { priority: "high" }, }, metadata: { reason: "specialist_needed" }, }; } // Standard processing - add metadata and return next_node.SetMetadata("duration_ms", duration); next_node.Complete({ status: "success" }); // Return null to use standard LLM response // Or return custom data to override return null; } ``` ## Best Practices 1. **Error Handling**: Always wrap Context operations in try-catch blocks 2. **Resource Cleanup**: Only call `ctx.Release()` for manually created Context, not in hooks 3. **Trace Organization**: Create meaningful trace nodes with descriptive labels 4. **Logging Levels**: Use appropriate log levels (Debug for development, Info for progress, Error for failures) 5. **Message IDs**: Let the system auto-generate message IDs unless you need specific tracking 6. **Parallel Operations**: Use `Trace.Parallel()` for concurrent operations to maintain trace clarity 7. **Memory Usage**: Use `ctx.memory.context` for request-scoped data, `ctx.memory.chat` for chat state, `ctx.memory.user` for user preferences 8. **Streaming Messages**: Use `SendStream()` + `Append()` + `End()` for streaming output; use `Send()` for complete messages 9. **Block Grouping**: Only use Block IDs when you need to group multiple messages together (e.g., LLM output + follow-up card) ## Error Handling All Context methods throw exceptions on failure. Always handle errors appropriately: ```javascript try { ctx.Send(message); } catch (error) { ctx.trace.Error("Failed to send message", { error: error.message }); throw error; } ``` ## TypeScript Support For TypeScript projects, the Context types are automatically inferred. You can also import explicit types: ```typescript import { Context, Message, TraceNodeOption } from "@yao/runtime"; interface NextPayload { messages: Message[]; completion: any; tools: any[]; error?: string; } function Next( ctx: Context, payload: NextHookPayload, options?: Record ): NextHookResponse | null { // Your code with full type checking const { messages, completion, tools, error } = payload; // ... } ``` ## See Also - [Agent Hooks Documentation](../hooks/README.md) - [MCP Protocol Specification](../mcp/README.md) - [Trace System Documentation](../../trace/README.md) - [Message Format Specification](../message/README.md)