Skip to content

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

448 Commits
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

MCPAgent - Go Agent Runtime

Go Version License

A production-ready Go library for building tool-using, code-executing agents across frontier, open, and CLI-native model providers. MCP support is built in, but it is only one part of the runtime.

⚑ Why People Use It

  • Build one agent runtime instead of separate code paths for MCP tools, code execution, and provider switching
  • Mix API-native models and CLI-native coding agents like Claude Code, Codex, Cursor, and Pi
  • Add production features such as summarization, large-output offloading, parallel tools, tracing, and caching
  • Reuse the same runtime from Go applications and from the Node.js SDK

🎯 What is MCPAgent?

MCPAgent is a general-purpose Go agent runtime. It gives you one agent abstraction that can:

  • Use MCP tools across multiple servers and protocols (HTTP, SSE, stdio)
  • Run in multiple execution modes with direct tool use and code execution
  • Connect to coding-agent CLIs such as Claude Code, Codex, Cursor, and Pi
  • Route across model ecosystems including OpenAI, Anthropic, OpenRouter, Bedrock, Vertex, Azure, MiniMax, and open-model gateways
  • Execute tools efficiently with optional parallel tool calls, caching, and dynamic tool discovery
  • Stay productive in long sessions with context summarization and large-output offloading
  • Support production workflows with observability, custom tools, session reuse, and a Node.js SDK

If you only need MCP, the library does that well. If you need a broader agent runtime that can mix MCP, code execution, provider routing, coding agents, and workflow orchestration, that is the larger value of the project.

βœ… Start Here

If you are evaluating the project for the first time, the Quick Start below is the smallest working MCP-backed agent. From there, the agent package tests are the maintained reference for real usage β€” they exercise construction, turns, tool routing, and coding-agent transports against the current API.

The standalone examples/ tree was removed: each example pinned its own module and kept compatibility APIs public purely to stay compiling. Executable behaviour now lives in tests that run in CI and cannot silently rot.

πŸš€ Quick Start

Installation

# Add to your go.mod
go get github.com/manishiitg/mcpagent

# Or use replace directive for local development
replace github.com/manishiitg/mcpagent => ../mcpagent

Basic Usage

package main

import (
	"context"
	"fmt"
	"os"
	"time"

	mcpagent "github.com/manishiitg/mcpagent/agent"
	"github.com/manishiitg/mcpagent/llm"
)

func main() {
	openAIKey := os.Getenv("OPENAI_API_KEY")
	if openAIKey == "" {
		panic("OPENAI_API_KEY is required")
	}

	llmModel, err := llm.InitializeLLM(llm.Config{
		Provider: llm.ProviderOpenAI,
		ModelID:  "gpt-4o",
		APIKeys: &llm.ProviderAPIKeys{
			OpenAI: &openAIKey,
		},
	})
	if err != nil {
		panic(err)
	}

	ctx, cancel := context.WithTimeout(context.Background(), 5*time.Minute)
	defer cancel()

	agent, err := mcpagent.NewAgentFromDefinition(ctx,
		mcpagent.AgentDefinition{
			Instructions: "You are a helpful assistant.",
			Tools: mcpagent.ToolSet{
				MCP: []mcpagent.MCPToolSource{{Name: "context7"}},
			},
		},
		mcpagent.RuntimeConfig{
			Model:         llmModel,
			MCPConfigPath: "mcp_servers.json",
		},
	)
	if err != nil {
		panic(err)
	}
	defer agent.Close()

	result, err := agent.Run(ctx, mcpagent.Turn{
		Input: "What tools are available?",
	})
	if err != nil {
		panic(err)
	}

	fmt.Println(result.Text)
	fmt.Printf("tokens: %d\n", result.Usage.TotalTokens)
}

The shape of the API

NewAgentFromDefinition is the only public constructor, and it takes exactly two values:

  • AgentDefinition β€” the agent's identity: Instructions, Skills, and Tools. These are cloned and validated at construction and never change afterwards.
  • RuntimeConfig β€” the infrastructure that operates it: Model, MCPConfigPath, plus grouped Generation, Tools, Context, Coding, MCP, Workspace, and Observability settings.

Per-request concerns belong to the turn, not the agent. Turn carries Input, optional History, a ToolPolicy, and an optional StreamingCallback; Result returns Text, History, a resumable Handle, and structured Usage.

*Agent has exactly four methods β€” Run, Start, Definition, and Close β€” and no exported fields. There are no With* option functions; anything that was once an option is now a named field on RuntimeConfig.

Multi-turn conversations

Run is the single-turn convenience path. When history must persist across turns, open a session β€” it owns history, continuation, steering, and events:

session, err := agent.Start(ctx)
if err != nil {
	panic(err)
}
defer session.Close()

first, err := session.Run(ctx, mcpagent.Turn{Input: "List the available tools."})
if err != nil {
	panic(err)
}

// History carries forward automatically; no need to thread it yourself.
second, err := session.Run(ctx, mcpagent.Turn{Input: "Now use the first one."})
if err != nil {
	panic(err)
}

fmt.Println(first.Text, second.Text)

Run calls on one session are serialized. Use separate sessions for concurrency. session.Snapshot() returns a handle you can later pass as RuntimeConfig.ResumeHandle to continue a conversation in a new process.

🟒 Node.js SDK

The official Node.js/TypeScript SDK provides a simple interface for building MCP agents in JavaScript/TypeScript applications. The SDK communicates with the Go server via gRPC over Unix sockets for low-latency, bidirectional streaming, and it can route through API providers as well as supported CLI-native providers.

Installation

npm install @mcpagent/node

Basic Usage

import { MCPAgent } from '@mcpagent/node';

const agent = new MCPAgent({
  serverOptions: {
    mcpConfigPath: './mcp_servers.json',
    logLevel: 'info',
  },
});

// Initialize with your LLM provider
await agent.initialize({
  provider: 'codex-cli',
  modelId: 'high',
});

// Ask a question
const response = await agent.ask('What tools do you have available?');
console.log(response.response);

// Streaming responses
for await (const event of agent.askStream('Explain quantum computing')) {
  if (event.type === 'chunk') {
    process.stdout.write(event.text);
  } else if (event.type === 'final' && event.response) {
    console.log(event.response);
  }
}

// Cleanup
await agent.destroy();

Custom Tools

Register JavaScript/TypeScript handlers that the LLM can call:

import { MCPAgent } from '@mcpagent/node';

const agent = new MCPAgent({
  serverOptions: { mcpConfigPath: './mcp_servers.json' },
});

// Register a calculator tool
agent.registerTool(
  'calculate',
  'Perform a mathematical calculation',
  {
    type: 'object',
    properties: {
      expression: { type: 'string', description: 'Math expression to evaluate' },
    },
    required: ['expression'],
  },
  async (args) => {
    const result = Function(`"use strict"; return (${args.expression})`)();
    return String(result);
  },
  { timeoutMs: 5000 }
);

await agent.initialize({
  provider: 'vertex',
  modelId: 'gemini-3-flash-preview',
});

// The LLM can now use your custom tool
const response = await agent.ask('What is 15 * 7 + 23?');
// Output: 15 * 7 + 23 = 128

Architecture

The Node.js SDK uses a gRPC bidirectional streaming architecture:

Node.js SDK ◄══════════════════════════════════► Go Server
            Single bidirectional gRPC stream
            - Client sends: questions, tool results
            - Server sends: text chunks, tool calls, events, final response

Benefits:

  • Real-time streaming: Token-by-token responses via gRPC stream
  • Inline tool callbacks: Custom tools execute in the same connection (no separate callback server)
  • Low latency: Unix domain sockets for IPC
  • Type-safe: Protocol Buffers for all messages

SDK Examples

For SDK usage and complete examples, see sdk-node/README.md.

πŸ“š Core Features

1. Standard Tool-Use Agent

The default mode where the LLM invokes tools directly through native tool calling. Nothing needs to be enabled β€” it is what you get from a definition with no code-execution flag:

agent, err := mcpagent.NewAgentFromDefinition(ctx,
    mcpagent.AgentDefinition{
        Instructions: "You are a helpful assistant.",
        Tools: mcpagent.ToolSet{
            MCP: []mcpagent.MCPToolSource{{Name: "context7"}},
        },
    },
    mcpagent.RuntimeConfig{Model: llmModel, MCPConfigPath: "config.json"},
)

2. Code Execution Mode

Execute code in any language (Python, bash, curl, Go, etc.) instead of JSON tool calls. The LLM discovers MCP tool endpoints via an OpenAPI spec and writes code that makes HTTP requests:

// Generate API token for bearer auth
apiToken := executor.GenerateAPIToken()

// Start HTTP server with per-tool endpoints and auth
handlers := executor.NewExecutorHandlers(configPath, logger)
mux := http.NewServeMux()
mux.HandleFunc("/api/mcp/execute", handlers.HandleMCPExecute)
mux.HandleFunc("/api/custom/execute", handlers.HandleCustomExecute)
// Per-tool wildcard endpoints (used by OpenAPI spec)
mux.HandleFunc("/tools/mcp/", func(w http.ResponseWriter, r *http.Request) {
    // Route /tools/mcp/{server}/{tool} to handler
    path := strings.TrimPrefix(r.URL.Path, "/tools/mcp/")
    parts := strings.SplitN(path, "/", 2)
    server, tool := parts[0], parts[1]
    handlers.HandlePerToolMCPRequest(w, r, server, tool)
})
authedHandler := executor.AuthMiddleware(apiToken)(mux)

server := &http.Server{Addr: "127.0.0.1:8000", Handler: authedHandler}
go server.ListenAndServe()
defer server.Shutdown(ctx)

// Create agent with code execution mode
agent, err := mcpagent.NewAgentFromDefinition(ctx,
    definition,
    mcpagent.RuntimeConfig{
        Model:         llmModel,
        MCPConfigPath: "config.json",
        Tools:         mcpagent.ToolRuntimeConfig{CodeExecution: true},
        MCP: mcpagent.MCPRuntimeConfig{
            APIBaseURL: "http://127.0.0.1:8000",
            APIToken:   apiToken,
        },
    },
)

The LLM calls get_api_spec(tool_name) to discover per-tool HTTP endpoints, then uses execute_shell_command to write and run code that calls those endpoints. Custom tools (workspace tools, shell execution) remain as direct tool calls.

tool_name accepts a single name or an array, and is the only required argument β€” the tool name is the address. server_name is optional and used solely to disambiguate a real MCP server; built-in tools resolve by name alone.

Note: Code execution mode requires an HTTP server with bearer token auth running (configured via RuntimeConfig.MCP.APIBaseURL and APIToken).

3. Context Offloading

Context offloading is a context engineering strategy that automatically saves large tool outputs to the filesystem instead of keeping them in the LLM's context window. This implements the "offload context" pattern, one of three primary context engineering approaches used in production agents like Manus.

Why Context Offloading?

As agents execute tasks, tool call results accumulate in the context window. Research from Chroma and Anthropic shows that as context windows fill, LLM performance degrades due to attention budget depletion. Context offloading prevents this by:

  • Saving tokens: Only file path + preview (~200 chars) instead of full content (potentially 50k+ chars)
  • Preventing context overflow: Large outputs don't consume context window space
  • Maintaining performance: LLM attention budget isn't depleted by large payloads
  • Enabling efficient exploration: Agent can access data incrementally as needed

How It Works:

offloading := true

agent, err := mcpagent.NewAgentFromDefinition(ctx, definition,
    mcpagent.RuntimeConfig{
        Model:         llmModel,
        MCPConfigPath: "config.json",
        Context: mcpagent.ContextRuntimeConfig{
            Offloading:           &offloading,
            LargeOutputThreshold: 10000, // tokens (default)
        },
    },
)

When tool outputs exceed the threshold:

  1. External Storage: Full content is saved to tool_output_folder/{session-id}/ with unique filenames
  2. Compact Reference: LLM receives file path + preview (first 50% of threshold) instead of full content
  3. On-Demand Access: Agent uses search_large_output with read, search, or query operations to access data incrementally.

Example Token Savings:

Without Context Offloading:
- Tool Output: 50,000 characters (~12,500 tokens)
- Sent to LLM: 50,000 chars (~12,500 tokens)
- Result: Context window overflow, attention budget depletion

With Context Offloading:
- Tool Output: 50,000 characters (~12,500 tokens)
- Saved to filesystem: 50,000 chars
- Sent to LLM: ~200 chars (file path + preview) (~50 tokens)
- Result: 99.6% token reduction, no context overflow

Note: The threshold is measured in tokens (using tiktoken encoding), not characters.
A threshold of 10000 tokens roughly equals ~40,000 characters (assuming ~4 chars per token).

Related Patterns:

This implementation follows the context engineering strategies outlined in Manus's approach:

  • Offload Context: Store tool results externally, access on-demand βœ… Implemented
  • Reduce Context: Compact stale results, summarize when needed ⏳ Pending
  • Isolate Context: Use sub-agents for discrete tasks (multi-agent support)

Similar patterns are used in Claude Code, LangChain, and other production agent systems.

Pending: Dynamic Context Reduction

Currently, context offloading only applies to large tool outputs when they're first generated. A future enhancement will implement dynamic context reduction to compact stale tool results as the context window fills, even if they weren't initially large.

What's Pending:

  1. Compact Stale Results

    • Concept: Replace older tool results with compact references (e.g., file paths) as context fills
    • Behavior: Keep recent tool results in full to guide the agent's next decision, while older results are replaced with references
    • Implementation: Automatically detect when tool results become "stale" (based on age, relevance, or context usage) and replace them with compact references
    • Scope: This would apply to ALL tool results (not just large ones), dynamically compacting them when they become "stale"
    • Reference: Similar to Anthropic's context editing feature
    • Example: A 2000-token tool result from 10 turns ago becomes: "Tool: search_docs returned results (saved to: tool_output_folder/session-123/search_20250101_120000.json)"
  2. Summarize When Needed

    • Concept: Once compaction reaches diminishing returns, apply schema-based summarization to the full trajectory
    • Behavior: Generate consistent summary objects using full tool results, further reducing context while preserving essential information
    • Implementation: When compaction alone isn't enough to manage context size, apply structured summarization with predefined schemas for different tool result types
    • Scope: Summarize the entire conversation trajectory when individual compaction is insufficient
    • Example: Instead of keeping 20 tool calls with full results, create a structured summary:
      {
        "tool_calls_summary": [
          {"tool": "search", "count": 5, "key_findings": ["..."], "files": ["..."]},
          {"tool": "read_file", "count": 3, "files_read": ["..."]}
        ]
      }

Current Behavior vs. Future Enhancement:

Current (Context Offloading):
- Large output (>10k tokens) β†’ Offloaded immediately
- Small output (<10k tokens) β†’ Stays in context forever
- Result: Context can still fill up with many small tool results

Future (Context Reduction):
- Large output (>10k tokens) β†’ Offloaded immediately βœ…
- Small output (<10k tokens) β†’ Stays in context initially
- As context fills β†’ Small outputs become "stale" β†’ Compacted to references
- When compaction insufficient β†’ Summarize trajectory
- Result: Context window stays manageable throughout long conversations

This enhancement would complete the "Reduce Context" strategy from Manus's context engineering approach, working alongside context offloading to maintain optimal context window usage.

Context offloading is exercised end-to-end by the search_large_output tests in the agent package.

4. Context Summarization

Automatically summarize conversation history when token usage exceeds a threshold to maintain long-running conversations:

agent, err := mcpagent.NewAgentFromDefinition(ctx, definition,
    mcpagent.RuntimeConfig{
        Model:         llmModel,
        MCPConfigPath: "config.json",
        Context: mcpagent.ContextRuntimeConfig{
            SummarizationEnabled: true,
            // Trigger when token usage reaches 70% of the context window
            SummarizeOnTokenThreshold: true,
            TokenThresholdPercent:     0.7,
            // Keep the last 8 messages intact
            SummaryKeepLastMessages: 8,
        },
    },
)

The agent monitors token usage and automatically replaces older messages with a concise LLM-generated summary when the threshold is reached, while preserving recent messages and tool call integrity. This enables "infinite" conversation depth within fixed context windows.

5. MCP Server Caching

Intelligent caching reduces connection times by 60-85%:

// Caching is enabled by default
// Configure via environment variables:
// MCP_CACHE_DIR=/path/to/cache
// MCP_CACHE_TTL_MINUTES=10080 (7 days)

6. Custom Tools

Register your own tools that work alongside MCP server tools. Custom tools work in both standard mode and code execution mode:

Standard Mode (direct tool calls):

// Define tool parameters (JSON schema)
params := map[string]interface{}{
    "type": "object",
    "properties": map[string]interface{}{
        "operation": map[string]interface{}{
            "type": "string",
            "enum": []string{"add", "subtract", "multiply", "divide"},
        },
        "a": map[string]interface{}{"type": "number"},
        "b": map[string]interface{}{"type": "number"},
    },
    "required": []string{"operation", "a", "b"},
}

// Declare the tool as part of the agent's identity
definition := mcpagent.AgentDefinition{
    Instructions: "You are a helpful assistant.",
    Tools: mcpagent.ToolSet{
        Direct: []mcpagent.ToolDefinition{{
            Name:         "calculator",
            Description:  "Performs mathematical operations",
            InputSchema:  params,
            Execute:      calculatorFunction,
            DisplayGroup: "utility", // optional presentation metadata
        }},
    },
}

// Tool execution function
func calculatorFunction(ctx context.Context, args map[string]interface{}) (string, error) {
    // Extract and validate arguments
    operation := args["operation"].(string)
    a := args["a"].(float64)
    b := args["b"].(float64)
    
    // Perform calculation
    var result float64
    switch operation {
    case "add": result = a + b
    case "subtract": result = a - b
    // ...
    }
    
    return fmt.Sprintf("Result: %.2f", result), nil
}

Code Execution Mode (direct tool calls + HTTP API):

// In code execution mode, custom tools are:
// 1. Exposed as direct LLM tool calls (e.g., execute_shell_command, workspace tools)
// 2. MCP server tools are accessed via HTTP API endpoints (discovered via get_api_spec)
// 3. Custom tools can also be accessed via /api/custom/execute endpoint

// Declared exactly the same way β€” there is no separate code-execution API
definition := mcpagent.AgentDefinition{
    Tools: mcpagent.ToolSet{
        Direct: []mcpagent.ToolDefinition{{
            Name:        "get_weather",
            Description: "Gets weather data for a location",
            InputSchema: weatherParams,
            Execute:     weatherFunction,
        }},
    },
}

// LLM can call custom tools directly as tool calls,
// or use get_api_spec to discover HTTP endpoints for MCP tools

Custom tools behave the same in standard and code-execution mode: they are registered on the AgentDefinition and are addressed by their globally unique tool name. In code-execution mode they are additionally reachable over the HTTP API described above.

7. Parallel Tool Execution

When the LLM returns multiple tool calls in a single response, they can be executed concurrently using goroutines (fork-join pattern) instead of sequentially:

agent, err := mcpagent.NewAgentFromDefinition(ctx, definition,
    mcpagent.RuntimeConfig{
        Model:         llmModel,
        MCPConfigPath: "config.json",
        Tools:         mcpagent.ToolRuntimeConfig{ParallelExecution: true},
    },
)

How it works:

  1. LLM returns N tool calls in one response
  2. All tool calls are prepared sequentially (argument parsing, client resolution)
  3. Tool calls execute concurrently via goroutines
  4. Results are collected in deterministic order matching the original tool call order

Observability: ToolCallStartEvent includes an IsParallel field (true when the tool call is part of a parallel batch, false for sequential execution) so event listeners and tracers can distinguish between parallel and sequential tool calls.

8. Observability

Built-in tracing with Langfuse support:

tracer, err := observability.NewLangfuseTracerWithLogger(logger)
if err != nil {
    return err
}
agent, err := mcpagent.NewAgentFromDefinition(ctx, definition,
    mcpagent.RuntimeConfig{
        Model:         llmModel,
        MCPConfigPath: "config.json",
        Observability: mcpagent.ObservabilityRuntimeConfig{
            Tracers: []observability.Tracer{tracer},
            TraceID: "trace-id",
            Logger:  logger,
        },
    },
)

πŸ“– Documentation

Comprehensive documentation is available in the docs/ directory:

πŸ“ Reference Usage

The standalone examples/ tree has been removed. Each example was its own Go module, and keeping them compiling required holding constructors and option functions public long after the library itself had stopped needing them β€” the demonstrations were dictating the API surface.

Maintained usage now lives in the agent package tests, which run in CI against the current public API:

  • agent construction through NewAgentFromDefinition and AgentDefinition
  • multi-turn conversations, history, and context summarization
  • custom tool registration and tool filtering
  • code-execution mode, including get_api_spec resolution and the HTTP tool API
  • coding-agent providers (Claude Code, Codex CLI) over the MCP bridge
  • context offloading via search_large_output

For the Node.js SDK, see sdk-node/README.md.

πŸ”§ Configuration

MCP Server Configuration

Create a JSON file with your MCP servers:

{
  "mcpServers": {
    "filesystem": {
      "command": "npx",
      "args": ["-y", "@modelcontextprotocol/server-filesystem", "./demo"]
    },
    "memory": {
      "command": "npx",
      "args": ["-y", "@modelcontextprotocol/server-memory"]
    }
  }
}

Runtime Configuration

Runtime settings are named fields on RuntimeConfig, grouped by purpose. There are no functional options β€” the grouping is what replaced them, so configuration is one explicit value rather than an order-sensitive list:

offloading := true

agent, err := mcpagent.NewAgentFromDefinition(ctx, definition,
    mcpagent.RuntimeConfig{
        Model:         llmModel,
        MCPConfigPath: "config.json",

        Generation: mcpagent.GenerationRuntimeConfig{
            MaxTurns:    30,
            Temperature: 0.7,
            ToolChoice:  "auto",
        },

        Tools: mcpagent.ToolRuntimeConfig{
            CodeExecution:     true,
            ParallelExecution: true,
            SelectedTools:     []string{"tool1", "tool2"},
            SelectedServers:   []string{"server1", "server2"},
        },

        Context: mcpagent.ContextRuntimeConfig{
            Offloading:                &offloading,
            LargeOutputThreshold:      10000,
            SummarizationEnabled:      true,
            SummarizeOnTokenThreshold: true,
            TokenThresholdPercent:     0.7,
        },

        Observability: mcpagent.ObservabilityRuntimeConfig{
            Tracers: []observability.Tracer{tracer},
            TraceID: traceID,
            Logger:  logger,
        },
    },
)

Custom tools are part of the definition, not registered afterwards β€” an agent's tools are fixed once it exists:

definition := mcpagent.AgentDefinition{
    Instructions: "You are a helpful assistant.",
    Tools: mcpagent.ToolSet{
        Direct: []mcpagent.ToolDefinition{{
            Name:        "calculate",
            Description: "Evaluate a arithmetic expression",
            InputSchema: map[string]interface{}{
                "type": "object",
                "properties": map[string]interface{}{
                    "expression": map[string]interface{}{"type": "string"},
                },
                "required": []string{"expression"},
            },
            Execute: func(ctx context.Context, args map[string]interface{}) (string, error) {
                return evaluate(args["expression"].(string))
            },
        }},
        MCP: []mcpagent.MCPToolSource{{Name: "context7"}},
    },
}

Tools are addressed by their globally unique Name. DisplayGroup is optional presentation metadata only β€” it takes no part in addressing or authorization.

To narrow which tools a single request may use without rebuilding the agent, set Turn.ToolPolicy.AllowedTools. An empty slice means every tool in the definition is allowed.

// Folder guard paths are set on the created agent instance agent.SetFolderGuardPaths(allowedRead, allowedWrite)


## πŸ§ͺ Testing

The package includes comprehensive testing utilities:

```bash
# Run all tests
cd cmd/testing
go test ./...

# Run specific test
go run testing.go agent-mcp --log-file logs/test.log
go run testing.go code-exec --log-file logs/test.log
go run testing.go parallel-tool-exec --provider vertex --model gemini-3-flash-preview

See cmd/testing/README.md for details.

πŸ“ Package Structure

mcpagent/
β”œβ”€β”€ agent/              # Core agent implementation
β”‚   β”œβ”€β”€ agent.go       # Core Agent struct and runtime
β”‚   β”œβ”€β”€ definition.go  # AgentDefinition, RuntimeConfig, NewAgentFromDefinition()
β”‚   β”œβ”€β”€ turn_session.go # Turn/Result, Session, and the four Agent methods
β”‚   β”œβ”€β”€ conversation.go # Conversation loop and tool execution
β”‚   β”œβ”€β”€ connection_session.go # Session-scoped MCP connection management
β”‚   └── ...
β”œβ”€β”€ grpcserver/        # gRPC server (for SDK communication)
β”‚   β”œβ”€β”€ server.go      # gRPC server setup
β”‚   β”œβ”€β”€ service.go     # AgentService implementation
β”‚   β”œβ”€β”€ stream_handler.go # Bidirectional stream handling
β”‚   └── pb/            # Generated protobuf code
β”œβ”€β”€ mcpclient/         # MCP client implementations
β”‚   β”œβ”€β”€ client.go       # Client interface and implementations
β”‚   β”œβ”€β”€ stdio_manager.go # stdio protocol
β”‚   β”œβ”€β”€ sse_manager.go  # SSE protocol
β”‚   └── http_manager.go # HTTP protocol
β”œβ”€β”€ mcpcache/          # Caching system
β”‚   β”œβ”€β”€ manager.go     # Cache manager
β”‚   └── openapi/       # OpenAPI spec generation for code execution mode
β”œβ”€β”€ llm/               # LLM provider integration
β”‚   β”œβ”€β”€ providers.go   # Provider implementations
β”‚   └── types.go       # LLM types
β”œβ”€β”€ events/            # Event system
β”‚   β”œβ”€β”€ data.go        # Event data structures
β”‚   └── types.go       # Event types
β”œβ”€β”€ logger/             # Logging
β”‚   └── v2/            # Logger v2 interface
β”œβ”€β”€ observability/     # Tracing and observability
β”‚   β”œβ”€β”€ tracer.go      # Tracer interface
β”‚   └── langfuse_tracer.go # Langfuse implementation
β”œβ”€β”€ executor/          # Tool execution handlers
β”œβ”€β”€ sdk-node/          # Node.js/TypeScript SDK
β”‚   β”œβ”€β”€ src/           # SDK source code
β”‚   β”‚   β”œβ”€β”€ agent.ts   # MCPAgent class
β”‚   β”‚   β”œβ”€β”€ grpc-client.ts # gRPC client
β”‚   β”‚   └── stream-handler.ts # Stream management
β”‚   └── README.md      # SDK documentation
β”œβ”€β”€ proto/             # Protocol Buffer definitions
β”‚   └── agent.proto    # gRPC service definitions
└── docs/              # Documentation

πŸ”Œ Supported LLM Providers

  • OpenAI: GPT-4.1, GPT-4o, reasoning models, and compatible tool-calling models
  • Anthropic: Claude models through direct provider integration
  • OpenRouter: Access to open and frontier models behind a unified API
  • AWS Bedrock: Claude, Llama, Mistral, and other Bedrock-served models
  • Google Vertex AI: Gemini and related Vertex-hosted models
  • Azure: Azure-hosted OpenAI and related model deployments
  • Claude Code / Codex / Cursor / Pi CLI providers: Coding-agent integrations through provider abstractions
  • MiniMax: MiniMax chat and coding-plan providers
  • Custom Providers: Extensible provider interface

πŸ”Œ Supported MCP Protocols

MCP remains an important integration layer in the runtime, with support for:

  • stdio: Standard input/output (most common)
  • SSE: Server-Sent Events
  • HTTP: REST API

🀝 Contributing

Contributions are welcome! Please see the Documentation Writing Guide for standards.

πŸ“„ License

This project is licensed under the MIT License - see the LICENSE file for details.

πŸ™ Acknowledgments


Made with ❀️ for the AI community

About

Go agent runtime for tool-using, code-executing, multi-provider agents with MCP support, coding-agent CLI integrations, structured output, summarization, and parallel tool execution.

Topics

Resources

Stars

1 star

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages