A production-ready Go library for building tool-using, code-executing agents across frontier, open, and CLI-native model providers. MCP support is built in, but it is only one part of the runtime.
- Build one agent runtime instead of separate code paths for MCP tools, code execution, and provider switching
- Mix API-native models and CLI-native coding agents like Claude Code, Codex, Cursor, and Pi
- Add production features such as summarization, large-output offloading, parallel tools, tracing, and caching
- Reuse the same runtime from Go applications and from the Node.js SDK
MCPAgent is a general-purpose Go agent runtime. It gives you one agent abstraction that can:
- Use MCP tools across multiple servers and protocols (HTTP, SSE, stdio)
- Run in multiple execution modes with direct tool use and code execution
- Connect to coding-agent CLIs such as Claude Code, Codex, Cursor, and Pi
- Route across model ecosystems including OpenAI, Anthropic, OpenRouter, Bedrock, Vertex, Azure, MiniMax, and open-model gateways
- Execute tools efficiently with optional parallel tool calls, caching, and dynamic tool discovery
- Stay productive in long sessions with context summarization and large-output offloading
- Support production workflows with observability, custom tools, session reuse, and a Node.js SDK
If you only need MCP, the library does that well. If you need a broader agent runtime that can mix MCP, code execution, provider routing, coding agents, and workflow orchestration, that is the larger value of the project.
If you are evaluating the project for the first time, the Quick Start below is
the smallest working MCP-backed agent. From there, the agent package tests are
the maintained reference for real usage β they exercise construction, turns,
tool routing, and coding-agent transports against the current API.
The standalone examples/ tree was removed: each example pinned its own module
and kept compatibility APIs public purely to stay compiling. Executable
behaviour now lives in tests that run in CI and cannot silently rot.
# Add to your go.mod
go get github.com/manishiitg/mcpagent
# Or use replace directive for local development
replace github.com/manishiitg/mcpagent => ../mcpagentpackage main
import (
"context"
"fmt"
"os"
"time"
mcpagent "github.com/manishiitg/mcpagent/agent"
"github.com/manishiitg/mcpagent/llm"
)
func main() {
openAIKey := os.Getenv("OPENAI_API_KEY")
if openAIKey == "" {
panic("OPENAI_API_KEY is required")
}
llmModel, err := llm.InitializeLLM(llm.Config{
Provider: llm.ProviderOpenAI,
ModelID: "gpt-4o",
APIKeys: &llm.ProviderAPIKeys{
OpenAI: &openAIKey,
},
})
if err != nil {
panic(err)
}
ctx, cancel := context.WithTimeout(context.Background(), 5*time.Minute)
defer cancel()
agent, err := mcpagent.NewAgentFromDefinition(ctx,
mcpagent.AgentDefinition{
Instructions: "You are a helpful assistant.",
Tools: mcpagent.ToolSet{
MCP: []mcpagent.MCPToolSource{{Name: "context7"}},
},
},
mcpagent.RuntimeConfig{
Model: llmModel,
MCPConfigPath: "mcp_servers.json",
},
)
if err != nil {
panic(err)
}
defer agent.Close()
result, err := agent.Run(ctx, mcpagent.Turn{
Input: "What tools are available?",
})
if err != nil {
panic(err)
}
fmt.Println(result.Text)
fmt.Printf("tokens: %d\n", result.Usage.TotalTokens)
}NewAgentFromDefinition is the only public constructor, and it takes exactly
two values:
AgentDefinitionβ the agent's identity:Instructions,Skills, andTools. These are cloned and validated at construction and never change afterwards.RuntimeConfigβ the infrastructure that operates it:Model,MCPConfigPath, plus groupedGeneration,Tools,Context,Coding,MCP,Workspace, andObservabilitysettings.
Per-request concerns belong to the turn, not the agent. Turn carries Input,
optional History, a ToolPolicy, and an optional StreamingCallback; Result
returns Text, History, a resumable Handle, and structured Usage.
*Agent has exactly four methods β Run, Start, Definition, and Close β
and no exported fields. There are no With* option functions; anything that was
once an option is now a named field on RuntimeConfig.
Run is the single-turn convenience path. When history must persist across
turns, open a session β it owns history, continuation, steering, and events:
session, err := agent.Start(ctx)
if err != nil {
panic(err)
}
defer session.Close()
first, err := session.Run(ctx, mcpagent.Turn{Input: "List the available tools."})
if err != nil {
panic(err)
}
// History carries forward automatically; no need to thread it yourself.
second, err := session.Run(ctx, mcpagent.Turn{Input: "Now use the first one."})
if err != nil {
panic(err)
}
fmt.Println(first.Text, second.Text)Run calls on one session are serialized. Use separate sessions for
concurrency. session.Snapshot() returns a handle you can later pass as
RuntimeConfig.ResumeHandle to continue a conversation in a new process.
The official Node.js/TypeScript SDK provides a simple interface for building MCP agents in JavaScript/TypeScript applications. The SDK communicates with the Go server via gRPC over Unix sockets for low-latency, bidirectional streaming, and it can route through API providers as well as supported CLI-native providers.
npm install @mcpagent/nodeimport { MCPAgent } from '@mcpagent/node';
const agent = new MCPAgent({
serverOptions: {
mcpConfigPath: './mcp_servers.json',
logLevel: 'info',
},
});
// Initialize with your LLM provider
await agent.initialize({
provider: 'codex-cli',
modelId: 'high',
});
// Ask a question
const response = await agent.ask('What tools do you have available?');
console.log(response.response);
// Streaming responses
for await (const event of agent.askStream('Explain quantum computing')) {
if (event.type === 'chunk') {
process.stdout.write(event.text);
} else if (event.type === 'final' && event.response) {
console.log(event.response);
}
}
// Cleanup
await agent.destroy();Register JavaScript/TypeScript handlers that the LLM can call:
import { MCPAgent } from '@mcpagent/node';
const agent = new MCPAgent({
serverOptions: { mcpConfigPath: './mcp_servers.json' },
});
// Register a calculator tool
agent.registerTool(
'calculate',
'Perform a mathematical calculation',
{
type: 'object',
properties: {
expression: { type: 'string', description: 'Math expression to evaluate' },
},
required: ['expression'],
},
async (args) => {
const result = Function(`"use strict"; return (${args.expression})`)();
return String(result);
},
{ timeoutMs: 5000 }
);
await agent.initialize({
provider: 'vertex',
modelId: 'gemini-3-flash-preview',
});
// The LLM can now use your custom tool
const response = await agent.ask('What is 15 * 7 + 23?');
// Output: 15 * 7 + 23 = 128The Node.js SDK uses a gRPC bidirectional streaming architecture:
Node.js SDK ββββββββββββββββββββββββββββββββββββΊ Go Server
Single bidirectional gRPC stream
- Client sends: questions, tool results
- Server sends: text chunks, tool calls, events, final response
Benefits:
- Real-time streaming: Token-by-token responses via gRPC stream
- Inline tool callbacks: Custom tools execute in the same connection (no separate callback server)
- Low latency: Unix domain sockets for IPC
- Type-safe: Protocol Buffers for all messages
For SDK usage and complete examples, see sdk-node/README.md.
The default mode where the LLM invokes tools directly through native tool calling. Nothing needs to be enabled β it is what you get from a definition with no code-execution flag:
agent, err := mcpagent.NewAgentFromDefinition(ctx,
mcpagent.AgentDefinition{
Instructions: "You are a helpful assistant.",
Tools: mcpagent.ToolSet{
MCP: []mcpagent.MCPToolSource{{Name: "context7"}},
},
},
mcpagent.RuntimeConfig{Model: llmModel, MCPConfigPath: "config.json"},
)Execute code in any language (Python, bash, curl, Go, etc.) instead of JSON tool calls. The LLM discovers MCP tool endpoints via an OpenAPI spec and writes code that makes HTTP requests:
// Generate API token for bearer auth
apiToken := executor.GenerateAPIToken()
// Start HTTP server with per-tool endpoints and auth
handlers := executor.NewExecutorHandlers(configPath, logger)
mux := http.NewServeMux()
mux.HandleFunc("/api/mcp/execute", handlers.HandleMCPExecute)
mux.HandleFunc("/api/custom/execute", handlers.HandleCustomExecute)
// Per-tool wildcard endpoints (used by OpenAPI spec)
mux.HandleFunc("/tools/mcp/", func(w http.ResponseWriter, r *http.Request) {
// Route /tools/mcp/{server}/{tool} to handler
path := strings.TrimPrefix(r.URL.Path, "/tools/mcp/")
parts := strings.SplitN(path, "/", 2)
server, tool := parts[0], parts[1]
handlers.HandlePerToolMCPRequest(w, r, server, tool)
})
authedHandler := executor.AuthMiddleware(apiToken)(mux)
server := &http.Server{Addr: "127.0.0.1:8000", Handler: authedHandler}
go server.ListenAndServe()
defer server.Shutdown(ctx)
// Create agent with code execution mode
agent, err := mcpagent.NewAgentFromDefinition(ctx,
definition,
mcpagent.RuntimeConfig{
Model: llmModel,
MCPConfigPath: "config.json",
Tools: mcpagent.ToolRuntimeConfig{CodeExecution: true},
MCP: mcpagent.MCPRuntimeConfig{
APIBaseURL: "http://127.0.0.1:8000",
APIToken: apiToken,
},
},
)The LLM calls get_api_spec(tool_name) to discover per-tool HTTP endpoints, then uses execute_shell_command to write and run code that calls those endpoints. Custom tools (workspace tools, shell execution) remain as direct tool calls.
tool_name accepts a single name or an array, and is the only required argument β the tool name is the address. server_name is optional and used solely to disambiguate a real MCP server; built-in tools resolve by name alone.
Note: Code execution mode requires an HTTP server with bearer token auth running (configured via RuntimeConfig.MCP.APIBaseURL and APIToken).
Context offloading is a context engineering strategy that automatically saves large tool outputs to the filesystem instead of keeping them in the LLM's context window. This implements the "offload context" pattern, one of three primary context engineering approaches used in production agents like Manus.
Why Context Offloading?
As agents execute tasks, tool call results accumulate in the context window. Research from Chroma and Anthropic shows that as context windows fill, LLM performance degrades due to attention budget depletion. Context offloading prevents this by:
- Saving tokens: Only file path + preview (~200 chars) instead of full content (potentially 50k+ chars)
- Preventing context overflow: Large outputs don't consume context window space
- Maintaining performance: LLM attention budget isn't depleted by large payloads
- Enabling efficient exploration: Agent can access data incrementally as needed
How It Works:
offloading := true
agent, err := mcpagent.NewAgentFromDefinition(ctx, definition,
mcpagent.RuntimeConfig{
Model: llmModel,
MCPConfigPath: "config.json",
Context: mcpagent.ContextRuntimeConfig{
Offloading: &offloading,
LargeOutputThreshold: 10000, // tokens (default)
},
},
)When tool outputs exceed the threshold:
- External Storage: Full content is saved to
tool_output_folder/{session-id}/with unique filenames - Compact Reference: LLM receives file path + preview (first 50% of threshold) instead of full content
- On-Demand Access: Agent uses
search_large_outputwithread,search, orqueryoperations to access data incrementally.
Example Token Savings:
Without Context Offloading:
- Tool Output: 50,000 characters (~12,500 tokens)
- Sent to LLM: 50,000 chars (~12,500 tokens)
- Result: Context window overflow, attention budget depletion
With Context Offloading:
- Tool Output: 50,000 characters (~12,500 tokens)
- Saved to filesystem: 50,000 chars
- Sent to LLM: ~200 chars (file path + preview) (~50 tokens)
- Result: 99.6% token reduction, no context overflow
Note: The threshold is measured in tokens (using tiktoken encoding), not characters.
A threshold of 10000 tokens roughly equals ~40,000 characters (assuming ~4 chars per token).
Related Patterns:
This implementation follows the context engineering strategies outlined in Manus's approach:
- Offload Context: Store tool results externally, access on-demand β Implemented
- Reduce Context: Compact stale results, summarize when needed β³ Pending
- Isolate Context: Use sub-agents for discrete tasks (multi-agent support)
Similar patterns are used in Claude Code, LangChain, and other production agent systems.
Pending: Dynamic Context Reduction
Currently, context offloading only applies to large tool outputs when they're first generated. A future enhancement will implement dynamic context reduction to compact stale tool results as the context window fills, even if they weren't initially large.
What's Pending:
-
Compact Stale Results
- Concept: Replace older tool results with compact references (e.g., file paths) as context fills
- Behavior: Keep recent tool results in full to guide the agent's next decision, while older results are replaced with references
- Implementation: Automatically detect when tool results become "stale" (based on age, relevance, or context usage) and replace them with compact references
- Scope: This would apply to ALL tool results (not just large ones), dynamically compacting them when they become "stale"
- Reference: Similar to Anthropic's context editing feature
- Example: A 2000-token tool result from 10 turns ago becomes:
"Tool: search_docs returned results (saved to: tool_output_folder/session-123/search_20250101_120000.json)"
-
Summarize When Needed
- Concept: Once compaction reaches diminishing returns, apply schema-based summarization to the full trajectory
- Behavior: Generate consistent summary objects using full tool results, further reducing context while preserving essential information
- Implementation: When compaction alone isn't enough to manage context size, apply structured summarization with predefined schemas for different tool result types
- Scope: Summarize the entire conversation trajectory when individual compaction is insufficient
- Example: Instead of keeping 20 tool calls with full results, create a structured summary:
{ "tool_calls_summary": [ {"tool": "search", "count": 5, "key_findings": ["..."], "files": ["..."]}, {"tool": "read_file", "count": 3, "files_read": ["..."]} ] }
Current Behavior vs. Future Enhancement:
Current (Context Offloading):
- Large output (>10k tokens) β Offloaded immediately
- Small output (<10k tokens) β Stays in context forever
- Result: Context can still fill up with many small tool results
Future (Context Reduction):
- Large output (>10k tokens) β Offloaded immediately β
- Small output (<10k tokens) β Stays in context initially
- As context fills β Small outputs become "stale" β Compacted to references
- When compaction insufficient β Summarize trajectory
- Result: Context window stays manageable throughout long conversations
This enhancement would complete the "Reduce Context" strategy from Manus's context engineering approach, working alongside context offloading to maintain optimal context window usage.
Context offloading is exercised end-to-end by the search_large_output tests in
the agent package.
Automatically summarize conversation history when token usage exceeds a threshold to maintain long-running conversations:
agent, err := mcpagent.NewAgentFromDefinition(ctx, definition,
mcpagent.RuntimeConfig{
Model: llmModel,
MCPConfigPath: "config.json",
Context: mcpagent.ContextRuntimeConfig{
SummarizationEnabled: true,
// Trigger when token usage reaches 70% of the context window
SummarizeOnTokenThreshold: true,
TokenThresholdPercent: 0.7,
// Keep the last 8 messages intact
SummaryKeepLastMessages: 8,
},
},
)The agent monitors token usage and automatically replaces older messages with a concise LLM-generated summary when the threshold is reached, while preserving recent messages and tool call integrity. This enables "infinite" conversation depth within fixed context windows.
Intelligent caching reduces connection times by 60-85%:
// Caching is enabled by default
// Configure via environment variables:
// MCP_CACHE_DIR=/path/to/cache
// MCP_CACHE_TTL_MINUTES=10080 (7 days)Register your own tools that work alongside MCP server tools. Custom tools work in both standard mode and code execution mode:
Standard Mode (direct tool calls):
// Define tool parameters (JSON schema)
params := map[string]interface{}{
"type": "object",
"properties": map[string]interface{}{
"operation": map[string]interface{}{
"type": "string",
"enum": []string{"add", "subtract", "multiply", "divide"},
},
"a": map[string]interface{}{"type": "number"},
"b": map[string]interface{}{"type": "number"},
},
"required": []string{"operation", "a", "b"},
}
// Declare the tool as part of the agent's identity
definition := mcpagent.AgentDefinition{
Instructions: "You are a helpful assistant.",
Tools: mcpagent.ToolSet{
Direct: []mcpagent.ToolDefinition{{
Name: "calculator",
Description: "Performs mathematical operations",
InputSchema: params,
Execute: calculatorFunction,
DisplayGroup: "utility", // optional presentation metadata
}},
},
}
// Tool execution function
func calculatorFunction(ctx context.Context, args map[string]interface{}) (string, error) {
// Extract and validate arguments
operation := args["operation"].(string)
a := args["a"].(float64)
b := args["b"].(float64)
// Perform calculation
var result float64
switch operation {
case "add": result = a + b
case "subtract": result = a - b
// ...
}
return fmt.Sprintf("Result: %.2f", result), nil
}Code Execution Mode (direct tool calls + HTTP API):
// In code execution mode, custom tools are:
// 1. Exposed as direct LLM tool calls (e.g., execute_shell_command, workspace tools)
// 2. MCP server tools are accessed via HTTP API endpoints (discovered via get_api_spec)
// 3. Custom tools can also be accessed via /api/custom/execute endpoint
// Declared exactly the same way β there is no separate code-execution API
definition := mcpagent.AgentDefinition{
Tools: mcpagent.ToolSet{
Direct: []mcpagent.ToolDefinition{{
Name: "get_weather",
Description: "Gets weather data for a location",
InputSchema: weatherParams,
Execute: weatherFunction,
}},
},
}
// LLM can call custom tools directly as tool calls,
// or use get_api_spec to discover HTTP endpoints for MCP toolsCustom tools behave the same in standard and code-execution mode: they are
registered on the AgentDefinition and are addressed by their globally unique
tool name. In code-execution mode they are additionally reachable over the HTTP
API described above.
When the LLM returns multiple tool calls in a single response, they can be executed concurrently using goroutines (fork-join pattern) instead of sequentially:
agent, err := mcpagent.NewAgentFromDefinition(ctx, definition,
mcpagent.RuntimeConfig{
Model: llmModel,
MCPConfigPath: "config.json",
Tools: mcpagent.ToolRuntimeConfig{ParallelExecution: true},
},
)How it works:
- LLM returns N tool calls in one response
- All tool calls are prepared sequentially (argument parsing, client resolution)
- Tool calls execute concurrently via goroutines
- Results are collected in deterministic order matching the original tool call order
Observability: ToolCallStartEvent includes an IsParallel field (true when the tool call is part of a parallel batch, false for sequential execution) so event listeners and tracers can distinguish between parallel and sequential tool calls.
Built-in tracing with Langfuse support:
tracer, err := observability.NewLangfuseTracerWithLogger(logger)
if err != nil {
return err
}
agent, err := mcpagent.NewAgentFromDefinition(ctx, definition,
mcpagent.RuntimeConfig{
Model: llmModel,
MCPConfigPath: "config.json",
Observability: mcpagent.ObservabilityRuntimeConfig{
Tracers: []observability.Tracer{tracer},
TraceID: "trace-id",
Logger: logger,
},
},
)Comprehensive documentation is available in the docs/ directory:
- OAuth Authentication - OAuth 2.0 authentication for MCP servers
- Code Execution Agent - Execute code in any language via OpenAPI spec
- Tool-Use Agent - Standard tool calling mode
- Context Summarization - Automatic history summarization
- Context Offloading - Offload large tool outputs to filesystem (offload context pattern)
- Implements the "offload context" strategy from Manus's context engineering approach
- Prevents context window overflow and reduces token costs
- Enables efficient on-demand data access via virtual tools
- MCP Cache System - Server metadata caching
- Folder Guard - Fine-grained file access control
- LLM Resilience - Error handling and fallbacks
- Event System - Event architecture
- Parallel Tool Execution - Concurrent tool call execution
- Token Tracking - Usage monitoring
The standalone examples/ tree has been removed. Each example was its own Go
module, and keeping them compiling required holding constructors and option
functions public long after the library itself had stopped needing them β the
demonstrations were dictating the API surface.
Maintained usage now lives in the agent package tests, which run in CI against
the current public API:
- agent construction through
NewAgentFromDefinitionandAgentDefinition - multi-turn conversations, history, and context summarization
- custom tool registration and tool filtering
- code-execution mode, including
get_api_specresolution and the HTTP tool API - coding-agent providers (Claude Code, Codex CLI) over the MCP bridge
- context offloading via
search_large_output
For the Node.js SDK, see sdk-node/README.md.
Create a JSON file with your MCP servers:
{
"mcpServers": {
"filesystem": {
"command": "npx",
"args": ["-y", "@modelcontextprotocol/server-filesystem", "./demo"]
},
"memory": {
"command": "npx",
"args": ["-y", "@modelcontextprotocol/server-memory"]
}
}
}Runtime settings are named fields on RuntimeConfig, grouped by purpose. There
are no functional options β the grouping is what replaced them, so configuration
is one explicit value rather than an order-sensitive list:
offloading := true
agent, err := mcpagent.NewAgentFromDefinition(ctx, definition,
mcpagent.RuntimeConfig{
Model: llmModel,
MCPConfigPath: "config.json",
Generation: mcpagent.GenerationRuntimeConfig{
MaxTurns: 30,
Temperature: 0.7,
ToolChoice: "auto",
},
Tools: mcpagent.ToolRuntimeConfig{
CodeExecution: true,
ParallelExecution: true,
SelectedTools: []string{"tool1", "tool2"},
SelectedServers: []string{"server1", "server2"},
},
Context: mcpagent.ContextRuntimeConfig{
Offloading: &offloading,
LargeOutputThreshold: 10000,
SummarizationEnabled: true,
SummarizeOnTokenThreshold: true,
TokenThresholdPercent: 0.7,
},
Observability: mcpagent.ObservabilityRuntimeConfig{
Tracers: []observability.Tracer{tracer},
TraceID: traceID,
Logger: logger,
},
},
)Custom tools are part of the definition, not registered afterwards β an agent's tools are fixed once it exists:
definition := mcpagent.AgentDefinition{
Instructions: "You are a helpful assistant.",
Tools: mcpagent.ToolSet{
Direct: []mcpagent.ToolDefinition{{
Name: "calculate",
Description: "Evaluate a arithmetic expression",
InputSchema: map[string]interface{}{
"type": "object",
"properties": map[string]interface{}{
"expression": map[string]interface{}{"type": "string"},
},
"required": []string{"expression"},
},
Execute: func(ctx context.Context, args map[string]interface{}) (string, error) {
return evaluate(args["expression"].(string))
},
}},
MCP: []mcpagent.MCPToolSource{{Name: "context7"}},
},
}Tools are addressed by their globally unique Name. DisplayGroup is optional
presentation metadata only β it takes no part in addressing or authorization.
To narrow which tools a single request may use without rebuilding the agent, set
Turn.ToolPolicy.AllowedTools. An empty slice means every tool in the definition
is allowed.
// Folder guard paths are set on the created agent instance agent.SetFolderGuardPaths(allowedRead, allowedWrite)
## π§ͺ Testing
The package includes comprehensive testing utilities:
```bash
# Run all tests
cd cmd/testing
go test ./...
# Run specific test
go run testing.go agent-mcp --log-file logs/test.log
go run testing.go code-exec --log-file logs/test.log
go run testing.go parallel-tool-exec --provider vertex --model gemini-3-flash-preview
See cmd/testing/README.md for details.
mcpagent/
βββ agent/ # Core agent implementation
β βββ agent.go # Core Agent struct and runtime
β βββ definition.go # AgentDefinition, RuntimeConfig, NewAgentFromDefinition()
β βββ turn_session.go # Turn/Result, Session, and the four Agent methods
β βββ conversation.go # Conversation loop and tool execution
β βββ connection_session.go # Session-scoped MCP connection management
β βββ ...
βββ grpcserver/ # gRPC server (for SDK communication)
β βββ server.go # gRPC server setup
β βββ service.go # AgentService implementation
β βββ stream_handler.go # Bidirectional stream handling
β βββ pb/ # Generated protobuf code
βββ mcpclient/ # MCP client implementations
β βββ client.go # Client interface and implementations
β βββ stdio_manager.go # stdio protocol
β βββ sse_manager.go # SSE protocol
β βββ http_manager.go # HTTP protocol
βββ mcpcache/ # Caching system
β βββ manager.go # Cache manager
β βββ openapi/ # OpenAPI spec generation for code execution mode
βββ llm/ # LLM provider integration
β βββ providers.go # Provider implementations
β βββ types.go # LLM types
βββ events/ # Event system
β βββ data.go # Event data structures
β βββ types.go # Event types
βββ logger/ # Logging
β βββ v2/ # Logger v2 interface
βββ observability/ # Tracing and observability
β βββ tracer.go # Tracer interface
β βββ langfuse_tracer.go # Langfuse implementation
βββ executor/ # Tool execution handlers
βββ sdk-node/ # Node.js/TypeScript SDK
β βββ src/ # SDK source code
β β βββ agent.ts # MCPAgent class
β β βββ grpc-client.ts # gRPC client
β β βββ stream-handler.ts # Stream management
β βββ README.md # SDK documentation
βββ proto/ # Protocol Buffer definitions
β βββ agent.proto # gRPC service definitions
βββ docs/ # Documentation
- OpenAI: GPT-4.1, GPT-4o, reasoning models, and compatible tool-calling models
- Anthropic: Claude models through direct provider integration
- OpenRouter: Access to open and frontier models behind a unified API
- AWS Bedrock: Claude, Llama, Mistral, and other Bedrock-served models
- Google Vertex AI: Gemini and related Vertex-hosted models
- Azure: Azure-hosted OpenAI and related model deployments
- Claude Code / Codex / Cursor / Pi CLI providers: Coding-agent integrations through provider abstractions
- MiniMax: MiniMax chat and coding-plan providers
- Custom Providers: Extensible provider interface
MCP remains an important integration layer in the runtime, with support for:
- stdio: Standard input/output (most common)
- SSE: Server-Sent Events
- HTTP: REST API
Contributions are welcome! Please see the Documentation Writing Guide for standards.
This project is licensed under the MIT License - see the LICENSE file for details.
- MCP Protocol: Built on the Model Context Protocol
- multi-llm-provider-go: LLM provider abstraction layer
- mcp-go: MCP protocol implementation
- Context Engineering: Context offloading implementation inspired by Manus's context engineering strategies
Made with β€οΈ for the AI community