EvalForge Lite

Developer Tools Python v1.0.1

Compare text LLMs across OpenRouter, Bedrock, Vertex AI and Foundry with automated grading.

View source ↗ Website ↗ Generate config for multiple servers More servers

Install

Pin version registry version 1.0.1

Python
uvx evalforge-lite

Python
uvx evalforge-lite@1.0.1

Setup by client

Pick your client — the config below is generated for this server (local stdio). Copy respects the “Pin version” switch above.

claude_desktop_config.json

{
  "mcpServers": {
    "evalforge-lite": {
      "command": "uvx",
      "args": [
        "evalforge-lite"
      ],
      "env": {
        "OPENROUTER_API_KEY": "<YOUR_OPENROUTER_API_KEY>"
      }
    }
  }
}

{
  "mcpServers": {
    "evalforge-lite": {
      "command": "uvx",
      "args": [
        "evalforge-lite@1.0.1"
      ],
      "env": {
        "OPENROUTER_API_KEY": "<YOUR_OPENROUTER_API_KEY>"
      }
    }
  }
}

Format verified against the official Claude Desktop docs ↗.

terminal

claude mcp add --env OPENROUTER_API_KEY=<YOUR_OPENROUTER_API_KEY> evalforge-lite -- uvx evalforge-lite

claude mcp add --env OPENROUTER_API_KEY=<YOUR_OPENROUTER_API_KEY> evalforge-lite -- uvx evalforge-lite@1.0.1

Format verified against the official Claude Code docs ↗.

.cursor/mcp.json

{
  "mcpServers": {
    "evalforge-lite": {
      "command": "uvx",
      "args": [
        "evalforge-lite"
      ],
      "env": {
        "OPENROUTER_API_KEY": "<YOUR_OPENROUTER_API_KEY>"
      }
    }
  }
}

{
  "mcpServers": {
    "evalforge-lite": {
      "command": "uvx",
      "args": [
        "evalforge-lite@1.0.1"
      ],
      "env": {
        "OPENROUTER_API_KEY": "<YOUR_OPENROUTER_API_KEY>"
      }
    }
  }
}

Format verified against the official Cursor docs ↗.

.vscode/mcp.json

{
  "servers": {
    "evalforge-lite": {
      "command": "uvx",
      "args": [
        "evalforge-lite"
      ],
      "env": {
        "OPENROUTER_API_KEY": "<YOUR_OPENROUTER_API_KEY>"
      }
    }
  }
}

{
  "servers": {
    "evalforge-lite": {
      "command": "uvx",
      "args": [
        "evalforge-lite@1.0.1"
      ],
      "env": {
        "OPENROUTER_API_KEY": "<YOUR_OPENROUTER_API_KEY>"
      }
    }
  }
}

Format verified against the official VS Code docs ↗.

mcp_config.json

{
  "mcpServers": {
    "evalforge-lite": {
      "command": "uvx",
      "args": [
        "evalforge-lite"
      ],
      "env": {
        "OPENROUTER_API_KEY": "<YOUR_OPENROUTER_API_KEY>"
      }
    }
  }
}

{
  "mcpServers": {
    "evalforge-lite": {
      "command": "uvx",
      "args": [
        "evalforge-lite@1.0.1"
      ],
      "env": {
        "OPENROUTER_API_KEY": "<YOUR_OPENROUTER_API_KEY>"
      }
    }
  }
}

Format verified against the official Windsurf docs ↗.

Environment variables

Defined in the server's official registry manifest. Required secrets are shown as <YOUR_…> placeholders in the configs above.

OPENROUTER_API_KEY secret — Optional. OpenRouter API key held by the server so tool calls need no credentials for OpenRouter. If unset, pass creds in each tool call.

GitHub

最近更新于 39 天前 · MIT license

About this server

Distributed as Python, listed under Developer Tools. Review our MCP security guide before granting access to real data.

Frequently asked questions

How do I install EvalForge Lite?

Run the install command shown above, then paste the config for your client (Claude Desktop, Claude Code, Cursor, VS Code or Windsurf) into its MCP settings and restart the client.

Is EvalForge Lite free to use?

The MCP server itself is free to install. The source is public on https://github.com/thejaredchapman/evalforge-lite. Any third-party service it calls may require its own API key and account.

Which clients support EvalForge Lite?

Any MCP-compatible client can use it, including Claude Desktop, Claude Code, Cursor, VS Code, Windsurf and custom agents.

Add this badge

Publish this server? Link back with a badge on your README or site — copy either snippet.

Markdown

[![Listed on MCPNav](https://mcpnav.net/badge/evalforge-lite.svg)](https://mcpnav.net/server/evalforge-lite/)

HTML

<a href="https://mcpnav.net/server/evalforge-lite/"><img src="https://mcpnav.net/badge/evalforge-lite.svg" alt="Listed on MCPNav" height="20"></a>