run any ai model. compose agents, stack knowledge, connect tools. one api, pay per run.
Install
Run one of the commands below, then add the client config underneath.
https://api.inference.sh/mcpClient configuration
Paste into Claude Desktop, Cursor (mcp.json), VS Code or any MCP client, then restart the client.
{
"mcpServers": {
"mcp": {
"url": "https://api.inference.sh/mcp"
}
}
}About this server
inference.sh is listed in the AI & Machine Learning category of the MCPNav directory. It is distributed as Streamable HTTP and can be loaded by any client that speaks the Model Context Protocol.
Typical uses include giving your assistant scoped access to the corresponding service so it can answer questions and take actions with real data instead of guessing. Always review what a server can access before you enable it — see our MCP security guide.
Frequently asked questions
What is the inference.sh MCP server?+
inference.sh is an MCP server by inference. run any ai model. compose agents, stack knowledge, connect tools. one api, pay per run.
How do I install inference.sh?+
Install it with: https://api.inference.sh/mcp. Then add the JSON config to your client's MCP settings and restart the client.
Is inference.sh free to use?+
The MCP server itself is free to install. Any third-party API it calls (such as a search or maps API) may require its own key and billing.
Which clients support inference.sh?+
Any MCP-compatible client can use it, including Claude Desktop, Cursor, VS Code, Windsurf and custom agents.