epic: Jan as a MCP Host

[louis-menlo]

Problem Statement

Jan integrates the MCP Client SDK and play as a MCP Host, which can run MCP Servers.

This enhancement allows Jan to function as a flexible MCP Host, making it interoperable with existing MCP-compatible servers, providing users with more options for AI model hosting and inference.

Feature Idea

MCP Client SDK allows application to spawn MCP Servers as child processes then it can communicate with them via stdio transport, or connec to externals MCP Servers using sse/websocket transports

ACs

• Implement MCP Host support in Jan.
• Ensure compatibility with mcp_config.json to allow seamless integration with various MCP Servers.
• Adde connection handling for multiple MCP Servers.
• Improve request routing between Jan (as an MCP Host) and configured MCP Servers.

Architecture draft

graph TD;
    Jan[Jan MCP Host] <-->|MCP Protocol| ServerA[MCP Server A];
    Jan <-->|MCP Protocol| ServerB[MCP Server B];
    ServerA <-->|Data Flow| DataResourceA[Data Resource A];
    ServerB <-->|Data Flow| DataResourceB[Data Resource B];

Loading

Out of scope

Currently, the most popular standard stdio protocol is added only, but it will soon support SSE and WebSocket protocols (When these protocols are stable and supported by numerous servers)