Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DOC: Installing MCP-Bridge with Ollama in Open-WebUI #54

Open
rgaricano opened this issue Mar 9, 2025 · 1 comment
Open

DOC: Installing MCP-Bridge with Ollama in Open-WebUI #54

rgaricano opened this issue Mar 9, 2025 · 1 comment

Comments

@rgaricano
Copy link

rgaricano commented Mar 9, 2025

Thanks man!!!
(my penny)

Installing MPC-Bridge with Ollama in Open-WebUI

Clone repo
git clone https://github.com/SecretiveShell/MCP-Bridge.git

Install MPC-bridge,

cd MCP-Bridge
uv sync

make your mpc-bridge config file, create config.json
(models are not necessary, it take its as other connections)
e.g. (inference_server is ollama's installed network address, network is config network address of MCP_Bridge server)

{
   "inference_server": {
      "base_url": "http://127.0.0.1:11434/v1",
      "api_key": "None"
   },
    "mcp_servers": {
        "fetch": {
            "command": "uvx",
            "args": [
                "mcp-server-fetch"
            ]
        }
    },
    "sampling": {
        "timeout": 10,
        "models": [
            {
                "model": "llama3.2:latest",
                "intelligence": 0.5,
                "cost": 0,
                "speed": 0.6
            },
            {
                "model": "deepseek-r1:8b",
                "intelligence": 0.7,
                "cost": 0,
                "speed": 0.4
            }
        ]
    },
    "network": {
        "host": "0.0.0.0",
        "port": 9090
    },
    "logging": {
        "log_level": "DEBUG"
    }
}

run server
uv run mcp_bridge/main.py
& check thats is runnig
openwebui-mpc-bridge
openwebui-mpc-bridge1

On openwebui add a openai api compatible connection for mpc-bridge server, and check:

openwebui-mpc-bridge2

Now you have all models as normal, but duplicated (one from ollama and one from mpc-bridge, one with size other without), to no be confused you can switch off ollama connection.

And voila, you have all models on tab & you can chat telling for use tools, or ask for avaible tools ;-)

openwebui-mpc-bridge3

(if is running fine you can change log_level to "INFO", install it as service,...)

NOTE: I forgot, use models with tool holders!!!!
https://ollama.com/search?q=tool

open-webui/open-webui#7363 (comment)

@SecretiveShell
Copy link
Owner

This is a great resource!

I would love to see it in the official documentation, if you are happy to submit a pr.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants