Open WebUI with vLLM
Serving models on GPU servers with vLLM and connecting them to Open WebUI through the OpenAI-compatible API, including timeouts during model loading and when to put LiteLLM in between.

Documented connections between Open WebUI and model servers, tool servers, search, speech, image and observability services.
Serving models on GPU servers with vLLM and connecting them to Open WebUI through the OpenAI-compatible API, including timeouts during model loading and when to put LiteLLM in between.
Connecting MCP servers over streamable HTTP with OAuth 2.1, why only admins can add them, the WEBUI_SECRET_KEY requirement, and how MCP differs from user-added OpenAPI tool servers.
Letting users attach files from OneDrive for Business and SharePoint in Open WebUI chats: Entra ID app registration, environment variables and the separate personal OneDrive option.
Adding web search to Open WebUI with a self-hosted SearXNG instance instead of a paid search API, and the trade-offs against hosted providers such as Brave or Tavily.
Connecting Open WebUI to a self-hosted ComfyUI or AUTOMATIC1111 server for image generation and editing inside chat, versus hosted OpenAI or Gemini image models.
Exporting Open WebUI traces, metrics and logs over OTLP into Grafana, Tempo, Loki and Prometheus to watch response times, database and Redis queries.
Keeping voice input and output on your own servers by pointing Open WebUI at OpenAI-compatible transcription and speech servers instead of a cloud audio API.

Tell us what you're working on, whether it's a deployment, an audit, a security test or a cyber range. You'll speak with an engineer who can help you scope it.