Open WebUI
Comparisons anchored on Open WebUI, the self-hosted, offline-capable AI chat platform under the Open WebUI License.
Private AI
Comparisons of self-hosted building blocks for private AI: chat front ends, LLM app builders, model gateways, LLM observability and vector databases, judged on license terms, architecture and the effort to run them in your own infrastructure.
Ollama
Comparisons anchored on Ollama, the MIT-licensed local model runtime, against inference servers built for many concurrent users.
Dify
Comparisons anchored on Dify, the LLM application builder under a modified Apache 2.0 license.
LiteLLM
Comparisons anchored on LiteLLM, the MIT-licensed OpenAI-compatible LLM gateway with virtual keys and budgets.
Langfuse
Comparisons anchored on Langfuse, the open-core LLM observability platform that can be self-hosted.
Qdrant
Comparisons anchored on Qdrant, the Apache-2.0 vector database written in Rust, against other self-hosted vector stores.
vLLM
Comparisons that start from vLLM, the Apache-2.0 high-throughput LLM serving engine, against other GPU inference servers.
Weaviate
Comparisons that start from Weaviate, the Go vector database with a BSD-3-Clause core, enterprise-licensed features and a managed cloud, against other vector stores.
Milvus
Comparisons anchored on Milvus, the Apache-2.0 distributed vector database under the LF AI and Data Foundation, against lighter vector stores.
LibreChat
Comparisons that start from LibreChat, the MIT-licensed multi-provider chat interface, against other self-hosted chat front ends.
Langflow
Comparisons that start from Langflow, the MIT-licensed Python visual builder for agents and workflows, against other low-code LLM builders.
Private AI compared
Roundups of self-hosted private AI building blocks: chat interfaces, LLM app builders, inference servers, vector databases and LLM observability, judged on license, maintenance status and operating effort.
Chroma
Comparisons anchored on Chroma, the Apache-2.0 vector and search database with an embedded API, single-node and distributed modes and the managed Chroma Cloud.
AnythingLLM
Comparisons anchored on AnythingLLM, the MIT-licensed private document chat and agent application from Mintplex Labs, offered as a desktop app or a Docker server.
Onyx
Comparisons anchored on Onyx (formerly Danswer), the open-core AI assistant and enterprise search platform that indexes company applications with their permissions.
