Anythingllm
App in the BluixApps catalog
What it is
AnythingLLM is a full-stack RAG knowledge base with a built-in chat UI. Upload documents, websites, code repositories, audio files — and chat with them through any LLM (Ollama, OpenAI, Anthropic, etc.). Workspaces isolate different knowledge contexts; embedded vector storage handles retrieval; agents extend with tool use.
It's the most polished "drop your docs in, get a chatbot out" experience in the self-hosted LLM space — used by teams who don't want to assemble RAG from individual components.
What it's for
- Internal knowledge bases — ingest company docs, get instant Q&A chatbot for the team
- Customer support RAG — train on product docs + support tickets, deflect tier-1 questions
- Personal research — upload PDFs, papers, transcripts; chat with your library
- Document compliance — search and reason over legal contracts, SOPs, regulations
- Multi-tenant chatbots — separate workspaces for different clients / departments
Who it's for
- Internal IT giving non-technical teams instant access to company knowledge via chat
- Customer support teams building self-service RAG on product docs and ticket archives
- Research teams managing libraries of PDFs / papers with semantic search
- Legal & compliance querying contract corpora and regulation libraries
- Agencies building custom chatbots for clients on white-label infrastructure
Why teams pick AnythingLLM over alternatives
- Batteries-included — no need to wire vector DB + embeddings + LLM separately
- Workspaces — multiple isolated knowledge contexts in one instance
- Document loader breadth — PDF, DOCX, MP3, MP4, websites, GitHub repos, YouTube
- Built-in agent framework — extend with custom tools beyond pure RAG
- MIT license — clean for commercial / multi-tenant deployment
- Mature UI — chat, citations, source previews built in
Integrations
- LLM backends — Ollama, OpenAI, Anthropic, Azure OpenAI, Mistral, Cohere, HuggingFace
- Vector stores — built-in LanceDB; Qdrant / Chroma / Weaviate / Milvus / pgvector via config
- Embeddings — OpenAI, Cohere, local sentence-transformers, AnythingLLM native embedder
- Document loaders — PDF, DOCX, MP3 (Whisper), MP4, web scraping, GitHub repos
- API + Embeddable widget — expose workspaces as REST API or embed as chatbot widget
- Authentication — multi-user with role-based permissions
- MCP support — extend with Model Context Protocol tools
Notable users & community
- 30k+ GitHub stars
- Featured in numerous "self-host your AI" guides
- Active Discord with daily contributor activity
- Backed by Mintplex Labs with sustainable open-core model
- Weekly releases with public roadmap
Tips & operations
- Pair with Qdrant for scale — built-in LanceDB is fine for <10k docs; switch to Qdrant for larger collections
- Workspace isolation — each workspace = separate vector index; useful for multi-client deployments
- Document chunking matters — tune chunk size + overlap in settings before bulk-ingesting
- Watch embedding costs — bulk ingestion via OpenAI embeddings can run up bills fast; use local embedder for free
- Persist
/app/server/storage— workspaces, documents, vectors all live here; mount volume from day one - Set up SMTP for invite emails — multi-user features break silently without it
What we ship in BluixApps
- Docker compose: AnythingLLM server + persistent storage volume
- Pinned
mintplexlabs/anythingllm:latest(locked to release tag) - Auto-detection of Ollama / Qdrant on same VPS for zero-config setup
- HTTPS via Let's Encrypt
- Admin user with random password on first boot
- API key auto-generated for programmatic access
- Backup hook covers storage volume (workspaces + vectors)
Get this app — pick a BluixApps plan
Same catalog. Scaling tenant isolation, white-label and support tier.
| Tier | Tenants | Catalog | Support | White-label | Monthly | |
|---|---|---|---|---|---|---|
| Stacks | 1 | 19 curated stacks | Standard | — | $19/mo | DetailDeploy |
| Starter | 10 | Full catalog | Standard | +$15–25/mo | $49/mo | DetailDeploy |
| Pro | 25 | Full catalog | Priority bugfix | +$15–25/mo | $149/mo | DetailDeploy |
| Growth | 100 | Full catalog | Priority bugfix | +$15–25/mo | $349/mo | DetailDeploy |
| Scale | 500 | Full catalog | 7-day window | +$15–25/mo | $799/mo | DetailDeploy |
| Enterprise | Unlimited | Full catalog | Priority 7-day | Bundled | $1,499/mo | DetailDeploy |
