KoboldCpp
KoboldCpp is a free program that lets you run AI chat and writing models privately on your own computer, with a built-in web page for chatting and writing stories. It is for people who want to use AI locally without sending their conversations to a company.
How hard it is to start using it. Easy: install it like a normal app, or use it in your browser. Advanced: you run it on your own server, use the command line, or it is a tool for developers.
Features
No commands neededDouble-click launcher works, but Linux and Mac need terminal commands
SourcePartly
Built-in model downloadsModels must be downloaded separately; launcher offers help templates
SourcePartly
Windows, Mac and Linux app
SourceYes
Connects to your other tools
SourceYes
Chat with your filesDocument Q&A only via RAG through TextDB, not clearly a simple file upload
SourcePartly
Makes pictures too
SourceYes
Connects extra tools (MCP)
SourceYes
Screenshots4
Listed in
How to help
AI contributionsNot stated
The project has not said how it feels about AI-written contributions. Maintainers can set this by claiming the listing.