Open Source Everything

Running AI on your own computer

Talk about this on r/TrueOpenSource

Open alternatives5

Ollama screenshot
Windows · Mac · LinuxMIT

Ollama is a free tool that runs AI models on your own computer, so your chats stay on your machine. It now has a simple chat window, and other apps can also use it to run models.

Has 3 of 7

Jan screenshot
Windows · Mac · LinuxApache-2.0

Jan is a desktop app that lets you download and run AI language models on your own computer, with an option to connect to cloud AI services. It is for people who want an AI chat assistant with more control and privacy.

Has 3 of 7

KoboldCpp screenshot
Windows · Mac · Linux · AndroidAGPL-3.0

KoboldCpp is a free program that lets you run AI chat and writing models privately on your own computer, with a built-in web page for chatting and writing stories. It is for people who want to use AI locally without sending their conversations to a company.

Has 4 of 7

No screenshot yet
Mac · LinuxMIT

LocalAI is free software that lets you download and run AI models on your own computer or server, without sending your data to outside companies. It is aimed at people and teams who want to use AI privately and control it themselves, and it is also used by programmers who build AI tools.

Has 3 of 7

llama.cpp screenshot
Windows · Mac · Linux · AndroidMITReplaces partly

llama.cpp is free software that runs large AI language models directly on a computer, using its own processor or graphics card. It is aimed mainly at programmers and technically inclined users who want to run AI models locally or on servers.

Has 0 of 7

See also

Help me choose

Before you build

Download the list

Fix the list itself