Choose Ollama (on this computer) or LM Studio (on this computer) in Filamental AI, click Connect, and Filamental AI runs on a model on your own computer instead of a hosted provider. There's no key, no account and no bill, and nothing you write leaves your machine.
Where: Top bar › Filamental AI › the provider list
Filamental AI can talk to a model server running on your computer, through Ollama or LM Studio. It's privacy, mostly: if your project holds things you'd rather not send anywhere, a local model keeps all of it on your computer. It also costs nothing per question once the model's downloaded, and it works without an internet connection.
The trade is capability. Local models are smaller than the hosted ones, so they're slower and less dependable on the bigger jobs, such as building a structure from scratch.
Ollama or LM Studio, installed and running, with at least one model downloaded. Both are free, made by other people, and their own sites cover installing them and choosing a model. We don't supply or host a model ourselves.
Choose a model that can call tools. Tool calling is how the AI reads and edits your project, so a model without it can chat but can't touch anything. Both apps usually say which models support it.
http://localhost:11434 for Ollama, http://localhost:1234 for LM Studio), so you'll only need to change it if you've set yours up differently.From then on it works like any other connection, and you can switch between it and your other models from the dropdown at the top of the chat.
Use it when the material is sensitive: client files, legal or medical notes, anything under a confidentiality agreement. Use it on a plane or anywhere without a connection, or when you want to ask a hundred small questions without watching a bill.
Still stuck? Email [email protected].