← All help

AI on Your Own Computer

Choose Ollama (on this computer) or LM Studio (on this computer) in Filamental AI, click Connect, and Filamental AI runs on a model on your own computer instead of a hosted provider. There's no key, no account and no bill, and nothing you write leaves your machine.

Where: Top bar › Filamental AI › the provider list

What it is

Filamental AI can talk to a model server running on your computer, through Ollama or LM Studio. It's privacy, mostly: if your project holds things you'd rather not send anywhere, a local model keeps all of it on your computer. It also costs nothing per question once the model's downloaded, and it works without an internet connection.

The trade is capability. Local models are smaller than the hosted ones, so they're slower and less dependable on the bigger jobs, such as building a structure from scratch.

What you need

Ollama or LM Studio, installed and running, with at least one model downloaded. Both are free, made by other people, and their own sites cover installing them and choosing a model. We don't supply or host a model ourselves.

Choose a model that can call tools. Tool calling is how the AI reads and edits your project, so a model without it can chat but can't touch anything. Both apps usually say which models support it.

How to use it

  1. Make sure Ollama is running, or in LM Studio, start its local server.
  2. Click the sparkle button in Filamental's top bar to open Filamental AI.
  3. Choose Ollama (on this computer) or LM Studio (on this computer) from the provider list.
  4. Check the address. Where a key would go, there's a box for the address of the server. We fill in the usual one (http://localhost:11434 for Ollama, http://localhost:1234 for LM Studio), so you'll only need to change it if you've set yours up differently.
  5. Click Connect. Filamental lists the models the server has, and you add whichever you like.

From then on it works like any other connection, and you can switch between it and your other models from the dropdown at the top of the chat.

If it won't connect

  • "Couldn't reach… Is it running?" The server isn't running, or it's on a different address. Start it, or check the address in Ollama's or LM Studio's own settings.
  • "…is running but has no models loaded." The server's up but has nothing to talk to, so load or download a model first.
  • It chats but never changes anything, or sending fails with an error about tools. That model probably can't call tools, and any error is in the server's own words. Try one that can.

Tips

  • Expect to guide it more, and check its work. It isn't as capable as the big hosted models.
  • We don't choose the model for you. What runs is entirely between you and Ollama or LM Studio.
  • Exploring documents works too. Explore a Folder or Document with AI runs on a local model, reading documents in smaller pieces, one at a time, which makes it slower. A model that can't call tools stops at its first step.
  • This isn't LM Studio over MCP. That's LM Studio using Filamental from its own window, covered in Connect Other AI Apps.

How this helps you

Use it when the material is sensitive: client files, legal or medical notes, anything under a confidentiality agreement. Use it on a plane or anywhere without a connection, or when you want to ask a hundred small questions without watching a bill.

Related

Still stuck? Email [email protected].