Getting the model running was the first hurdle. Comparing models, keeping chats, and trusting the numbers are still hard.
A different screen for every app.
Ollama, LM Studio, and llama.cpp do not share chats.
Studio
One Studio install can talk to any of them. Older chats stay on your computer when you switch models.
Speed numbers from someone else’s computer.
A public ranking does not say how fast a model is on your computer, or how long you wait before the first words.
Studio
It times one model at a time, on the app you saved. It leaves out a practice run by default. You can run the test once, or three times.
Faster gets treated as better.
A quicker reply gets read as a better answer.
Studio
The numbers are how fast this model answered on your computer. A finished run means a reply came back. It does not mean the writing or the picture is correct.
A list of names, and nothing else.
The model list is a set of names. It does not say which ones can look at pictures.
Studio
You can download or remove a model only with Ollama. For the other apps, load the model there, then refresh. Studio marks which models can look at pictures.
A download that seems to vanish.
A model can take a long time to download. Leaving the page looks like it stopped.
Studio
A download keeps going in the background. Switching pages or refreshing shows the same progress. Only one download runs at a time.
The model is on another computer.
At home or at work, the model may be on a different computer. Saving that address should be a choice you make on purpose.
Studio
An address on this computer is saved right away. An address on another computer on your network is saved only after you confirm. The page says your messages will go there.
A cloud address pasted into a local app.
It is easy to paste a cloud address into a box that says “on this computer.”
Studio
Saving the OpenAI website address is refused. The list you already saved stays as it was.
Chats trapped inside an app.
Chats buried inside an app are hard to back up or delete.
Studio
Chats and pictures are files in a data folder on your computer. Deleting a chat deletes its pictures.
Comparisons that mix different tests.
Different questions, a slow first try, or an older test make the table misleading.
Studio
It compares two runs only when they used the same test, the same settings, and every question succeeded. Older tests can still be opened. They are not placed side by side.
A test that does more than you asked.
Sample code should not run by itself, and a picture link should not be opened for you.
Studio
Code is shown as text. It is never run. Pictures are made only by a picture app you already saved on your own network. Studio does not open picture links.
A sign-in for a model you already have.
A sign-in stands between you and a model that is already on your computer.
Studio
There is no sign-in, and Studio does not report how you use it.