-
Notifications
You must be signed in to change notification settings - Fork 93
Open
Labels
good first issueGood for newcomersGood for newcomers
Description
I noticed that some models I have, that appear in docker model list, when run with docker model run somemodel they say "the model isn't found, pulling from server", but then the cli proceeds to run, and then throws an error when i send the first message, as if the model doesn't exist.
Could be closely related to #634, with the main difference being in that other case the models do redownload, in this case they seem not to and the cli then starts normally
OS: Ubuntu 25.10
$ docker model version
Docker Model Runner version v1.0.2-99-gca12aae1-dirty
Docker Engine Kind: Docker Engine$ docker model status
Docker Model Runner is running
Status:
mlx: not installed
sglang: python3 not found in PATH
vllm: vLLM binary not found
diffusers: python3 not found in PATH
llama.cpp: running llama.cpp version: c55bce4Screenshot

Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
good first issueGood for newcomersGood for newcomers