Skip to content

Model unavailable after sending first message #635

@krissetto

Description

@krissetto

I noticed that some models I have, that appear in docker model list, when run with docker model run somemodel they say "the model isn't found, pulling from server", but then the cli proceeds to run, and then throws an error when i send the first message, as if the model doesn't exist.

Could be closely related to #634, with the main difference being in that other case the models do redownload, in this case they seem not to and the cli then starts normally

OS: Ubuntu 25.10

$ docker model version
Docker Model Runner version v1.0.2-99-gca12aae1-dirty
Docker Engine Kind: Docker Engine
$ docker model status
Docker Model Runner is running

Status:
mlx: not installed
sglang: python3 not found in PATH
vllm: vLLM binary not found
diffusers: python3 not found in PATH
llama.cpp: running llama.cpp version: c55bce4

Screenshot

Image

Metadata

Metadata

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions