image: set default TCP port

When running as a container, we'll always want to listen on TCP, so
we'll set the default port to match the standard model runner default.

Signed-off-by: Jacob Howard <jacob.howard@docker.com>
This commit is contained in:
Jacob Howard 2025-05-12 19:17:50 -06:00
parent 96af7b750f
commit df8bc82281
No known key found for this signature in database
GPG Key ID: 3E8B8F7FEB46FC66
1 changed files with 1 additions and 0 deletions

View File

@ -60,6 +60,7 @@ USER modelrunner
# Set the environment variable for the socket path and LLaMA server binary path
ENV MODEL_RUNNER_SOCK=/var/run/model-runner/model-runner.sock
ENV MODEL_RUNNER_PORT=12434
ENV LLAMA_SERVER_PATH=/app/bin
ENV HOME=/home/modelrunner
ENV MODELS_PATH=/models