image: set default TCP port
When running as a container, we'll always want to listen on TCP, so we'll set the default port to match the standard model runner default. Signed-off-by: Jacob Howard <jacob.howard@docker.com>
This commit is contained in:
parent
96af7b750f
commit
df8bc82281
|
@ -60,6 +60,7 @@ USER modelrunner
|
|||
|
||||
# Set the environment variable for the socket path and LLaMA server binary path
|
||||
ENV MODEL_RUNNER_SOCK=/var/run/model-runner/model-runner.sock
|
||||
ENV MODEL_RUNNER_PORT=12434
|
||||
ENV LLAMA_SERVER_PATH=/app/bin
|
||||
ENV HOME=/home/modelrunner
|
||||
ENV MODELS_PATH=/models
|
||||
|
|
Loading…
Reference in New Issue