docker
/
model-runner
mirror of https://github.com/docker/model-runner.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
model-runner/pkg/inference/backends
History
Piotr Stankiewicz 880818f741 inference: Support memory estimation for remote models 
Signed-off-by: Piotr Stankiewicz <piotr.stankiewicz@docker.com>
 		2025-08-22 10:15:03 +02:00
..
llamacpp inference: Support memory estimation for remote models 2025-08-22 10:15:03 +02:00
mlx inference: Support memory estimation for remote models 2025-08-22 10:15:03 +02:00
vllm inference: Support memory estimation for remote models 2025-08-22 10:15:03 +02:00