model-runner/pkg/inference/backends
Emily Casey bb7abccf47
Update pkg/inference/backends/llamacpp/llamacpp.go
Co-authored-by: Jacob Howard <jacob.howard@docker.com>
2025-08-22 10:38:25 -06:00
..
llamacpp Update pkg/inference/backends/llamacpp/llamacpp.go 2025-08-22 10:38:25 -06:00
mlx inference: Support memory estimation for remote models 2025-08-22 10:15:03 +02:00
vllm inference: Support memory estimation for remote models 2025-08-22 10:15:03 +02:00