Repositories Users Organizations
Sort
Newest Oldest Alphabetically Reverse alphabetically Recently updated Least recently updated Most stars Fewest stars Most forks Fewest forks
containers / ramalama
Python 0 0
RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.
containers ai llm inference-server intel llamacpp podman vllm cuda hip
Updated 2025-07-19 18:35:54 +08:00
vLLM / vllm
Python 0 0
A high-throughput and memory-efficient inference and serving engine for LLMs
llm mlops pytorch cuda inference llama llm-serving llmops model-serving qwen rocm tpu trainium transformer amd xpu deepseek gpt hpu inferentia
Updated 2025-07-04 16:00:34 +08:00