Repositories Users Organizations
Sort
Newest Oldest Alphabetically Reverse alphabetically Recently updated Least recently updated Most stars Fewest stars Most forks Fewest forks
vLLM / vllm-ascend
Python 0 0
Community maintained hardware plugin for vLLM on Ascend
mlops llm inference model-serving transformer vllm llm-serving llmops ascend
Updated 2025-07-20 16:30:47 +08:00
containers / ramalama
Python 0 0
RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.
containers ai llm inference-server intel llamacpp podman vllm cuda hip
Updated 2025-07-19 18:35:54 +08:00
vLLM / vllm
Python 0 0
A high-throughput and memory-efficient inference and serving engine for LLMs
llm mlops pytorch cuda inference llama llm-serving llmops model-serving qwen rocm tpu trainium transformer amd xpu deepseek gpt hpu inferentia
Updated 2025-07-04 16:00:34 +08:00
kubeflow / katib
Python 0 0
Automated Machine Learning on Kubernetes
kubernetes machine-learning kubeflow ai tensorflow huggingface llm mlops jax pytorch hyperparameter-tuning neural-architecture-search automl scikit-learn
Updated 2025-06-26 22:13:16 +08:00
kubeflow / trainer
Python 0 0
Distributed ML Training and Fine-Tuning on Kubernetes
kubernetes huggingface ai llm gpu jax kubeflow distributed xgboost machine-learning mlops python pytorch tensorflow fine-tuning
Updated 2025-06-20 16:05:11 +08:00
cncf / llm-in-action
Python 0 0
🤖 Discover how to apply your LLM app skills on Kubernetes!
cloudnative inference llm
Updated 2024-03-09 05:47:39 +08:00