ome-projects /ome
Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton
Go525

multi-node-kubernetes 话题在 GitHub 上没有填写简介,这里按 Star 数汇总最相关的热门仓库。
Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton
Create and administer a local one or multi-node Kubernetes cluster(s) preset for development with simple commands.