#llm-d: Dissecting the Kubernetes-Native AI Inference Architecture with vLLM & Gateway

11K views

BazAI

2 months ago

#llm-d: Dissecting the Kubernetes-Native AI Inference Architecture with vLLM & Gateway

#llm-d: Dissecting the Kubernetes-Native AI Inference Architecture with vLLM & Gateway