vLLM: High-performance serving of LLMs using open-source technology

601 views

AI Infra Forum

2 months ago

vLLM: High-performance serving of LLMs using open-source technology

vLLM: High-performance serving of LLMs using open-source technology