← All tools

By PyTorch Foundation

vLLM

vLLM

PyTorch Foundation

High-throughput serving engine for running open LLMs with an OpenAI-compatible API

v0.28.02026-08-26PythonApache-2.0
#llm #serving #inference #python
91.2k Completely free Open source