← All tools

By PyTorch Foundation

vLLM

vLLM

PyTorch Foundation

High-throughput serving engine for running open LLMs with an OpenAI-compatible API

v0.30.02026-09-22PythonApache-2.0
#llm #serving #inference #python
92.4k Completely free Open source