← All tools

By PyTorch Foundation

vLLM

vLLM

PyTorch Foundation

High-throughput serving engine for running open LLMs with an OpenAI-compatible API

v0.25.12026-07-14PythonApache-2.0
#llm #serving #inference #python
87.0k Completely free Open source