← All tools

Tag #serving

vLLM

vLLM

PyTorch Foundation

High-throughput serving engine for running open LLMs with an OpenAI-compatible API

v0.28.02026-08-26PythonApache-2.0
#llm #serving #inference #python
91.1k Completely free Open source