85FreeIndexed/ ai-tools

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

87.6k stars3k contributorsupdated 13m agovllm-project/vllm

GitHub Try it

About

A high-throughput and memory-efficient inference and serving engine for LLMs

Topics: amd, blackwell, cuda, deepseek, deepseek-v3, gpt, gpt-oss, inference, kimi, llama, llm, llm-serving, model-serving, moe, openai, pytorch, qwen, qwen3, tpu, transformer

Tags

amdblackwellcudadeepseekdeepseek-v3gptgpt-ossinferencekimillamallmllm-servingmodel-servingmoeopenaipytorchqwenqwen3tputransformer

GitHub signals

Indexed

stars

87.6k

forks

20k

contributors

last commit

13m ago

Verify on GitHub

Details

Category: AI Tools
Type: AI tool
Pricing: Open source
Visit: vllm.ai

Stack

Pythonamdblackwellcudadeepseekdeepseek-v3gptgpt-ossinferencekimillamallmllm-servingmodel-servingmoeopenaipytorchqwenqwen3tputransformer

Engagement

claps

views

FindIt Score

Low confidence

A 0–100 score from what actually matters: the code, the community, the buzz, and the site itself. Nobody can pay to raise it.

Code: 100
Freshness(modifier): 100

If a bucket has no data, we leave it out rather than guess. Confidence goes up as more independent sources agree.

Community

Your votes feed straight into the FindIt Score. We weight them by account age so new accounts can’t game it.

Trust & provenance

Ownership: Nobody has proved they own this listing.
Provenance: Indexed from the public repo vllm-project/vllm.
Signals: Not enough history yet — we've only just started watching this one.
Safety: Repo is public and reachable, checked 12m ago.

These are automated checks, not a security audit or a promise the tool is any good. Verified ownership means someone proved they control the domain or repo — nothing more. Do your own homework before you rely on it, and especially before you send anyone money.

Open the repo