Skip to main content
← All vulnerabilities
CVE-2026-44223GHSA-83VM-P52W-F9PWPYSEC-2026-145

vLLM: extract_hidden_states speculative decoding crashes server on any request with penalty parameters

Published
Last modified
published
Not listed in CISA KEV
Fix
Fixed in 0.20.0
None on Exploit-DB, Metasploit or GitHub
  • Exploitation: poc
  • Automatable: no
  • Technical impact: partial

Summary

vLLM is an inference and serving engine for large language models (LLMs). From 0.18.0 to before 0.20.0, the extract_hidden_states speculative decoding proposer in vLLM returns a tensor with an incorrect shape after the first decode step, causing a RuntimeError that crashes the EngineCore process. The crash is triggered when any request in the batch uses sampling penalty parameters (repetition_penalty, frequency_penalty, or presence_penalty). A single request with a penalty parameter (e.g., "repetition_penalty": 1.1) is sufficient to crash the server. This vulnerability is fixed in 0.20.0.

Timeline

  1. CVE published
  2. CISA SSVC assessment

    Exploitation: poc · Automatable: no · Technical impact: partial

  3. Record last updated

Affected versions

  • vllm-project vllm

    From 0.18.0 · fixed in 0.20.0

  • vllmPyPI

    From 0.18.0 · fixed in 0.20.0

References 2

GitHub · vllm-project/vllm