NVIDIA appears to be preparing a looped transformer: Dory 1.0 🔥 A new vLLM PR names a 4B checkpoint and implements shared layers running multiple internal loops, with separate KV caches per loop. Draft PR; public weights and release unconfirmed.
Model reference spotted ·
nvidia/dory-1.0-4b
by NVIDIA found in NVIDIA Dory draft vLLM PR
Model reference
2 sightings
- Status
- Listed in a catalog, not announced
- Maker
- NVIDIA
- Found in
- NVIDIA Dory draft vLLM PR github.com
- First detected
- Posted to X
- 1 s after detection
- Model ID
nvidia/dory-1.0-4balso listed asnvidia/NVIDIA-Nemotron-Labs-Dory1.0-4B-BF16-10_05_26
Timeline
2 sightings-
reference
Spotted in NVIDIA Dory draft vLLM PR
NVIDIA appears to be preparing a looped transformer: Dory 1.0 🔥
Post on X -
reference
Spotted in NVIDIA Dory draft vLLM PR
NVIDIA appears to be preparing a looped transformer: Dory 1.0 🔥
Post on X