Tag: research

All the articles with the tag "research".

• research

  28 Jul, 2026

  MARS: Several Tokens per Forward Pass, Without Giving Up Autoregression

  One SFT checkpoint, two modes: full-quality AR at τ=1.0, or 1.8 tokens per forward pass for 1.56–2.16× speedup, with an exact, free fallback to plain AR.

• research

  9 Jun, 2026

  How Much Do Diffusion LLMs Memorize? (vs Autoregressive)

  Same size, same memory ceiling, but the diffusion model needs ~10x the training to reach it, and eventually just can't.