Zum Inhalt springen
Search the hub

AI & ML

Speculative Decoding

Also known as: Draft Model Decoding, Speculative Sampling

Small model proposes tokens, large model verifies — cuts latency, needs compatible model pairs.

Tour