AI & ML
Speculative Decoding
Also known as: Draft Model Decoding, Speculative Sampling
Small model proposes tokens, large model verifies — cuts latency, needs compatible model pairs.
AI & ML
Also known as: Draft Model Decoding, Speculative Sampling
Small model proposes tokens, large model verifies — cuts latency, needs compatible model pairs.