Mentored decoding
September 24, 2023 ยท View on GitHub
Supplementary material for the blog post on A provably optimal lossy variant of speculative decoding:
- Optimality proof
- Code
September 24, 2023 ยท View on GitHub
Supplementary material for the blog post on A provably optimal lossy variant of speculative decoding: