Mentored decoding

September 24, 2023 ยท View on GitHub

Supplementary material for the blog post on A provably optimal lossy variant of speculative decoding:

  • Optimality proof
  • Code