candle-sampling

March 10, 2024 ยท View on GitHub

Continuous integration Documentation

Sampling techniques for Candle.

Currently implemented methods are:

  • multinomial (ancestral)
  • top-k
  • top-p (nucleus)
  • top-n logprobs
  • repeat penalty (frequency penalty)
  • presence penalty
  • logit bias