Faster Debug and Development with Tiny Models, Tokenizers and Datasets

Moved to Debugging PyTorch Programs.

Making a tiny model

Moved to Debugging PyTorch Programs.

Making a tiny tokenizer

Moved to Debugging PyTorch Programs.

Anthony Moi's version

Moved to Debugging PyTorch Programs.

Lysandre Debut's version

Moved to Debugging PyTorch Programs.

Hack the tokenizer file approach

Moved to Debugging PyTorch Programs.

SentencePiece vocab shrinking

Moved to Debugging PyTorch Programs.

Making a tiny model with a tiny tokenizer

Moved to Debugging PyTorch Programs.

Making a tiny dataset

Moved to Debugging PyTorch Programs.

Conclusion

Moved to Debugging PyTorch Programs.

Backup of all scripts in this chapter

Moved to Debugging PyTorch Programs.