Thai Dictionary Cleaner

November 30, 2023 ยท View on GitHub

Cleaning dictionary data for NLP usage.

You can use this as "The list of all Thai words" for NLP usage, such as tokenization or word recognition.

This will be contributed to pythainlp

LICENSE

All data provided from this repository respects the license of the original data.
Look at the LICENSE.md in each folder.

Data

Wikipedia titles

This is useful for enable recognizing proper-nouns or terminology such as people names, products names or mathematical theories names.

There were some extraction during the cleaning process. Please view the Jupyter notebook.

Words: 29K+

Volubilis

This is useful for recognizing almost all the words used (including new words) in Thai language (except proper-nouns).

Words: 12K+