Effects of threading

October 18, 2025 ยท View on GitHub

Threading support has been added to the downloader with commits be3aae9 and c6a1119. The selected number of threads is used to download pages from the document in parallel.

On average, the execution time has been decreased proportionally to the number of threads, as it can be seen in the figure.

Performance

Old performance

Before the usage of a ThreadPoolExecutor the average execution time was scaling slightly worse.

Old performance