Minet Library Usage

November 17, 2023 ยท View on GitHub

Sorry, this section is currently being reworked, hang tight...

Summary

  • minet.web: module containing utilities related to one-shot HTTP requests, redirections etc.
  • minet.executors: specialized threadpool executors that can be used to download/resolve large numbers of urls efficiently.
  • minet.crawlers: multithreaded crawlers to navigate and collect data on the web.
  • WonderfulSoup: enhanced BeautifulSoup class.