07 January 2019 A simple multi-threaded web crawler for randomly gathering huge lists dcrawl is a simple, but smart, multi-threaded web crawler for randomly gathering huge lists of unique domain names.
07 January 2019 A web scraping system aiming to simplify data extraction from the web ferret is a web scraping system aiming to simplify data extraction from the web for such things like UI testing, machine learning and analytics.