PHP
Scrawler is an extensible, declarative web robot and scrapper
Latest version requires bopoda/robots-txt-parser ^2.3
19 9
A web spider to scrape Progressive Web Apps
Latest version requires bopoda/robots-txt-parser ^2.4
4 0