web crawler
internet bot that systematically browses the World Wide Web, typically for the purpose of Web indexing (web spidering)
--Agreed Upon Solutions

The discussion does not exist would you like to add the first comment?

anonymous