Ages ago I wrote a tool called ProxySpider, long story short it scrapes then checks/filters proxies.

 

Here is a log of it in action:

[02:56:23 0 0/0 27/27]: Scraping proxies…
[02:56:50 0 31169/31168 178/414]: Checking proxies…
[03:00:49 1220 0/31168 178/414]: Scraping proxies…

It took 5 minutes to scrape then check 31169 proxies, out of that it found 1220 high anonymous proxies.

 

Here is another log of it in action, this time it’s looking for all types of proxies:

[03:03:03 0 0/0 27/27]: Scraping proxies…
[03:03:21 0 27367/27364 182/414]: Checking proxies…
[03:06:48 2512 0/27364 182/414]: Scraping proxies…

It took 5 minutes to scrape then check 27367 proxies, out of that it found 2512 proxies.

 

Ofcourse, that’s just one rotation, you can leave proxy spider running for several more hours to scrape more proxies.

 

Anyways, I’m not sure what to do with it, if I wanted I could automate a service for free proxies, would anyone want that? Let me know via twitter.