I think this is my first post in this subforum.
This is quick and dirty code. I am not a programmer and I am sure there are a really better ways to do this.
The main plus of this code is the speed. I use SQLITE and this makes this script more fast then every example here.
Find all URLs from one domain
Find all e-mails from one domain (you can modify this and get URLS and e-mail out of domain too)
You can stop it and start it - it will start from last URL
Deep Level Option
Deep level option
Everything is in SQLITE DB but you can convert it to what you need. I use SQLite Database Browser to review the db.
If you need to reset the tool just remove or rename the database file.
Edited by Valik, 13 March 2012 - 03:22 PM.