bboysza Posted February 28, 2006 Share Posted February 28, 2006 Before I start dev on a webcrawler script, I thought I should ask if any has already written one. What I need to do specifically, is crawl a site, and dump all hrefs and arefs to a log file. Basically, logging the source for each image. Also, I would need to then follow any hrefs (or other jscript or asp links) to other pages and then do the same thing there. I don't need it written for me, just looking for some ideas for the architecture. Thanks, Ben Ben Link to comment Share on other sites More sharing options...
Moderators SmOke_N Posted February 28, 2006 Moderators Share Posted February 28, 2006 Before I start dev on a webcrawler script, I thought I should ask if any has already written one. What I need to do specifically, is crawl a site, and dump all hrefs and arefs to a log file. Basically, logging the source for each image. Also, I would need to then follow any hrefs (or other jscript or asp links) to other pages and then do the same thing there. I don't need it written for me, just looking for some ideas for the architecture.Thanks,BenSearched the word Spider... and poof: http://www.autoitscript.com/forum/index.ph...26entry125826 Common sense plays a role in the basics of understanding AutoIt... If you're lacking in that, do us all a favor, and step away from the computer. Link to comment Share on other sites More sharing options...
Valuater Posted February 28, 2006 Share Posted February 28, 2006 (edited) Might take a look at this too!http://www.autoitscript.com/forum/index.ph...68&hl=Valuater#8) Edited February 28, 2006 by Valuater Link to comment Share on other sites More sharing options...
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now