BobbyStranger Posted February 4, 2014 Posted February 4, 2014 Hi there. I'm looking to create a bot, but before I start out, was wondering if you good folks could advise me on it's viability. I'm hoping to come up with a bot that scrapes a website > save said info into a file/database > refresh the page, and scrape again (looking for fresh content) > compare the new info with the old > if any new info is available, then have a pop up notify me. I'm currently using Zennoposter for this, but it's proving cumbersome and slightly prone to bugging out. Your thoughts?
Danp2 Posted February 4, 2014 Posted February 4, 2014 Yes, it should be possible. What website are you attempting to monitor? Latest Webdriver UDF Release Webdriver Wiki FAQs
Moderators JLogan3o13 Posted February 4, 2014 Moderators Posted February 4, 2014 And what specific data are you attempting to scrape from it? "Profanity is the last vestige of the feeble mind. For the man who cannot express himself forcibly through intellect must do so through shock and awe" - Spencer W. Kimball How to get your question answered on this forum!
nullschritt Posted February 4, 2014 Posted February 4, 2014 AutoIt can do pretty much anything, this would be a trivial task.
BobbyStranger Posted February 4, 2014 Author Posted February 4, 2014 And what specific data are you attempting to scrape from it? I'll simply scrape urls (I'm pretty handy with Regex) from the page. Based upon the replies, I'll invest some time into AI. Thanks!
JohnOne Posted February 4, 2014 Posted February 4, 2014 Artificial Intelligence? My mate Arthur, down the pub suffers from that. AutoIt Absolute Beginners Require a serial Pause Script Video Tutorials by Morthawt ipify Monkey's are, like, natures humans.
Moderators JLogan3o13 Posted February 4, 2014 Moderators Posted February 4, 2014 There is not a whole lot you cannot do with AutoIt in this arena. I asked specifically for the type of information because it will determine what functions might help you the best (_IEGetObjByID over _IEBodyReadHTML, for example). "Profanity is the last vestige of the feeble mind. For the man who cannot express himself forcibly through intellect must do so through shock and awe" - Spencer W. Kimball How to get your question answered on this forum!
JohnQSmith Posted February 4, 2014 Posted February 4, 2014 I used a Chrome addon called Page Monitor. Supports regex. Very configurable. Whenever someone says "pls" because it's shorter than "please", I say "no" because it's shorter than "yes".
BobbyStranger Posted February 4, 2014 Author Posted February 4, 2014 I used a Chrome addon called Page Monitor. Supports regex. Very configurable. Thanks for this. I was also looking to bodge together a Chrome/Firefox extention that achieves all of the above.
BobbyStranger Posted February 4, 2014 Author Posted February 4, 2014 Artificial Intelligence? My mate Arthur, down the pub suffers from that. I've heard that a copious amount of mead will cure a victim of AI, but I wouln't believe everything you read in the DSM IV manual. JohnOne 1
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now