BobbyStranger Posted February 4, 2014 Share Posted February 4, 2014 Hi there. I'm looking to create a bot, but before I start out, was wondering if you good folks could advise me on it's viability. I'm hoping to come up with a bot that scrapes a website > save said info into a file/database > refresh the page, and scrape again (looking for fresh content) > compare the new info with the old > if any new info is available, then have a pop up notify me. I'm currently using Zennoposter for this, but it's proving cumbersome and slightly prone to bugging out. Your thoughts? Link to comment Share on other sites More sharing options...
Danp2 Posted February 4, 2014 Share Posted February 4, 2014 Yes, it should be possible. What website are you attempting to monitor? Latest Webdriver UDF Release Webdriver Wiki FAQs Link to comment Share on other sites More sharing options...
Moderators JLogan3o13 Posted February 4, 2014 Moderators Share Posted February 4, 2014 And what specific data are you attempting to scrape from it? "Profanity is the last vestige of the feeble mind. For the man who cannot express himself forcibly through intellect must do so through shock and awe" - Spencer W. Kimball How to get your question answered on this forum! Link to comment Share on other sites More sharing options...
nullschritt Posted February 4, 2014 Share Posted February 4, 2014 AutoIt can do pretty much anything, this would be a trivial task. Link to comment Share on other sites More sharing options...
BobbyStranger Posted February 4, 2014 Author Share Posted February 4, 2014 And what specific data are you attempting to scrape from it? I'll simply scrape urls (I'm pretty handy with Regex) from the page. Based upon the replies, I'll invest some time into AI. Thanks! Link to comment Share on other sites More sharing options...
JohnOne Posted February 4, 2014 Share Posted February 4, 2014 Artificial Intelligence? My mate Arthur, down the pub suffers from that. AutoIt Absolute Beginners Require a serial Pause Script Video Tutorials by Morthawt ipify Monkey's are, like, natures humans. Link to comment Share on other sites More sharing options...
Moderators JLogan3o13 Posted February 4, 2014 Moderators Share Posted February 4, 2014 There is not a whole lot you cannot do with AutoIt in this arena. I asked specifically for the type of information because it will determine what functions might help you the best (_IEGetObjByID over _IEBodyReadHTML, for example). "Profanity is the last vestige of the feeble mind. For the man who cannot express himself forcibly through intellect must do so through shock and awe" - Spencer W. Kimball How to get your question answered on this forum! Link to comment Share on other sites More sharing options...
JohnQSmith Posted February 4, 2014 Share Posted February 4, 2014 I used a Chrome addon called Page Monitor. Supports regex. Very configurable. Whenever someone says "pls" because it's shorter than "please", I say "no" because it's shorter than "yes". Link to comment Share on other sites More sharing options...
BobbyStranger Posted February 4, 2014 Author Share Posted February 4, 2014 I used a Chrome addon called Page Monitor. Supports regex. Very configurable. Thanks for this. I was also looking to bodge together a Chrome/Firefox extention that achieves all of the above. Link to comment Share on other sites More sharing options...
BobbyStranger Posted February 4, 2014 Author Share Posted February 4, 2014 Artificial Intelligence? My mate Arthur, down the pub suffers from that. I've heard that a copious amount of mead will cure a victim of AI, but I wouln't believe everything you read in the DSM IV manual. JohnOne 1 Link to comment Share on other sites More sharing options...
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now