13lack13lade Posted May 22, 2015 Share Posted May 22, 2015 Hi Guys,I am wondering if there is a way to do data/screen scraping more effectively or even just automate some of processes.We currently are outsourcing this by having a bunch of people troll through certain websites to obtain prices for price comparision.. and i believe they use chrome scraper extension to get the data and put it into an excel spreadsheet.Just wondering if there is any awesome autoit script that someone has created or if i should look into creating one and how hard would that be? Has anyone done anything like this before and could help point me in the right direction? Link to comment Share on other sites More sharing options...
13lack13lade Posted May 22, 2015 Author Share Posted May 22, 2015 might just get them to keep using chrome screen scraper.. unless anyone has any other suggestions? Link to comment Share on other sites More sharing options...
AlmarM Posted May 22, 2015 Share Posted May 22, 2015 Creating something yourself is never a bad idea. You'll gain loads of experience and information from the process.As far as I know, I have no clue if anyone has already done this. Is 'chrome screen scaper' not good enough, or are you just curious? Minesweeper A minesweeper game created in autoit, source available. _Mouse_UDF An UDF for registering functions to mouse events, made in pure autoit. 2D Hitbox Editor A 2D hitbox editor for quick creation of 2D sphere and rectangle hitboxes. Link to comment Share on other sites More sharing options...
Bert Posted May 22, 2015 Share Posted May 22, 2015 have you checked to see if the site they are harvesting data has an API you can hook into? I say this for if ANYTHING changes on the page your scraping, the script can break.Been there, got the t-shirt. The Vollatran project My blog: http://www.vollysinterestingshit.com/ Link to comment Share on other sites More sharing options...
topten Posted May 22, 2015 Share Posted May 22, 2015 Regexp might be your best friend Link to comment Share on other sites More sharing options...
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now