mkmcst Posted September 3, 2011 Posted September 3, 2011 (edited) Hello seems i have a problom with this script i have been working on the script is search google and display urls in my program my problom is it will only show me the first page of the search cant fig out how to get the script to go to page two of the google search ? For $i = 0 To 1000 $success = $spider.CrawlNext() If ($success = 1) Then ; Show the URL of the page just spidered. GUICtrlSetData($Edit1,$spider.LastHtmlTitle&@CRLF&$spider.LastHtmlKeywords&@CRLF& $spider.GetOutboundLink($i)& @CRLF,1) ; The HTML is available in the LastHtml property Else ; Did we get an error or are there no more URLs to crawl? If ($spider.NumUnspidered = 0) Then Else MsgBox (0,'',$spider.LastErrorText) EndIf EndIf ; Sleep a second before spidering the next URL. $spider.SleepMs(1000) Next Edited September 3, 2011 by mkmcst ^SLEEPY^sleepys-sin scripting
Herb191 Posted September 7, 2011 Posted September 7, 2011 If I were you I would loop though the Google pages using the URL parameter start=. That way you can jump to the next page of results you want. http://www.google.com/cse/docs/resultsxml.html
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now