hoangzinh Posted April 13, 2015 Share Posted April 13, 2015 Hello all, I want to get some information form whitepages.ca. But when I try to get page source. It's show the robot content like this: <!DOCTYPE html> <head> <META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW"> <meta http-equiv="cache-control" content="max-age=0" /> <meta http-equiv="cache-control" content="no-cache" /> <meta http-equiv="expires" content="0" /> <meta http-equiv="expires" content="Tue, 01 Jan 1980 1:00:00 GMT" /> <meta http-equiv="pragma" content="no-cache" /> <meta http-equiv="refresh" content="10; url=/distil_r_captcha.html?Ref=/name/Hamza/California&distil_RID=688BA74C-E1CD-11E4-994E-D448D7E7D06D&distil_TID=20150413110826" /> <script type="text/javascript" src="/ga.881155.js" defer></script><style type="text/css">#d__fFH{position:absolute;top:-5000px;left:-5000px}#d__fF{font-family:serif;font-size:200px;visibility:hidden}#sduxccvwcqyyavyaxyy{display:none!important}</style></head> <body> <div id="distil_ident_block"> </div> </body> </html> This is my code: HttpSetUserAgent('Mozilla/5.0 (Windows NT 6.1; WOW64; Trident/7.0; AS; rv:11.0) like Gecko') Local $link = 'http://www.whitepages.com/name/Scarlette/California' Local $page = InetRead($link) ConsoleWrite($page) Is there anyone have same problem with me? And how to pass it. Link to comment Share on other sites More sharing options...
JohnOne Posted April 13, 2015 Share Posted April 13, 2015 They've probably got your IP logged as a spam or potential attack bot. Works perfectly fine here. Try not hammering the site and your block (if it is one) might be removed. AutoIt Absolute Beginners Require a serial Pause Script Video Tutorials by Morthawt ipify Monkey's are, like, natures humans. Link to comment Share on other sites More sharing options...
Kyan Posted April 13, 2015 Share Posted April 13, 2015 (edited) You probably did lots of requests like JohnOne said. Good thing you're using a proper user agent EDIT: Tested and didn't have any issues retrieving the page using InetRead. HttpSetUserAgent('Mozilla/5.0 (Windows NT 6.1; WOW64; Trident/7.0; AS; rv:11.0) like Gecko') Local $link = 'http://www.whitepages.com/name/Scarlette/California' Local $page = BinaryToString(InetRead($link,1),4) ConsoleWrite($page&@LF) Exit Edited April 13, 2015 by Kyan Heroes, there is no such thing One day I'll discover what IE.au3 has of special for so many users using it.C'mon there's InetRead and WinHTTP, way better Link to comment Share on other sites More sharing options...
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now