Sign in to follow this  
Followers 0
hoangzinh

InetRead function was detected is ROBOT

3 posts in this topic

Hello all, 

I want to get some information form whitepages.ca. But when I try to get page source. It's show the robot content like this:

 

<!DOCTYPE html>

<head>
<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW">
<meta http-equiv="cache-control" content="max-age=0" />
<meta http-equiv="cache-control" content="no-cache" />
<meta http-equiv="expires" content="0" />
<meta http-equiv="expires" content="Tue, 01 Jan 1980 1:00:00 GMT" />
<meta http-equiv="pragma" content="no-cache" />
<meta http-equiv="refresh" content="10; url=/distil_r_captcha.html?Ref=/name/Hamza/California&amp;distil_RID=688BA74C-E1CD-11E4-994E-D448D7E7D06D&amp;distil_TID=20150413110826" />
<script type="text/javascript" src="/ga.881155.js" defer></script><style type="text/css">#d__fFH{position:absolute;top:-5000px;left:-5000px}#d__fF{font-family:serif;font-size:200px;visibility:hidden}#sduxccvwcqyyavyaxyy{display:none!important}</style></head>
<body>
<div id="distil_ident_block">&nbsp;</div>
</body>
</html>

 

This is my code:

 

HttpSetUserAgent('Mozilla/5.0 (Windows NT 6.1; WOW64; Trident/7.0; AS; rv:11.0) like Gecko')

Local $link = 'http://www.whitepages.com/name/Scarlette/California'

Local $page = InetRead($link)
ConsoleWrite($page)

 

Is there anyone have same problem with me? And how to pass it.

Share this post


Link to post
Share on other sites



#3 ·  Posted (edited)

You probably did lots of requests like JohnOne said.

 

Good thing you're using a proper user agent ;)

 

EDIT: Tested and didn't have any issues retrieving the page using InetRead.

 

HttpSetUserAgent('Mozilla/5.0 (Windows NT 6.1; WOW64; Trident/7.0; AS; rv:11.0) like Gecko')
Local $link = 'http://www.whitepages.com/name/Scarlette/California'
Local $page = BinaryToString(InetRead($link,1),4)
ConsoleWrite($page&@LF)
Exit

Edited by Kyan

Heroes, there is no such thing

One day I'll discover what IE.au3 has of special for so many users using it.
C'mon there's InetRead and WinHTTP, way better
happy.png

Share this post


Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!


Register a new account

Sign in

Already have an account? Sign in here.


Sign In Now
Sign in to follow this  
Followers 0