Append URL Help

[dade]

Hello all,

I'm fairly new to coding, (especially with Auto It) and still learning. I've used the forums a lot to find examples, and piece together things in attempts to create a script. Here's what I have so far:

#include <IE.au3>
#include <MsgBoxConstants.au3>

HotKeySet('/', 'EndProgram')
$sURL = "https://website.com/1"
$sSearch = "google"
$oIE = _IECreate ($sURL)
$file = FileOpen(@DesktopDir & "\results.txt", 1)

Local $i = 0
Do
If StringInStr(_IEBodyReadText($oIE), $sSearch) Then
   Beep(500,2)
   $lURL = _IEPropertyGet($oIE,"locationurl")
    FileWrite($file, $lURL & @CRLF)
    Sleep(150)
    _IELinkClickByText($oIE, "next")
Else
    Sleep(150)
    _IELinkClickByText($oIE, "next")
 EndIf
 $i = $i + 1
 Until $i = 10

 Func EndProgram()
    Exit
EndFunc

What I'd like to do is instead of going from page to page, start at a specified page and increase by X and search X amount of pages after that before making the jump again.

Example: Start page 1 > search 10 pages > jump 10 pages, search 10 pages.

Any help / suggestions / modifications to make this better please do! This is basically my first script I've pieced together in Auto It. 

[Nine]

The page number is probably part of the URL.  Just adapt your $sURL to the page number of your choice. Use _IENavigate to go to the page you want, instead of clicking Next button.

Edited May 25, 2020 by Nine

[MrCreatoR]

#include <IE.au3>
#include <MsgBoxConstants.au3>

HotKeySet('/', 'EndProgram')

$sURL = "https://website.com/"
$sSearch = "google"
$oIE = _IECreate($sURL)
$hFile = FileOpen(@DesktopDir & "\results.txt", 1)

$iStart = 1
$iEnd = 100

For $iPage = $iStart To $iEnd
    _IENavigate($oIE, $sURL & $iPage)
    
    If StringInStr(_IEBodyReadText($oIE), $sSearch) Then
        Beep(500, 2)
        FileWrite($hFile, $sURL & $iPage & @CRLF)
        Sleep(150)
    EndIf
Next

EndProgram()

Func EndProgram()
    FileClose($hFile)
    Exit
EndFunc

 

[dade]

This works great, other than it needs to have somewhat of a delay as it causes a 504 error. >.<

[MrCreatoR]

1 hour ago, dade said:

needs to have somewhat of a delay as it causes a 504 error

This is another issue, i can only suggest to make random delay: Sleep(Random(500, 2000, 1)).

[dade]

Is it possible to set something like $page in the link and add a sum to it?

$sURL = "https://website.com/" $page

Like $page = 10
 

[dade]

I accidentally hit enter and am not sure how to edit my previous reply but I was saying:

$page = 10

$next page = previous page + 10. Or append the URL to have the next page number inserted after it is calculated.

[MrCreatoR]

9 hours ago, dade said:

Is it possible to set something like $page in the link and add a sum to it?

Yes.