Wait until part of web page loads

[plasmon]

Hi All,

I am trying to run a script that goes through a number of webpages by clicking and entering values. The problem is that when I get to one of the pages, the page loads, but a section on the page does not load; it just shows a circular loading sign in this section and after 5 minutes or so the data in finally populates. I found a related post called 'While Loop confusion', but it seems the problem was not fully solved. 

I have tried while loops myself to try to make the code sleep in increments until the text appears, but could not get it to work. Could someone please advise me on how to wait for a web page to fully load before continuing with the script? The time to load can vary, which is why sleep commands are not guaranteed to always work.

Thanks in advance.

 

 

 

 

 

[Melba23]

plasmon,

Welcome to the AutoIt forums.

The only reliable way I have found to deal with these slow loads is to determine something visual that changes only when the section has finally loaded and then loop until you can detect that change. So what could that clue be in your case? A change in colour for part of the page? A suddenly visible unique text string? Over to you.

M23

 

 

[junkew]

A trick can be to use javascript favlet in addressbar to add something to the html dom content. It will only be added when the page is finished loading.

[mLipok]

  On 9/30/2015 at 4:54 PM, junkew said:

A trick can be to use javascript favlet in addressbar to add something to the html dom content. It will only be added when the page is finished loading.

Interesting.
Can you show any example?

 

mLipok

[junkew]

On google you can find bookmarklets and favlets

As you can reach javascript thru the addressbar in any browser (opera, safari, chrome, firefox, internet explorer, microsoft edge) there are no limits to remotely controlling browsers as javascript can reach the dom. Below example is manually typing but its easy to do controlsend to most browsers addressbar (otherwise use IUIAutomation to reach addressbar)

1.  Type in your addressbar:     javascript:alert('hello');void(0);

javascript: you have to type other part can be copy pasted

void(0); is there to prevent reloading of the page

2.a  Next step is to inject some javascript as a oneliner

\ is escaping character for \/ and \"

javascript:var js = document.createElement('script');js.type = "text\/javascript";js.text = 'function testme(){alert(\"hello\");}';var first=document.getElementsByTagName('script')[0];first.parentNode.insertBefore(js, first);void(0);

2.b. Type in your addressbar:     javascript:testme();void(0);

3.   Type in your addressbar:

javascript:var input = document.createElement('input'); input.type = "text";input.value=document.readyState;document.body.appendChild(input);void(0);

You should see a textbox at the bottom of your page including the state of your document (see examples section on IUIAutomation on how to reach the contents of that textbox)

4.  probably easiest to get status (as you can read statusbar or statusbar as regular windows controls)

javascript:window.status=document.readyState;void(0);

or javascript:window.history.replaceState('Object', 'Title', '/'+document.readyState);void(0);

5. And from this part on its any imagination you have with html5 like injecting websocket and talk tcp/ip from AutoIT to your injected websocket javascript

javascript:var wsUri = "ws://127.0.0.1:65432/";function testWebSocket() {websocket = new WebSocket(wsUri);websocket.onopen = function(evt) {onOpen(evt)};websocket.onclose = function(evt) {onClose(evt)};  websocket.onmessage = function(evt) { onMessage(evt) };websocket.onerror = function(evt) { onError(evt) };} function onOpen(evt) { alert("CONNECTED");} function onClose(evt) { alert("DISCONNECTED");} function onMessage(evt) { alert("Message" + evt.data);} function onError(evt) { alert("ERROR:" + evt.data); } ;void(0);

and then run this script

expandcollapse popup

#include <MsgBoxConstants.au3>

; I am the server, start me first! (Start in second the TCPConnect example script).

Example()

Func Example()
    TCPStartup() ; Start the TCP service.

    ; Register OnAutoItExit to be called when the script is closed.
    OnAutoItExitRegister("OnAutoItExit")

    ; Assign Local variables the loopback IP Address and the Port.
    Local $sIPAddress = "127.0.0.1" ; This IP Address only works for testing on your own computer.
    Local $iPort = 65432 ; Port used for the connection.

    ; Bind to the IP Address and Port specified with a maximum of 100 pending connexions
    ;(Take a look at the example of this function for further details).
    Local $iListenSocket = TCPListen($sIPAddress, $iPort, 100)
    Local $iError = 0

    ; If an error occurred display the error code and return False.
    If @error Then
        ; Someone is probably already listening on this IP Address and Port (script already running?).
        $iError = @error
        MsgBox(BitOR($MB_SYSTEMMODAL, $MB_ICONHAND), "", "Could not listen, Error code: " & $iError)
        Return False
    EndIf

    ; Assign Local variable to be used by Listening and Client sockets.
    Local $iSocket = 0
    Do ; Wait for someone to connect (Unlimited).
        ; Accept incomming connexions if present (Socket to close when finished; one socket per client).
        $iSocket = TCPAccept($iListenSocket)

        ; If an error occurred display the error code and return False.
        If @error Then
            $iError = @error
            MsgBox(BitOR($MB_SYSTEMMODAL, $MB_ICONHAND), "", "Could not accept the incoming connection, Error code: " & $iError)
            Return False
        EndIf
    Until $iSocket <> -1 ;if different from -1 a client is connected.

    ; Close the Listening socket to allow afterward binds.
    TCPCloseSocket($iListenSocket)

    MsgBox($MB_SYSTEMMODAL, "", "Client Connected.")

    ; Close the socket.
    TCPCloseSocket($iSocket)
EndFunc   ;==>Example

Func OnAutoItExit()
    TCPShutdown() ; Close the TCP service.
EndFunc   ;==>OnAutoItExit

and then type in your addressbar:  

javascript:testWebSocket();void(0);

6. As you have a socket you can exchange strings and dynamically eval these in javascript and as such completely remote control any browser just like ff.au3 is doing internally with a lot of javascript calls but then its an addin.

 

[mLipok]

I see that I have something to read, search, test ... for the next few days.
Thanks.

mLipok

 

EDIT:

I see this is much related feature to this:

http://slayeroffice.com/tools/modi/v2.0/modi_help.html

 

Edited October 1, 2015 by mLipok

[plasmon]

Hi All,

 

Sorry, I did not receive notifications that I had replies. Many thanks for your responses, I have since developed my own technique wherein I search for text on the loading screen, I put this search in a loop and and when the text disappears, the loop exits and the rest of the code is executed. 

 

Thanks again.