Speed up Functions waiting on IE loading

[Champak]

So I have two computers with drastically different speeds; one I get 120 down, the other average I get 13 down since its linked to a phone hotspot. Navigating with IE functions I have it set to wait until the page loads, but it takes forever even though generally the info I actually need is on the page well before it's finished loading. This is bottlenecking the speed of this function drastically, adding an estimated extra 40 seconds to this function on the computer that's doing 120 down....imagine the other one.

any ideas on how to let the page return immediately and monitor something simple to appear then proceed? I basically need to wait until all the text appears on the page and then continue instead of waiting for all the images and referers to load.

[mLipok]

1. speed up your internet connection
2. buy 2 new i7 computers with SSD drives
3. show your code

 

Edited November 19, 2015 by mLipok

[Champak]

There is no code to show. I need ideas/workaround to have my script look at something other than load complete of the navigation functions to continue on with the rest of my function.

[mLipok]

Try this:

#include <IE.au3>
#include <MsgBoxConstants.au3>

Local $oIE = _IECreate("onet.pl")
While StringLen(_IEDocReadHTML($oIE)) < Sleep(1000)+StringLen(_IEDocReadHTML($oIE))
Wend
MsgBox($MB_SYSTEMMODAL, "TEST", 'Done')

 

Edited November 19, 2015 by mLipok

[Champak]

I dont know what exactly youre trying to do there, but its popping up errors.

[JLogan3o13]

Not the way I would have done it, but I'm not getting any errors. Works just fine.

[mLipok]

I dont know what exactly youre trying to do there, but its popping up errors.

Show us these errors.

Not the way I would have done it, but I'm not getting any errors. Works just fine.

This is one of many solutions which I previously used .... , and basically still not fallen into disuse.

Edited November 19, 2015 by mLipok

[Champak]

i'm staring at the code and I simply don't understand what its supposed to do...and that only happens with regexpression stuff lol.

anyway the best word I can use for what im experiencing with this is unstable.

scenario 1/ run the code and nothing happens for 15sec or so, then I hit the scroll bar and the msg pops up.

scenario 2/ run the code and nothing happens for 2min and I close the window and I get errors:

--> IE.au3 T3.0-1 Error from function _IELoadWait, $_IESTATUS_ClientDisconnected (-2147023179, Browser has been deleted prior to operation.)
--> IE.au3 T3.0-1 Error from function _IEDocReadHTML, $_IESTATUS_InvalidObjectType (Expected document element)
--> IE.au3 T3.0-1 Error from function _IEDocReadHTML, $_IESTATUS_InvalidObjectType (Expected document element)
--> IE.au3 T3.0-1 Error from function _IEDocReadHTML, $_IESTATUS_InvalidObjectType (Expected document element)

scenario 3/ run the code while another ie window is open and that error pops up right away

all of this is being done on the connection with 120 down.

JLogan, how would you do it?

[mLipok]

small fix:

#include <IE.au3>
#include <MsgBoxConstants.au3>

Local $oIE = _IECreate("onet.pl")
While StringLen(_IEDocReadHTML($oIE)) < Sleep(1000) - 1 + StringLen(_IEDocReadHTML($oIE))
    ; ConsoleWrite(StringLen(_IEDocReadHTML($oIE)) & @CRLF)
WEnd
MsgBox($MB_SYSTEMMODAL, "TEST", 'Done')

 

EDIT:
What you mean: "all of this is being done on the connection with 120 down". do you mean 120 Mbit/s download speed ?
Please be more precice, with your statements.

Edited November 19, 2015 by mLipok

[Champak]

yes Mbits

But it's still not doing what I need...as I don't understand what its supposed to do.

Look at the following site which is what I need it for: http://www.gaspricewatch.com/OR-oregon/Klamath-Falls/gas-prices/page-1/2.htm

When I insert that address, all the text content I need to grab displays a good 4-5sec before the msg pops up. And the page actually finishes loading (the circle on the tab stops spinning) 2sec before the msg pops up.

[mLipok]

>"C:\Program Files (x86)\AutoIt3\SciTE\..\AutoIt3.exe" "C:\Program Files (x86)\AutoIt3\SciTE\AutoIt3Wrapper\AutoIt3Wrapper.au3" /run /prod /ErrorStdOut /in "C:\Program Files (x86)\AutoIt3\Examples\Helpfile\_IEDocReadHTML__2.au3" /UserParams    
+>00:02:24 Starting AutoIt3Wrapper v.15.920.938.4 SciTE v.3.6.2.0   Keyboard:00000415  OS:WIN_7/Service Pack 1  CPU:X64 OS:X64  Environment(Language:0415)  CodePage:65001  utf8.auto.check:4    # detect ascii high characters and if none found set default encoding to UTF8 and do not add BOM
+>         SciTEDir => C:\Program Files (x86)\AutoIt3\SciTE   UserDir => C:\Users\user\AppData\Local\AutoIt v3\SciTE\AutoIt3Wrapper   SCITE_USERHOME => C:\Users\user\AppData\Local\AutoIt v3\SciTE 
>Running AU3Check (3.3.14.2)  from:C:\Program Files (x86)\AutoIt3  input:C:\Program Files (x86)\AutoIt3\Examples\Helpfile\_IEDocReadHTML__2.au3
+>00:02:24 AU3Check ended.rc:0
>Running:(3.3.14.2):C:\Program Files (x86)\AutoIt3\autoit3.exe "C:\Program Files (x86)\AutoIt3\Examples\Helpfile\_IEDocReadHTML__2.au3"    
--> Press Ctrl+F11 to Restart or Ctrl+Break -or- F11 to Stop
+>00:02:34 AutoIt3.exe ended.rc:0
+>00:02:34 AutoIt3Wrapper Finished.
>Exit code: 0    Time: 10.79

I have HSPA+ modem and how you can see execution time is 10,79 seconds.

EDIT: I forget to say I was used the url which you posted here.
EDIT2: I remove MsgBox and the time is 5,83 seconds.

Edited November 19, 2015 by mLipok

[mLipok]

adding an estimated extra 40 seconds to this function on the computer that's doing 120 down....imagine the other one.

any ideas on how to let the page return immediately and monitor something simple to appear then proceed? I basically need to wait until all the text appears on the page and then continue instead of waiting for all the images and referers to load.

You was adding extra 40 seconds.

 

I need ideas/workaround to have my script look at something other than load complete of the navigation functions to continue on with the rest of my function.

You was asking about idea.

 

But it's still not doing what I need...as I don't understand what its supposed to do.

The idea of my solution is to wait a moment when Document Contents not changing (download is complete).

When I insert that address, all the text content I need to grab displays a good 4-5sec before the msg pops up. And the page actually finishes loading (the circle on the tab stops spinning) 2sec before the msg pops up.

So if you have now problem with only few seconds then I helped you to save at least 35 seconds

Am I not right?

Edited November 19, 2015 by mLipok

[jdelaney]

look at the help file...by default, most IE functions wait for the entire page to load...flip that switch, add an error handler, and loop until your element is present...you can use my signature to do the loop.