Downloading a PDF within IE

[Hebron]

I have a set of PDF files I need to download. I can't download them directly because the PDFs are loaded from a script and have a URL structure like this:

http://www.example.com/2291/scripts/?pages=3&module=print

This will print page 3 of the PDF. I want to iterate through and download each page till I reach the end of the file. 

 

The problem is that I can't get to the DOM for some reason.

$oX.Navigate($sUrl)
Sleep(10*$iSeconds)
;_IELoadWait($oX, 10*$iSeconds, 5*$iSeconds) ;_IELoadWait hangs :(

ConsoleWrite( 'URL of Instance #1: ' & _IEPropertyGet($oX, 'locationurl') & @CRLF)
ConsoleWrite( _IEBodyReadHTML($oX) & @CRLF)

I can get the URL of the page, but I can't get the body HTML, I get the following error:

"C:\Program Files (x86)\AutoIt3\Include\IE.au3" (1583) : ==> The requested action with this object has failed.:
Return SetError($_IESTATUS_Success, 0, $oObject.document.body.innerHTML)
Return SetError($_IESTATUS_Success, 0, $oObject.document^ ERROR

 

The way the webpage works when the page number is out of bounds (i.e., requesting page 50 when there's only 10 pages in total) is not by 404ing but instead printing an error message so I can't look at the return code for the page and I MUST look at the HTML of the page.

 

Any advice?

 

Edit: Follow up question - how can I programmatically download the PDF without having to go use an unreliable method like a mouse click over the PDF reader's save button.

Edited October 5, 2015 by Hebron
Follow up question added.

[Hebron]

Anyone?

[Melba23]

Hebron,

Welcome to the AutoIt forums.

Please do not bump your own threads within 24 hours. Remember this is not a 24/7 support forum - those who answer are only here because they like helping others and have some time to spare.  You just have to wait until someone who knows something about your particular problem, and is willing to help, comes online.  Be patient and someone will answer eventually.

M23

 

[mLipok]

Do you See entire pdf embeded inside IE ? 

Do you know How this pdf file is name? 

Edited October 5, 2015 by mLipok

[Hebron]

Do you See entire pdf embeded inside IE ? 

Do you know How this pdf file is name? 

Yes, the entire PDF is embedded inside the IE window.

I don't know the name of the pdf, just the URLs to iterate through. So for example, if the PDF had 5 pages, I would go to the following URLs:

http://www.example.com/2291/scripts/?pages=1&module=print
http://www.example.com/2291/scripts/?pages=2&module=print
http://www.example.com/2291/scripts/?pages=3&module=print
http://www.example.com/2291/scripts/?pages=4&module=print
http://www.example.com/2291/scripts/?pages=5&module=print

and then when I go to the 6th page, it'll give me an error message like this: 

The catalogue is not available

Which is when I need to stop iterating.

[mLipok]

Do you can check the PDF file name just try to manually save it to disc, and say what name is proposed in each case (for each page)

[Hebron]

Do you can check the PDF file name just try to manually save it to disc, and say what name is proposed in each case (for each page)

When I tried saving the page I get this error:

URL of Instance #1: http://www.example.com/2291/scripts/index.html?pages=51&module=print
"C:\Program Files (x86)\AutoIt3\Include\IE.au3" (1959) : ==> The requested action with this object has failed.:
$oObject.document.execCommand("SaveAs")
$oObject.document^ ERROR

Here is what my calls look like:

Dim $sUrl = 'http://www.example.com/' & $sPublicationId & '/scripts/index.html?pages=' & $i & '&module=print'
Dim $oCurrentTab

$oX.Navigate($sUrl)
Sleep(10*$iSeconds)
;_IELoadWait($oX, 10*$iSeconds, 5*$iSeconds) ;This hangs :(

ConsoleWrite( 'URL of Instance #1: ' & _IEPropertyGet($oX, 'locationurl') & @CRLF)
_IEAction($oX, 'saveas') ;Breaks here

 

It looks like it doesn't work when it's a PDF being displayed but if I get to a page that doesn't exist, it returns HTML so the code works then.

Is there any way to recognize that there is a PDF being displayed instead? And how I could save it?

Edited October 5, 2015 by Hebron

[mLipok]

Do you can check the PDF file name JUST TRY TO MANUALLY SAVE IT TO DISC, and say what name is proposed in each case (for each page)

try again.

btw.

read this:    ie.au3 UDF with AutoIt v3.3.14.x  

[Hebron]

try again.

btw.

read this:    ie.au3 UDF with AutoIt v3.3.14.x  

When I manually saved the file after the page had loaded, it was proposed as "index.pdf" automatically. 

 

And I read through that post... I'm not sure what you wanted me to get out of it.

[mLipok]

When I tried saving the page I get this error:

URL of Instance #1: http://www.example.com/2291/scripts/index.html?pages=51&module=print
"C:\Program Files (x86)\AutoIt3\Include\IE.au3" (1959) : ==> The requested action with this object has failed.:
$oObject.document.execCommand("SaveAs")
$oObject.document^ ERROR

This error is bring to you in this way/form as you are not properly using ie.au3.

 

[Hebron]

This error is bring to you in this way/form as you are not properly using ie.au3.

 

Ok, I implemented your method and got the following info from the error:

C:\Users\...\file.au3 (1959) : ==> COM Error intercepted !
    err.number is:      0x80020009
    err.windescription: Exception occurred.

    err.description is:     
    err.source is:      
    err.helpfile is:    
    err.helpcontext is:     0
    err.lastdllerror is:    0
    err.scriptline is:  1959
    err.retcode is:     0x80070057

--> IE.au3 T3.0-2 Error from function _IEAction(saveas), $_IESTATUS_COMError (-2147352567)

Does that help? I'm new to AutoIt and I don't see anything that's helpful.

[Melba23]

Hebron,

Can you let us have the real URL of the site so we can actually look at the page - working with pseudonyms such as http://www.example.com/... is never helpful.

M23

[Hebron]

Hebron,

Can you let us have the real URL of the site so we can actually look at the page - working with pseudonyms such as http://www.example.com/... is never helpful.

M23

The real URL requires you to log in before you can access any of this material. I can take screenshots and post them instead.

 

Here's a screenshot of a random one with page #51:

 

 

And when I look at the Developer tools/DOM explorer, it's just empty:

 

 

Edited October 6, 2015 by Hebron

[Melba23]

Hebron,

It was just a thought - pictures are no use.

M23

[mLipok]

@Hebron Try this:

Example()

Func Example()
    Local $sIECacheDir = _IE_GetCacheDir()
    Local $aPDF_Files = _FileListToArrayRec($sIECacheDir, '*.pdf', 1, 1, 0, 2)
    If @error = 0 Then
        _ArrayDisplay_Debug($aPDF_Files, '$aPDF_Files')
    
        For $i = 1 To UBound($aPDF_Files) - 1
            ConsoleWrite($aPDF_Files[$i] & @CRLF)
        Next
    EndIf
EndFunc   ;==>Example

Func _IE_GetCacheDir()
    Local $sIECacheDir = RegRead('HKEY_CURRENT_USER\Software\Microsoft\Windows\CurrentVersion\Explorer\User Shell Folders\', 'Cache')
    $sIECacheDir = StringReplace($sIECacheDir, '%USERPROFILE%', @UserProfileDir)
    If StringInStr(@OSVersion, 'WIN_8') Or StringInStr(@OSVersion, 'WIN_2012') Then
        $sIECacheDir &= '\IE'
    Else
        $sIECacheDir &= '\Content.IE5'
    EndIf
    Return SetError(0, 0, $sIECacheDir)
EndFunc   ;==>_IE_GetCacheDir

 

Edited October 6, 2015 by mLipok