UrlDownloadEx() - Download with maximum speed

June 23, 2014

If you ever tried to download some remote file from your script using InetGet(), InetRead() or other download functions, you probably noticed that the download speed was never as good as when you try to download the same file using a download manager.

But that's over, you won't lack the high speed download capability of download managers in your AutoIt scripts, not anymore.

Enjoy:

#include-once
#AutoIt3Wrapper_Au3Check_Parameters=-q -d -w 1 -w 2 -w 3 -w 4 -w 5 -w 6 -w 7

#include <WinHttp.au3> ;http://www.autoitscript.com/forum/topic/84133-winhttp-functions/
#include <FileConstants.au3>

; #FUNCTION# ====================================================================================================================
; Name ..........: UrlDownloadEx
; Description ...: Download a single file by splitting it in segments and using several simultaneous connections to download these segments from a single server.
; Syntax ........: UrlDownloadEx($sUrl [, $sFileName = Default [, $iNumberOfConnections = Default [, $CallbackFunction = Default [, $vParam = 0]]]])
; Parameters ....: $sUrl                 - Url of the file to download.
;                  $sFileName            - [optional] Local filename to download to. Default is "".
;                  $iNumberOfConnections - [optional] Number of simultaneous connections. Default is 8.
;                  $CallbackFunction     - [optional] An application-defined callback function to call when progress is made. Default is Null.
;                  $vParam               - [optional] An application-defined value to be passed to the callback function. Default is 0.
; Return values .: Success - Returns a binary string if file name is not supplied.
;                          - Returns 1 if file name is supplied
;                          - @extended receives the number of received bytes.
;                  Failure - Returns 0 and sets @error:
;                  |1  - Invalid number of connections
;                  |2  - Invalid callback function
;                  |3  - Invalid url
;                  |4  - _WinHttpOpen failed
;                  |5  - _WinHttpConnect failed
;                  |6  - _WinHttpOpenRequest failed
;                  |7  - _WinHttpSendRequest failed
;                  |8  - _WinHttpReceiveResponse failed
;                  |9  - _WinHttpQueryHeaders failed
;                  |10 - _WinHttpOpenRequest failed, while trying to create multiple request
;                  |11 - _WinHttpQueryHeaders failed, while trying to prepare multiple request
;                  |12 - Not enough memory to allocate buffer
;                  |13 - _WinHttpQueryDataAvailable failed
;                  |14 - Download aborted, callback function returned False
;                  |15 - FileOpen failed
;                  |16 - FileWrite failed
; Author ........: FaridAgl
; Remarks .......: The Url parameter should be in the form "http://www.somesite.com/path/file.html", just like an address you would type into your web browser.
;                  + Please use a high number of connections with caution. Some servers may have specific limitations for a number of connections from one client, when the number of connections is high, the servers can put your computer to a black list.
;                  + For some connection types or for low performance computers or routers, the download speed may decrease when you increase the number of connections.
;                  + The callback function is called with the following parameters: $iReceivedBytes, $iTotalReceivedBytes, $iDownloadSize, $vParam
;                  + To continue downloading, the callback function must return True; to stop downloading, it must return False.
; Example .......: Yes
; ===============================================================================================================================
Func UrlDownloadEx($sUrl, $sFileName = Default, $iNumberOfConnections = Default, $CallbackFunction = Default, $vParam = 0)
    If ($sFileName = Default Or $sFileName = -1) Then $sFileName = ""

    If ($iNumberOfConnections = Default Or $iNumberOfConnections = -1) Then
        $iNumberOfConnections = 8
    ElseIf (IsInt($iNumberOfConnections) = 0 Or $iNumberOfConnections < 1) Then
        Return SetError(1, 0, 0)
    EndIf

    If ($CallbackFunction = Default Or $CallbackFunction = -1) Then
        $CallbackFunction = Null
    Else
        If (IsFunc($CallbackFunction) = 0) Then Return SetError(2, 0, 0)
    EndIf

    Local $avUrlComponents = _WinHttpCrackUrl($sUrl, $ICU_DECODE)
    If ($avUrlComponents = 0) Then Return SetError(3, 0, 0)

    Local Const $SERVER_NAME = $avUrlComponents[2]
    Local Const $OBJECT_NAME = $avUrlComponents[6]
    Local Const $SERVER_PORT = $avUrlComponents[3]
    Local Const $FLAGS = ($avUrlComponents[1] = $INTERNET_SCHEME_HTTPS) ? ($WINHTTP_FLAG_SECURE) : (0)

    Local $hSession = _WinHttpOpen("Mozilla/5.0 (Windows; U; MSIE 9.0; WIndows NT 9.0; en-US))", $WINHTTP_ACCESS_TYPE_DEFAULT_PROXY, $WINHTTP_NO_PROXY_NAME, $WINHTTP_NO_PROXY_BYPASS, 0)
    If ($hSession = 0) Then Return SetError(4, 0, 0)

    Local $hConnect = _WinHttpConnect($hSession, $SERVER_NAME, $SERVER_PORT)
    If ($hConnect = 0) Then
        _WinHttpCloseHandle($hSession)
        Return SetError(5, 0, 0)
    EndIf

    Local $hRequest = _WinHttpOpenRequest($hConnect, "GET", $OBJECT_NAME, 0, $WINHTTP_NO_REFERER, $WINHTTP_DEFAULT_ACCEPT_TYPES, $FLAGS)
    If ($hRequest = 0) Then
        _WinHttpCloseHandle($hConnect)
        _WinHttpCloseHandle($hSession)
        Return SetError(6, 0, 0)
    EndIf

    If (_WinHttpSendRequest($hRequest, "Range: bytes=0-0", $WINHTTP_NO_REQUEST_DATA, 0, 0) = 0) Then
        _WinHttpCloseHandle($hRequest)
        _WinHttpCloseHandle($hConnect)
        _WinHttpCloseHandle($hSession)
        Return SetError(7, 0, 0)
    EndIf

    If (_WinHttpReceiveResponse($hRequest) = 0) Then
        _WinHttpCloseHandle($hRequest)
        _WinHttpCloseHandle($hConnect)
        _WinHttpCloseHandle($hSession)
        Return SetError(8, 0, 0)
    EndIf

    Local $sStatusCode = _WinHttpQueryHeaders($hRequest, $WINHTTP_QUERY_STATUS_CODE, $WINHTTP_HEADER_NAME_BY_INDEX, $WINHTTP_NO_HEADER_INDEX)
    If (Int($sStatusCode, 1) <> $HTTP_STATUS_PARTIAL_CONTENT) Then
        _WinHttpCloseHandle($hRequest)
        _WinHttpCloseHandle($hConnect)
        _WinHttpCloseHandle($hSession)
        Return SetError(9, 0, 0)
    EndIf

    Local $sContentRange = _WinHttpQueryHeaders($hRequest, $WINHTTP_QUERY_CONTENT_RANGE, $WINHTTP_HEADER_NAME_BY_INDEX, $WINHTTP_NO_HEADER_INDEX)
    _WinHttpCloseHandle($hRequest)

    Local Enum $REQUEST_HANDLE, $RECEIVED_BYTES, $DOWNLOAD_OFFSET, $BYTES_TO_DOWNLOAD
    Local $avConnections[$iNumberOfConnections][4]

    Local $iDownloadSize = Int(StringTrimLeft($sContentRange, StringLen("bytes 0-0/")), 1)
    Local $iDownloadSizePerConnection = Floor($iDownloadSize / $iNumberOfConnections)

    Local $iLastByteToDownload = 0
    For $i = 0 To $iNumberOfConnections - 1
        $avConnections[$i][$REQUEST_HANDLE] = _WinHttpOpenRequest($hConnect, "GET", $OBJECT_NAME, 0, $WINHTTP_NO_REFERER, $WINHTTP_DEFAULT_ACCEPT_TYPES, $FLAGS)
        If ($avConnections[$i][$REQUEST_HANDLE] = 0) Then
            For $j = $i - 1 To 0 Step -1
                _WinHttpCloseHandle($avConnections[$j][$REQUEST_HANDLE])
            Next

            _WinHttpCloseHandle($hConnect)
            _WinHttpCloseHandle($hSession)
            Return SetError(10, 0, 0)
        EndIf

        $avConnections[$i][$RECEIVED_BYTES] = 0
        $avConnections[$i][$DOWNLOAD_OFFSET] = $i * $iDownloadSizePerConnection
        If ($i <> $iNumberOfConnections - 1) Then
            $avConnections[$i][$BYTES_TO_DOWNLOAD] = $iDownloadSizePerConnection
            $iLastByteToDownload = $avConnections[$i][$DOWNLOAD_OFFSET] + $iDownloadSizePerConnection - 1
        Else
            $avConnections[$i][$BYTES_TO_DOWNLOAD] = $iDownloadSizePerConnection + Mod($iDownloadSize, $iNumberOfConnections)
            $iLastByteToDownload = $iDownloadSize - 1
        EndIf

        _WinHttpSendRequest($avConnections[$i][$REQUEST_HANDLE], "Range: bytes=" & $avConnections[$i][$DOWNLOAD_OFFSET] & "-" & $iLastByteToDownload, $WINHTTP_NO_REQUEST_DATA, 0, 0)
        _WinHttpReceiveResponse($avConnections[$i][$REQUEST_HANDLE])

        $sStatusCode = _WinHttpQueryHeaders($avConnections[$i][$REQUEST_HANDLE], $WINHTTP_QUERY_STATUS_CODE, $WINHTTP_HEADER_NAME_BY_INDEX, $WINHTTP_NO_HEADER_INDEX)
        If (Int($sStatusCode, 1) <> $HTTP_STATUS_PARTIAL_CONTENT) Then
            For $j = $i - 1 To 0 Step -1
                _WinHttpCloseHandle($avConnections[$j][$REQUEST_HANDLE])
            Next

            _WinHttpCloseHandle($hConnect)
            _WinHttpCloseHandle($hSession)
            Return SetError(11, 0, 0)
        EndIf
    Next

    Local $tBuffer = DllStructCreate("BYTE[" & $iDownloadSize & "]")
    If (@error) Then Return SetError(12, 0, 0)

    Local $pBuffer = DllStructGetPtr($tBuffer)

    Local $iTotalReceivedBytes = 0
    While (True)
        For $i = 0 To $iNumberOfConnections - 1
            If ($avConnections[$i][$RECEIVED_BYTES] = $avConnections[$i][$BYTES_TO_DOWNLOAD]) Then ContinueLoop

            If (_WinHttpQueryDataAvailable($avConnections[$i][$REQUEST_HANDLE]) = 1) Then
                $iTotalReceivedBytes += @extended

                _WinHttpReadData($avConnections[$i][$REQUEST_HANDLE], 2, @extended, $pBuffer + $avConnections[$i][$DOWNLOAD_OFFSET] + $avConnections[$i][$RECEIVED_BYTES])
                $avConnections[$i][$RECEIVED_BYTES] += @extended

                If ($CallbackFunction <> Null) Then
                    If ($CallbackFunction(@extended, $iTotalReceivedBytes, $iDownloadSize, $vParam) = False) Then
                        For $j = 0 To $iNumberOfConnections - 1
                            If ($avConnections[$j][$REQUEST_HANDLE] > 0) Then _WinHttpCloseHandle($avConnections[$j][$REQUEST_HANDLE])
                        Next

                        _WinHttpCloseHandle($hConnect)
                        _WinHttpCloseHandle($hSession)
                        Return SetError(14, 0, 0)
                    EndIf
                EndIf

                If ($avConnections[$i][$RECEIVED_BYTES] = $avConnections[$i][$BYTES_TO_DOWNLOAD]) Then
                    _WinHttpCloseHandle($avConnections[$i][$REQUEST_HANDLE])
                    $avConnections[$i][$REQUEST_HANDLE] = 0
                EndIf
            Else
                For $j = 0 To $iNumberOfConnections - 1
                    If ($avConnections[$j][$REQUEST_HANDLE] > 0) Then _WinHttpCloseHandle($avConnections[$j][$REQUEST_HANDLE])
                Next

                _WinHttpCloseHandle($hConnect)
                _WinHttpCloseHandle($hSession)
                Return SetError(13, 0, 0)
            EndIf
        Next

        If ($iTotalReceivedBytes = $iDownloadSize) Then
            _WinHttpCloseHandle($hConnect)
            _WinHttpCloseHandle($hSession)
            ExitLoop
        EndIf
    WEnd

    If ($sFileName <> "") Then
        Local $hFile = FileOpen($sFileName, BitOR($FO_OVERWRITE, $FO_CREATEPATH, $FO_BINARY))
        If ($hFile = -1) Then Return SetError(15, 0, 0)

        If (FileWrite($hFile, DllStructGetData($tBuffer, 1)) = 0) Then
            FileClose($hFile)
            Return SetError(16, 0, 0)
        EndIf

        FileClose($hFile)
        Return SetError(0, $iDownloadSize, 1)
    EndIf

    Return SetError(0, $iDownloadSize, DllStructGetData($tBuffer, 1))
EndFunc

Example 1 - Download to a local file and use callback function to monitor and control the download progress:

#include "UrlDownloadEx.au3"

Global $t1 = TimerInit()
Global $vResult = UrlDownloadEx("http://www.autoitscript.com/files/autoit3/autoit-v3-setup.exe", @ScriptDir & "\AutoIt 3.3.12.0.exe", Default, BytesReceived)
ConsoleWrite(StringFormat("Result:\t%s\nSize:\t%u\nError:\t%u\nTimer:\t%u\n", $vResult, @extended, @error, TimerDiff($t1)))

Func BytesReceived($iReceivedBytes, $iTotalReceivedBytes, $iDownloadSize, $vParam)
    If ($iTotalReceivedBytes >= 2 * 1024 * 1024) Then Return False ;Stop downloading

    ConsoleWrite(StringFormat("%u bytes received.\n%u/%u\nParam: %s\n\n", $iReceivedBytes, $iTotalReceivedBytes, $iDownloadSize, $vParam))
    Return True ;Continue downloading
EndFunc

Example 2 - Download to memory and set the number of connections to 2:

#include "UrlDownloadEx.au3"

Global $t1 = TimerInit()
Global $vResult = UrlDownloadEx("http://icdn4.digitaltrends.com/image/microsoft_xp_bliss_desktop_image-650x0.jpg", Default, 2)
ConsoleWrite(StringFormat("Result:\t%s\nSize:\t%u\nError:\t%u\nTimer:\t%u\n", $vResult, @extended, @error, TimerDiff($t1)))

You can also download all of the above scripts at once:

UrlDownloadEx + Examples.zip

Edited June 23, 2014 by FaridAgl

June 23, 2014

Thank you for sharing this! Very nice job!

_SingletonHWID() · June 23, 2014

Of course I ran it once and was like "Where is the AutoIt exe?" but then I commented out line 8 and voila it worked. I somehow get the feeling I gave you inspiration for the delegate function BytesReceived() concept. -_0

5* from me at least.

Edited June 23, 2014 by guinness

_SingletonHWID() · June 23, 2014

Could you explain the usage of $vParam to me please. I get it's used in the callback function, but I can't see why it is needed.

June 23, 2014

I somehow get the feeling I gave you inspiration for the delegate function BytesReceived() concept. -_0

Well, I was going to admit it

Could you explain the usage of $vParam to me please. I get it's used in the callback function, but I can't see why it is needed.

I believe this is somehow the usual way of defining a callback (delegate), an additional parameter that can deliver whatever you may need into your callback function.

June 23, 2014

Oh, I forgot to say.

it's not possible to abort (cancel) the download by returning False from the callback function, and retrieve the downloaded data, that makes no sense because the file is getting downloaded as multiple segments, and there isn't any reliable data to retrieve as long as the download isn't completed. This is why 1st example doesn't create any file.

_SingletonHWID() · June 23, 2014

Well, I was going to admit it

I believe this is somehow the usual way of defining a callback (delegate), an additional parameter that can deliver whatever you may need into your callback function.

Haha. I understand, it's some sort of user parameter.

June 23, 2014

Haha. I understand, it's some sort of user parameter.

That's so true.

Thank you for sharing this! Very nice job!

Thank you for your support.

Also I would like to say thank you to trancexx, because of her great WinHTTP UDF.

June 24, 2014

WinHttp.au3 which version

Example 1.au3 and Example 2.au3 dont work

https://code.google.com/p/autoit-winhttp/downloads/list

your WinHttp.au3,,can you add please ,,or link version

mine version 1.6.3.7 ,,,, or yours?

June 24, 2014

Latest version.

What error did you get? Check the @error value.

June 24, 2014

Hey,

Nice work! The speed difference surely depends on the speed of the server, and how much speed it is able to give per connection. I made a little Example where you can see the speed. The file is hosted on a very fast server, so the difference shouldn't be that huge. But you can try it with other files from slower servers or may servers which are on the other side of the world (from your position )

Thanks for sharing Farid!

#include "UrlDownloadEx.au3"


HotKeySet("{ESC}","_exit")
Global $t1 = TimerInit()
ProgressOn("Exit with {ESC}", "Download 50mb","Start download...")
AdlibRegister("_update",250)



Global $vResult = UrlDownloadEx("http://download.thinkbroadband.com/50MB.zip", @ScriptDir & "\[temp]50MB.zip", 1, BytesReceived);Quite the same speed over the complete download
ConsoleWrite(StringFormat("Result:\t%s\nSize:\t%u\nError:\t%u\nTimer:\t%u\n", $vResult, @extended, @error, TimerDiff($t1)))
AdlibRegister("_update",1000)

If Not BytesReceived(0,0,0,0) Then Exit;if abborted, exit

Global $vResult = UrlDownloadEx("http://download.thinkbroadband.com/50MB.zip", @ScriptDir & "\[temp]50MB2.zip", Default, BytesReceived);speed differ from time to time. you have to but an higher amout of MS in the AdlibRegister (like 1000 instead of 250)
ConsoleWrite(StringFormat("Result:\t%s\nSize:\t%u\nError:\t%u\nTimer:\t%u\n", $vResult, @extended, @error, TimerDiff($t1)))

Func BytesReceived($iReceivedBytes, $iTotalReceivedBytes, $iDownloadSize, $vParam)
    Local Static $hTimer = TimerInit(), $iBytes, $iKbS, $sKbS, $iDownloadSize2, $iTotalReceivedBytes2, $fExit = False
    If $vParam = 1 Then
        ProgressSet($iTotalReceivedBytes2 / $iDownloadSize2 * 100, StringFormat("%.1f%%\r\n%.2f %s",$iTotalReceivedBytes2 / $iDownloadSize2 * 100,$iKbS,$sKbS))
        Local $iTime = 0
        $iKbS = 1000 / TimerDiff($hTimer) * $iBytes
        While $iKbS > 1000
            $iTime += 1
            $iKbS /= 1024
        WEnd
        Switch $iTime
            Case 0
                $sKbS = "Bytes/s"
            Case 1
                $sKbS = "KB/s"
            Case 2
                $sKbS = "MB/s"
            Case 3
                $sKbS = "GB/s"
        EndSwitch

        $iKbS = $iKbS
        $hTimer = TimerInit()
        $iBytes = 0
    ElseIf $vParam = 2 Then
        $fExit = True
    Else
        $iBytes += $iReceivedBytes
        $iDownloadSize2 = $iDownloadSize
        $iTotalReceivedBytes2 = $iTotalReceivedBytes
    EndIf
    Return Not $fExit
EndFunc   ;==>BytesReceived


Func _update()
    BytesReceived(0, 0, 0, 1)
EndFunc   ;==>speed

Func _exit()
    BytesReceived(0, 0, 0, 2)
EndFunc

Greetz,

Spider

Example 3.au3

Edited June 24, 2014 by GtaSpider

June 25, 2014

Thank you, a very nice example.

You are absolutely true, it depends on the servers and how the server is configured. Usually servers have a download speed limit per each connection, so downloading a file with multiple connection can boost the download speed.

However, if your Internet connection's download bandwidth is low, or the server has no limit on the download speed, the difference shouldn't be that much.

Also some servers won't allow multiple connections for downloading a single file, or they don't even support the "Range" http header field.

But, most of the times, you would enjoy using this method of downloading.

June 25, 2014

>"C:\Users\hppc\Desktop\autoit-v3.3.11.6\install\SciTE4AutoIt3(8)\AutoIt3Wrapper\AutoIt3Wrapper.exe" /run /prod /ErrorStdOut /in "C:\Users\hppc\Desktop\UrlDownloadEx + Examples(1)\Example 1.au3" /UserParams    
+>15:37:05 Starting AutoIt3Wrapper v.2.2.0.3 SciTE v.3.4.1.0   Keyboard:0001041F  OS:WIN_8/  CPU:X64 OS:X64    Environment(Language:041F)
+>         SciTEDir => C:\Users\hppc\Desktop\autoit-v3.3.11.6\install\SciTE4AutoIt3(8)   UserDir => C:\Users\hppc\Desktop\autoit-v3.3.11.6\install\SciTE4AutoIt3(8)\AutoIt3Wrapper
>Running AU3Check (3.3.11.6)  from:C:\Users\hppc\Desktop\autoit-v3.3.11.6\install  input:C:\Users\hppc\Desktop\UrlDownloadEx + Examples(1)\Example 1.au3
+>15:37:05 AU3Check ended.rc:0
>Running:(3.3.11.6):C:\Users\hppc\Desktop\autoit-v3.3.11.6\install\autoit3.exe "C:\Users\hppc\Desktop\UrlDownloadEx + Examples(1)\Example 1.au3"    
--> Press Ctrl+Alt+F5 to Restart or Ctrl+Break to Stop
3339 bytes received.
3339/11878040
Param: 0

3692 bytes received.
7031/11878040
Param: 0

3692 bytes received.
10723/11878040
Param: 0

3692 bytes received.
14415/11878040
Param: 0

3692 bytes received.
18107/11878040
Param: 0

3692 bytes received.
21799/11878040
Param: 0

3691 bytes received.
25490/11878040
Param: 0

3690 bytes received.
29180/11878040
Param: 0

8192 bytes received.
37372/11878040
Param: 0

8192 bytes received.
45564/11878040
Param: 0

8192 bytes received.
53756/11878040
Param: 0

8192 bytes received.
61948/11878040
Param: 0

8192 bytes received.
70140/11878040
Param: 0

8192 bytes received.
78332/11878040
Param: 0

8192 bytes received.
86524/11878040
Param: 0

8192 bytes received.
94716/11878040
Param: 0

8192 bytes received.
102908/11878040
Param: 0

8192 bytes received.
111100/11878040
Param: 0

8192 bytes received.
119292/11878040
Param: 0

8192 bytes received.
127484/11878040
Param: 0

8192 bytes received.
135676/11878040
Param: 0

8192 bytes received.
143868/11878040
Param: 0

8192 bytes received.
152060/11878040
Param: 0

2260 bytes received.
154320/11878040
Param: 0

8192 bytes received.
162512/11878040
Param: 0

8192 bytes received.
170704/11878040
Param: 0

8192 bytes received.
178896/11878040
Param: 0

8192 bytes received.
187088/11878040
Param: 0

8192 bytes received.
195280/11878040
Param: 0

8192 bytes received.
203472/11878040
Param: 0

8192 bytes received.
211664/11878040
Param: 0

8192 bytes received.
219856/11878040
Param: 0

8192 bytes received.
228048/11878040
Param: 0

8192 bytes received.
236240/11878040
Param: 0

8192 bytes received.
244432/11878040
Param: 0

8192 bytes received.
252624/11878040
Param: 0

8192 bytes received.
260816/11878040
Param: 0

8192 bytes received.
269008/11878040
Param: 0

8192 bytes received.
277200/11878040
Param: 0

1972 bytes received.
279172/11878040
Param: 0

8192 bytes received.
287364/11878040
Param: 0

8192 bytes received.
295556/11878040
Param: 0

8192 bytes received.
303748/11878040
Param: 0

8192 bytes received.
311940/11878040
Param: 0

8192 bytes received.
320132/11878040
Param: 0

8192 bytes received.
328324/11878040
Param: 0

8192 bytes received.
336516/11878040
Param: 0

8192 bytes received.
344708/11878040
Param: 0

8192 bytes received.
352900/11878040
Param: 0

8192 bytes received.
361092/11878040
Param: 0

8192 bytes received.
369284/11878040
Param: 0

8192 bytes received.
377476/11878040
Param: 0

8192 bytes received.
385668/11878040
Param: 0

8192 bytes received.
393860/11878040
Param: 0

8192 bytes received.
402052/11878040
Param: 0

3424 bytes received.
405476/11878040
Param: 0

8192 bytes received.
413668/11878040
Param: 0

8192 bytes received.
421860/11878040
Param: 0

8192 bytes received.
430052/11878040
Param: 0

8192 bytes received.
438244/11878040
Param: 0

8192 bytes received.
446436/11878040
Param: 0

8192 bytes received.
454628/11878040
Param: 0

8192 bytes received.
462820/11878040
Param: 0

7260 bytes received.
470080/11878040
Param: 0

8192 bytes received.
478272/11878040
Param: 0

8192 bytes received.
486464/11878040
Param: 0

8192 bytes received.
494656/11878040
Param: 0

8192 bytes received.
502848/11878040
Param: 0

8192 bytes received.
511040/11878040
Param: 0

8192 bytes received.
519232/11878040
Param: 0

8192 bytes received.
527424/11878040
Param: 0

8192 bytes received.
535616/11878040
Param: 0

8192 bytes received.
543808/11878040
Param: 0

8192 bytes received.
552000/11878040
Param: 0

8192 bytes received.
560192/11878040
Param: 0

8192 bytes received.
568384/11878040
Param: 0

8192 bytes received.
576576/11878040
Param: 0

8192 bytes received.
584768/11878040
Param: 0

8192 bytes received.
592960/11878040
Param: 0

6328 bytes received.
599288/11878040
Param: 0

8192 bytes received.
607480/11878040
Param: 0

8192 bytes received.
615672/11878040
Param: 0

8192 bytes received.
623864/11878040
Param: 0

8192 bytes received.
632056/11878040
Param: 0

8192 bytes received.
640248/11878040
Param: 0

8192 bytes received.
648440/11878040
Param: 0

8192 bytes received.
656632/11878040
Param: 0

8192 bytes received.
664824/11878040
Param: 0

8192 bytes received.
673016/11878040
Param: 0

8192 bytes received.
681208/11878040
Param: 0

8192 bytes received.
689400/11878040
Param: 0

8192 bytes received.
697592/11878040
Param: 0

8192 bytes received.
705784/11878040
Param: 0

8192 bytes received.
713976/11878040
Param: 0

8192 bytes received.
722168/11878040
Param: 0

8192 bytes received.
730360/11878040
Param: 0

8192 bytes received.
738552/11878040
Param: 0

8192 bytes received.
746744/11878040
Param: 0

8192 bytes received.
754936/11878040
Param: 0

8192 bytes received.
763128/11878040
Param: 0

8192 bytes received.
771320/11878040
Param: 0

8192 bytes received.
779512/11878040
Param: 0

8192 bytes received.
787704/11878040
Param: 0

3944 bytes received.
791648/11878040
Param: 0

8192 bytes received.
799840/11878040
Param: 0

8192 bytes received.
808032/11878040
Param: 0

8192 bytes received.
816224/11878040
Param: 0

8192 bytes received.
824416/11878040
Param: 0

8192 bytes received.
832608/11878040
Param: 0

8192 bytes received.
840800/11878040
Param: 0

8192 bytes received.
848992/11878040
Param: 0

2904 bytes received.
851896/11878040
Param: 0

8192 bytes received.
860088/11878040
Param: 0

8192 bytes received.
868280/11878040
Param: 0

8192 bytes received.
876472/11878040
Param: 0

8192 bytes received.
884664/11878040
Param: 0

8192 bytes received.
892856/11878040
Param: 0

8192 bytes received.
901048/11878040
Param: 0

8192 bytes received.
909240/11878040
Param: 0

4356 bytes received.
913596/11878040
Param: 0

8192 bytes received.
921788/11878040
Param: 0

8192 bytes received.
929980/11878040
Param: 0

8192 bytes received.
938172/11878040
Param: 0

8192 bytes received.
946364/11878040
Param: 0

8192 bytes received.
954556/11878040
Param: 0

8192 bytes received.
962748/11878040
Param: 0

8192 bytes received.
970940/11878040
Param: 0

8192 bytes received.
979132/11878040
Param: 0

8192 bytes received.
987324/11878040
Param: 0

8192 bytes received.
995516/11878040
Param: 0

8192 bytes received.
1003708/11878040
Param: 0

8192 bytes received.
1011900/11878040
Param: 0

8192 bytes received.
1020092/11878040
Param: 0

8192 bytes received.
1028284/11878040
Param: 0

8192 bytes received.
1036476/11878040
Param: 0

7780 bytes received.
1044256/11878040
Param: 0

8192 bytes received.
1052448/11878040
Param: 0

8192 bytes received.
1060640/11878040
Param: 0

8192 bytes received.
1068832/11878040
Param: 0

8192 bytes received.
1077024/11878040
Param: 0

8192 bytes received.
1085216/11878040
Param: 0

8192 bytes received.
1093408/11878040
Param: 0

1348 bytes received.
1094756/11878040
Param: 0

8192 bytes received.
1102948/11878040
Param: 0

8192 bytes received.
1111140/11878040
Param: 0

8192 bytes received.
1119332/11878040
Param: 0

8192 bytes received.
1127524/11878040
Param: 0

8192 bytes received.
1135716/11878040
Param: 0

8192 bytes received.
1143908/11878040
Param: 0

8192 bytes received.
1152100/11878040
Param: 0

8192 bytes received.
1160292/11878040
Param: 0

7780 bytes received.
1168072/11878040
Param: 0

8192 bytes received.
1176264/11878040
Param: 0

8192 bytes received.
1184456/11878040
Param: 0

8192 bytes received.
1192648/11878040
Param: 0

8192 bytes received.
1200840/11878040
Param: 0

8192 bytes received.
1209032/11878040
Param: 0

8192 bytes received.
1217224/11878040
Param: 0

8192 bytes received.
1225416/11878040
Param: 0

4356 bytes received.
1229772/11878040
Param: 0

8192 bytes received.
1237964/11878040
Param: 0

8192 bytes received.
1246156/11878040
Param: 0

8192 bytes received.
1254348/11878040
Param: 0

8192 bytes received.
1262540/11878040
Param: 0

8192 bytes received.
1270732/11878040
Param: 0

8192 bytes received.
1278924/11878040
Param: 0

8192 bytes received.
1287116/11878040
Param: 0

8192 bytes received.
1295308/11878040
Param: 0

8192 bytes received.
1303500/11878040
Param: 0

8192 bytes received.
1311692/11878040
Param: 0

8192 bytes received.
1319884/11878040
Param: 0

8192 bytes received.
1328076/11878040
Param: 0

8192 bytes received.
1336268/11878040
Param: 0

8192 bytes received.
1344460/11878040
Param: 0

8192 bytes received.
1352652/11878040
Param: 0

8192 bytes received.
1360844/11878040
Param: 0

8192 bytes received.
1369036/11878040
Param: 0

8192 bytes received.
1377228/11878040
Param: 0

8192 bytes received.
1385420/11878040
Param: 0

8192 bytes received.
1393612/11878040
Param: 0

8192 bytes received.
1401804/11878040
Param: 0

8192 bytes received.
1409996/11878040
Param: 0

8192 bytes received.
1418188/11878040
Param: 0

8192 bytes received.
1426380/11878040
Param: 0

8192 bytes received.
1434572/11878040
Param: 0

8192 bytes received.
1442764/11878040
Param: 0

8192 bytes received.
1450956/11878040
Param: 0

8192 bytes received.
1459148/11878040
Param: 0

8192 bytes received.
1467340/11878040
Param: 0

8192 bytes received.
1475532/11878040
Param: 0

8192 bytes received.
1483724/11878040
Param: 0

8192 bytes received.
1491916/11878040
Param: 0

8192 bytes received.
1500108/11878040
Param: 0

8192 bytes received.
1508300/11878040
Param: 0

8192 bytes received.
1516492/11878040
Param: 0

8192 bytes received.
1524684/11878040
Param: 0

8192 bytes received.
1532876/11878040
Param: 0

8192 bytes received.
1541068/11878040
Param: 0

8192 bytes received.
1549260/11878040
Param: 0

8192 bytes received.
1557452/11878040
Param: 0

8192 bytes received.
1565644/11878040
Param: 0

8192 bytes received.
1573836/11878040
Param: 0

8192 bytes received.
1582028/11878040
Param: 0

8192 bytes received.
1590220/11878040
Param: 0

8192 bytes received.
1598412/11878040
Param: 0

8192 bytes received.
1606604/11878040
Param: 0

8192 bytes received.
1614796/11878040
Param: 0

6956 bytes received.
1621752/11878040
Param: 0

8192 bytes received.
1629944/11878040
Param: 0

8192 bytes received.
1638136/11878040
Param: 0

8192 bytes received.
1646328/11878040
Param: 0

8192 bytes received.
1654520/11878040
Param: 0

8192 bytes received.
1662712/11878040
Param: 0

8192 bytes received.
1670904/11878040
Param: 0

8192 bytes received.
1679096/11878040
Param: 0

8192 bytes received.
1687288/11878040
Param: 0

8192 bytes received.
1695480/11878040
Param: 0

8192 bytes received.
1703672/11878040
Param: 0

8192 bytes received.
1711864/11878040
Param: 0

8192 bytes received.
1720056/11878040
Param: 0

8192 bytes received.
1728248/11878040
Param: 0

8192 bytes received.
1736440/11878040
Param: 0

8192 bytes received.
1744632/11878040
Param: 0

520 bytes received.
1745152/11878040
Param: 0

8192 bytes received.
1753344/11878040
Param: 0

8192 bytes received.
1761536/11878040
Param: 0

8192 bytes received.
1769728/11878040
Param: 0

8192 bytes received.
1777920/11878040
Param: 0

8192 bytes received.
1786112/11878040
Param: 0

8192 bytes received.
1794304/11878040
Param: 0

8192 bytes received.
1802496/11878040
Param: 0

8192 bytes received.
1810688/11878040
Param: 0

8192 bytes received.
1818880/11878040
Param: 0

8192 bytes received.
1827072/11878040
Param: 0

8192 bytes received.
1835264/11878040
Param: 0

8192 bytes received.
1843456/11878040
Param: 0

8192 bytes received.
1851648/11878040
Param: 0

8192 bytes received.
1859840/11878040
Param: 0

8192 bytes received.
1868032/11878040
Param: 0

4876 bytes received.
1872908/11878040
Param: 0

8192 bytes received.
1881100/11878040
Param: 0

8192 bytes received.
1889292/11878040
Param: 0

8192 bytes received.
1897484/11878040
Param: 0

8192 bytes received.
1905676/11878040
Param: 0

8192 bytes received.
1913868/11878040
Param: 0

8192 bytes received.
1922060/11878040
Param: 0

8192 bytes received.
1930252/11878040
Param: 0

8192 bytes received.
1938444/11878040
Param: 0

8192 bytes received.
1946636/11878040
Param: 0

8192 bytes received.
1954828/11878040
Param: 0

8192 bytes received.
1963020/11878040
Param: 0

8192 bytes received.
1971212/11878040
Param: 0

8192 bytes received.
1979404/11878040
Param: 0

8192 bytes received.
1987596/11878040
Param: 0

8192 bytes received.
1995788/11878040
Param: 0

520 bytes received.
1996308/11878040
Param: 0

8192 bytes received.
2004500/11878040
Param: 0

8192 bytes received.
2012692/11878040
Param: 0

8192 bytes received.
2020884/11878040
Param: 0

8192 bytes received.
2029076/11878040
Param: 0

8192 bytes received.
2037268/11878040
Param: 0

8192 bytes received.
2045460/11878040
Param: 0

8192 bytes received.
2053652/11878040
Param: 0

8192 bytes received.
2061844/11878040
Param: 0

8192 bytes received.
2070036/11878040
Param: 0

8192 bytes received.
2078228/11878040
Param: 0

8192 bytes received.
2086420/11878040
Param: 0

8192 bytes received.
2094612/11878040
Param: 0

Result: 0
Size:   0
Error:  14
Timer:  2475
+>15:37:07 AutoIt3.exe ended.rc:0
+>15:37:07 AutoIt3Wrapper Finished.
>Exit code: 0    Time: 2.931

------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

this code worked

but not 50mb

try it

#include "UrlDownloadEx.au3"


HotKeySet("{ESC}","_exit")
Global $t1 = TimerInit()
ProgressOn("Exit with {ESC}", "Download 50mb","Start download...")
AdlibRegister("_update",250)



Global $vResult = UrlDownloadEx("http://www.autoitscript.com/files/autoit3/autoit-v3-setup.exe", @ScriptDir & "\AutoIt 3.3.12.0.exe", 1, BytesReceived);Quite the same speed over the complete download
ConsoleWrite(StringFormat("Result:\t%s\nSize:\t%u\nError:\t%u\nTimer:\t%u\n", $vResult, @extended, @error, TimerDiff($t1)))
AdlibRegister("_update",1000)

If Not BytesReceived(0,0,0,0) Then Exit;if abborted, exit

;Global $vResult = UrlDownloadEx("http://download.thinkbroadband.com/50MB.zip", @ScriptDir & "\[temp]50MB2.zip", Default, BytesReceived);speed differ from time to time. you have to but an higher amout of MS in the AdlibRegister (like 1000 instead of 250)
;ConsoleWrite(StringFormat("Result:\t%s\nSize:\t%u\nError:\t%u\nTimer:\t%u\n", $vResult, @extended, @error, TimerDiff($t1)))

Func BytesReceived($iReceivedBytes, $iTotalReceivedBytes, $iDownloadSize, $vParam)
    Local Static $hTimer = TimerInit(), $iBytes, $iKbS, $sKbS, $iDownloadSize2, $iTotalReceivedBytes2, $fExit = False
    If $vParam = 1 Then
        ProgressSet($iTotalReceivedBytes2 / $iDownloadSize2 * 100, StringFormat("%.1f%%\r\n%.2f %s",$iTotalReceivedBytes2 / $iDownloadSize2 * 100,$iKbS,$sKbS))
        Local $iTime = 0
        $iKbS = 1000 / TimerDiff($hTimer) * $iBytes
        While $iKbS > 1000
            $iTime += 1
            $iKbS /= 1024
        WEnd
        Switch $iTime
            Case 0
                $sKbS = "Bytes/s"
            Case 1
                $sKbS = "KB/s"
            Case 2
                $sKbS = "MB/s"
            Case 3
                $sKbS = "GB/s"
        EndSwitch

        $iKbS = $iKbS
        $hTimer = TimerInit()
        $iBytes = 0
    ElseIf $vParam = 2 Then
        $fExit = True
    Else
        $iBytes += $iReceivedBytes
        $iDownloadSize2 = $iDownloadSize
        $iTotalReceivedBytes2 = $iTotalReceivedBytes
    EndIf
    Return Not $fExit
EndFunc   ;==>BytesReceived


Func _update()
    BytesReceived(0, 0, 0, 1)
EndFunc   ;==>speed

Func _exit()
    BytesReceived(0, 0, 0, 2)
EndFunc

added udf but dont work ?

but example 3 worked

dowload

Edited June 25, 2014 by mesale0077

June 25, 2014

Error:  14

It means the callback function returned False, so the download got aborted.

Check your code and make sure you are returning True from the callback function all the times.

Remember, it's necessary for the callback function to return True, if you don't return any value from the callback function, it will be considered as False and the download progress will be aborted.

June 29, 2014

Fantastic work!

I tested It in a dirty download benchmark with temporary links-> .

But Combofix.exe don't get downloaded...

June 29, 2014

Is this the link?

http://www.bleepingcomputer.com/download/combofix/dl/12/|combofix.exe

If yes, I can't even download it in the browser, because:

404: Page Not Found

June 30, 2014

The static link is only

http://www.bleepingcomputer.com/download/combofix/dl/12/

my example search the temporary link (using the static link and the filename.exe as parameters) and it tries to download.

the temporary link is like

http://download.bleepingcomputer.com/dl/3a314486dc4cdc746d35b26ea1bb0837/53b10c72/windows/security/anti-virus/c/combofix/ComboFix.exe

Your UrlDownloadEx() is OK with the other two downloads, I think it's a property of the combofix hosting server, maybe it doesn't permit downloading in pieces ?

June 30, 2014

Yes, that's possible and can be the reason.

Check the @error value and tell me what is that.

June 30, 2014

Tried to download Combofix:

|8  - _WinHttpReceiveResponse failed

June 30, 2014

I've tested it with this temporary link:

http://download.bleepingcomputer.com/dl/ccf409088ff492398a2318ab3b9dc11e/53b199e7/windows/security/anti-virus/c/combofix/ComboFix.exe

And it just worked.

Sign In

UrlDownloadEx() - Download with maximum speed

33 posts in this topic

Share this post

Link to post

Share on other sites

Share this post

Link to post

Share on other sites

Share this post

Link to post

Share on other sites

Share this post

Link to post

Share on other sites

Share this post

Link to post

Share on other sites

Share this post

Link to post

Share on other sites

Share this post

Link to post

Share on other sites

Share this post

Link to post

Share on other sites

Share this post

Link to post

Share on other sites

Share this post

Link to post

Share on other sites

Share this post

Link to post

Share on other sites

Share this post

Link to post

Share on other sites

Share this post

Link to post

Share on other sites

Share this post

Link to post

Share on other sites

Share this post

Link to post

Share on other sites

Share this post

Link to post

Share on other sites

Share this post

Link to post

Share on other sites

Share this post

Link to post

Share on other sites

Share this post

Link to post

Share on other sites

Share this post

Link to post

Share on other sites

Create an account or sign in to comment

Create an account

Sign in

Browse

AutoIt Resources

Release

Beta