How to get cookies and download a file with cookies?

[foozoor]

How to grab cookies from a website url?

And how to download a file that needs cookies?

Here is a working python script but I really prefer AutoIt and I have no Python skill:

expandcollapse popup

import os
import tempfile
import requests

def from_url(url, cookies=None):

    response = requests.get(url=url, cookies=cookies, allow_redirects=True, stream=True)
    filepath = tempfile.NamedTemporaryFile().name

    with open(filepath, 'wb') as f:
        for chunk in response.iter_content(chunk_size=1024):
            if chunk:
                f.write(chunk)
                f.flush()

    return filepath


def from_majorgeek(root):

    # Start a new requests session.
    session = requests.Session()

    # Get the root page cookies.
    response = session.get(root)
    cookies = session.cookies

    # Download the file.
    filepath = from_url('http://www.majorgeeks.com/index.php?ct=files&action=download&', cookies)

    # Return the downloaded file path.
    return filepath


if __name__ == '__main__':
    f = from_majorgeek('http://www.majorgeeks.com/mg/getmirror/chromium,1.html')
    print(f)

Thanks in advance for your help!

Edited August 11, 2016 by foozoor

[foozoor]

Nobody?

[mLipok]

What kind of file you want to download ?
From where you get this Python code snippet ?

Edited August 11, 2016 by mLipok

[foozoor]

17 minutes ago, mLipok said:

What kind of file you want to download ?
From where you get this Python code snippet ?

Sorry I forgot some piece of code in the first post. I fixed it now.

I want to download files from MajorGeek, from this kind of url:
http://www.majorgeeks.com/mg/getmirror/multi_commander,1.html

The python script grabs cookies from: http://www.majorgeeks.com/mg/getmirror/chromium,1.html

And download the file from http://www.majorgeeks.com/index.php?ct=files&action=download& by injecting the cookies.

I have got this script from multiple forums and stackoverflow.

Edited August 11, 2016 by foozoor

[Danyfirex]

Hello. You need to grab your cookie after login. then use/send it in your next request.

 

Saludos

[foozoor]

10 minutes ago, Danyfirex said:

Hello. You need to grab your cookie after login. then use/send it in your next request.

What do you mean by login?

I can't find a proper way to grab cookies and send/inject them to download the file with AutoIt.

[Danyfirex]

Sorry I thought page require login. It does not.

 

Saludos

[Danyfirex]

You can get download links this way. Then just use InetGet or InetRead to download the files.

 

expandcollapse popup

#include <InetConstants.au3>
#include <Array.au3>
#include <String.au3>
Global Const $sBaseURL = "http://www.majorgeeks.com/"


;~ AdsFix 3_11.08.2016.1 Read more at: https://tr.im/1XUul
Local $sURLProgramToDownload = "http://www.majorgeeks.com/files/details/adsfix.html"
Local $sData = BinaryToString(InetRead($sURLProgramToDownload, $INET_FORCERELOAD))



Local $aDownLoadsURLs = _StringBetween($sData, "images/arrowd.gif", '"><strong>')

If IsArray($aDownLoadsURLs) Then
    Local $iPos = 0
    For $i = 0 To UBound($aDownLoadsURLs) - 1
        $iPos = StringInStr($aDownLoadsURLs[$i], 'href="') + 6 ;get Correct URL Path
        $aDownLoadsURLs[$i] = $sBaseURL & StringMid($aDownLoadsURLs[$i], $iPos)
    Next
;~  _ArrayDisplay($aDownLoadsURLs)
    Local $aDownloadLinks[UBound($aDownLoadsURLs)]

    Local $sHotLinkData = ""
    Local $aDebugLink = 0
    ;Get Valid HotLinks for download using InetGet
    For $i = 0 To UBound($aDownloadLinks) - 1
        $sHotLinkData = BinaryToString(InetRead($aDownLoadsURLs[$i], $INET_FORCERELOAD))
        $aDebugLink = _StringBetween($sHotLinkData, 'Debug:', '-->')
        If IsArray($aDebugLink) Then
            $aDownloadLinks[$i] = StringStripWS($aDebugLink[0], $STR_STRIPALL)
        EndIf
    Next

    _ArrayDisplay($aDownloadLinks)
    ;use InetGet to download 

EndIf

 

Edit: if you want to download using the url you show like  http://www.majorgeeks.com/mg/getmirror/multi_commander,1.html

you just need to do one step. check code in ;Get Valid HotLinks for download using InetGet

 

Saludos

Edited August 12, 2016 by Danyfirex

[mikell]

This small code is very raw (no details/error checking etc) but it works for me

$oHTTP = ObjCreate("WinHttp.WinHttpRequest.5.1")
; get cookie
$oHTTP.Open("GET", "http://www.majorgeeks.com/mg/getmirror/symenu,1.html")
$oHTTP.Send()
$rh = $oHTTP.GetAllResponseHeaders()
$cookie = StringRegExpReplace($rh, '(?s).*SESSID=(\w+).*', "$1")
   ; msgbox(0,"", $cookie)
; then download
$oHTTP.Open("GET", "http://www.majorgeeks.com/index.php?ct=files&action=download&")
$oHTTP.setRequestHeader("Cookie", $cookie)
$oHTTP.Send()
$data = $oHTTP.ResponseBody()
FileWrite("symenu.zip", $data)

 

[foozoor]

11 hours ago, Danyfirex said:

You can get download links this way. Then just use InetGet or InetRead to download the files.

 

expandcollapse popup

#include <InetConstants.au3>
#include <Array.au3>
#include <String.au3>
Global Const $sBaseURL = "http://www.majorgeeks.com/"


;~ AdsFix 3_11.08.2016.1 Read more at: https://tr.im/1XUul
Local $sURLProgramToDownload = "http://www.majorgeeks.com/files/details/adsfix.html"
Local $sData = BinaryToString(InetRead($sURLProgramToDownload, $INET_FORCERELOAD))



Local $aDownLoadsURLs = _StringBetween($sData, "images/arrowd.gif", '"><strong>')

If IsArray($aDownLoadsURLs) Then
    Local $iPos = 0
    For $i = 0 To UBound($aDownLoadsURLs) - 1
        $iPos = StringInStr($aDownLoadsURLs[$i], 'href="') + 6 ;get Correct URL Path
        $aDownLoadsURLs[$i] = $sBaseURL & StringMid($aDownLoadsURLs[$i], $iPos)
    Next
;~  _ArrayDisplay($aDownLoadsURLs)
    Local $aDownloadLinks[UBound($aDownLoadsURLs)]

    Local $sHotLinkData = ""
    Local $aDebugLink = 0
    ;Get Valid HotLinks for download using InetGet
    For $i = 0 To UBound($aDownloadLinks) - 1
        $sHotLinkData = BinaryToString(InetRead($aDownLoadsURLs[$i], $INET_FORCERELOAD))
        $aDebugLink = _StringBetween($sHotLinkData, 'Debug:', '-->')
        If IsArray($aDebugLink) Then
            $aDownloadLinks[$i] = StringStripWS($aDebugLink[0], $STR_STRIPALL)
        EndIf
    Next

    _ArrayDisplay($aDownloadLinks)
    ;use InetGet to download 

EndIf

 

Edit: if you want to download using the url you show like  http://www.majorgeeks.com/mg/getmirror/multi_commander,1.html

you just need to do one step. check code in ;Get Valid HotLinks for download using InetGet

 

Saludos

Thank you for this approach.

5 hours ago, mikell said:

This small code is very raw (no details/error checking etc) but it works for me

$oHTTP = ObjCreate("WinHttp.WinHttpRequest.5.1")
; get cookie
$oHTTP.Open("GET", "http://www.majorgeeks.com/mg/getmirror/symenu,1.html")
$oHTTP.Send()
$rh = $oHTTP.GetAllResponseHeaders()
$cookie = StringRegExpReplace($rh, '(?s).*SESSID=(\w+).*', "$1")
   ; msgbox(0,"", $cookie)
; then download
$oHTTP.Open("GET", "http://www.majorgeeks.com/index.php?ct=files&action=download&")
$oHTTP.setRequestHeader("Cookie", $cookie)
$oHTTP.Send()
$data = $oHTTP.ResponseBody()
FileWrite("symenu.zip", $data)

 

Thank you, it corresponds perfectly to my problem and you solved it!

What are these errors and details to check?
Is there a way to improve the script?

Is there a way to retrieve the filename automatically or at least its extension while downloading?

Edited August 12, 2016 by foozoor

[mikell]

As I said this code is extremely basic
The only way make the script able to get more infos, handle redirections etc would be to use WinHTTP.au3 from trancexx
Danifirex' approach is much easier 

[oemript]

I would like to know on what kind of programming coding is.

PowerShell?

Do you have any suggestions?
Thanks, to everyone very much for any suggestions

 

 

On 8/12/2016 at 3:37 PM, mikell said:

This small code is very raw (no details/error checking etc) but it works for me

$oHTTP = ObjCreate("WinHttp.WinHttpRequest.5.1")
; get cookie
$oHTTP.Open("GET", "http://www.majorgeeks.com/mg/getmirror/symenu,1.html")
$oHTTP.Send()
$rh = $oHTTP.GetAllResponseHeaders()
$cookie = StringRegExpReplace($rh, '(?s).*SESSID=(\w+).*', "$1")
   ; msgbox(0,"", $cookie)
; then download
$oHTTP.Open("GET", "http://www.majorgeeks.com/index.php?ct=files&action=download&")
$oHTTP.setRequestHeader("Cookie", $cookie)
$oHTTP.Send()
$data = $oHTTP.ResponseBody()
FileWrite("symenu.zip", $data)