Getting the correct map names from an URL

[AlmarM]

Hiya!

Whats the easiest way to get the correct map names from an URL?

Example:

http://www.example-site.com/images/background.gif -> DesktopDir/site/images/background.gif

http://www.example-site.com/images/buttons/hover.gif -> DesktopDir/site/images/buttons/hover.gif

http://www.example-site.com/img/navbar/shine.gif -> DesktopDir/site/img/navbar/shine.gif

http://www.example-site.com/spacer.gif -> DesktopDir/site/spacer.gif

What im trying to do is:

• Grab whole HTML code from an URL
• Save it to a .html
• Get all images inside the site
• Save those images into the correct maps

Hope it's clear.

AlmarM

Edited February 4, 2011 by AlmarM

[jvanegmond]

$url = "DesktopDir/site/" & StringReplace($url, "http://www.example-site.com/", "")

For a generic URL, find the 3rd / and then StringMid it.

[AlmarM]

$url = "DesktopDir/site/" & StringReplace($url, "http://www.example-site.com/", "")

For a generic URL, find the 3rd / and then StringMid it.

Thanks for that!

But what if the images are saved on a different URL?

Example:

http://www.spele.nl/
http://proxy.spele.nl/img/1/9/7/1/9/s.jpg

I can't do a StringReplace on the base URL here, any fast solutions to get the img base URL?

[iamtheky]

provided they are in tags on the source URL you could grab them all this way.

#include <IE.au3>

$oIE = _IECreate ("http://www.foxnews.com/" , 0 , 0)
$oImgs = _IEImgGetCollection($oIE)
$iNumImg = @extended

For $oImg In $oImgs
    msgbox (0, '' , $oImg.src)
    Next

Edited February 6, 2011 by iamtheky

[GEOSoft]

This works against your example but I don't know how it will be against the actual page.

$sExample = "http://www.example-site.com/images/background.gif" & @CRLF
$sExample &= "http://www.example-site.com/images/buttons/hover.gif" & @CRLF
$sExample &= "http://www.example-site.com/img/navbar/shine.gif" & @CRLF
$sExample &= "http://www.example-site.com/spacer.gif"

$aImages = StringRegExp($sExample, "(?i)http://.+?/(.+?\.[gjbp][a-z2]{2,3})", 3)
If NOT @Error Then
    For $i = 0 To Ubound($aImages) -1
        ;; Do something here
    Next
EndIf

EDIT: Modified the expression to also catch the very rare .jp2 files.

EDIT 2: If I missed any file extensions just add the first character of the extension into the [gjbp] group.

EDIT 3: Fixed the example string by adding @CRLF

Edited February 6, 2011 by GEOSoft

[guinness]

In the example GEOSoft provided I keep getting >>

images/background.gifh

img/navbar/shine.gifh

[GEOSoft]

I'll fix that. It's because I left out the @CRLFs

[AlmarM]

Thanks for that GEO!

But when I visit this site: http://www.spele.nl/ and use _IEImgGetCollection it returns image links with

http://proxy.spele.nl/

How do I get the "http://xxx.xxx.xx/" from each IEImgGetCollection link?

[GEOSoft]

Luckily I already had this saved and I think it should be what you want. It will handle http:, https: and ftp: with or without the www and it stops at the third slash if it exists. That is the first one after the // if it exists.

$sSRE="(?i)href\s*=[\x22\x27]?([fh]t+ps?://[\w]*\.?.+\.[\a-z]{2,3}/?).*"

This will work fine on

href="http://www.autoitscript.com/forum/topic/125066"
href="https://www.autoitscript.com"
href="http://dundats.mvps.org/
href="ftp://microsoft.com"
href="http://proxy.spele.nl/

"

If you need to get something like href="../" then try this (untested)

$sURL="http://proxy.spele.nl/"
$sSRE="(?i)href\s*=[\x22\x27]?([fh]t+ps?://[\w]*\.?.+\.[\a-z]{2,3}/?).*"
$aHref = StringRegExp(StringRegExtPeplace($sSource, "(href\s*=[\x22\x27]?)[./]+", $sURL), $sSre, 3)

EDIT: Since you are using _IEImageGetCollection() it probably doesn't return the href part so change the expression to

$sSRE = "(?i)(?m:^)([fh]t+ps?://[\w]*\.?.+\.[\a-z]{2,3}/?).*"

Edited February 9, 2011 by GEOSoft