Jump to content
Sign in to follow this  
Decipher

RegEx Split String at every 'n' characters into Array

Recommended Posts

Decipher

The string only contains word characters and should only be 40 characters long.

String Example: ce1fc50bffb09962be8f3c49478cbeb65e2afe0f

I need to split the string into chunks of two.

Array[0] = ce

Array[1] = 1f

And so on.

My attempt:

Dim $aArray = StringRegExp($sString, '(w{2})+', 1, 1)

I would also like to know how to specify exclude characters or (if not) if there is similiar functionality with regex please.

This will be used to check torrent tracker status. I need to put % before every two characters. The above ex. string is SHA-1 Torrent Info Hash.

Edited by Decipher

Spoiler

censored.jpg

 

Share this post


Link to post
Share on other sites
czardas

I don't know if this is any help to you. Look at the second example in that post.

Edit

I'm not sure what you mean by exclude characters. You could remove unwanted characters before or after the split - leading to different results.

Edited by czardas

Share this post


Link to post
Share on other sites
Decipher

I don't know if this is any help to you. Look at the second example in that post.

Edit

I'm not sure what you mean by exclude characters. You could remove unwanted characters before or after the split - leading to different results.

Thats what I asked for thank you. Lets say I wanted to write a regular expression where I wanted the statement to be true if it dosen't contain a given character. How would I do that?

#include <Array.au3>
Dim $aArray = _StringEqualSplit(StringUpper('962fb077e814c55a9a01b8f07e2fd2945cef6998'), 2)
ConsoleWrite('%' & _ArrayToString($aArray, '%') & @CRLF)
Func _StringEqualSplit($sString, $iNumChars)
    If (Not IsString($sString)) Or $sString = "" Then Return SetError(1, 0, 0)
    If (Not IsInt($iNumChars)) Or $iNumChars < 1 Then Return SetError(2, 0, 0)
    Return StringRegExp($sString, "(?s).{1," & $iNumChars & "}", 3)
EndFunc

The above code outputs: %96%2F%B0%77%E8%14%C5%5A%9A%01%B8%F0%7E%2F%D2%94%5C%EF%69%98

It is not valid. I am confused as how to encode the info hash to request information from a torrent tracker. This page shows what I'm trying to do, if someone dosen't mind helping me out.

http://nakkaya.com/2009/12/03/bittorrent-tracker-protocol/

Edited by Decipher

Spoiler

censored.jpg

 

Share this post


Link to post
Share on other sites
czardas

If your condition is based on there being only one character then I would use StringInStr() to check if the string contains the character you want to avoid. I'm not sure about the other technical details of your request. It sounds like it might take some study.

Edited by czardas

Share this post


Link to post
Share on other sites
Decipher

Perhaps this is what you are after, but I'm not sure:

ConsoleWrite('%' & _ArrayToString($aArray, '') & @CRLF)

If your condition is based on there being only one character then I would use StringInStr() to check if the string contains the character you want to avoid. I'm not sure about the other technical details of your request. It sounds like it might take some study.

Thanks for your help, This my attempt to encode the hash.

ConsoleWrite(_HashEncode(_StringEqualSplit('123456789abcdef123456789abcdef123456789a', 2)) & @CRLF)
Func _HashEncode($aArray)
Local $url = "", $acode
For $i = 0 To UBound($aArray, 1) - 1
  $acode = $aArray[$i]
  Select
   Case ($acode >= 48 And $acode <= 57) Or _
     ($acode >= 65 And $acode <= 90) Or _
     ($acode >= 97 And $acode <= 122)
    $url = $url & Chr($acode)
   Case $acode = 45 Or $acode = 95 Or $acode = 46 Or $acode = 126
    $url = $url & Chr($acode)
   Case Else
    $url = $url & '%' & $aArray[$i]
  EndSelect
Next
Return $url
EndFunc   ;==>_URLEncode
Func _StringEqualSplit($sString, $iNumChars)
    If (Not IsString($sString)) Or $sString = "" Then Return SetError(1, 0, 0)
    If (Not IsInt($iNumChars)) Or $iNumChars < 1 Then Return SetError(2, 0, 0)
    Return StringRegExp($sString, "(?s).{1," & $iNumChars & "}", 3)
EndFunc

Output: %12%348N%9a%bc%de%f1%23-CY%ab%cd%ef%12%348N%9a

Needed Output: %124Vx%9a%bc%de%f1%23Eg%89%ab%cd%ef%124Vx%9a

Based on the above link.

If you don't pay attention to the spec and send this directly to tracker you will get an error this should be in URL Encoded form. Padding every two chars with % sign also doesn't work, been there done that don't waste your time. Any hex in the hash that corresponds to a unreserved character should be replaced,

a-z A-Z 0-9 -_.~

Partition the hex in to chunks of two and check if the hex corresponds to any of these values, if they do replace them with the unreserved char,

(defn url-encode [hash]

(apply str

(map (fn [[a b]]

(let [byte (BigInteger. (str a ;) 16) ]

(if (or (and (>= byte 65) (<= byte 90)) ; A-Z

(and (>= byte 97) (<= byte 122)) ; a-z

(and (>= byte 48) (<= byte 57)) ; 0-9

(= byte 45) (= byte 95) (= byte 46) (= byte 126))

(char byte) (str "%" a :)) )) (partition 2 hash))))

So that a hash such as,

123456789abcdef123456789abcdef123456789a

becomes,

%124Vx%9a%bc%de%f1%23Eg%89%ab%cd%ef%124Vx%9a

notice that hex 34 became 4 which is what it is in ASCII. You can test the correctness of your hashes using the tracker url but don't request from announce request from file,

http://some.tracker.com/file?info_hash=hash

If you get a torrent back that means you have the correct hash.

Here are some tracker you can test it with:

Tr_1=udp://fr33domtracker.h33t.com:3310/announce

Tr_2=http://announce.torrentsmd.com:8080/announce

Tr_4=udp://9.rarbg.com:2710/announce

Tr_6=udp://tracker.openbittorrent.com:80/announce

Here are some info hashes for different torrents each on its on line:

89fc7b8e7aa220368213bc555e0f24b72295c35d1

1326dcb7fb42312d7d47d8347281a89b8c3804f3

a9e22c72041e3d336766a3ed5769070ebe9c548a

86e1b0fac439d34d34d96af168d8dfe7cbc42000

646ca38de9ec32ae6d1971fcc46665ab88c888fa

25942cb889387c509c165c923cf34c907b6e83aa

Before where I was asking how to exclude characters I was just asking out of curiosity not for my current project.

$sString = 'thisisatest'

Normally to check if it contains the word 'test' you could do StringRegExp($sString, 'test')

How could I tell it to return False if it also contains the word 'this'?

Edited by Decipher

Spoiler

censored.jpg

 

Share this post


Link to post
Share on other sites
czardas

Hmm, did you solve it? Here's what I wrote just now.

#include <Array.au3>
Dim $aArray = _StringEqualSplit('123456789abcdef123456789abcdef123456789a', 2)

$testStr = "0123456789abcdefghijklmnopqrstuvwxyz-_.~"
For $i = 0 To UBound($aArray) -1
    If StringInStr($testStr, Chr(Dec($aArray[$i]))) Then
        $aArray[$i] = Chr(Dec($aArray[$i]))
    Else
        $aArray[$i] = "%" & $aArray[$i]
    EndIf
Next
ConsoleWrite(_ArrayToString($aArray, "") & @CRLF)

Func _StringEqualSplit($sString, $iNumChars)
    If (Not IsString($sString)) Or $sString = "" Then Return SetError(1, 0, 0)
    If (Not IsInt($iNumChars)) Or $iNumChars < 1 Then Return SetError(2, 0, 0)
    Return StringRegExp($sString, "(?s).{1," & $iNumChars & "}", 3)
EndFunc

Share this post


Link to post
Share on other sites
Decipher

Hmm, did you solve it? Here's what I wrote just now.

#include <Array.au3>
Dim $aArray = _StringEqualSplit('123456789abcdef123456789abcdef123456789a', 2)

$testStr = "0123456789abcdefghijklmnopqrstuvwxyz-_.~"
For $i = 0 To UBound($aArray) -1
    If StringInStr($testStr, Chr(Dec($aArray[$i]))) Then
        $aArray[$i] = Chr(Dec($aArray[$i]))
    Else
        $aArray[$i] = "%" & $aArray[$i]
    EndIf
Next
ConsoleWrite(_ArrayToString($aArray, "") & @CRLF)

Func _StringEqualSplit($sString, $iNumChars)
    If (Not IsString($sString)) Or $sString = "" Then Return SetError(1, 0, 0)
    If (Not IsInt($iNumChars)) Or $iNumChars < 1 Then Return SetError(2, 0, 0)
    Return StringRegExp($sString, "(?s).{1," & $iNumChars & "}", 3)
EndFunc

Yes you did.

Do you mind explaining how your using dec and char for future reference aka break it down?


Spoiler

censored.jpg

 

Share this post


Link to post
Share on other sites
czardas

The function Chr only accepts decimal input, and because the 2 digits in each element represent hex values, they first need to be converted to decimal using Dec before you pass them to the Chr function. This can be done easily by passing the functions as parameters in the correct sequence as I did (but it isn't necessary to do it this way). You should look up these functions in the help file and check out the ascii character codes page in there too.

I hope that makes sense. You might need to study it a bit. ;)

One thing that isn't clear to me from the artucle is whether or not the string needs to begin with %. You may need to watch out for this if the first array element is replaced (my code will not always add a preceeding % at the start). I'm unfamiliar with bencode but it is easy to add % at the start of the string if it is needed.

Edited by czardas

Share this post


Link to post
Share on other sites
Decipher

The function Chr only accepts decimal input, and because the 2 digits in each element represent hex values, they first need to be converted to decimal using Dec before you pass them to the Chr function. This can be done easily by passing the functions as parameters in the correct sequence as I did (but it isn't necessary to do it this way). You should look up these functions in the help file and check out the ascii character codes page in there too.

I hope that makes sense. You might need to study it a bit. ;)

One thing that isn't clear to me from the artucle is whether or not the string needs to begin with %. You may need to watch out for this if the first array element is replaced (my code will not always add a preceeding % at the start). I'm unfamiliar with bencode but it is easy to add % at the start of the string if it is needed.

Awesome, I think I got everything I need now. I appreciate your help with this.


Spoiler

censored.jpg

 

Share this post


Link to post
Share on other sites
czardas

It was interesting to spend time on. I'm happy to help. ;)

Edit

Actually looking at this again, it can be improved slightly. It's not a major change.

#include <Array.au3>
Dim $aArray = _StringEqualSplit('123456789abcdef123456789abcdef123456789a', 2)

$testStr = "0123456789abcdefghijklmnopqrstuvwxyz-_.~"
For $i = 0 To UBound($aArray) -1
    $sChar = Chr(Dec($aArray[$i])) ; This should make it slightly faster - less conversion involved.
    If StringInStr($testStr, $sChar) Then
        $aArray[$i] = $sChar
    Else
        $aArray[$i] = "%" & $aArray[$i]
    EndIf
Next
ConsoleWrite(_ArrayToString($aArray, "") & @CRLF)

Func _StringEqualSplit($sString, $iNumChars)
    If (Not IsString($sString)) Or $sString = "" Then Return SetError(1, 0, 0)
    If (Not IsInt($iNumChars)) Or $iNumChars < 1 Then Return SetError(2, 0, 0)
    Return StringRegExp($sString, "(?s).{1," & $iNumChars & "}", 3)
EndFunc

It may be possible to do all this with one complicated RegExpReplace, but that would take some thinking about (I have my doubts about it). Also whether it would be better or not is perhaps debatable (depending on the complexity).

Edited by czardas

Share this post


Link to post
Share on other sites
Robjong

If you want to increase speed you should get rid of _ArrayToString.

$sHash = '123456789abcdef123456789abcdef123456789a'
ConsoleWrite(_BencodeHash($sHash) & @CRLF) ; '%124Vx%9a%bc%de%f1%23Eg%89%ab%cd%ef%124Vx%9a'

Func _BencodeHash($sStr)
    Local $aArray = StringRegExp($sStr, 'w{2}', 3)
    Local $sReturn = '', $sChar = ''
    For $i = 0 To UBound($aArray) -1
        $sChar = Chr(Dec($aArray[$i]))
        If StringInStr("0123456789abcdefghijklmnopqrstuvwxyz-_.~", $sChar) Then
            $sReturn &= $sChar
        Else
            $sReturn &= "%" & $aArray[$i]
        EndIf
    Next
    Return $sReturn
EndFunc

$sString = 'thisisatest'

Normally to check if it contains the word 'test' you could do StringRegExp($sString, 'test')

How could I tell it to return False if it also contains the word 'this'?

I think you want something like this:

#cs
    A(?!.*this).*test
    A                Anchor the match at the beginning of the string
    (?!             Start a negative lookahead subpattern
      .*            Match 0 or more of any characters, except newline
      this           The word we do NOT want in the string
    )               Close the negative lookahead
    .*               Match 0 or more of any characters, except newline
    test             The word we do want in the string

    The lookahead is a zero width assertion, so matching will continue at the
    same position after matching the subpattern, provided it did not terminate.
    Because it is a "negative" lookahead the subpattern will be satisfied if it
    can NOT match and continue with the rest of the pattern, it will terminate
    if it does match.
#ce

$sString = 'this is a test'
$sString = 'that was a test'
If StringRegExp($sString, 'A(?!.*this).*test') Then
    ConsoleWrite("Contains 'test' and NOT 'this'" & @CRLF)
ElseIf StringRegExp($sString, 'test') Then
    ConsoleWrite("Contains 'test' and 'this'" & @CRLF)
Else
    ConsoleWrite("Does not contain 'test'" & @CRLF)
EndIf

But for such simple needs, why not just use StringInStr?

$sString = 'this is a test'
$sString = 'that was a test'
If StringInStr($sString, 'test') And Not StringInStr($sString, 'this') Then
    ConsoleWrite("Contains 'test' and NOT 'this'" & @CRLF)
ElseIf StringInStr($sString, 'test') Then
    ConsoleWrite("Contains 'test' and 'this'" & @CRLF)
Else
    ConsoleWrite("Does not contain 'test'" & @CRLF)
EndIf
Edited by Robjong

Share this post


Link to post
Share on other sites
czardas

If you want to increase speed you should get rid of _ArrayToString.

$sHash = '123456789abcdef123456789abcdef123456789a'
ConsoleWrite(_BencodeHash($sHash) & @CRLF) ; '%124Vx%9a%bc%de%f1%23Eg%89%ab%cd%ef%124Vx%9a'

Func _BencodeHash($sStr)
    Local $aArray = StringRegExp($sStr, 'w{2}', 3)
    Local $sReturn = '', $sChar = ''
    For $i = 0 To UBound($aArray) -1
        $sChar = Chr(Dec($aArray[$i]))
        If StringInStr("0123456789abcdefghijklmnopqrstuvwxyz-_.~", $sChar) Then
            $sReturn &= $sChar
        Else
            $sReturn &= "%" & $aArray[$i]
        EndIf
    Next
    Return $sReturn
EndFunc

Yeah that should run slightly faster. I wonder which regexp is quicker. I might test it later. ;)

Of course there are no error checks.

Edited by czardas

Share this post


Link to post
Share on other sites
Robjong

There should not be a noticeable difference.

Share this post


Link to post
Share on other sites
Decipher

Thanks for your help and information.


Spoiler

censored.jpg

 

Share this post


Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
Sign in to follow this  

  • Similar Content

    • DynamicRookie
      By DynamicRookie
      Hey There!
       
      So, what i need to do is an app that can read text in a image (I.e. a png that has text saying "This is a png" and return the text to a variable)
      I'm pretty much a newbie on AutoIt, my purpose is doing that but i don't know any function that can

      Any help is much appreciated
    • therks
      By therks
      I'm looking for a regex genius, cus I'm stumped when it comes to assertions.
      So what I have now, is this regular expression: ([^|=]+)=([^|]+)
      It takes a string (user input) of keys=values separated by pipes (ie: "param=value|param=value") and splits them into an array.
      Example:
      $vParamData = 'example=value|fruit=apple|phrase=Hello world' $aRegEx = StringRegExp($vParamData, '([^|=]+)=([^|]+)', 3) ; Result ; [0] => example ; [1] => value ; [2] => fruit ; [3] => apple ; [4] => phrase ; [5] => Hello world So that's working fine, but I'm wondering if there's also a way I could have this capture escaped pipes instead of splitting by them.
      ie:
      $vParamData = 'pipe test=this \| is a pipe|example=value' $aRegEx = StringRegExp($vParamData, '([^|=]+)=([^|]+)', 3) ; I'm getting this: ; [0] => pipe test ; [1] => this \ ; [2] => example ; [3] => value ; But I'd like a result like this: ; [0] => pipe test ; [1] => this \| is a pipe ; [2] => example ; [3] => value Is there some pattern that would accomplish this, or am I better off parsing it some other way?
    • santoshM
      By santoshM
      How can i exit from a procedure in auto
      Func test() if x=o then     return endif endFunc  
    • Valnurat
      By Valnurat
      Hi
      Small question.
      I trying to find all index in an array with value higher than 7.
      How can that be possible?
    • corz
      By corz
      Associative Array Functions
      I've seen a couple of UDFs for this on the forum. One of them I quite like. But it's still nearly not as good as this method, IMHO.
      I don't recall if I discovered the "Scripting.Dictionary" COM object myself or if I got the original base code from somewhere online. I have recently searched the web (and here) hard for any AutoIt references to this, other than my own over the years I've been using this (in ffe, etc..), and I can find nothing, so I dunno. If anyone does, I'd love to give credit where it's due; this is some cute stuff! It could actually be all my own work! lol
      At any rate, it's too useful to not have posted somewhere at autoitscript.com, so I've put together a wee demo.
      For those who haven't heard of the COM "Scripting.Dictionary".. 
      If you've ever coded in Perl or PHP (and many other languages), you know how useful associative arrays are. Basically, rather than having to iterate through an array to discover it's values, with an associative array you simply pluck values out by their key "names".
      I've added a few functions over the years, tweaked and tuned, and this now represent pretty much everything you need to easily work with associative arrays in AutoIt. En-joy!
      The main selling point of this approach is its simplicity and weight. I mean, look at how much code it takes to work with associative arrays! The demo is bigger than all the functions put together! The other selling point is that we are using Windows' built-in COM object functions which are at least theoretically, fast and robust.
      I've used it many times without issues, anyhow, here goes..
      ; Associative arrays in AutoIt? Hells yeah! ; Initialize your array ... global $oMyError = ObjEvent("AutoIt.Error", "AAError") ; Initialize a COM error handler ; first example, simple. global $simple AAInit($simple) AAAdd($simple, "John", "Baptist") AAAdd($simple, "Mary", "Lady Of The Night") AAAdd($simple, "Trump", "Silly Man-Child") AAList($simple) debug("It is said that Trump is a " & AAGetItem($simple, "Trump") & ".", @ScriptLineNumber);debug debug("") ; slightly more interesting.. $ini_path = "AA_Test.ini" ; Put this prefs section in your ini file.. ; [test] ; foo=foo value ; foo2=foo2 value ; bar=bar value ; bar2=bar2 value global $associative_array AAInit($associative_array) ; We are going to convert this 2D array into a cute associative array where we ; can access the values by simply using their respective key names.. $test_array = IniReadSection($ini_path, "test") for $z = 1 to 2 ; do it twice, to show that the items are *really* there! for $i = 1 to $test_array[0][0] $key_name = $test_array[$i][0] debug("Adding '" & $key_name & "'..");debug ; key already exists in "$associative_array", use the pre-determined value.. if AAExists($associative_array, $key_name) then $this_value = AAGetItem($associative_array, $key_name) debug("key_name ALREADY EXISTS! : =>" & $key_name & "<=" , @ScriptLineNumber);debug else $this_value = $test_array[$i][1] ; store left=right value pair in AA if $this_value then AAAdd($associative_array, $key_name, $this_value) endif endif next next debug(@CRLF & "Array Count: =>" & AACount($associative_array) & "<=" , @ScriptLineNumber);debug AAList($associative_array) debug(@CRLF & "Removing 'foo'..");debug AARemove($associative_array, "foo") debug(@CRLF & "Array Count: =>" & AACount($associative_array) & "<=" , @ScriptLineNumber);debug AAList($associative_array) debug(@CRLF & "Removing 'bar'..");debug AARemove($associative_array, "bar") debug(@CRLF & "Array Count: =>" & AACount($associative_array) & "<=" , @ScriptLineNumber);debug AAList($associative_array) quit() func quit() AAWipe($associative_array) AAWipe($simple) endfunc ;; Begin AA Functions func AAInit(ByRef $dict_obj) $dict_obj = ObjCreate("Scripting.Dictionary") endfunc ; Adds a key and item pair to a Dictionary object.. func AAAdd(ByRef $dict_obj, $key, $val) $dict_obj.Add($key, $val) If @error Then return SetError(1, 1, -1) endfunc ; Removes a key and item pair from a Dictionary object.. func AARemove(ByRef $dict_obj, $key) $dict_obj.Remove($key) If @error Then return SetError(1, 1, -1) endfunc ; Returns true if a specified key exists in the associative array, false if not.. func AAExists(ByRef $dict_obj, $key) return $dict_obj.Exists($key) endfunc ; Returns a value for a specified key name in the associative array.. func AAGetItem(ByRef $dict_obj, $key) return $dict_obj.Item($key) endfunc ; Returns the total number of keys in the array.. func AACount(ByRef $dict_obj) return $dict_obj.Count endfunc ; List all the "Key" > "Item" pairs in the array.. func AAList(ByRef $dict_obj) debug("AAList: =>", @ScriptLineNumber);debug local $k = $dict_obj.Keys ; Get the keys ; local $a = $dict_obj.Items ; Get the items for $i = 0 to AACount($dict_obj) -1 ; Iterate the array debug($k[$i] & " ==> " & AAGetItem($dict_obj, $k[$i])) next endfunc ; Wipe the array, obviously. func AAWipe(ByRef $dict_obj) $dict_obj.RemoveAll() endfunc ; Oh oh! func AAError() Local $err = $oMyError.number If $err = 0 Then $err = -1 SetError($err) ; to check for after this function returns endfunc ;; End AA Functions. ; debug() (trimmed-down version) ; ; provides quick debug report in your console.. func debug($d_string, $ln=false) local $pre ; For Jump-to-Line in Notepad++ if $ln then $pre = "(" & $ln & ") " & @Tab ConsoleWrite($pre & $d_string & @CRLF) endfunc  
      ;o) Cor
×

Important Information

We have placed cookies on your device to help make this website better. You can adjust your cookie settings, otherwise we'll assume you're okay to continue.