Sign in to follow this  
Followers 0
Decipher

RegEx Split String at every 'n' characters into Array

15 posts in this topic

#1 ·  Posted (edited)

The string only contains word characters and should only be 40 characters long.

String Example: ce1fc50bffb09962be8f3c49478cbeb65e2afe0f

I need to split the string into chunks of two.

Array[0] = ce

Array[1] = 1f

And so on.

My attempt:

Dim $aArray = StringRegExp($sString, '(w{2})+', 1, 1)

I would also like to know how to specify exclude characters or (if not) if there is similiar functionality with regex please.

This will be used to check torrent tracker status. I need to put % before every two characters. The above ex. string is SHA-1 Torrent Info Hash.

Edited by Decipher

Spoiler

censored.jpg

 

Share this post


Link to post
Share on other sites



#2 ·  Posted (edited)

I don't know if this is any help to you. Look at the second example in that post.

Edit

I'm not sure what you mean by exclude characters. You could remove unwanted characters before or after the split - leading to different results.

Edited by czardas

Share this post


Link to post
Share on other sites

#3 ·  Posted (edited)

I don't know if this is any help to you. Look at the second example in that post.

Edit

I'm not sure what you mean by exclude characters. You could remove unwanted characters before or after the split - leading to different results.

Thats what I asked for thank you. Lets say I wanted to write a regular expression where I wanted the statement to be true if it dosen't contain a given character. How would I do that?

#include <Array.au3>
Dim $aArray = _StringEqualSplit(StringUpper('962fb077e814c55a9a01b8f07e2fd2945cef6998'), 2)
ConsoleWrite('%' & _ArrayToString($aArray, '%') & @CRLF)
Func _StringEqualSplit($sString, $iNumChars)
    If (Not IsString($sString)) Or $sString = "" Then Return SetError(1, 0, 0)
    If (Not IsInt($iNumChars)) Or $iNumChars < 1 Then Return SetError(2, 0, 0)
    Return StringRegExp($sString, "(?s).{1," & $iNumChars & "}", 3)
EndFunc

The above code outputs: %96%2F%B0%77%E8%14%C5%5A%9A%01%B8%F0%7E%2F%D2%94%5C%EF%69%98

It is not valid. I am confused as how to encode the info hash to request information from a torrent tracker. This page shows what I'm trying to do, if someone dosen't mind helping me out.

http://nakkaya.com/2009/12/03/bittorrent-tracker-protocol/

Edited by Decipher

Spoiler

censored.jpg

 

Share this post


Link to post
Share on other sites

#4 ·  Posted (edited)

If your condition is based on there being only one character then I would use StringInStr() to check if the string contains the character you want to avoid. I'm not sure about the other technical details of your request. It sounds like it might take some study.

Edited by czardas

Share this post


Link to post
Share on other sites

#5 ·  Posted (edited)

Perhaps this is what you are after, but I'm not sure:

ConsoleWrite('%' & _ArrayToString($aArray, '') & @CRLF)

If your condition is based on there being only one character then I would use StringInStr() to check if the string contains the character you want to avoid. I'm not sure about the other technical details of your request. It sounds like it might take some study.

Thanks for your help, This my attempt to encode the hash.

ConsoleWrite(_HashEncode(_StringEqualSplit('123456789abcdef123456789abcdef123456789a', 2)) & @CRLF)
Func _HashEncode($aArray)
Local $url = "", $acode
For $i = 0 To UBound($aArray, 1) - 1
  $acode = $aArray[$i]
  Select
   Case ($acode >= 48 And $acode <= 57) Or _
     ($acode >= 65 And $acode <= 90) Or _
     ($acode >= 97 And $acode <= 122)
    $url = $url & Chr($acode)
   Case $acode = 45 Or $acode = 95 Or $acode = 46 Or $acode = 126
    $url = $url & Chr($acode)
   Case Else
    $url = $url & '%' & $aArray[$i]
  EndSelect
Next
Return $url
EndFunc   ;==>_URLEncode
Func _StringEqualSplit($sString, $iNumChars)
    If (Not IsString($sString)) Or $sString = "" Then Return SetError(1, 0, 0)
    If (Not IsInt($iNumChars)) Or $iNumChars < 1 Then Return SetError(2, 0, 0)
    Return StringRegExp($sString, "(?s).{1," & $iNumChars & "}", 3)
EndFunc

Output: %12%348N%9a%bc%de%f1%23-CY%ab%cd%ef%12%348N%9a

Needed Output: %124Vx%9a%bc%de%f1%23Eg%89%ab%cd%ef%124Vx%9a

Based on the above link.

If you don't pay attention to the spec and send this directly to tracker you will get an error this should be in URL Encoded form. Padding every two chars with % sign also doesn't work, been there done that don't waste your time. Any hex in the hash that corresponds to a unreserved character should be replaced,

a-z A-Z 0-9 -_.~

Partition the hex in to chunks of two and check if the hex corresponds to any of these values, if they do replace them with the unreserved char,

(defn url-encode [hash]

(apply str

(map (fn [[a b]]

(let [byte (BigInteger. (str a ;) 16) ]

(if (or (and (>= byte 65) (<= byte 90)) ; A-Z

(and (>= byte 97) (<= byte 122)) ; a-z

(and (>= byte 48) (<= byte 57)) ; 0-9

(= byte 45) (= byte 95) (= byte 46) (= byte 126))

(char byte) (str "%" a :)) )) (partition 2 hash))))

So that a hash such as,

123456789abcdef123456789abcdef123456789a

becomes,

%124Vx%9a%bc%de%f1%23Eg%89%ab%cd%ef%124Vx%9a

notice that hex 34 became 4 which is what it is in ASCII. You can test the correctness of your hashes using the tracker url but don't request from announce request from file,

http://some.tracker.com/file?info_hash=hash

If you get a torrent back that means you have the correct hash.

Here are some tracker you can test it with:

Tr_1=udp://fr33domtracker.h33t.com:3310/announce

Tr_2=http://announce.torrentsmd.com:8080/announce

Tr_4=udp://9.rarbg.com:2710/announce

Tr_6=udp://tracker.openbittorrent.com:80/announce

Here are some info hashes for different torrents each on its on line:

89fc7b8e7aa220368213bc555e0f24b72295c35d1

1326dcb7fb42312d7d47d8347281a89b8c3804f3

a9e22c72041e3d336766a3ed5769070ebe9c548a

86e1b0fac439d34d34d96af168d8dfe7cbc42000

646ca38de9ec32ae6d1971fcc46665ab88c888fa

25942cb889387c509c165c923cf34c907b6e83aa

Before where I was asking how to exclude characters I was just asking out of curiosity not for my current project.

$sString = 'thisisatest'

Normally to check if it contains the word 'test' you could do StringRegExp($sString, 'test')

How could I tell it to return False if it also contains the word 'this'?

Edited by Decipher

Spoiler

censored.jpg

 

Share this post


Link to post
Share on other sites

Hmm, did you solve it? Here's what I wrote just now.

#include <Array.au3>
Dim $aArray = _StringEqualSplit('123456789abcdef123456789abcdef123456789a', 2)

$testStr = "0123456789abcdefghijklmnopqrstuvwxyz-_.~"
For $i = 0 To UBound($aArray) -1
    If StringInStr($testStr, Chr(Dec($aArray[$i]))) Then
        $aArray[$i] = Chr(Dec($aArray[$i]))
    Else
        $aArray[$i] = "%" & $aArray[$i]
    EndIf
Next
ConsoleWrite(_ArrayToString($aArray, "") & @CRLF)

Func _StringEqualSplit($sString, $iNumChars)
    If (Not IsString($sString)) Or $sString = "" Then Return SetError(1, 0, 0)
    If (Not IsInt($iNumChars)) Or $iNumChars < 1 Then Return SetError(2, 0, 0)
    Return StringRegExp($sString, "(?s).{1," & $iNumChars & "}", 3)
EndFunc

Share this post


Link to post
Share on other sites

Hmm, did you solve it? Here's what I wrote just now.

#include <Array.au3>
Dim $aArray = _StringEqualSplit('123456789abcdef123456789abcdef123456789a', 2)

$testStr = "0123456789abcdefghijklmnopqrstuvwxyz-_.~"
For $i = 0 To UBound($aArray) -1
    If StringInStr($testStr, Chr(Dec($aArray[$i]))) Then
        $aArray[$i] = Chr(Dec($aArray[$i]))
    Else
        $aArray[$i] = "%" & $aArray[$i]
    EndIf
Next
ConsoleWrite(_ArrayToString($aArray, "") & @CRLF)

Func _StringEqualSplit($sString, $iNumChars)
    If (Not IsString($sString)) Or $sString = "" Then Return SetError(1, 0, 0)
    If (Not IsInt($iNumChars)) Or $iNumChars < 1 Then Return SetError(2, 0, 0)
    Return StringRegExp($sString, "(?s).{1," & $iNumChars & "}", 3)
EndFunc

Yes you did.

Do you mind explaining how your using dec and char for future reference aka break it down?


Spoiler

censored.jpg

 

Share this post


Link to post
Share on other sites

#8 ·  Posted (edited)

The function Chr only accepts decimal input, and because the 2 digits in each element represent hex values, they first need to be converted to decimal using Dec before you pass them to the Chr function. This can be done easily by passing the functions as parameters in the correct sequence as I did (but it isn't necessary to do it this way). You should look up these functions in the help file and check out the ascii character codes page in there too.

I hope that makes sense. You might need to study it a bit. ;)

One thing that isn't clear to me from the artucle is whether or not the string needs to begin with %. You may need to watch out for this if the first array element is replaced (my code will not always add a preceeding % at the start). I'm unfamiliar with bencode but it is easy to add % at the start of the string if it is needed.

Edited by czardas

Share this post


Link to post
Share on other sites

The function Chr only accepts decimal input, and because the 2 digits in each element represent hex values, they first need to be converted to decimal using Dec before you pass them to the Chr function. This can be done easily by passing the functions as parameters in the correct sequence as I did (but it isn't necessary to do it this way). You should look up these functions in the help file and check out the ascii character codes page in there too.

I hope that makes sense. You might need to study it a bit. ;)

One thing that isn't clear to me from the artucle is whether or not the string needs to begin with %. You may need to watch out for this if the first array element is replaced (my code will not always add a preceeding % at the start). I'm unfamiliar with bencode but it is easy to add % at the start of the string if it is needed.

Awesome, I think I got everything I need now. I appreciate your help with this.


Spoiler

censored.jpg

 

Share this post


Link to post
Share on other sites

#10 ·  Posted (edited)

It was interesting to spend time on. I'm happy to help. ;)

Edit

Actually looking at this again, it can be improved slightly. It's not a major change.

#include <Array.au3>
Dim $aArray = _StringEqualSplit('123456789abcdef123456789abcdef123456789a', 2)

$testStr = "0123456789abcdefghijklmnopqrstuvwxyz-_.~"
For $i = 0 To UBound($aArray) -1
    $sChar = Chr(Dec($aArray[$i])) ; This should make it slightly faster - less conversion involved.
    If StringInStr($testStr, $sChar) Then
        $aArray[$i] = $sChar
    Else
        $aArray[$i] = "%" & $aArray[$i]
    EndIf
Next
ConsoleWrite(_ArrayToString($aArray, "") & @CRLF)

Func _StringEqualSplit($sString, $iNumChars)
    If (Not IsString($sString)) Or $sString = "" Then Return SetError(1, 0, 0)
    If (Not IsInt($iNumChars)) Or $iNumChars < 1 Then Return SetError(2, 0, 0)
    Return StringRegExp($sString, "(?s).{1," & $iNumChars & "}", 3)
EndFunc

It may be possible to do all this with one complicated RegExpReplace, but that would take some thinking about (I have my doubts about it). Also whether it would be better or not is perhaps debatable (depending on the complexity).

Edited by czardas

Share this post


Link to post
Share on other sites

#11 ·  Posted (edited)

If you want to increase speed you should get rid of _ArrayToString.

$sHash = '123456789abcdef123456789abcdef123456789a'
ConsoleWrite(_BencodeHash($sHash) & @CRLF) ; '%124Vx%9a%bc%de%f1%23Eg%89%ab%cd%ef%124Vx%9a'

Func _BencodeHash($sStr)
    Local $aArray = StringRegExp($sStr, 'w{2}', 3)
    Local $sReturn = '', $sChar = ''
    For $i = 0 To UBound($aArray) -1
        $sChar = Chr(Dec($aArray[$i]))
        If StringInStr("0123456789abcdefghijklmnopqrstuvwxyz-_.~", $sChar) Then
            $sReturn &= $sChar
        Else
            $sReturn &= "%" & $aArray[$i]
        EndIf
    Next
    Return $sReturn
EndFunc

$sString = 'thisisatest'

Normally to check if it contains the word 'test' you could do StringRegExp($sString, 'test')

How could I tell it to return False if it also contains the word 'this'?

I think you want something like this:

#cs
    A(?!.*this).*test
    A                Anchor the match at the beginning of the string
    (?!             Start a negative lookahead subpattern
      .*            Match 0 or more of any characters, except newline
      this           The word we do NOT want in the string
    )               Close the negative lookahead
    .*               Match 0 or more of any characters, except newline
    test             The word we do want in the string

    The lookahead is a zero width assertion, so matching will continue at the
    same position after matching the subpattern, provided it did not terminate.
    Because it is a "negative" lookahead the subpattern will be satisfied if it
    can NOT match and continue with the rest of the pattern, it will terminate
    if it does match.
#ce

$sString = 'this is a test'
$sString = 'that was a test'
If StringRegExp($sString, 'A(?!.*this).*test') Then
    ConsoleWrite("Contains 'test' and NOT 'this'" & @CRLF)
ElseIf StringRegExp($sString, 'test') Then
    ConsoleWrite("Contains 'test' and 'this'" & @CRLF)
Else
    ConsoleWrite("Does not contain 'test'" & @CRLF)
EndIf

But for such simple needs, why not just use StringInStr?

$sString = 'this is a test'
$sString = 'that was a test'
If StringInStr($sString, 'test') And Not StringInStr($sString, 'this') Then
    ConsoleWrite("Contains 'test' and NOT 'this'" & @CRLF)
ElseIf StringInStr($sString, 'test') Then
    ConsoleWrite("Contains 'test' and 'this'" & @CRLF)
Else
    ConsoleWrite("Does not contain 'test'" & @CRLF)
EndIf
Edited by Robjong

Share this post


Link to post
Share on other sites

#12 ·  Posted (edited)

If you want to increase speed you should get rid of _ArrayToString.

$sHash = '123456789abcdef123456789abcdef123456789a'
ConsoleWrite(_BencodeHash($sHash) & @CRLF) ; '%124Vx%9a%bc%de%f1%23Eg%89%ab%cd%ef%124Vx%9a'

Func _BencodeHash($sStr)
    Local $aArray = StringRegExp($sStr, 'w{2}', 3)
    Local $sReturn = '', $sChar = ''
    For $i = 0 To UBound($aArray) -1
        $sChar = Chr(Dec($aArray[$i]))
        If StringInStr("0123456789abcdefghijklmnopqrstuvwxyz-_.~", $sChar) Then
            $sReturn &= $sChar
        Else
            $sReturn &= "%" & $aArray[$i]
        EndIf
    Next
    Return $sReturn
EndFunc

Yeah that should run slightly faster. I wonder which regexp is quicker. I might test it later. ;)

Of course there are no error checks.

Edited by czardas

Share this post


Link to post
Share on other sites

There should not be a noticeable difference.

Share this post


Link to post
Share on other sites

Probably not but it's interesting nontheless. I never heard of Bencode before today.

Share this post


Link to post
Share on other sites

Thanks for your help and information.


Spoiler

censored.jpg

 

Share this post


Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!


Register a new account

Sign in

Already have an account? Sign in here.


Sign In Now
Sign in to follow this  
Followers 0

  • Similar Content

    • Miliardsto
      By Miliardsto
      Hello I got these tabs
       
      Global $TabMain = GUICtrlCreateTabItem("Main") Global $Action = GUICtrlCreateTabItem("Actions") Global $TabThings = GUICtrlCreateTabItem("Things") As we know to change tab we have to click with mouse on tab name like here it looks like below.
      Is there possibility to change tab without click on the tab but change by click on button for example?

    • sree161
      By sree161
      Hi,
      i have a code which generates two numeric outputs.i have to save them in excel.
      Is there any way to export them to specific cells in excel???
    • TotalAuto
      By TotalAuto
      Howdy All
      I've gone around and around in circles wasting hours trying to fix this problem to no avail so I thought I would try posting for help given there are some real smart people in this forum.
      Background
      I have 5 separate .au3 scripts that all do different basic tasks. For example:
      1.au3 = opens Chrome browser to obtain information from a specific website then closes
      2.au3 = opens an Excel workbook to run a macro then saves and closes
      3.au3 = Open two seperate workbooks and transfers data from one to the other then saves and closes
      4.au3 = .......etc
      5.au3 = .......etc
      These 5 separate scripts, doing completely different tasks, need to each run once per day at 5 different designated times within a day and then close. For example:
      1.au3 = 10am
      2.au3 = 12pm
      3.au3 = 2pm
      4.au3 = 4pm
      5.au3 = 5pm
      Problem
      I can not get these different scripts to reliably run at their designated times. When I manually run these scripts individually by using 'Go F5' they work perfectly. If I convert these scripts to an .exe and manually run each one they work about 98% of time.
      How can I schedule these different .au3 files or associated .exe files to reliably run each day at different times?
      Attempts To Fix The Issue
      1. I have tried converting each .au3 script into their own .exe file and use Window's Task Scheduler to run these .exe files at their designated time but the success rate  of running each .exe in full, to completion, without error is very low at about 30%. Things that commonly go wrong include a browser not opening but movement still continues on the desk top. Other times things just do not happen at all.
      2. I have Windows 7 64 bit and have tried creating and running both (x86) and (x64) .exe files but again reliability problems exist;
      3. I have also tried moving each .exe file to the My Documents folder as I read someone that keeping your files on your desktop ties your files to individual Windows user profiles which can cause AutoIt operating errors. Not sure if this is correct but thought I would try it anyway. It did not fix my issue.
      4. I installed a program called AlwaysUp which supposedly always reliably runs in the background and will reliably execute your AutoIt script or .exe files. Still have significant reliability issues.
      Therefore, can someone please provide advice on how I can get my 5 different .au3 files to run at 5 designated times through the day, every day, without fail? Overtime I will be creating more and more different .au3 files to run certain tasks throughout the day and do not want to create one large AutoIt file that continually runs and attempts to do all the different tasks itself.
      Any help is very appreciated.
      Thanks
      Dan
       
       
    • hugomito
      By hugomito
      Hi all,
      I built an AutoIt application that interacts with several other applications/software. Now, it's turn to interfact with Visual Studio Team Services (VSTS).
      Does anyone has a blog, demo, script to share?
      Thanks!
    • Viki
      By Viki
      This is my first time here so please dont bombard me that what a silly question I am asking!!
      I have 500 rows (A1:A500) in a spreadsheet and I just want to copy one by one row and then paste into another application and then press enter, loop should repeat this until finishes all 500 rows.
      I have looked at clipget(), clip(put() but dont know how to select next row in next turn. I also looked at Array to store but again no luck. Can some guide me please..