Jump to content
Reizvoller

BIG String to Array

Recommended Posts

Reizvoller

Greetings,

I am getting the "RawData" return from FastFind's "FFGetRawData" function and then attempting to make it into an array.

What I have here does the job as it should but it is a slow process. I feel I may be overlooking a more effecient way to handle this matter. In the end ( in an ideal situation ) I'd like to end up with a 2D array with 580 col and 375 rows. Currently it's just a 1D array as I am still trying to get my head around how to make it into a 2D. BUT... My question is this ...

Is there a better way to handle what I am trying to do? 

Func trimmer ()
    Local $i = 0 ;The "Counter"
    Local $WorkAreaLength = StringLen ($WorkAreaData) ;Get the length of the string
    ConsoleWrite ("WorkAreaLegnth="&$WorkAreaLength&@CR)
    Local $iWorkAreaLengthCount = $WorkAreaLength / 8 ;How many segments of 8 can we make? Use this for the counter later on
    ConsoleWrite ("WorkArealengthCount="&$iWorkAreaLengthCount&@CR) 
    Local $sPiece = 0 ; The string segment holder
    Global $aWorkArea ; The array to write to
        Do
            $sPiece = StringLeft ($WorkAreaData, 8) ; Grab the first 8 characters and put them into $sPiece
            _ArrayAdd ($aWorkArea, $sPiece) ; Put what $sPiece is into the array
            StringTrimLeft ($WorkAreaData, 8) ;Trim off the first 8 characters that were just copied

            $i = $i + 1 ;Count up 1
            ConsoleWrite ($i&@CR)
        Until $i >= $iWorkAreaLengthCount ; Keep going until $i >= $iWorkAreaLengthCount

    ConsoleWrite ("Done"&@CR)
    Local $sFile = FileOpen ("main.txt");Open the text file
    _FileWriteFromArray ($sFile , $aWorkArea);Write the array to the text file
    FileClose ($sFile); Close the text file
EndFunc

 

A little secondary problem, that isn't throwing any errors to speak of, is the file is never written to. It remains blank even though it is in the same directory as the script and the script isn't responding with any errors. This isn't my main focus though as it just lets me see what the array is rather than using the console which can be a little cramped at times.

Any advise would be appreciated, thank you!

Share this post


Link to post
Share on other sites
alien4u
$sPiece = StringLeft ($WorkAreaData, +8)

Hi @Reizvoller

I don't know how BIG could be your string but sometimes we just over complicate things.

Like I see it to save your string to an Array 1D or 2D you need to split that string, or you need some kind of delimiter.
So you split your string on segments of 8 character each one, because you don't have any other way to split your string? no delimiters? spaces? anything?

Anyways in order to make this more efficient what I would probably do is to avoid another string operation:

StringTrimLeft ($WorkAreaData, 8)

Try to avoid this operation, maybe if you sum first position to second one?

$sPiece = StringLeft ($WorkAreaData, 8)

Maybe If $i >= 1 Then

$sPiece = StringLeft ($WorkAreaData, +8)

I mean increment StringLeft position by 8 because is always your increment factor, on each loop cicle you could save next StringLeft left position and use that.

I thinks avoiding StringTrimLeft will give you better performance.

Kind Regards
Alien.

Share this post


Link to post
Share on other sites
Reizvoller

Greetings,

Fantastic idea regarding not doing the "StringTrim" and the subsequent +8 on the StringLeft.

Truth be told I am starting to feel like I am attempting to do something I shouldn't.

The string is a bunch of Hexadecimal color values all in a line without any spaces further than a "00" but some colors have "00" in them hence me not using it as a delimiter for this process.

The string is a bit over 1.7million characters which is off of about 217500 pixel values.

This process is to hunt through a work area, see if there is something, then continue along.

After putting more thought into it I feel I need to find another method to tackle my goal but this was great learning along the way! :)

Share this post


Link to post
Share on other sites
alien4u

Anyways if this are Hexadecimal color values always with a fixed length for example 4 characters you could take a high multiple of 4.

For example 400 this will make each array element store 100 colors values and this will make the arrays also shorten for parsing in the next stage of your code.

Kind Regards
Alien.

Share this post


Link to post
Share on other sites
czardas

Perhaps this helps:

#include <Array.au3>
Local $aArray = _StringEqualSplit("12345678910123456789101234567890", 8)
_ArrayDisplay($aArray)

Func _StringEqualSplit($sString, $iNumChars)
    If Not IsString($sString) Or $sString = "" Then Return SetError(1, 0, 0)
    If Not IsInt($iNumChars) Or $iNumChars < 1 Then Return SetError(2, 0, 0)
    Return StringRegExp($sString, "(?s).{1," & $iNumChars & "}", 3)
EndFunc

 

Edited by czardas

Share this post


Link to post
Share on other sites
markyrocks

$file=fileopen ("file.txt",1)

 

Your file is opening in read only mode

 

Edit.  I believe you could use 0x as delimiter then just add it back later

2d array simple example 

Dim $array[10][10]

For $col=0 to ubound($array,2)-1
For $row=0 to ubound($array1)-1
$array[$row][$col]
MsgBox("","", $$array[$row][$col])
;this basically just shuffle through the array and display the results

Next
Next

 

Edited by markyrocks
made a mistake

Share this post


Link to post
Share on other sites
AutoBert

This funcs do the job:

Func _FFArrayFromRawData($String, $iRows = 0, $iCols = 0)
    #cs
        _FFArrayFromRawData($String, [$iRows = 0, [$iCols = 0]])
        Params:     $String     the String with raw pixel data as returned from _FFArrayFromRawData
        $iRows      number of Rows in resulting array OPTIONAL
        $iCols      number of Cols in resulting array OPTIONAL
        possible
        Returns:    $aResult[$iPixelCount+1]    $iRows and $iCols = 0
        so all Pixels in a 1D array
        $aResult[$iRows]            1D array
        $aResult[$iRows][$iCols]    2D array
        also
        setting:    @Error      (0 no error, 1 error occured)
        @extended   10 no valid RawDataString
        11 Arraydimensions to big
        1 Array is 1D (info only)
        2 Array is 2D (info only)

        Author:     HarryBotter 2016
    #ce
    Local $aResult[0], $iPixNo, $iEx
    Local $iLen = StringLen($String)
    If Mod($iLen, 8) Then ;no valid RawDataString
        SetError(1, 10)
        Return
    EndIf
    If $iRows * $iCols * 8 > $iLen Then ;Arraydimensions to big
        SetError(1, 11)
        Return
    EndIf
    If $iRows = 0 And $iCols = 0 Then
        $iRows = $iLen / 8
        ReDim $aResult[$iRows]
        $iEx = 1
    Else
        If $iCols = 0 Then
            ReDim $aResult[$iRows]
            $iEx = 1
        Else
            ReDim $aResult[$iRows][$iCols]

            $iEx = 2
        EndIf
    EndIf
    For $i = 0 To $iRows - 1
        If $iEx > 1 Then
            For $j = 0 To $iCols - 1
                $iPixNo = $i * $iCols + $j
                $aResult[$i][$j] = _FFGetPixelColor($iPixNo, $String)
            Next
        Else
            $aResult[$i] = _FFGetPixelColor($i, $String)
        EndIf
    Next
    SetError(0, $iEx, $aResult)
    Return $aResult
EndFunc   ;==>_FFArrayFromRawData

Func _FFGetPixelColor($iPixNo, $String)
    #cs
        Params:     $iPixNo     the number of Pixel for wich the color is extracted
        $String     the String with raw pixel data as returned from _FFArrayFromRawData

        Remarks:    no Errorhandling only for using together with _FFArrayFromRawData

        Author:     HarryBotter 2016
    #ce
    Local $sRet = StringMid($String, $iPixNo * 8 + 1, 8)
    ;ConsoleWrite($iPixNo & ': ' & $sRet & @CRLF)
    Return $sRet
EndFunc   ;==>_FFGetPixelColor

i already posted you the link to script using this:

#include "FastFind.au3"
#include <Array.au3>

$tdStart = TimerInit()
FFSnapShot(1, 1, 100, 100, 1)
ConsoleWrite('SnapShot after '&TimerDiff($tdStart)&' ms returned with: '  & @error & @CRLF)
Local $sData = FFGetRawData(1)
ConsoleWrite('GetRawData: ' & @error & @CRLF)
Local $aPixels = _FFArrayFromRawData($sData, 100, 100)
If @extended=2 Then
    $iPixelCount=UBound($aPixels,1)*UBound($aPixels,1)
Else
    $iPixelCount=UBound($aPixels)
EndIf

ConsoleWrite('ArrayFromRawData: ' & @error & @TAB & @extended & @TAB & TimerDiff($tdStart) & ' ms'& @CRLF)
ConsoleWrite('Average Time: ' & TimerDiff($tdStart) / $iPixelCount &'ms Pixels: ' & $iPixelCount & @CRLF)
_ArrayDisplay($aPixels)

Without the _ArrayDisplay its very fast. Using smaller workarea will save absolut time.

Edited by AutoBert

Share this post


Link to post
Share on other sites
Reizvoller
3 hours ago, alien4u said:

Anyways if this are Hexadecimal color values always with a fixed length for example 4 characters you could take a high multiple of 4.

For example 400 this will make each array element store 100 colors values and this will make the arrays also shorten for parsing in the next stage of your code.

Kind Regards
Alien.

Shortening them would indeed be handy!

3 hours ago, czardas said:

Perhaps this helps:

#include <Array.au3>
Local $aArray = _StringEqualSplit("12345678910123456789101234567890", 8)
_ArrayDisplay($aArray)

Func _StringEqualSplit($sString, $iNumChars)
    If Not IsString($sString) Or $sString = "" Then Return SetError(1, 0, 0)
    If Not IsInt($iNumChars) Or $iNumChars < 1 Then Return SetError(2, 0, 0)
    Return StringRegExp($sString, "(?s).{1," & $iNumChars & "}", 3)
EndFunc

 

This is an interesting approach! I am going to try it right away, even if it is just for the learning experience :)

2 hours ago, markyrocks said:

$file=fileopen ("file.txt",1)

 

Your file is opening in read only mode

 

Edit.  I believe you could use 0x as delimiter then just add it back later

2d array simple example 

Dim $array[10][10]

For $col=0 to ubound($array)-1
For $row=0 to ubound($array)-1
$array[$row][$col]
MsgBox("","", $$array[$row][$col])
;this basically just shuffle through the array and display the results

Next
Next

 

I KNEW I was over looking something super simple with the FileWrite! I was staring at it going "There has gotta be a setting I am just not even thinking of..." Thank you! 

As for using 0x , I actually don't think that the function FFGetRawData throws out the 0x too or else this would be ideal.

19 minutes ago, AutoBert said:

This funcs do the job:

Func _FFArrayFromRawData($String, $iRows = 0, $iCols = 0)
    #cs
        _FFArrayFromRawData($String, [$iRows = 0, [$iCols = 0]])
        Params:     $String     the String with raw pixel data as returned from _FFArrayFromRawData
        $iRows      number of Rows in resulting array OPTIONAL
        $iCols      number of Cols in resulting array OPTIONAL
        possible
        Returns:    $aResult[$iPixelCount+1]    $iRows and $iCols = 0
        so all Pixels in a 1D array
        $aResult[$iRows]            1D array
        $aResult[$iRows][$iCols]    2D array
        also
        setting:    @Error      (0 no error, 1 error occured)
        @extended   10 no valid RawDataString
        11 Arraydimensions to big
        1 Array is 1D (info only)
        2 Array is 2D (info only)

        Author:     HarryBotter 2016
    #ce
    Local $aResult[0], $iPixNo, $iEx
    Local $iLen = StringLen($String)
    If Mod($iLen, 8) Then ;no valid RawDataString
        SetError(1, 10)
        Return
    EndIf
    If $iRows * $iCols * 8 > $iLen Then ;Arraydimensions to big
        SetError(1, 11)
        Return
    EndIf
    If $iRows = 0 And $iCols = 0 Then
        $iRows = $iLen / 8
        ReDim $aResult[$iRows]
        $iEx = 1
    Else
        If $iCols = 0 Then
            ReDim $aResult[$iRows]
            $iEx = 1
        Else
            ReDim $aResult[$iRows][$iCols]

            $iEx = 2
        EndIf
    EndIf
    For $i = 0 To $iRows - 1
        If $iEx > 1 Then
            For $j = 0 To $iCols - 1
                $iPixNo = $i * $iCols + $j
                $aResult[$i][$j] = _FFGetPixelColor($iPixNo, $String)
            Next
        Else
            $aResult[$i] = _FFGetPixelColor($i, $String)
        EndIf
    Next
    SetError(0, $iEx, $aResult)
    Return $aResult
EndFunc   ;==>_FFArrayFromRawData

Func _FFGetPixelColor($iPixNo, $String)
    #cs
        Params:     $iPixNo     the number of Pixel for wich the color is extracted
        $String     the String with raw pixel data as returned from _FFArrayFromRawData

        Remarks:    no Errorhandling only for using together with _FFArrayFromRawData

        Author:     HarryBotter 2016
    #ce
    Local $sRet = StringMid($String, $iPixNo * 8 + 1, 8)
    ;ConsoleWrite($iPixNo & ': ' & $sRet & @CRLF)
    Return $sRet
EndFunc   ;==>_FFGetPixelColor

i already posted you the link unsing to script using this in

I need to save CodeBot to my favorites , you have referenced it before and it seems like a valuable source of data. Your solution is very intricuit and will take a little time for me to review and employ for myself. Thank you for the information!

<><><>

So many replies to this little question of mine, I really apreciate every moment that was put into writing back to me. Thank you all very much! I am headed out of the office for the weekend but will be back on this problem ( and probably this forum ) come Monday :)

Thank you again!~

~~~Reiz

Share this post


Link to post
Share on other sites
AutoBert
5 hours ago, alien4u said:

Anyways if this are Hexadecimal color values always with a fixed length for example 4 characters you could take a high multiple of 4.

It's a String each Pixel is represented in BGRA-Format 2 chars for Blue, 2 chars for green, 2 chars for red and 2 chars for the alphachannel

 

2 hours ago, Reizvoller said:

Your solution is very intricuit and will take a little time for me to review and employ for myself.

It's not mine. I had a small look in FastFind's helpfile and i think there a better solutions possible than creating a array and search with AutoItscript for a pixel with specific color. Using the wrapped DLL-calls like FFGetPixel, FFNearestPixel, FFBestSpot should be perfomater you don't need the 2 Steps:

  • FFGetRawData
  • creating a array from resultstring for easier searching

and then searching in the array. If knowing the coords for a pixel you want know the colour use FFGetPixel. If you want the nearest pixel from a given coordinate in defined colour (shadevariantions are possible) user FFNearesPixel. For a Spot of Pixels you can use FFBestSpot, FFNearestSpot.

As this functions are wrapped DLL-calls for the FF.DLL it's much faster than the best optimized AutoIt code. FF.au3 is very complex and so it needs time to explore all the possiblilies. But this time is not wasted for you, not using a FF'-func when it's possible is wasted time. Only in case you know how to include and execute ASM-routines in autoit (I don't) you can build faster algorithm than the FF-funcs.

Share this post


Link to post
Share on other sites
Reizvoller
On 4/8/2016 at 7:06 PM, AutoBert said:

It's a String each Pixel is represented in BGRA-Format 2 chars for Blue, 2 chars for green, 2 chars for red and 2 chars for the alphachannel

 

It's not mine. I had a small look in FastFind's helpfile and i think there a better solutions possible than creating a array and search with AutoItscript for a pixel with specific color. Using the wrapped DLL-calls like FFGetPixel, FFNearestPixel, FFBestSpot should be perfomater you don't need the 2 Steps:

  • FFGetRawData
  • creating a array from resultstring for easier searching

and then searching in the array. If knowing the coords for a pixel you want know the colour use FFGetPixel. If you want the nearest pixel from a given coordinate in defined colour (shadevariantions are possible) user FFNearesPixel. For a Spot of Pixels you can use FFBestSpot, FFNearestSpot.

As this functions are wrapped DLL-calls for the FF.DLL it's much faster than the best optimized AutoIt code. FF.au3 is very complex and so it needs time to explore all the possiblilies. But this time is not wasted for you, not using a FF'-func when it's possible is wasted time. Only in case you know how to include and execute ASM-routines in autoit (I don't) you can build faster algorithm than the FF-funcs.

Howdy!

I applied the idea of  using just PixelSearch for another process for the same web interface. Trouble is, with this next step, there are many items that will have the color I am looking for and the location is going to change. This problem is actually why I am making this little script because this particular task is very cumbersome.

The entire thing, the work space,  renders as a big BMP and is not searchable as text. 

 

So the strategy was this ...

  1. Get reference RAW data for the areas of interest that I want to automatically navigate to/find
    1. Get a snapShot of the wanted area, convert to RAW, save on a .txt
  2. Open the work area
  3. Snap shot work area
  4. Search for the reference RAW in the WorkArea SnapShot RAW
  5. Scroll down x units 
  6. Go back to step 2

It isn't the most elegant of solutions but with the interface I have, it's really my only option ( that I can see at the moment. )

I suppose the better way would be to find a more finite way to specify the target areas I am wanting the script to find. Like a 1 pixel tall by 100 pixels wide rather than an area of 300x500 pixels.

I am going to see about finding other ways to search through this thing in the meantime. I think that my described method is too lengthy of a process to really be useful when compared against just manual searching. 

Edited by Reizvoller

Share this post


Link to post
Share on other sites
AutoBert

You don't need FFGetRawData, FFGetPixel searches in SnapShot too and this much faster. I think (not tested, i am no gamer or gamebotter) that building 2DArray with FFGetPixel is Faster than the way Hairy Botter showed. 

Share this post


Link to post
Share on other sites
Reizvoller
23 minutes ago, AutoBert said:

You don't need FFGetRawData, FFGetPixel searches in SnapShot too and this much faster. I think (not tested, i am no gamer or gamebotter) that building 2DArray with FFGetPixel is Faster than the way Hairy Botter showed. 

Quick note this is NOT for a game in any capacity! 

But your information is quite useful and will be tested once I get the chance, thank you. 

Share this post


Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now

  • Similar Content

    • rm4453
      By rm4453
      I have a table I am parsing, to find specific vehicle information. I am unable to get _ArrayFindAll to return the only valid result with my test data.
      Below is a sample of the table's HTML:
      <td class="textCenter">2010</td> <td>TOYOTA</td> <td>TACOMA 4X4 DB</td> <td></td> <td>BLACK</td> <td class="textCenter">C</td> <td class="textCenter">6</td> <td>GAS</td> <td class="textCenter">A</td> <td class="textCenter">4X4</td> <td class="textCenter">Y</td> <td>CD</td> <td class="textCenter">HT</td> <td class="textCenter">C</td> <td class="textRight" nowrap="nowrap">80,975</td> <td class="textRight" nowrap="nowrap">$16,800</td> </tr> <tr><!-- 308 --> <td class="textCenter">2010</td> <td>TOYOTA</td> <td>TACOMA 4X4 RG</td> <td></td> <td>BLACK</td> <td class="textCenter">R</td> <td class="textCenter">4</td> <td>GAS</td> <td class="textCenter">5</td> <td class="textCenter">4X4</td> <td class="textCenter">A</td> <td>CD</td> <td class="textCenter">HT</td> <td class="textCenter">C</td> <td class="textRight" nowrap="nowrap">95,224</td> <td class="textRight" nowrap="nowrap">$9,500</td> </tr> <tr><!-- 309 --> <td class="textCenter">2011</td> <td>BUICK</td> <td>REGAL</td> <td>CXL RL4</td> <td>BLACK</td> <td class="textCenter">4</td> <td class="textCenter">4</td> <td>GAS</td> <td class="textCenter">A</td> <td class="textCenter"></td> <td class="textCenter">A</td> <td>CD</td> <td class="textCenter">SR</td> <td class="textCenter">L</td> <td class="textRight" nowrap="nowrap">102,694</td> <td class="textRight" nowrap="nowrap">$5,000</td> </tr> <tr><!-- 310 --> <td class="textCenter">2011</td> <td>CHEVROLET</td> <td>AVALANCH 4X4 CR</td> <td>LS</td> <td>GRAY</td> <td class="textCenter">C</td> <td class="textCenter">8</td> <td>E</td> <td class="textCenter">A</td> <td class="textCenter">4X4</td> <td class="textCenter">A</td> <td>CD</td> <td class="textCenter">HT</td> <td class="textCenter">C</td> <td class="textRight" nowrap="nowrap">64,759</td> <td class="textRight" nowrap="nowrap">$16,300</td> </tr> <tr><!-- 311 --> <td class="textCenter">2011</td> <td>CHEVROLET</td> <td>EQUINOX AWD 4C</td> <td>LT W/2LT</td> <td>BLACK</td> <td class="textCenter">S</td> <td class="textCenter">4</td> <td>GAS</td> <td class="textCenter">A</td> <td class="textCenter">AWD</td> <td class="textCenter">Y</td> <td>CD</td> <td class="textCenter">SR</td> <td class="textCenter">C</td> <td class="textRight" nowrap="nowrap">91,896</td> <td class="textRight" nowrap="nowrap">$4,400</td> </tr> <tr><!-- 312 --> <td class="textCenter">2011</td> <td>CHEVROLET</td> <td>TAHOE 4X4 V8</td> <td>LTZ</td> <td>WHITE</td> <td class="textCenter">S</td> <td class="textCenter">8</td> <td>C</td> <td class="textCenter">A</td> <td class="textCenter">4X4</td> <td class="textCenter">A</td> <td>N</td> <td class="textCenter">MR</td> <td class="textCenter">L</td> <td class="textRight" nowrap="nowrap">126,982</td> <td class="textRight" nowrap="nowrap">$17,800</td> </tr> <tr><!-- 313 --> <td class="textCenter">2011</td> <td>CHEVROLET</td> <td>1500 SLV 4X4 EX</td> <td>LT</td> <td>GRAY</td> <td class="textCenter">X</td> <td class="textCenter">8</td> <td>GAS</td> <td class="textCenter">O</td> <td class="textCenter">4X4</td> <td class="textCenter">A</td> <td>CD</td> <td class="textCenter">HT</td> <td class="textCenter">C</td> <td class="textRight" nowrap="nowrap">60,303</td> <td class="textRight" nowrap="nowrap">$18,100</td> </tr> <tr><!-- 314 --> <td class="textCenter">2011</td> <td>CHEVROLET</td> <td>1500 SLV 4X4 EX</td> <td>LT</td> <td>SILVER</td> <td class="textCenter">X</td> <td class="textCenter">8</td> <td>E</td> <td class="textCenter">O</td> <td class="textCenter">4X4</td> <td class="textCenter">A</td> <td>CD</td> <td class="textCenter">HT</td> <td class="textCenter">C</td> <td class="textRight" nowrap="nowrap">89,403</td> <td class="textRight" nowrap="nowrap">$15,900</td> </tr> <tr><!-- 315 --> <td class="textCenter">2011</td> <td>CHEVROLET</td> <td>1500 SLV 4X4 EX</td> <td>LTZ</td> <td>BLUE</td> <td class="textCenter">X</td> <td class="textCenter">8</td> <td>E</td> <td class="textCenter">A</td> <td class="textCenter">4X4</td> <td class="textCenter">A</td> <td>CD</td> <td class="textCenter">HT</td> <td class="textCenter">L</td> <td class="textRight" nowrap="nowrap">53,087</td> <td class="textRight" nowrap="nowrap">$17,700</td> </tr> <tr><!-- 316 --> <td class="textCenter">2011</td> <td>CHEVROLET</td> <td>3500 CUTAWAY</td> <td>WORK VAN</td> <td>WHITE</td> <td class="textCenter">S</td> <td class="textCenter"></td> <td></td> <td class="textCenter">A</td> <td class="textCenter">4X2</td> <td class="textCenter"></td> <td>N</td> <td class="textCenter">HT</td> <td class="textCenter">C</td> <td class="textRight" nowrap="nowrap">202,477</td> <td class="textRight" nowrap="nowrap">$2,700</td> </tr> <tr><!-- 317 --> <td class="textCenter">2011</td> <td>CHRYSLER</td> <td>TOWN &amp; COUNTRY</td> <td>TOURING</td> <td>BLACK</td> <td class="textCenter">4</td> <td class="textCenter">6</td> <td>E</td> <td class="textCenter">A</td> <td class="textCenter">4X2</td> <td class="textCenter">A</td> <td>CD</td> <td class="textCenter">HT</td> <td class="textCenter"></td> <td class="textRight" nowrap="nowrap">198,541</td> <td class="textRight" nowrap="nowrap">$1,900</td> </tr> <tr><!-- 318 --> <td class="textCenter">2011</td> <td>DODGE</td> <td>DURANGO AWD V6</td> <td>CREW</td> <td>BLUE</td> <td class="textCenter">S</td> <td class="textCenter">6</td> <td>GAS</td> <td class="textCenter">A</td> <td class="textCenter">AWD</td> <td class="textCenter">A</td> <td>CD</td> <td class="textCenter">SR</td> <td class="textCenter">C</td> <td class="textRight" nowrap="nowrap">176,036</td> <td class="textRight" nowrap="nowrap">$2,800</td> </tr> <tr><!-- 319 --> <td class="textCenter">2011</td> <td>FORD</td> <td>FOCUS</td> <td>SE</td> <td>SILVER</td> <td class="textCenter">4</td> <td class="textCenter">4</td> <td>GAS</td> <td class="textCenter">A</td> <td class="textCenter"></td> <td class="textCenter">Y</td> <td>CD</td> <td class="textCenter">HT</td> <td class="textCenter">C</td> <td class="textRight" nowrap="nowrap">101,929</td> <td class="textRight" nowrap="nowrap">$3,100</td> </tr> <tr><!-- 320 --> <td class="textCenter">2011</td> <td>FORD</td> <td>FUSION FWD 4C</td> <td>SEL</td> <td>WHITE</td> <td class="textCenter">4</td> <td class="textCenter">4</td> <td>GAS</td> <td class="textCenter">A</td> <td class="textCenter"></td> <td class="textCenter">Y</td> <td>CD</td> <td class="textCenter">SR</td> <td class="textCenter">L</td> <td class="textRight" nowrap="nowrap">78,290</td> <td class="textRight" nowrap="nowrap">$5,500</td> </tr> <tr><!-- 321 --> <td class="textCenter">2011</td> <td>FORD</td> <td>F150 4X4 CR</td> <td>XLT</td> <td>BLACK</td> <td class="textCenter">C</td> <td class="textCenter">8</td> <td>GAS</td> <td class="textCenter">A</td> <td class="textCenter">4X4</td> <td class="textCenter">Y</td> <td>CD</td> <td class="textCenter">HT</td> <td class="textCenter">C</td> <td class="textRight" nowrap="nowrap">70,909</td> <td class="textRight" nowrap="nowrap">$16,000</td> </tr> <tr><!-- 322 --> <td class="textCenter">2011</td> <td>FORD</td> <td>MUSTANG V6 CPE</td> <td>V6 PREMIUM</td> <td>BLACK</td> <td class="textCenter">2</td> <td class="textCenter">6</td> <td>GAS</td> <td class="textCenter">A</td> <td class="textCenter">4X2</td> <td class="textCenter">A</td> <td>CD</td> <td class="textCenter">HT</td> <td class="textCenter">L</td> <td class="textRight" nowrap="nowrap">92,531</td> <td class="textRight" nowrap="nowrap">$2,700</td> </tr> <tr><!-- 323 --> <td class="textCenter">2011</td> <td>GMC</td> <td>ACADIA FWD</td> <td>SLE</td> <td>RED</td> <td class="textCenter">4</td> <td class="textCenter">6</td> <td>GAS</td> <td class="textCenter">A</td> <td class="textCenter"></td> <td class="textCenter">A</td> <td>CD</td> <td class="textCenter">HT</td> <td class="textCenter">C</td> <td class="textRight" nowrap="nowrap">79,199</td> <td class="textRight" nowrap="nowrap">$10,700</td> A picture of the table test data is attached here:

      Here is the _query function, and all other relevant code that I can share.
       
      Func _query($aSel, $aUrls) $oIE = _login() If $oIE = "Return" Then Return EndIf $j = 0 While $j < UBound($aSel) - 1 $i = 1 $aucID ;Unable To Share What This Is Other Than Var Name. _IENavigate($oIE, "Something" & $aucID[0] & "Something") _IELoadWait($oIE, 100, 2000) $oObj = _IETableGetCollection($oIE, 3) $cars = _IETableWriteToArray_ProgressBar($oObj, True, "Processing Requested Information!") ;<---- Modified Version See Post For It: https://www.autoitscript.com/forum/topic/195335-solved-how-to-add-a-progress-bar-to-_ietablewritetoarray/?tab=comments#comment-1400699 $carsYear = _filter($cars, 0, 0, GUICtrlRead($year)) $carsMake = _filter($carsYear, 0, 1, GUICtrlRead($make)) Global $carsModel = _filter($carsMake, 0, 2, GUICtrlRead($model)) $i = 0 $engine = GUICtrlRead($engine) If $engine <> "" Then While $i < StringLen($engine) $carsEngine = _filter($carsModel, 0, 6 + $i, StringLeft($engine, 1)) ;_ArrayDisplay($carsModel, "Cars Model Before Array Delete") $x = 1 While $x <= UBound($carsModel) _ArrayDelete($carsModel, $x) $x += 1 WEnd ;_ArrayDisplay($carsModel, "Cars Model After Array Delete") ;_ArrayConcatenate($carsModel, $carsEngine) ;_ArrayDisplay($carsModel, "Cars Model After Concatenate") $engine = StringTrimLeft($engine, 1) $i += 1 WEnd Else Dim $carsEngine[1][16] EndIf _ArrayConcatenate($carsEngine, $carsModel) _ArrayDisplay($carsEngine, "Cars Engine") Dim $carsDriveTrain[1][16] Dim $carsDriveTrain2[1][16] $driveTrainVal = GUICtrlRead($driveTrain) If $driveTrainVal = "4x4" Or $driveTrainVal = "awd" Then $carsDriveTrain = _filter($carsEngine, 0, 9, "4") $carsDriveTrain2 = _filter($carsEngine, 0, 9, "a") ;~ _ArrayDisplay($carsDriveTrain, "Drive Train Before") ;~ If @error Then ;~ MsgBox("", "", "Cars Drive Train Error: " & @error) ;~ EndIf ;~ _ArrayDisplay($carsDriveTrain2, "Drive Train2 Before") ;~ If @error Then ;~ MsgBox("", "", "Cars Drive Train 2 Error: " & @error) ;~ EndIf _ArrayConcatenate($carsDriveTrain, $carsDriveTrain2) _ArrayDisplay($carsDriveTrain, "Drive Train After Concat") ElseIf $driveTrainVal = "" Then _ArrayConcatenate($carsDriveTrain, $carsEngine) Else $carsDriveTrain = _filter($carsEngine, 0, 9, $driveTrain) EndIf Dim $carsOdom[1][16] $min = GUICtrlRead($odomMin) $max = GUICtrlRead($odomMax) For $i = 0 To UBound($carsDriveTrain) - 1 If $carsDriveTrain[$i][14] > $min And $carsDriveTrain[$i][14] < $max Then _ArrayAdd($carsOdom, $carsDriveTrain[$i]) MsgBox("", "", "ADDED!") EndIf Next _ArrayDisplay($carsOdom, "Cars Odom") $j += 1 WEnd _IEQuit($oIE) EndFunc ;==>_query Func _filter($tofilter, $xpos1, $ypos1, $str) ;~ If UBound($tofilter, 1) <= 1 Then ;~ $endx = 0 ;~ Else ;~ $endx = UBound($tofilter, 1) - 1 ;~ EndIf ;~ $cars = _ArrayFindAll($tofilter, $str, $tofilter[$xpos1][$ypos1], $tofilter[$endx][$ypos1], 0, 1, $ypos1, False) $cars = _ArrayFindAll($tofilter, $str, Default, Default, 0, 1, $ypos1) Dim $carsFiltered[1][16] = [["a", "b", "c", "d", "e", "f", "g", "h", "i", "j", "k", "l", "m", "n", "o", "p"]] ;_ArrayDisplay($carsFiltered) $i = 0 $uBound = UBound($cars) - 1 While $i < $uBound $filtered = _ArrayExtract($tofilter, $cars[$i], $cars[$i], 0, 15) ;_ArrayDisplay($filtered, "_filter Array of Filtered") _ArrayConcatenate($carsFiltered, $filtered) $i += 1 WEnd _ArrayDelete($carsFiltered, 0) Return $carsFiltered EndFunc ;==>_filter  
      If you know of a more efficient way of doing this please let me know would be more than happy to chew down my inefficiency while learning! (It's like my grandpa used to say, "The only criticism I can't use is that which is not given to me.")
       
      The Item an I am using to test the filter is:

       
    • rm4453
      By rm4453
      Hello,
       
      I am currently writing a program that parses a massive table from a website, and need a way to add a progress bar while parsing.
      I am currently using the function _IETableWriteToArray($oObj, True) to parse the array. I need the progress bar to update as the table is parsed, not just at the end of the parsing.
      Any help at all would be very much appreciated!
       
      *EDIT --> The array I am left with after parsing is $array[0-50000][16]
    • TrashBoat
      By TrashBoat
      So Im trying to make a simple 2d game and make some sort of collision detection so why not to make a 2 dimensional array but i have no clue how  to write it in multiple lines
      Global $map[5,5] = [0,0,0,0,0 _ [0,0,0,0,0 _ [0,0,0,0,0 _ [0,0,0,0,0 _ [0,0,0,0,0] something like this but it doesn't work
    • Zein
      By Zein
      #include "..\Include\Array.au3" #include "..\Include\File.au3" #include "..\Include\AutoItConstants.au3" Local $aRetArray Local $sFilePath = "n.csv" _FileReadToArray($sFilePath, $aRetArray, ",") ; _FileReadToArray($sFilePath, $aRetArray, $FRTA_COUNT, ",") _ArrayDisplay($aRetArray, "Original", Default, 8) The above code shows two versions of _FileReadToArray and both don't work as expected.
      The first one doesn't use the comma as a delimiter. (so I get a single column array)  I tried adding "Default" between $aRetArray and "," then it told me it had an incorrect number of parameters. 

      I looked again at the documentation:
       
      #include <File.au3> _FileReadToArray ( $sFilePath, ByRef $vReturn [, $iFlags = $FRTA_COUNT [, $sDelimiter = ""]] )
      And I with or without the flags params I should be getting a 2D array due to my file being a csv. 
      I then tried a regular flag, $FRTA_COUNT, and it tells me that I'm using a variable $FRTA_COUNT while it's not declared. Tried putting in 1 instead and it told me again, incorrect number of params. 

       
    • ternal
      By ternal
      Hi,
      Recently I have had the need to do a sort and then do a second sort while the item of the first sort stays the same ( double sorting , first on column x then while column x is the same sort column y).
      I did not put much efffort into error checking but so far I did not need it.
      For my applications so far it works perfectly however if someone is willing I want to test this extensivly.
      If anyone has big lists of random stuff to sort could you try this out please?
      #include <Array.au3> ; #FUNCTION# ==================================================================================================================== ; Name ..........: _ArraySort_Double ; Description ...: ; Syntax ........: _ArraySort_Double (Byref $array[, $first_index = Default[, $second_index = Default[, $ascending = Default]]]) ; Parameters ....: $array - 2d array to sort. ; $first_index - [optional] first column to sort. Default is 0. ; $second_index - [optional] second column to sort. Default is 1. ; $ascending - [optional] ascending/descending. Default is 1. ; Return values .: 1 if no errors occured , -1 if errors occured ; Author ........: Ternal ; Remarks .......: Needs excessive testing. ; Related .......: _arraysort() ; =============================================================================================================================== Func _ArraySort_Double (byref $array, $first_index = Default, $second_index = Default, $ascending = Default) Local $temp_value Local $counter = 1 If UBound($array, $UBOUND_DIMENSIONS) <> 2 Then MsgBox(0, "error", "error") return -1 EndIf If $first_index = Default Then $first_index = 0 If $second_index = Default Then $second_index = 1 If $ascending = Default Then $ascending = 1 _ArraySort($array, $ascending, 0, 0, $first_index); you can alter settings of primary sort here If @error Then MsgBox(0, "error", @error) return -1 EndIf $temp_value = $array[0][$first_index] For $x = 1 to UBound($array, 1) - 1 If Mod( $x, 10000) = 0 Then ConsoleWrite("at " & $x & " of a total : " & UBound($array, 1) & @CRLF) If $array[$x][$first_index] = $temp_value Then $counter+= 1 If $x = UBound($array, 1) - 1 Then; do last line here(if last line is not a new item) _ArraySort($array, $ascending, $x - $counter, $x, $second_index);you can alter settings of secondary sort here(don't forget to place line 34 the exact same) If @error Then MsgBox(0, "error", @error) return -1 EndIf EndIf Else If $counter > 0 Then ;at least 2 of the same _ArraySort($array, $ascending, $x - $counter, $x - 1, $second_index);you can alter settings of secondary sort here(don't forget to place line 29 the exact same) If @error Then MsgBox(0, "error", @error) return -1 EndIf $counter = 1 EndIf EndIf $temp_value = $array[$x][$first_index] Next Return 1 EndFunc Kind regards, Ternal
×