Jump to content
HardXOR

Optimize/speedup code for texture decoding - (Moved)

Recommended Posts

HardXOR

Hello AutoIt community

I run into speed problem in my script wich i cant solve myself, problem is with decoding texture loop - for better explanation, you need extract from file pallete (16x 16 RGB color) and picture data (224 * 128 byte), then use correct color for your picture data.... nothing extra hard and also texture is quite small 224*256

it is for my car model viewer/later maybe editor GranTurismo 2 from Playstation 1, so its old dataformat and i cant understand why AutoIt take so long to decode texture when good old Playstation almost 2,5 decades old can do that nearly immediately (when you list through cars in shop or garage)

My first atempt was create all trought dllstructure, because its easier approach, but it was soooo slow (40-50s for create textures) then i upgrade my routine via arrays, first 3D arrays later only 1D, next i put decoding colors outside loop but it is still not enough, my last version took cca 15s wich is still unacceptable for car model viewer when you click on one carmodel from listview (1100 cars for whole game) and you must wait 15-16s for model to load.... :( oh and i forgot mention some cars have more then 1 color (much more... 8-9-10 etc) soloading take 8-9-10 times more time

in attachment i post texture file from GranTurismo 2 for one car (contain only 1 color) and also my dll struct version and array version code

dll struct version - ± 40 sec (33 without saving)

#include <FileConstants.au3>

Global $IMDT[256][256][4]

LoadTexture("ufs9r.cdp")

Func LoadTexture($file)
    $fileHandle = FileOpen($file, $FO_BINARY)

    $header = FileRead($fileHandle, 0x20)
    ConsoleWrite("header> " & $header & @CRLF)
    $PAL = FileRead($fileHandle, 0x200)
    ConsoleWrite("PAL> " & $PAL & @CRLF)
    FileSetPos($fileHandle, 0x43A0, $FILE_BEGIN)
    $IMD = FileRead($fileHandle, 0x7000)
    ConsoleWrite("IMD> " & $IMD & @CRLF)

    $st = DllStructCreate("BYTE[512]")
    DllStructSetData($st, 1, $PAL)
    $struct_PAL = DllStructCreate("WORD[16];WORD[16];WORD[16];WORD[16];WORD[16];WORD[16];WORD[16];WORD[16];WORD[16];WORD[16];WORD[16];WORD[16];WORD[16];WORD[16];WORD[16];WORD[16]", DllStructGetPtr($st))

    $struct_IMD = DllStructCreate("BYTE[" & 0x7000 & "]")
    DllStructSetData($struct_IMD, 1, $IMD)


    $start = TimerInit()
    For $i = 0 To 15
        For $j = 0 To 223
            $cn = 0
            For $k = 0 To 127
                $bt = DllStructGetData($struct_IMD, 1, $j * 128 + $k + 1)

                $blue = BitShift(DllStructGetData($struct_PAL, $i + 1, BitAND($bt, 0x0F) + 1), 7)
                $IMDT[$j][$cn][0] = $blue
                $green = BitShift(DllStructGetData($struct_PAL, $i + 1, BitAND($bt, 0x0F) + 1), 2)
                $IMDT[$j][$cn][1] = $green
                $red = BitShift(DllStructGetData($struct_PAL, $i + 1, BitAND($bt, 0x0F) + 1), - 3)
                $IMDT[$j][$cn][2] = $red

                If DllStructGetData($struct_PAL, $i + 1, BitAND($bt, 0x0F) + 1) = 0 Then
                    $IMDT[$j][$cn][3] = 0x00
                Else
                    $IMDT[$j][$cn][3] = 0xFF
                EndIf

                $cn += 1

                $blue = BitShift(DllStructGetData($struct_PAL, $i + 1, BitShift($bt, 4) + 1), 7)
                $IMDT[$j][$cn][0] = $blue
                $green = BitShift(DllStructGetData($struct_PAL, $i + 1, BitShift($bt, 4) + 1), 2)
                $IMDT[$j][$cn][1] = $green
                $red = BitAND(BitShift(DllStructGetData($struct_PAL, $i + 1, BitShift($bt, 4) + 1), - 3), 0xFF)
                $IMDT[$j][$cn][2] = $red

                If DllStructGetData($struct_PAL, $i + 1, BitShift($bt, 4) + 1) = 0 Then
                    $IMDT[$j][$cn][3] = 0x00
                Else
                    $IMDT[$j][$cn][3] = 0xFF
                EndIf

                $cn += 1
            Next
        Next
        saveTGA($i)
    Next
    ConsoleWrite("t " & TimerDiff($start) & @CRLF) ; +- 40 seconds

    FileClose($fileHandle)
EndFunc

Func saveTGA($name)
    Local $tga[18] = [0x00, 0x00, 0x02, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, 0x01, 0x00, 0x01, 0x20, 0x20]
    Local $data
    for $i = 0 To 17
        $data &= Hex($tga[$i], 2)
    Next
    For $i = 0 To 255
        For $j = 0 To 255
            For $k = 0 To 3
                $data &= hex($IMDT[$i][$j][$k], 2)
            Next
        Next
    Next
    $binary = FileOpen("test\" & $name & ".tga", BitOR($FO_BINARY, $FO_OVERWRITE, $FO_CREATEPATH))
    FileWrite($binary, "0x" & $data)
    FileClose($binary)
EndFunc

 

array version - ± 15 sec (under 10s without saving)

#include <FileConstants.au3>

LoadTexture2("ufs9r.cdp")

Func LoadTexture2($file)
    $fileHandle = FileOpen($file, $FO_BINARY)

$a = TimerInit()
    Global $header[0x20]
    For $i = 0 To UBound($header) - 1
        $header[$i] = Int(String(FileRead($fileHandle, 1))) ; read 0x20 bytes
    Next
ConsoleWrite("header " & TimerDiff($a) & @CRLF)

$a = TimerInit()
    Global $PAL[0x100]
    For $i = 0 To UBound($PAL) - 1
        $PAL[$i] = Number(FileRead($fileHandle, 2)) ; read 0x200 (16*16) words
    Next

    Global $PALcolor[16 * 16 * 4]
    For $i = 0 To UBound($PAL) - 1
        $PALcolor[$i * 4 + 0] = BitShift($PAL[$i], 7)
        $PALcolor[$i * 4 + 1] = BitShift($PAL[$i], 2)
        $PALcolor[$i * 4 + 2] = BitShift($PAL[$i], -3)
        If $PAL[$i] = 0 Then
            $PALcolor[$i * 4 + 3] = 0x00
        Else
            $PALcolor[$i * 4 + 3] = 0xFF
        EndIf
    Next


ConsoleWrite("PAL " & TimerDiff($a) & @CRLF)

$a = TimerInit()
    FileSetPos($fileHandle, 0x43A0, $FILE_BEGIN)
    Global $IMD[0x7000]
    For $i = 0 To UBound($IMD) - 1
        $IMD[$i] = Int(String(FileRead($fileHandle, 1))) ; read 0x7000 bytes
    Next
ConsoleWrite("IMD " & TimerDiff($a) & @CRLF)

Global $IMDT[256*256*4]

$a = TimerInit()
    For $i = 0 To 15
        For $j = 0 To 223
            $cn = 0
            For $k = 0 To 127
                $byte = $IMD[$j * 128 + $k] ; byte for decode

                $index = $j * 1024 + $cn * 4
                $index2 = $i * 0x40 + BitAND($byte, 0x0F) * 4
                $IMDT[$index + 0] = $PALcolor[$index2 + 0] ; blue
                $IMDT[$index + 1] = $PALcolor[$index2 + 1] ; green
                $IMDT[$index + 2] = $PALcolor[$index2 + 2] ; red
                $IMDT[$index + 3] = $PALcolor[$index2 + 3] ; alpha
                $cn += 1

                $index = $j * 1024 + $cn * 4
                $index2 = $i * 0x40 + BitShift($byte, 4) * 4
                $IMDT[$index + 0] = $PALcolor[$index2 + 0] ; blue
                $IMDT[$index + 1] = $PALcolor[$index2 + 1] ; green
                $IMDT[$index + 2] = $PALcolor[$index2 + 2] ; red
                $IMDT[$index + 3] = $PALcolor[$index2 + 3] ; alpha
                $cn += 1
            Next
        Next
;~      $b = TimerInit()
        saveTGA2($i)
;~      ConsoleWrite("save TGA " & TimerDiff($b) & @CRLF)
    Next

ConsoleWrite("full time " & TimerDiff($a) & @CRLF) ; 16 seconds


    FileClose($fileHandle)
EndFunc

Func saveTGA2($name)
    Local $tga[18] = [0x00, 0x00, 0x02, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, 0x01, 0x00, 0x01, 0x20, 0x20]
    Local $data

    For $i = 0 To 17
        $data &= Hex($tga[$i], 2)
    Next
    For $i = 0 To UBound($IMDT) - 1
        $data &= Hex($IMDT[$i], 2)
    Next

    $binary = FileOpen("test\" & $name & ".tga", BitOR($FO_BINARY, $FO_OVERWRITE, $FO_CREATEPATH))
    FileWrite($binary, "0x" & $data)
    FileClose($binary)
EndFunc

if anyone can optimize my code I would be very grateful, or pointing me to better solution, thx

ufs9r.cdp

Share this post


Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now

  • Similar Content

    • Skeletor
      By Skeletor
      Hi Virtual People,
      My array works perfectly fine. However, what is the best practice if the line in the array doesn't have the correct amount of columns and if I can add a placeholder?

       
      For $count = 1 To _FileCountLines($FileRead1) Step 1 $string = FileReadLine($FileRead1, $count) $input = StringSplit($string, ",", 1) $value1 = $input[1] $value2 = $input[2] $value3 = $input[3] _Excel_RangeWrite($oWorkbook, $oWorkbook.Activesheet, $value2, "A1") _Excel_RangeWrite($oWorkbook, $oWorkbook.Activesheet, $value1, "B1") _Excel_RangeWrite($oWorkbook, $oWorkbook.Activesheet, $value3, "C1") Next  
    • MrCheese
      By MrCheese
      hi all,
      reviewing the forum, this thread is applicable: 
       
       
      I wanted to know if there is now a better way to do this?
      In essence, I load a tab delimited txt file into an array (works well). I used tab, as some fields in the original csv contains commas.
      However, I needed autoit to manipulate this array, and output it as a csv.
      IF my array contains items with a comma, without double quotes around the field, then how best do I get a csv out of this?
      My current workaround is to filewritefromarray tab delimited, then open it in excel and save as a csv. I will need to check this to see how the address fields behave that contain a comma.
       
      Any thoughts would be appreciated.
       
    • faustf
      By faustf
      hi guys how is possible set a speed of  all function _Ie ?? 
    • Skeletor
      By Skeletor
      Hi All,

      I would like to know how you would take a FileLineRead and insert it into an array which then inserts it into Excel?
      One thing to know is the files content is broken up, so I only use half of the content within $FileRead1.
      So its imperative that the $value1, $value2, etc variables be used. 
      Code below:
      $FileRead1 = FileReadLine("C:\temp\sample.txt",1) For $count = 1 To _FileCountLines($FileRead1) Step 1 $string = FileReadLine($FileRead1, $count) $input = StringSplit($string, ",", 1) $value1 = $input[1] $value2 = $input[2] $value3 = $input[3] $value4 = $input[4] _Excel_RangeWrite($oWorkbook, $oWorkbook.Activesheet, $value1, "A1") _Excel_RangeWrite($oWorkbook, $oWorkbook.Activesheet, $value2, "B1") _Excel_RangeWrite($oWorkbook, $oWorkbook.Activesheet, $value3, "C1") _Excel_RangeWrite($oWorkbook, $oWorkbook.Activesheet, $value4, "D1") Next  
    • AnonymousX
      By AnonymousX
      Hello,
      I'm trying to write a script that moves copies excel cells into an array. I'll than manipulate the values and send array into another program. 
      I don't want range to be specific to a workbook, or sheet, or set of cells.
      I want user to be able to highlight desired cells and to copy either normally ("Ctrl+C") or by a hotkey ("Alt+C"). 
      Could someone help me with this?
      Thank you,
      I've tried to write the framework: (edited)
      #include <MsgBoxConstants.au3> #include <Array.au3> #include <Excel.au3> HotKeySet("!v", "Pastedata") While True Sleep(1000) WEnd func Makearray() local $bArray ;User has cells already copied ;Convert clipboard into an array ;I don;t know how excel stores data to clipboard so don;t know how to bring it into array _Arraydisplay($bArray) MsgBox(0,0,$bArray) return $bArray endfunc func Pastedata() Local $aArray MsgBox(0,0,"wait",1) ;make array based on assumption user has already copied a range to clipboard $aArray = Makearray() ;paste code ;don;t worry about this I got the rest endfunc  
×