How to parse faster?

[BlueScreen]

Hi,

I would like to know if there is a way to speed up a parsing action of a text file (it takes me long long time to parse around 100000 lines)

Here is my simple script:

$LineNum=1

$file=FileOpen("c:\blabla.txt",0)

While 1

$Line=FileReadLine($file,$LineNum)

$x=StringMid($line,10,4)

If $x="xyz" Then exit

$LineNum=$LineNum+1

ToolTip($LineNum,0,0)

Wend

Thanks!!

[/dev/null]

_FileReadToArray()

Cheers

Kurt

[dabus]

Do as example says:

$file = FileOpen("test.txt", 0)

; Check if file opened for reading OK
If $file = -1 Then
    MsgBox(0, "Error", "Unable to open file.")
    Exit
EndIf

; Read in lines of text until the EOF is reached
While 1
    $line = FileReadLine($file)
    If @error = -1 Then ExitLoop
    MsgBox(0, "Line read:", $line)
Wend

FileClose($file)

since a FileReadLine($file, $line) causes the $file to be read from beginning.

Example just jumps to the next line.

[/dev/null]

Do as example says:

since a FileReadLine($file, $line) causes the $file to be read from beginning.

Example just jumps to the next line.

That won't be any faster. _FileReadToArray() speeds up file processing quite a lot.

Cheers

Kurt

[BlueScreen]

Thanks!

Its works a lot faster with _FileReadToArray...

[peethebee]

Hi!

The best solution would be pure C++, I think...

peethebee

[/dev/null]

Hi!

The best solution would be pure C++, I think...

peethebee

Sure, Assembly would be even faster, but then this would be the wrong forum to ask for help....

Cheers

Kurt

[seandisanti]

Hi,

I would like to know if there is a way to speed up a parsing action of a text file (it takes me long long time to parse around 100000 lines)

Here is my simple script:

$LineNum=1

$file=FileOpen("c:\blabla.txt",0)

While 1

$Line=FileReadLine($file,$LineNum)

$x=StringMid($line,10,4)

If $x="xyz" Then exit

$LineNum=$LineNum+1

ToolTip($LineNum,0,0)

Wend

Thanks!!

2 things.... first, when would a 4 character string equal "xyz" ? second... another thing you may try, which sped up my commanator (turns a file into csv file) alot would be to read the file in and then put to an array by using stringsplit(). it does pretty much the same thing as the _filereadtoarray(), just another way to skin the cat. here's my revised commanator code for example. if you wanted to compare speed of the two methods, you could add a TimerInit() and TimerDiff() to each of the codes and run for the same data, i'd be kind of interested to see if i shouldn't change my code to make use of _FileReadToArray()

FileDelete("C:\output.txt")
dim $contents
$blah = FileRead("C:\sourceo.txt",filegetsize("C:\sourceo.txt"))
$output = FileOpen("C:\output.txt",1)
$contents = StringSplit($blah,@CRLF)
for $z = 1 to $contents[0]
$line = $contents[$z]
$newline = ""
        for $x = 1 to StringLen($line)
            $achar = StringMid($line,$x,1)
            if $achar = " " Then
                if StringRight($newline,1) = "," Then 
                    ContinueLoop
                Else
                    $newline = $newline & ","
                EndIf
            Else
                $newline = $newline & $achar
            EndIf
        Next
if StringLen($newline) then FileWriteLine($output,$newline)
Next
FileClose($output)

[flyingboz]

http://www.autoitscript.com/forum/index.ph...ndpost&p=116649