Find, Sort, Filter, Mask big ACII Files

[TomTom]

Hi,

I have to sort , filter and display the results in listview box.

The problem I will face, I will have a lot off (more then 2500 )ASCII Text file with can be have a size more the 30 MByte each.

Do anybody have done some job with AutoIt ?

If yes, please can you help me ?

Thanks

Tom

[Xenobiologist]

Hi,

never done that job with such an amount of huge files, but it should work. Maybe it could last a long long time.

Give it a try.

So long,

Mega

[Uten]

Provide some data samples and you might get supriced

[ptrex]

@TomTom

Look in my signature for "GuiListView - Navigation"

Tested with +250.000 records !!

This might help you out.

Regards

Edited June 20, 2006 by ptrex

[AMiSM]

I did a gui which entered data into a toolbar. I had to extract coordinates of a ton of cities at FallingRain.com from HTML into data files. I ended up compiling hash tables in separate files with which to populate drop down boxes, with thousands of cities in each list. It was quick. There was no lag between the event that determined the list to populate with and the completion of the population event.

[randallc]

Hi,

In the function in "Autoit3Ex.au3" [see my sig] , called"Func DirToList($szPath)", I made a dos file which could be huge; the rest of the func retrieved parts of that for display; filtering could be added; limit the display to the number you want, and scroll;

Not as pretty as @ptrex, but simple; uses "DOS findstr" so its as fast as anything else, I think;

(Sorting fast could be added if required using "_GUIlistView.au3 from my sig too")

best, Randall

[AMiSM]

Yes, Loading only part of the data you are working with at any one time is crucial. I do alot of raw data processing. I've made the mistake many times of loading 100MB files in one shot, and the thing freezes up. I've frequently resorted to opening a file, then reading and evaluating each line one at a time, using the same variable for the current line loaded.