File System, Array, or Something Else?!?

[Kickassjoe]

I am currently faced with the problem of speed. I need to sort through a 3743 line text file every 3 seconds or so... but when a piece of information being searched for is at the end of the text file, it often takes more than 10 seconds, sometimes almost 20. Should I put the text file into an array when I load the script, would that make it any faster? Or is there another way that I could make searching through a large text file faster?

[rasim]

Hi! Works with large text file used arrays not a good idea. See aside sed, gsar, egrep utilites.

Edited February 23, 2008 by rasim

[randallc]

I am currently faced with the problem of speed. I need to sort through a 3743 line text file every 3 seconds or so... but when a piece of information being searched for is at the end of the text file, it often takes more than 10 seconds, sometimes almost 20. Should I put the text file into an array when I load the script, would that make it any faster? Or is there another way that I could make searching through a large text file faster?

Hi,

if you know it is at the end, load, say the last 10 or 100 linnes or whatever only; use "TailRW" link from my signature;

if it can be anywhere in the file, , then you are stuck..

Best, randall