Polling a dir with 30,000+ files

[sshrum]

I'm using the _FileSearch function(and t works great for sub 1,000 file searches) I got from someone here and find that pulling this list takes FOREVER to poll a folder of 30,000+ files!

A DOS dir /b /o command takes like 20-30 seconds.

Is there a way to make the DOS dir call and harvest the output?

TIA

BTW: AutoIT really should have some sort of built-in higher level FileDir function (in addition to the filefind options) (IMHO)

Edited August 29, 2006 by sshrum

[sshrum]

Opps...STDOUT. I should look first before I post.

[trids]

I haven't tried StdOut yet .. but you can also re-route the output of the DIR command to a file which you can then interrogate ..

DIR /B/O>c:\Files.txt

[SmOke_N]

Are you using this one.. I use several different versions like this for different things because of the speed?

http://www.autoitscript.com/forum/index.ph...c=16421&hl=

[trids]

That kind of thing, yes

The DOS DIR command is very useful (and fast) .. here are some more links..

• iterating subfolders for size .. or just for the filenames, a common requirement.
• ordered file list .. also easily switched to recusion with "/s" parameter

[SmOke_N]

Those are great (and old )!!!

[trids]

LOL .. there are quite a few old things that are great

The best part is that AU3 allows you to leverage all sorts of great things from outside too.

[sshrum]

This is what I came up with on my own last night. It's a ton faster then the old _FileSearch()!

Uses STDOUT (no file writting/parsing like the other one you mentioned), took 14 seconds to return a listing of ~19,000 files versus ~3+ minutes the old way.

This can be used to replace your _FileSearch() and _FileSearchUtil(). Uses the same function syntax.

Func _FileSearch($sQuery, $bSubdir=0)
    $iLine = 0
    $sLine = ""
    $aLine = ""
    Dim $aFiles[100000];just a big number, we'll redim later
    $sArguments = "/a-d /b /on";filenames, not folders
    If $bSubdir = 1 Then $sArguments = $sArguments & " /s"
    $aRaw = Run(@ComSpec & " /c dir " & $sQuery & " " & $sArguments, @SystemDir, @SW_HIDE, 2)
    While 1
        $sLine = StdoutRead($aRaw)
        If @error Then ExitLoop
        $aLine = StringSplit($SLine, @CRLF)
        If $aLine[0] > 1 Then 
            For $i = 1 To $aLine[0]
                If $aLine[$i] = "" Then Continueloop
                $iLine = $iLine + 1
                $aFiles[$iLine] = $aLine[$i]
            Next
        Else
            $iLine = $iLine + 1
            $aFiles[$iLine] = $sLine
        EndIf
    Wend
    $aFiles[0] = $iLine
    ReDim $aFiles[$iLine + 1]
    Return $aFiles
EndFunc

Work's for me! Enjoy!

[Valuater]

did you try this one... filelisttoarray()

#Include <File.au3>
#Include <Array.au3>
$FileList=_FileListToArray(@DesktopDir, 1)
If (Not IsArray($FileList)) and (@Error=1) Then
    MsgBox (0,"","No Files\Folders Found.")
    Exit
EndIf
_ArrayDisplay($FileList,"$FileList")

8)

[Valuater]

actually, this uses both dir in dos and filelisttoarray

advanced file manager

http://www.autoitscript.com/forum/index.ph...=20459&hl=#

8)

Edited August 29, 2006 by Valuater

[sshrum]

No...I didn't know about that!

Was just starting to create a File UDF too.

Gunna check it out now!

Thanx

[sshrum]

Hey valuater...I noticed that the STDOUT in AutoIT munges accented characters (I have another thread on this). I'll assume the FileListToArray will do the same thing as it uses the same sort of call. Any way to correct this?

Edited August 29, 2006 by sshrum