Get all files - no matter how deep

[nitekram]

I am looking to get a list of files via *.doc or *.xls or what ever extension and doing something with each file. I can figure out the doing part - its the finding part. I know I have seen this before and looked into Smoke-N's UDF for listing to array, but it only shows the main directory and the folders, but not the files inside those folders. Should I parse out the name of the folders and do it on each folder and then continue again for the next set of folders - is there a better way (faster)?

Is there or has anyone wrote, a script that will find all files in a directory or a drive? Maybe I missed something, it is Monday.

[BigDod]

Does This help

[SmOke_N]

http://www.autoitscript.com/forum/index.ph...st&p=267097

[nitekram]

Does This help

That works great - cannot believe that it was written in 2004. Any chance that it will be added to a future version (beta)?

[SmOke_N]

That works great - cannot believe that it was written in 2004. Any chance that it will be added to a future version (beta)?

I noticed you said you looked at mine... do $iRecurse = 1 or True

[nitekram]

I noticed you said you looked at mine... do $iRecurse = 1 or True

I looked at this

http://www.autoitscript.com/forum/index.ph...ind++all++files

I do not see the flag for Recurse - am I looking at the wrong one?

[SmOke_N]

I looked at this

http://www.autoitscript.com/forum/index.ph...ind++all++files

I do not see the flag for Recurse - am I looking at the wrong one?

Yes, I gave you the link to the right one here:

http://www.autoitscript.com/forum/index.ph...st&p=267097

Up above.

[nitekram]

I looked at this

http://www.autoitscript.com/forum/index.ph...ind++all++files

I do not see the flag for Recurse - am I looking at the wrong one?

@smoke_n

It looks like your UDF (the one above) does not include the recurse, but the link you posted does.

EDIT - Sorry should have waited 30 mor seconds and you would have answered

Edited November 27, 2006 by nitekram

[nitekram]

OK now I am at a loss - your defintion is for 5 flags, but your calling it with 6 flags.

I have removed the last one

_FileListToArrayEx($file, '*.mp3;*.wav', 0, '', False, True)

and made it this, but only exits not showing anything.

_FileListToArrayEx($file, '*.mp3;*.wav', 0, '', True)

EDIT - working now - thanks

Edited November 27, 2006 by nitekram

[nitekram]

smoke_n

Have a problem with a file that will not work - 67 works fine but 68 does not - I have excluded ~* (so anything that starts with the ~ will be skipped as the program hangs

48 U:\Sales\Proposals&Spreadsheets\Brent\APCI\Laporte\Laporte I & E reader add move proposal 101606 rev 1.doc

67 U:\Sales\Proposals&Spreadsheets\Brent\Lock Proposals\Sommerset Westfield Building access 041906.doc

68 U:\Sales\Proposals&Spreadsheets\Brent\Lock Proposals\Sommerset Westfield Building access proposal 041906.doc

F:\find_them_all_with_recurse.au3 (152) : ==> The requested action with this object has failed.: 
$objFile.SummaryProperties.Company = $string 
$objFile.SummaryProperties.Company = $string^ ERROR

Do you have any idea what could be wrong - long name? 48 works and it is only 2 chars less

[sshrum]

Personnally, I like my function as it runs faster on large sets and is more robust as it uses the DOS DIR cmd and all it's arguments:

Func _FileSearch($sQuery, $iSubdir=0)
    $iLine = 0
    $sLine = ""
    $aLine = ""
    Dim $aFiles[100000]
    $aFiles[0] = 0
    $sArguments = "/a-d /b /on"
    If $iSubDir Then $sArguments = $sArguments & " /s"
    $sQuery = StringReplace($sQuery, ":\\", ":\")
    $aRaw = Run(@ComSpec & ' /c dir "' & $sQuery & '" ' & $sArguments, @SystemDir, @SW_HIDE, $STDOUT_CHILD)
    While 1
        $sLine = StdoutRead($aRaw)
        If @error Then ExitLoop
        $aLine = StringSplit($SLine, @CRLF)
        If $aLine[0] > 1 Then
            For $i = 1 To $aLine[0] - 1
                If $aLine[$i] = "" Then Continueloop
                $iLine = $iLine + 1
                $aFiles[$iLine] = $aLine[$i]
            Next
        ElseIf $aLine[0] = 1 Then
            If $aLine[1] = "" Then Continueloop
            If $aLine[1] = "File Not Found" Then Exitloop
            $iLine = $iLine + 1
            $aFiles[$iLine] = $sLine
        Else
            ExitLoop
        EndIf
    Wend
    $aFiles[0] = $iLine
    ReDim $aFiles[$iLine + 1]
    Return $aFiles
EndFunc

Edited November 28, 2006 by sshrum

[SmOke_N]

Personnally, I like my function as it runs faster on large sets and is more robust as it uses the DOS DIR cmd and all it's arguments:

Func _FileSearch($sQuery, $iSubdir=0)
    $iLine = 0
    $sLine = ""
    $aLine = ""
    Dim $aFiles[100000]
    $aFiles[0] = 0
    $sArguments = "/a-d /b /on"
    If $iSubDir Then $sArguments = $sArguments & " /s"
    $sQuery = StringReplace($sQuery, ":\\", ":\")
    $aRaw = Run(@ComSpec & ' /c dir "' & $sQuery & '" ' & $sArguments, @SystemDir, @SW_HIDE, $STDOUT_CHILD)
    While 1
        $sLine = StdoutRead($aRaw)
        If @error Then ExitLoop
        $aLine = StringSplit($SLine, @CRLF)
        If $aLine[0] > 1 Then
            For $i = 1 To $aLine[0] - 1
                If $aLine[$i] = "" Then Continueloop
                $iLine = $iLine + 1
                $aFiles[$iLine] = $aLine[$i]
            Next
        ElseIf $aLine[0] = 1 Then
            If $aLine[1] = "" Then Continueloop
            If $aLine[1] = "File Not Found" Then Exitloop
            $iLine = $iLine + 1
            $aFiles[$iLine] = $sLine
        Else
            ExitLoop
        EndIf
    Wend
    $aFiles[0] = $iLine
    ReDim $aFiles[$iLine + 1]
    Return $aFiles
EndFunc

Hmm, how does that run faster and give you more options? You can only search one file type, and then you have to parse through each at a time... think you had better check you speed times again, yours was almost 3 times slower with all the initial parsing you do.

[nitekram]

Hmm, how does that run faster and give you more options? You can only search one file type, and then you have to parse through each at a time... think you had better check you speed times again, yours was almost 3 times slower with all the initial parsing you do.

It does not matter - without the ability to skip files that start with ~ - the script fails on file number 15.

Smoke_n - do you have a clue as to what I (I is really you) need to do to fix this - or is it on my side.

I have had issues with my first attempt with this with hidden files and files that start with ~ as they are either temp files or and this is taking a guess - in use. But I was not using your script - I was gathering the files with FileOpenDialog and selecting them by hand - takes way to long.

[nitekram]

It does not matter - without the ability to skip files that start with ~ - the script fails on file number 15.

Smoke_n - do you have a clue as to what I (I is really you) need to do to fix this - or is it on my side.

I have had issues with my first attempt with this with hidden files and files that start with ~ as they are either temp files or and this is taking a guess - in use. But I was not using your script - I was gathering the files with FileOpenDialog and selecting them by hand - takes way to long.

I was able to check out the file in question and sure enough it is a hidden file.

[sshrum]

Hmm, how does that run faster and give you more options? You can only search one file type, and then you have to parse through each at a time... think you had better check you speed times again, yours was almost 3 times slower with all the initial parsing you do.

My results were based on large returns (1000+ files). I found that Larrys function would take more than 15 seconds whereas mine took <1. On a return of over 23,000 files, Larry's function took over 2 minutes while mine was about 5 secs.

As for options, my function can use any of the DIR arguments for customizing the return. Type 'DIR /?' in a DOS shell for a list.

[Guest JRowe_1]

I'm sitting at about 10 minutes or so into the process, waiting to see if my list of 18 GB worth of files is valid or not

[nitekram]

Yes, I gave you the link to the right one here:

http://www.autoitscript.com/forum/index.ph...st&p=267097

Up above.

SmOke_N

Have another question - If I just wanted to put a drive letter in for the $sPath what is the syntax - I have tried 'X:\', 'X:\*', 'X:\*.*' - what am I doing wrong or do you have to have at least a folder under the drive to start the search?

[GEOSoft]

Yes, I gave you the link to the right one here:

http://www.autoitscript.com/forum/index.ph...st&p=267097

Up above.

_FileListToArrayEx is a nice UDF

I've been playing with the older _FileListToArray and I have recursion working but it's much slower than this version. The other change I made to it was to add 1 more param.

$iOpt =0 (default) Returns file name only

$iOpt = 1 Returns full path\filename.

You migt want to take a look at adding it

BTW is this version going to be added to the standard UDF's? It should be.

[nitekram]

_FileListToArrayEx is a nice UDF

I've been playing with the older _FileListToArray and I have recursion working but it's much slower than this version. The other change I made to it was to add 1 more param.

$iOpt =0 (default) Returns file name only

$iOpt = 1 Returns full path\filename.

You migt want to take a look at adding it

BTW is this version going to be added to the standard UDF's? It should be.

Since nobody replied - I knew I must have been a dump $hit again and looked at the code once more - well a little more than once. Anyway I found out what I was doing wrong - when I pick the directory you add a trailing '\' to the string. Sorry for not understanding the code.