Search in files extract needed

[6105]

Hi Guys,

i have 1 question,

i want to write some script to search the ProductID in one folder, with ~4000 html files,

in every file is some ProductID on line 255, and also some Picture on line 315,

I have all products ID, need Picture names, with what comands i will can do this functions?

Thank you!

Best Regards,

Toader.

[Melba23]

toader,

As you know the line numbers involved, FileReadLine would seem to be a good place to start.

- Get the file names into an array using _FileListToArray.

- Loop through the files and read lines 255 and 315 from each one.

- Store the results somewhere and do what you need with them after you finish the loop.

M23

[6105]

wow.. thank you so mutch) is real needed comands)

but, how i will can cut unneeded information from the string?

String = <input name="productID" value="2555" />

newstring = 2555

Thank you, so mutch!

[Melba23]

toader,

Dog eaten your Help file?

If the structure of the line is always the same, then _StringBetween should do the job nicely, as long as you use long enough specifiers. Otherwise you could write your own SRE ... but that might be for another day.

M23

[6105]

thank you, i will try to understand this function, now i does something like it and not work:

Dim $file=c:\test.ini
$line=FileReadLine($file,255)
$s_start="<imput name=" &Chr(34)& "productID" &Chr(34)& "value=" &Chr(34)
$new=_StringBetween($file,$s_start,"")
MsgBox(0, "test", $new)

Result in Msg is "0"

but $line=<input name="productID" value="13131" />

theoretical $new is 13131

Ok but now is not for this, i experiment with my script and find some problems

what help file not help to resolve

code:

#include <file.au3>
#include <array.au3>

$Line1= ""
$Line2= ""
$List=_FileListToArray("c:\product\")
$Array=$List
While 1
   $i = $i+1
   $folder=$List[$i]
   $file="c:\product\"&$folder&"\index.html"
   $Line1=FileReadLine($file,255)
   $Line2=FileReadLine($file,315)
   _ArrayInsert[$i][2]($Array,"",$Line1)
   _ArrayInsert[$i][3]($Array,"",$Line2)
WEnd

How i can put information in the new Colon of Array, i can't find it on forum and AutoIt.chm? this is $List:

+--+-----+

|nr|Col0 |

|0 | 123 |

|1 | 233 |

|2 | 434 |

+--+-----+

and want $Array to be something like this:

+--+-----+-----+

|nr|Col0 |Col1 |

|0 | 123 | 242 |

|1 | 233 | 234 |

|2 | 434 | 355 |

+--+-----+-----+

Thank you.

Toader.

Edited September 30, 2010 by toader

[Melba23]

toader,

Tell me - do you actually ever look at the Help file? Or do you just type a few random parameters into the function calls and then post here hoping some kind soul will provide you with the correct answer?

Let us start with _StringBetween.

#include <String.au3>

; Here is a test string to work on
$line = '<input name="productID" value="13131" />'

$s_start = 'value="' ; You can use single/double quotes to include " in the string - and you do not need all of the line!
$s_end = '" />'      ; You need an end string!

; Now use _StringBetween to get the part you want - if you look in the Help file - you see that you get an array as a return value
$new = _StringBetween($line, $s_start, $s_end) 

; So you need to use array notation to read the result - and look - here it is!
MsgBox(0, "test", $new[0])

Now, the new array. You cannot change the number of dimensions (that is the number of [ ] after the array name) - you can only increase the size of an exisiting dimension (the number within the [ ]). So you will have to declare a new array with the correct number and size of dimensions and copy over the data. Something like this:

#include <File.au3>
#include <Array.au3>

; Get your file list by using the correct syntax to get just the files returned
$List = _FileListToArray("c:\product\", "*", 1)

; Declare a new array to hold the data with the correct number of dimensions
Global $Array[UBound($List)][2]

; Now loop through the list of files and fill the new array
For $i = 1 To $List[0]
    ; Put the filename in the first column
    $Array[$i][0] = $List[$i]
    ; Now read the line in the file
    $Line = FileReadLine("c:\product\" & $List[$i], 255)
    ; And insert it into the array
    $Array[$i][1] = $Line
Next

; And here is your array nicely filled
_ArrayDisplay($Array)

Ask if you do understand something. But you really do need to start reading the Help file more carefully and at least trying to get something close to the correct syntax before posting here.

M23

[6105]

wow.. M23, the information is very, very useful!, thank you so mutch!

i did this:

#include <File.au3>
#include <Array.au3>
#include <String.au3>

$map = "c:\product\"
$file = "\index.html"
  $s_start1='value="'
  $s_start2='SC/pic/'
  $s_end1='" type'
  $s_end2="' img_with"
$List=_FileListToArray($map)

Global $Array[2450][3]

For $i = 1 To 10
    $Array[$i][0] = $List[$i]
    $Line1 = FileReadLine($map & $List[$i] & $file, 255)
    $Line2 = FileReadLine($map & $List[$i] & $file, 255)
    $nLine1=_StringBetween($Line1,$s_start1,$s_end1)
    $nLine2=_StringBetween($Line2,$s_start2,$s_end2)
    $Array[$i][1] = $nLine1
    $Array[$i][2] = $nLine2
Next

_ArrayDisplay($aArray)

and in result i see just 10 lines of List, but nLine1 and nLine2 is free, in the last 2 row (9,10) the Col1,Col2=0 i can't understand n fix it ^^

in the rest i see all is Ok if i put before Next MsgBox(0,"",$nLine1[0] & " : " & $nLine2[0]) i will see what is needed...

i think that need to put $Array[$i][1] = $nLine1[0] but that give the error at $nLine1^ (Subscript used with non-Array variable.)

Did you know what can be the problem?

Thank you sooo mutch!

Toader.

Edited September 30, 2010 by toader

[Melba23]

toader,

READ THE HELP FILE!

If you want the list of files in your folder, you need to specify "files only" when you use _FileListToArray by setting the $iFlag parameter to 1. So that line should read:

$List=_FileListToArray($map, "*.*", 1)

just as it did in the code I posted above. This will return the list of filenames in the folder - the whole file name, not just a number.

Now, when you loop through the file, why are you adding "\index.html" at the end of the filename? It is little wonder that you are not getting any output from FileReadLine as you are asking AutoIt to read "c:\product\this_filename\index.html" - which is not what you said you wanted to do.

Question: Are you looking to read a file called "index.html" in each folder in "c:\product"? Or are you trying to read all the files in "c:\product", which is what I understood at the beginning?

Please let me know, because we will not get much further until we clear up exactly what it is that you are trying to do!

M23

[6105]

thank you so mutch M23, i try to read a file called "index.html" in each folder in "c:\product\"

i don't say all what i need to do, for does it by my self, needs just needed function to find, i reads the help file, but i'm not very wall in english, i understand all by Examples. and if i put $List=_FileListToArray($map, "*.*", 1) i has error, and i removed the , "*.*", 1

i don't understand why the script don't add the values to array, because in troubleshuting mesages that show me every value from eath file...

Toader.

Edited September 30, 2010 by toader

[Melba23]

toader,

OK, now we know!

I hope this works for you:

#include <File.au3>
#include <Array.au3>
#include <String.au3>

$map = "c:\product\"
$file = "\index.html"
  $s_start1='value="'
  $s_start2='SC/pic/'
  $s_end1='" type'
  $s_end2="' img_with"
  
; Look for folders
$List=_FileListToArray($map, "*", 2) ; 2 =  folders only

; Now create the array 
Global $Array[$List[0] + 1][3] ; we use $List[0] because that tells us how many folders we found

; Now loop through the folders
For $i = 1 To $List[0] ; Again we use the number of folders
    ; Insert the folder name in the [0] element
    $Array[$i][0] = $List[$i]
    ; Read the line just once
    $Line = FileReadLine($map & $List[$i] & $file, 255)
    ; Now extract the 2 parts of the line you want
    $Extract1 = _StringBetween($Line, $s_start1, $s_end1)
    $Extract2 = _StringBetween($Line, $s_start2, $s_end2)
    ; And put them into elements [1] and [2]
    $Array[$i][1] = $Extract1 
    $Array[$i][2] = $Extract2 
Next

; See if we have it right this time!
_ArrayDisplay($aArray)

in result i see just 10 lines of List

That is because you only ran your loop as 1 To 10! Look above to see how you should set the loop.

M23

Edit: Silly copy and paste error in the code, sorry.

Edited September 30, 2010 by Melba23

[6105]

THANK YOU M23!!! that don't work too)) i removed the:

$Extract1 = _StringBetween($Line, $s_start1, $s_end1)

$Extract2 = _StringBetween($Line, $s_start2, $s_end2)

lines and all work perfectly) i will delete the unneeded information by search&change))

thank you

i now write a joke with your Toast, gift for help

ok, if not every ProductID is on line 255, with what i can find it? if i will use FileRead that will make very very big time. Thanks

Edited September 30, 2010 by toader

[Melba23]

toader,

I made a silly error in the code I posted above - sorry. It should work better now.

I am glad we got there in the end!

M23

[6105]

Hi M23,

i also have some bug with this StringBetween((( can't fix it( can you see?:

expandcollapse popup

#include <String.au3>
#include <Array.au3>
#include <File.au3>
$map = "c:\product2\"
$file = "\index.html"
Local $sSearch1 = 'productID'
Local $sSearch2a = '<a target="_blank"'
Local $sSearch2b = "<img id='img-current_picture' border='0'"
Local $iLineNumber = 1
Local $iStopOnLine = 0
Local $iStartPos = 1, $sFound1, $iPos, $sLineText, $sFound2
Local $List=_FileListToArray($map, "*", 2)
Local $Array[$List[0] + 1][10]
    $s_start1='value="'
    $s_start2='tachments/SC/products_pictures'
    $s_end1='" type'
    $s_end2="' img_width="


For $i = 1 To $List[0]
    $Array[$i][0] = $List[$i]
    $sFilePath = $map & $List[$i] & $file
    _Search1()
    _Search2()
    $Line1 = FileReadLine($sFilePath, $sFound1)
    $snip1 = _StringBetween($Line1, $s_start1, $s_end1, -1)
        If @Error = 1 then
            Local $snip1[1]
            _ArrayInsert($snip1, 0, "N/A1")
        EndIf
    $Line2 = FileReadLine($sFilePath, $sFound2)
    $snip2 = _StringBetween($Line2, $s_start2, $s_end2, -1)
        If @Error = 1 Then
            Local $snip2[1]
            _ArrayInsert($snip2, 0, "N/A2")
        EndIf

;===============//DEBUG//=====================
    ;i see message with correct Snip1 n  Snip2
            MsgBox(0,'',$snip1[0] & '-----' & $snip2[0])
;===============//DEBUG//=====================
        $Array[$i][1] = $snip1      ;in Array [$i][1] is empty
        $Array[$i][2] = $snip2      ;in Array [$i][2] is empty
        $Array[$i][3] = $sFound1
        $Array[$i][4] = $sFound2
        $Array[$i][5] = $Line1
        $Array[$i][6] = $Line2
        $Array[$i][7] = $i
;==============//DEBUG//======================
Next

Func _Search1()
    $iLineNumber = 1
    $iStartPos = 1
    $sFound1 = ''
    $iPos = ''
    $sLineText = ''
            While 1
            $sLineText = FileReadLine($sFilePath, $iLineNumber)
            If @error Then ExitLoop

            While 1
                $iPos = StringInStr($sLineText, $sSearch1, 1, 1, $iStartPos)
                If Not $iPos Then ExitLoop
                If $iStartPos = 1 Then
                    $sFound1 = $iLineNumber
                    ExitLoop
                EndIf
                $iStartPos = $iPos+1
            WEnd

            $iLineNumber += 1

        WEnd
EndFunc

Func _Search2()
    $iLineNumber = 1
    $iStartPos = 1
    $sFound2 = ''
    $iPos = ''
    $sLineText = ''
        While 1
            $sLineText = FileReadLine($sFilePath, $iLineNumber)
            If @error Then ExitLoop

            While 1
                $iPos = StringInStr($sLineText, $sSearch2a, 1, 1, $iStartPos)
                If Not $iPos Then ExitLoop
                If $iStartPos = 1 Then
                    $sFound2 = $iLineNumber
                    ExitLoop
                EndIf
                $iStartPos = $iPos+1
            WEnd

            $iLineNumber += 1

        WEnd
EndFunc

    _ArrayDisplay($Array)

Thank you!

Toader.

[Melba23]

toader,

These comments refer to the <<<<<<<<<<<< Note # lines in the following code:

1. Just fill the array as you declare it - no need for _Array Insert.

2. When you transfer the data between the $snip# and $Array arrays you need to specify the [element] for both arrays. You did it with $snip# for the MsgBox - you also need to do it for the transfer lines.

$snip1 = _StringBetween($Line1, $s_start1, $s_end1, -1)
If @Error = 1 then
    Local $snip1[1] = ["N/A1"] ; <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< Note 1
    ;_ArrayInsert($snip1, 0, "N/A1") ; <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< Note 1
EndIf
$Line2 = FileReadLine($sFilePath, $sFound2)
$snip2 = _StringBetween($Line2, $s_start2, $s_end2, -1)
If @Error = 1 Then
    Local $snip2[1] =  = ["N/A1"] ; <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< Note 1
    ;_ArrayInsert($snip2, 0, "N/A2") ; <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< Note 1
EndIf

;===============//DEBUG//=====================
;i see message with correct Snip1 n  Snip2
MsgBox(0,'',$snip1[0] & '-----' & $snip2[0]) ; You used the [element[] here!
;===============//DEBUG//=====================
$Array[$i][1] = $snip1[0] ; <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< Note 2
$Array[$i][2] = $snip2[0] ; <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< Note 2

Try that and see if it works.

M23

[6105]

Ohh.. if fking nooby i remeber that: $Array[$i][1] = $Extract1 ;where u don't use [0] and not tested with [0] -.-

Thank you so mutch M23!

and the

If @Error = 1 Then
            Local $snip2[1]
            _ArrayInsert($snip2, 0, "N/A2")
        EndIf

i use for debbuging, if code don't find $Line1, to don't give error, but to declare it like N/A and search in another file.

Thank you M23.

Edited October 5, 2010 by toader

[Melba23]

toader,

Delighted i got it right!

M23