Reading a text file to find dupicates

[diablo456]

Okay i got a list of links in a text file i need it to go threw the list and see if any of the links are the same if so then delete that link each link is on its own line if you could help that'd be great thanks

[Malkey]

Okay i got a list of links in a text file i need it to go threw the list and see if any of the links are the same if so then delete that link each link is on its own line if you could help that'd be great thanks

Something like this should work.

#include <file.au3>

Local $aRecords, $NewFile, $OldFile = "Links.txt"

If Not _FileReadToArray($OldFile, $aRecords) Then
    MsgBox(4096, "Error", " Error reading file to Array     error:" & @error)
    Exit
EndIf

For $x = 1 To $aRecords[0]
    If StringInStr($NewFile, $aRecords[$x]) = 0 Then $NewFile &= $aRecords[$x] & @CRLF
Next

;ConsoleWrite($NewFile & @CRLF)

$file = FileOpen($OldFile, 2)
FileWrite($file, $NewFile)
FileClose($file)

ShellExecute($OldFile)

[water]

Or:

$aLink = _FileReadToArray("Your Filename") 
$aArrayUnique = _ArrayUnique($aLink)

Edited December 4, 2009 by water