Jump to content

delete duplicate lines from text file or array

Recommended Posts

i've managed to get links from my text file to display into array like this:

#include <file.au3>
#include <Array.au3>
Dim $text
If Not _FileReadToArray(@ScriptDir & "\AnchorLinks.txt", $text) Then
MsgBox(4096, "Error", " Error reading text file to Array error:" & @error)
Dim $link[UBound($text)]
$link[0] = $text[0]
For $x = 1 To $text[0]
$array = StringSplit($text[$x], ",")
$link[$x] = $array[1]
_ArrayDisplay($link, "Link list")

so what i need now is to remove all the duplicate lines either from text file before getting it into array or from array itself.

does anyone know how i might do that?

Edited by dickjones
Link to comment
Share on other sites

Look at the functions _ArrayUnique for the first question, and also _ArrayDelete for deleting the first element of the array if you feel you really need to delete it.

Edited by BrewManNH

If I posted any code, assume that code was written using the latest release version unless stated otherwise. Also, if it doesn't work on XP I can't help with that because I don't have access to XP, and I'm not going to.
Give a programmer the correct code and he can do his work for a day. Teach a programmer to debug and he can do his work for a lifetime - by Chirag Gude
How to ask questions the smart way!

I hereby grant any person the right to use any code I post, that I am the original author of, on the autoitscript.com forums, unless I've specifically stated otherwise in the code or the thread post. If you do use my code all I ask, as a courtesy, is to make note of where you got it from.

Back up and restore Windows user files _Array.au3 - Modified array functions that include support for 2D arrays.  -  ColorChooser - An add-on for SciTE that pops up a color dialog so you can select and paste a color code into a script.  -  Customizable Splashscreen GUI w/Progress Bar - Create a custom "splash screen" GUI with a progress bar and custom label.  -  _FileGetProperty - Retrieve the properties of a file  -  SciTE Toolbar - A toolbar demo for use with the SciTE editor  -  GUIRegisterMsg demo - Demo script to show how to use the Windows messages to interact with controls and your GUI.  -   Latin Square password generator

Link to comment
Share on other sites

This should do the trick. You will however loose the order of your links, is that a problem?

Dim $aFile
_FileReadToArray(@DesktopDir & '\Codes2.txt', $aFile)
_ArrayDelete($aFile, 0)
For $i = UBound($aFile) - 1 To 1 Step -1
   If $aFile[$i] = $aFile[$i - 1] Then _ArrayDelete($aFile, $i)
Link to comment
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now

  • Recently Browsing   0 members

    • No registered users viewing this page.
  • Create New...