Jump to content
BlazerV60

Search an array for duplicates?

Recommended Posts

BlazerV60

Hello everyone :),

Let's say I have an array that contains these numbers: 2,5,7,2,25,6,31,1,24,5,7,8,7,99

How would I make my program be able to tell me something like "There are three 7's".

Is it possible to make an array detect duplicates and notify you?

Thanks,

Brian

Share this post


Link to post
Share on other sites
somdcomputerguy

The _ArrayFindAll() UDF can be used to do this for you.

edit:

Here's an example:

#include <Array.au3>

Local $aArray[14] = [2,5,7,2,25,6,31,1,24,5,7,8,7,99]
Local $aResult = _ArrayFindAll($aArray, 7)
ConsoleWrite("There are " & UBound($aResult) & " 7's"& @LF)
Edited by somdcomputerguy

- Bruce /*somdcomputerguy */  If you change the way you look at things, the things you look at change.

Share this post


Link to post
Share on other sites
somdcomputerguy

You bet. Good luck with your project. :)


- Bruce /*somdcomputerguy */  If you change the way you look at things, the things you look at change.

Share this post


Link to post
Share on other sites
iamtheky

#Include <Array.au3>

Local $aArray[14] = [2,5,7,2,25,6,31,1,24,5,7,8,7,99]

For $i = ubound($aArray) - 1 to 0 step -1
Local $aResult = _ArrayFindAll($aArray, $aArray[$i])
if ubound($aResult) > 1 Then
msgbox (0 , '' , "There are " & ubound($aResult) & ":  " & $aArray[$i])
for $x = UBound($aResult) - 1 to 0 step - 1
    _ArrayDelete($aArray , $aResult[$x])
Next
Endif
$i = $i - (UBound($aResult) - 1)
Next

Edited by boththose
  • Like 1

,-. .--. ________ .-. .-. ,---. ,-. .-. .-. .-.
|(| / /\ \ |\ /| |__ __||| | | || .-' | |/ / \ \_/ )/
(_) / /__\ \ |(\ / | )| | | `-' | | `-. | | / __ \ (_)
| | | __ | (_)\/ | (_) | | .-. | | .-' | | \ |__| ) (
| | | | |)| | \ / | | | | | |)| | `--. | |) \ | |
`-' |_| (_) | |\/| | `-' /( (_)/( __.' |((_)-' /(_|
'-' '-' (__) (__) (_) (__)

Share this post


Link to post
Share on other sites
Chimp

a little improvement
this searches any duplicate (no need to know prior what to search)
note: if there are more empty elements are considered duplicate

#include <Array.au3>

Local $aArray[14] = [2,5,7,2,25,6,31,1,24,5,7,8,7,99]
Local $aResult
Local $aArrayUnique = _ArrayUnique($aArray, 1, 0, 0, 0) ; keep only single elements
If UBound($aArrayUnique) = UBound($aArray) Then
    ConsoleWrite("There are not duplicates." & @CRLF)
Else
    For $i = 0 To UBound($aArrayUnique) - 1
        $aResult = _ArrayFindAll($aArray, $aArrayUnique[$i])
        If UBound($aResult) > 1 Then
            ConsoleWrite("There are " & UBound($aResult) & " '" & $aArrayUnique[$i] & "'" & @LF)
        EndIf
    Next
EndIf

edit:

I saw the post by boththose only after I posted this
Edited by Chimp
  • Like 1

small minds discuss people average minds discuss events great minds discuss ideas.... and use AutoIt....

Share this post


Link to post
Share on other sites
jguinch

Oups, sorry, it's not the good post...

@Chimp, your code does not work (seems to be an error with _ArrayUnique

 

Edited by jguinch
Posted you the bad topic, sorry

Share this post


Link to post
Share on other sites
Chimp
7 minutes ago, jguinch said:

Oups, sorry, it's not the good post...

@Chimp, your code does not work (seems to be an error with _ArrayUnique

 

Yes, cause of the second parameter of _ArrayUnique() that now is 0 based, while in previous versions it was 1 based.

Updated working code:

#include <Array.au3>

Local $aArray[14] = [2,5,7,2,25,6,31,1,24,5,7,8,7,99]
Local $aResult
Local $aArrayUnique = _ArrayUnique($aArray, 0, 0, 0, 0) ; keep only single elements
_ArrayDisplay($aArrayUnique)
If UBound($aArrayUnique) = UBound($aArray) Then
    ConsoleWrite("There are not duplicates." & @CRLF)
Else
    For $i = 0 To UBound($aArrayUnique) - 1
        $aResult = _ArrayFindAll($aArray, $aArrayUnique[$i])
        If UBound($aResult) > 1 Then
            ConsoleWrite("There are " & UBound($aResult) & " '" & $aArrayUnique[$i] & "'" & @LF)
        EndIf
    Next
EndIf

 


small minds discuss people average minds discuss events great minds discuss ideas.... and use AutoIt....

Share this post


Link to post
Share on other sites
Dizzastaffy
On 3/26/2016 at 8:39 PM, Chimp said:

Yes, cause of the second parameter of _ArrayUnique() that now is 0 based, while in previous versions it was 1 based.

Updated working code:

#include <Array.au3>

Local $aArray[14] = [2,5,7,2,25,6,31,1,24,5,7,8,7,99]
Local $aResult
Local $aArrayUnique = _ArrayUnique($aArray, 0, 0, 0, 0) ; keep only single elements
_ArrayDisplay($aArrayUnique)
If UBound($aArrayUnique) = UBound($aArray) Then
    ConsoleWrite("There are not duplicates." & @CRLF)
Else
    For $i = 0 To UBound($aArrayUnique) - 1
        $aResult = _ArrayFindAll($aArray, $aArrayUnique[$i])
        If UBound($aResult) > 1 Then
            ConsoleWrite("There are " & UBound($aResult) & " '" & $aArrayUnique[$i] & "'" & @LF)
        EndIf
    Next
EndIf

 

Hi sorry to open an older thread, it my first post and stuck. @Chimp I am using the above which is close to working for me.

 

What I have is an array with one column that has usernames and the other column passwords. What I want this script to do is list usernames who share the same password, so to count the column2 and display it. I can get the above working if it is on column1 it displays and counts usernames that are duplicates fine. If I change it to do this on column 2 it detects there is duplicates, but I cant get it to count or display them. I am sure if is something simple,but I just cant get this working and would really appreciate some help.

Here is an example of my data that is split into 2 columns in an array

 

user1: 76560BB696114467
user2: 76560BB696114467
user3: 76560BB696114467
user4: 76560BB696114467
user5: 76560BB696114467
user6: 765454545454545
user7: 7666565656565656
user8: 76560BB6uyuyu567
user1: 76560BB696114467

The array where this data sits is called avIPS.

Local $aResult
Local $aArrayUnique = _ArrayUnique($avIPs, 0, 0, 0, 0) ; keep only single elements
;_ArrayDisplay($aArrayUnique)

If UBound($aArrayUnique) = UBound($avIPs) Then
    ConsoleWrite("There are not duplicates." & @CRLF)

Else
    ConsoleWrite("There are duplicates." & @CRLF)
    For $i = 0 To UBound($aArrayUnique) - 1
       $aResult = _ArrayFindAll($avIPs, $aArrayUnique[$i])
        If UBound($aResult) > 1 Then
            ConsoleWrite("There are " & UBound($aResult) & " '" & $aArrayUnique[$i] & "'" & @LF)
        EndIf
    Next
EndIf

So running the above on my array on matches column1 fine and says there are 2 user1 which is correct

There are duplicates.
There are 2 'user1'

If I alter the above to try and work on the password column (changing 0,0,0,0 to 1,0,0,0 ) then it detects there are duplicates but doesnt count or display them, so is something I need to edit around the Ubound I think?

 

Local $aResult
Local $aArrayUnique = _ArrayUnique($avIPs, 1, 0, 0, 0) ; keep only single elements
;_ArrayDisplay($aArrayUnique)

If UBound($aArrayUnique) = UBound($avIPs) Then
    ConsoleWrite("There are not duplicates." & @CRLF)

Else
    ConsoleWrite("There are duplicates." & @CRLF)
    For $i = 0 To UBound($aArrayUnique) - 1
       $aResult = _ArrayFindAll($avIPs, $aArrayUnique[$i])
        ;If UBound($aResult) > 1 Then
            ConsoleWrite("There are " & UBound($aResult) & " '" & $aArrayUnique[$i] & "'" & @LF)
       ; EndIf
    Next
EndIf

This is then my output, so it knows there are duplicates, but wont count them.

 

There are duplicates.
There are 1 ''
There are 0 ' 76560BB696114467'
There are 0 ' 765454545454545'
There are 0 ' 7666565656565656'
There are 0 ' 76560BB6uyuyu567'

Worst case I would like it to say there are 5x users with password 76560BB696114467 or even better the following usernames have the same password of 76560BB696114467.

This are not real passwords, just an example.

 

Any pointers I would be really grateful. thanks

 

Share this post


Link to post
Share on other sites
iamtheky
#include <Array.au3>
local $aFinal[0]

Local $avArray[9][2] = [ _
        ["user1", "76560BB696114467"], _
        ["user2", "76560BB696114467"], _
        ["user3", "76560BB696114467"], _
        ["user4", "76560BB696114467"], _
        ["user5", "76560BB696114467"], _
        ["user6", "765454545454545"], _
        ["user7", "7666565656565656"], _
        ["user8", "76560BB6uyuyu567"], _
        ["user1", "76560BB696114467"]]


 $aUniquePW = _ArrayUnique($avArray , 1)

For $i = 1 to ubound($aUniquePW) - 1

   $aMatch = _ArrayFindAll($avArray , $aUniquePW[$i] , 0 , 0 , 0 , 0 , 1)

      for $k = 0 to ubound($aMatch) - 1
         $aMatch[$k] = $avArray[$aMatch[$k]][0]
      next

      $aUniqueUser = _ArrayUnique($aMatch)
      $aUniqueUser[0] = $aUniquePW[$i]
      _ArrayAdd($aUniqueUser , "")
      _ArrayConcatenate($aFinal , $aUniqueUser)

Next

_ArrayDisplay($aFinal)

 

  • Like 1

,-. .--. ________ .-. .-. ,---. ,-. .-. .-. .-.
|(| / /\ \ |\ /| |__ __||| | | || .-' | |/ / \ \_/ )/
(_) / /__\ \ |(\ / | )| | | `-' | | `-. | | / __ \ (_)
| | | __ | (_)\/ | (_) | | .-. | | .-' | | \ |__| ) (
| | | | |)| | \ / | | | | | |)| | `--. | |) \ | |
`-' |_| (_) | |\/| | `-' /( (_)/( __.' |((_)-' /(_|
'-' '-' (__) (__) (_) (__)

Share this post


Link to post
Share on other sites
Dizzastaffy
16 minutes ago, iamtheky said:
#include <Array.au3>
local $aFinal[0]

Local $avArray[9][2] = [ _
        ["user1", "76560BB696114467"], _
        ["user2", "76560BB696114467"], _
        ["user3", "76560BB696114467"], _
        ["user4", "76560BB696114467"], _
        ["user5", "76560BB696114467"], _
        ["user6", "765454545454545"], _
        ["user7", "7666565656565656"], _
        ["user8", "76560BB6uyuyu567"], _
        ["user1", "76560BB696114467"]]


 $aUniquePW = _ArrayUnique($avArray , 1)

For $i = 1 to ubound($aUniquePW) - 1

   $aMatch = _ArrayFindAll($avArray , $aUniquePW[$i] , 0 , 0 , 0 , 0 , 1)

      for $k = 0 to ubound($aMatch) - 1
         $aMatch[$k] = $avArray[$aMatch[$k]][0]
      next

      $aUniqueUser = _ArrayUnique($aMatch)
      $aUniqueUser[0] = $aUniquePW[$i]
      _ArrayAdd($aUniqueUser , "")
      _ArrayConcatenate($aFinal , $aUniqueUser)

Next

_ArrayDisplay($aFinal)

 

Perfect thanks very much, works just as I wanted.

Share this post


Link to post
Share on other sites
Dizzastaffy

Sorry to be a pain @iamtheky what would the easiest way using your example to only show usernames/passwords where greater than 1? i.e only display the items in the array if more than 1 user shares the same password. Basically I am only interested in if users have the same password as others.

 

many thanks

Edited by Dizzastaffy

Share this post


Link to post
Share on other sites
iamtheky

check $aUniqueUser[0] > 1

Do that right after its created, and If true then proceed on to change the value in element 0 to the password, add the blank row, and concatenate with final, else continueloop.


,-. .--. ________ .-. .-. ,---. ,-. .-. .-. .-.
|(| / /\ \ |\ /| |__ __||| | | || .-' | |/ / \ \_/ )/
(_) / /__\ \ |(\ / | )| | | `-' | | `-. | | / __ \ (_)
| | | __ | (_)\/ | (_) | | .-. | | .-' | | \ |__| ) (
| | | | |)| | \ / | | | | | |)| | `--. | |) \ | |
`-' |_| (_) | |\/| | `-' /( (_)/( __.' |((_)-' /(_|
'-' '-' (__) (__) (_) (__)

Share this post


Link to post
Share on other sites
Dizzastaffy
18 minutes ago, iamtheky said:

check $aUniqueUser[0] > 1

Do that right after its created, and If true then proceed on to change the value in element 0 to the password, add the blank row, and concatenate with final, else continueloop.

Thanks. So if I understand correct you mean add a if $aUniqueUser[0] > 1 then after this line

or do you mean after the end of the script and array afinal is created?

    $aUniqueUser = _ArrayUnique($aMatch)

Share this post


Link to post
Share on other sites
iamtheky

yeah, you can put an _ArrayDisplay($aUniqueUser) line there as well to debug if there are issues or edge cases unaccounted for.

  • Like 1

,-. .--. ________ .-. .-. ,---. ,-. .-. .-. .-.
|(| / /\ \ |\ /| |__ __||| | | || .-' | |/ / \ \_/ )/
(_) / /__\ \ |(\ / | )| | | `-' | | `-. | | / __ \ (_)
| | | __ | (_)\/ | (_) | | .-. | | .-' | | \ |__| ) (
| | | | |)| | \ / | | | | | |)| | `--. | |) \ | |
`-' |_| (_) | |\/| | `-' /( (_)/( __.' |((_)-' /(_|
'-' '-' (__) (__) (_) (__)

Share this post


Link to post
Share on other sites
Chimp

You can also view users that share passwords groupped in a treeview...

#include <Array.au3>
#include <TreeViewConstants.au3>
#include <GUITreeView.au3>
#include <WindowsConstants.au3>

Local $aArray = [ _
        ["user1", "76560BB696114467"], _
        ["user2", "76560BB696114467"], _
        ["user3", "76560BB696114467"], _
        ["user4", "76560BB696114467"], _
        ["user5", "76560BB696114467"], _
        ["user6", "76560BB6uyuyu567"], _
        ["user7", "765454545454545"], _
        ["user8", "76560BB6uyuyu567"], _
        ["user9", "765454545454545"]]

Local $aResult, $aArrayUnique = _ArrayUnique($aArray, 1, 0, 1, 0) ; keep only single elements
If UBound($aArrayUnique) = UBound($aArray) Then
    MsgBox(0, "Info", "There are not duplicates.")
Else
    $hMain = GUICreate("unwary users", 280, 400, 10, 10)
    $hTree = GUICtrlCreateTreeView(5, 5, 270, 390, BitOR($TVS_HASBUTTONS, $TVS_HASLINES, $TVS_LINESATROOT, $TVS_DISABLEDRAGDROP, $TVS_SHOWSELALWAYS), $WS_EX_CLIENTEDGE)
    GUISetState()
    _GUICtrlTreeView_BeginUpdate($hTree)
    Local $hAncestor = _GUICtrlTreeView_Add($hTree, 0, "Shared pwds")
    For $i = 0 To UBound($aArrayUnique) - 1
        $aResult = _ArrayFindAll($aArray, $aArrayUnique[$i], 0, 0, 0, 0, 1) ; password
        If UBound($aResult) > 1 Then
            Local $hGroup = _GUICtrlTreeView_AddChild($hTree, $hAncestor, $aArray[$aResult[0]][1])
            For $i1 = 0 To UBound($aResult) - 1
                _GUICtrlTreeView_AddChild($hTree, $hGroup, $aArray[$aResult[$i1]][0]) ; Users
            Next
        EndIf
    Next
    _GUICtrlTreeView_EndUpdate($hTree)
    MsgBox(0, "Pause", "Click OK to end")
EndIf

 

Edited by Chimp
debugged listing
  • Like 1

small minds discuss people average minds discuss events great minds discuss ideas.... and use AutoIt....

Share this post


Link to post
Share on other sites
iamtheky

There it is new folk.  Give all the details, show effort, get multiple responses that solve the problem. That's how this biatch works.  

No one even harassed him for resjacking (which i just coined and should be used everywhere) a thread, because its related, and a complete question.

  • Like 1

,-. .--. ________ .-. .-. ,---. ,-. .-. .-. .-.
|(| / /\ \ |\ /| |__ __||| | | || .-' | |/ / \ \_/ )/
(_) / /__\ \ |(\ / | )| | | `-' | | `-. | | / __ \ (_)
| | | __ | (_)\/ | (_) | | .-. | | .-' | | \ |__| ) (
| | | | |)| | \ / | | | | | |)| | `--. | |) \ | |
`-' |_| (_) | |\/| | `-' /( (_)/( __.' |((_)-' /(_|
'-' '-' (__) (__) (_) (__)

Share this post


Link to post
Share on other sites
Dizzastaffy

Thanks all. There has been many times I wanted to post, but got there in the end by looking, trying, more trying and looking at other answers on the forum. I have gone from never using to writing something that is very useful. I didn't want to just post hi how do I do this without even trying, I tried but was above my knowledge in this case, I have several arrays working by reading files, splitting data, etc, but this one got me. thanks 

Share this post


Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now

  • Similar Content

    • VollachR
      By VollachR
      Hi,
      I'm looking for a way to take a number value from a Row2 of a 2D array and according to this check if files that appear in rows 3-11 in the array exists.
      For example, if the number in Row2 is 5 I need to check for the files in Row 3-6 only, if it is 6 than rows 3-7 and so on.
      I thought on using a FOR loop but I have very little experience with those.
      Can you suggest the best way to do what I need?
      BTW, the files in Rows 3-11 will usually have blank value for any row above the number in Row2 (e.g. Row2 = 5 so Rows3-6 will have values but 8-11 be empty), The values I need are in Column 1 of the array, the name of the key from the INI file that the array was created from is in Column 0.
      Full Example:
      Row2 of Array:
      Col0 = Games# - Col1 = 5
      Rows3-6
      Col0 = Exe2 - Col1 = Path To File
      Col0 = Exe3 - Col1 = Path To File
      Col0 = Exe4 - Col1 = Path To File
      Col0 = Exe5 - Col1 = Path To File
      I need that if Row2 is 5 to check these above for rows if the file exists, if it was 6 then the next row as well and so on up until number 10 in Row2 as it can't go above 10.
      So basically for whatever number in Row2 from 2-10 need to check 1-9 rows from 3-11 to see if the files in Col1 exists and if any of them don't exist it should call a function that shows an error message.
      I'm pretty sure I have the first line of the for look correct:
      For $i = 1 To $aAIO[2][1] Just not sure how to continue from there, also not sure if $i should be equal 1 or 2.
      Help will be appreciated.
    • FMS
      By FMS
      Hello,
      I'm trying to get data from twitter to an array and so far I found an Twitter UDF whish lookes very intresting but couldn't get it to work.
      It lookes not supported any more(2010) and buggy when i read all te replies.
      More around this subject (autoit and twitter) i couldn't find on this forum.
      Is there sombody who know's a good way to get live data from twitter to an array inside autoit?
      (I kinda doubt that this isn't tackled before)
      In the end I was hoping to get all tweets from date to date from an specific subject inside a 2D array to work whit.
    • AndreasNWWWWW
      By AndreasNWWWWW
      I got a question:  i am trying to run different functions based upon what i select in these radio buttons.(code below)
      it needs to check server 1. then run function 1 or function 2 after what i selected in the checkbox.
      once that function is done it moves to the next one, until it has been trough all 5 
       
      iv'e tried using while loops with different while $i equals to something but then i manualy need to go in and edit the script every time.
      #include <ButtonConstants.au3> #include <GUIConstantsEx.au3> #include <StaticConstants.au3> #include <WindowsConstants.au3> #Region ### START Koda GUI section ### Form= $Form1 = GUICreate("Form1", 615, 437, 192, 124) $Server2 = GUICtrlCreateLabel("Server2", 216, 95, 41, 17) $server1 = GUICtrlCreateLabel("Server1", 216, 72, 41, 17) $server4 = GUICtrlCreateLabel("Server4", 216, 144, 41, 17) $server3 = GUICtrlCreateLabel("Server3", 216, 119, 41, 17) $server5 = GUICtrlCreateLabel("Server5", 216, 170, 41, 17) $Start = GUICtrlCreateButton("Start", 240, 248, 147, 25) $Checkbox1 = GUICtrlCreateCheckbox("function1", 288, 72, 97, 17) $Checkbox2 = GUICtrlCreateCheckbox("function2", 392, 72, 97, 17) $Checkbox3 = GUICtrlCreateCheckbox("function1", 288, 96, 97, 17) $Checkbox4 = GUICtrlCreateCheckbox("function2", 392, 96, 97, 17) $Checkbox5 = GUICtrlCreateCheckbox("function1", 288, 120, 97, 17) $Checkbox6 = GUICtrlCreateCheckbox("function2", 392, 120, 97, 17) $Checkbox7 = GUICtrlCreateCheckbox("function1", 288, 144, 97, 17) $Checkbox8 = GUICtrlCreateCheckbox("function2", 392, 144, 97, 17) $Checkbox9 = GUICtrlCreateCheckbox("function1", 288, 170, 97, 17) $Checkbox10 = GUICtrlCreateCheckbox("function2", 392, 170, 97, 17) GUISetState(@SW_SHOW) #EndRegion ### END Koda GUI section ### While 1 $nMsg = GUIGetMsg() Switch $nMsg Case $GUI_EVENT_CLOSE Exit EndSwitch WEnd  
    • 31290
      By 31290
      Hi everyone, 
      I'm currently writing a script that allow me to list all currently installed software on a computer but some of the are listed in the HKLM64 hive of the registry whereas 95% of all others are in the HKLM "normal" one.
      Thing is, I'd like to combine these two reg key into one single ListView item.
      Here's my code so far, knowing that it's working on both cases (changing to HKLM64 or HKLM short)
      Thanks in advance for the help
      -31290-
    • Iceburg
      By Iceburg
      Hi everyone, I'm at best a noobie.  I have read through the Array helps, and specifically the 2D array help file, and I'm struggling to get my code working.
      I have an array that is read from a file, thats working great.  I'm trying to do some math on the array, so I can find the largest, average, lowest, day over day change %, etc.
      The array read working fine, I get 43 lines, line 0 is 44, and then I get data that looks like
      0519 $10,000
      0520 $10,001
      0521 $10,002
      The data in this array is a single 1D array, breaking it out into 2 columns so I can do the math is what I can get to happen.  
      How do I reference the array to store this data?  Second, how do I assign this data to the appropriate row/column?
      Thanks in advance.
      Dim $all_cash_amounts[UBound($aInput)][2] Dim $max_amount_in_account Dim $min_amount_in_account _FileReadToArray($LC_Check_file_path, $aInput) _ArrayDisplay($aInput) local $date = StringRegExp($aInput[1], "(\d\d\d\d)", 1) local $cash = StringRegExp($aInput[1], "\d+\s(-?[0-9\.\,]+)", 1) ConsoleWrite("Date is: " & $date & @CRLF) For $i = 1 To UBound($aInput)-1     $date = StringRegExp($aInput[$i], "(\d\d\d\d)", 1)     $all_cash_amounts[$i][2] = $date[$i][0], $cash[$i][1]      Next _ArrayDisplay($all_cash_amounts)  
×