Anyone created a programmable sync/delete tool?

[storme]

G'day all

I've been doing a few rebuilds/transfers to new systems.

My usual is to copy their whole OLD C drive to the new computer (e.g. C:OLD_computer) AND use another tool that cherry picks the users data to be integrated into the new user on the new/rebuilt system.

I copy the WHOLE C drive because in the past I've run into the fact that programs/users spread their data data all over the place and I don't want to loose their data.

OK so now I have a directory with the WHOLE OLD C drive, a Copy of the userdata and the new system with all the userdata in place.  Customers happy and they go away... Until in the future they run out of hard drive because they forgot I said to delete the "Old Computer" folder when they were sure they had everything....sigh

So what I want to do is to compare the new C drives contents (minus the "OLD_computer" folder) with the "OLD_computer" and delete any exact duplicates from the "OLD_computer" folder.

I've found a few tools that do something like that but they are manual and a pain.

I know it's relatively easy in AutoIt....

{Outer directory traverser pointed at the C drive} (that doesn't traverse the "OLD_computer" folder.)

   Compare the current path with OLD_computerCurrent path

      If the file is the same delete it

However, I know that it won't be that easy and if someone has already done it I'll be saving myself a lot of work.

So anyone already done this and willing to share they code/approach/???

Thanks

John Morrison

Edit :  Add some highlighting yo clarify what I'm trying to do.

Edited February 2, 2014 by storme

[guinness]

FreeFileSync

[Neutro]

Hey storme,

Your idea would require a lot of hard drive disk scanning, thus reducing the performance of the computer it's running on.

If you do this, your customers could say to you "doh my computer is so slow!"

You could do a small software that checks free space on hard drive of your customer every 2 mins. If it finds out that there is few free space, it could display a message like "Hey bro, seems like your hard drive is almost full! Remember to delete old computer folder if you don't need it anymore :)"

[storme]

Hey storme,

Your idea would require a lot of hard drive disk scanning, thus reducing the performance of the computer it's running on.

If you do this, your customers could say to you "doh my computer is so slow!"

You could do a small software that checks free space on hard drive of your customer every 2 mins. If it finds out that there is few free space, it could display a message like "Hey bro, seems like your hard drive is almost full! Remember to delete old computer folder if you don't need it anymore :)"

No you misunderstand I this would be done BEFORE it's given back to them so that the "wasted space" is minimal.

I can't think of any reason I'd leave a program like I described running on a computer as everything would be clean after the first run.

Thanks anyway for the feedback

John

[storme]

FreeFileSync

Hi guinness

I can't see how FreeFileSync would help me in this one.

I want to "delete" the files that are the same not copy them....

I use FreeFileSync to keep my various USB keys synced with the master copy on the server.  It's a great program.

Thanks for the feedback!

John Morrison

[Neutro]

John,

I don't understand why there should be any file of the old computer on the new computer if the new computer has been formated and only has a fresh windows install?

[storme]

John,

I don't understand why there should be any file of the old computer on the new computer if the new computer has been formated and only has a fresh windows install?

Because I've copied the OLD C DRIVE to the new C DRIVE (Usually under C:OLD Computer).....

My customers wouldn't be happy if I rebuilt their computers without saving their data (docs/photos/etc).....

[Neutro]

So basicly you want to check for duplicates inside the old computer folder?

[t0nZ]

I have often your exact problem, but i have to transfer user data from corporate notebooks, so I have tell to my users that everything outside c:usersusername will be wiped.

This is the theory, users keep put every sort of thing in every place , like c:personalxxx   , but if I forget that folder no one blame me.

I have developed a couple of programs  to do that in autoit (only for c:users and corporate programs), but for your particolar problem I think you can use .

It's a  script by user llewxam I have modified some time ago, perhaps in mirror mode, give a look to the screenshot. 

It has also command line mode, I use it in some servers over freefilesync, I don't remember why....

Bye

Edited February 2, 2014 by t0nZ

[storme]

So basicly you want to check for duplicates inside the old computer folder?

YEP!

However I don't want to Sync the duplicates I want to DELETE them on ONE side only.

 

As I stated in my pseudo code in the OP

 

I know it's relatively easy in AutoIt....

{Outer directory traverser pointed at the C drive} (that doesn't traverse the "OLD_computer" folder.)

   Compare the current path with OLD_computerCurrent path

      If the file is the same delete it

 

However, I know that it won't be that easy and if someone has already done it I'll be saving myself a lot of work.

I'd also prefer if it could "just do it"

(e.g. SomeProgramToDoThis C: C:OLD_computer /DeleteDups)

I found a program called ALLDup that will be a big help but is more a general purpose duplicate finder and can't be automated to do what I want it to do.

But it's in the toolbox for future duplicate clean up needs.

John Morrison

 

[storme]

I have often your exact problem, but i have to transfer user data from corporate notebooks, so I have tell to my users that everything outside c:usersusername will be wiped.

This is the theory, users keep put every sort of thing in every place , like c:personalxxx   , but if I forget that folder no one blame me.

I have developed a couple of programs  to do that in autoit (only for c:users and corporate programs), but for your particolar problem I think you can use .

It's a  script by user llewxam I have modified some time ago, perhaps in mirror mode, give a look to the screenshot. 

It has also command line mode, I use it in some servers over freefilesync, I don't remember why....

Bye

Thanks

I did have his script in the back of my mind and did use it a while back until I had a few problems and moved to other programs.

I may revisit it again.

Thanks for the suggestion and you fork!

John Morrison

[Rogue5099]

      If the file is the same delete it

 

Are you wanting the EXACT file (MD2|MD4|MD5|SHA1|SHA256|SHA384|SHA512) match or just file name (FileExists)?

>Here I helped with if an older file exits it will replace the new with the old and could be converted either way with a little work.  Example would be to do a file list to array excluding C:OLD_Computer directory to compare with C:OLD_Computer.

Dealing with customers and their data myself, I would stick with t0nZ and say that you would back-up only "C:Users" folders and anything outside of that would not be saved unless explicitly asked for.  Also make sure to cover yourself with a signed document that you are not responsible for any data outside the scope of "C:Users" directory due to personal security measures.  If it is just a transfer from 1 HDD to another make sure to tell them to keep the OLD HDD in case they come across a file they remembered they needed.

[Chimaera]

Would this still work with a Windows XP Old box going onto a Windows 7 New Box for the data

Because i would be interested in a solution if one exists, because the damn customers never save their data in the right places..

I use a robocopy backup written in cmd atm as it works everytime and doesnt fail.

But would automating Robocopy work for you because im sure there are some switches in it to not overwrite etc like

/MOVE or maybe /XO /XN

http://ss64.com/nt/robocopy.html

The _CopyRobo in my sig may help for testing

Edited February 2, 2014 by Chimaera

[AZJIO]

>Synchronization - There is a search for "the same path and size". The checksum is not checked.
>Check_md5 - You can get the list. Then replace the path to another directory. And scan again. The output will be 2 files, match and mismatch. At least just write a script that deletes files.

 

>Create list of files - get a list of files (relative path) and checksum. >Compare strings - to compare two lists. Again, you only get a list of the identical.

Edited February 3, 2014 by AZJIO

[GhostLine]

expandcollapse popup

Func _copie_compare($chemin_source, $chemin_destination)

    $source = _FileListToArrayRec($chemin_source, "*", 0, 1)

    $destination = _FileListToArrayRec($chemin_destination, "*", 0, 1)

    If FileExists($path & "flag.tmp") = 1 Then

        $log_copie = $path & "\log\source.log"

    Else

        $log_copie = $path & "\log\" & $sn & ".log"

    EndIf

    FileOpen($log_copie, 1)

;~     1 - On recopie ce qui est sur la source et qui n'est pas sur la cible

    For $i = 1 To UBound($source) - 1

        $recherche_copie = _ArraySearch($destination, $source[$i])

        If $recherche_copie = -1 Then

            If FileGetAttrib($chemin_source & "\" & $source[$i]) <> "D" Then

                FileCopy($chemin_source & "\" & $source[$i] & "\", $chemin_destination & "\" & $source[$i], $FC_CREATEPATH)

                FileSetTime($chemin_destination & "\" & $source[$i], FileGetTime($chemin_source & "\" & $source[$i], 0, 1), 0)

            Else

                DirCreate($chemin_destination & "\" & $source[$i] & "\")

            EndIf

            FileOpen($log_copie, 1)

            FileWrite($log_copie, @MDAY & "/" & @MON & "-" & @HOUR & ":" & @MIN & " * " & "Ajout " & $chemin_destination & "\" & $source[$i] & " - création" & @CRLF)

            FileClose($log_copie)

            ConsoleWrite("Ajout " & $chemin_destination & "\" & $source[$i] & " - création" & @CR)

        ElseIf FileGetTime($chemin_destination & "\" & $destination[$recherche_copie], 0, 1) <> FileGetTime($chemin_source & "\" & $source[$i], 0, 1) Then

            If FileGetAttrib($chemin_source & "\" & $source[$i]) <> "D" Then

                FileDelete($chemin_destination & "\" & $source[$i])

                FileCopy($chemin_source & "\" & $source[$i] & "\", $chemin_destination & "\" & $source[$i])

                FileSetTime($chemin_destination & "\" & $source[$i], FileGetTime($chemin_source & "\" & $source[$i], 0, 1), 0)

                FileOpen($log_copie, 1)

                FileWrite($log_copie, @MDAY & "/" & @MON & "-" & @HOUR & ":" & @MIN & " * " & "Rempl. " & $chemin_destination & "\" & $source[$i] & " - timestamp" & @CRLF)

                FileClose($log_copie)

                ConsoleWrite("Rempl. " & $chemin_destination & "\" & $source[$i] & " - timestamp" & @CR)

            EndIf

        ElseIf FileGetSize($chemin_destination & "\" & $destination[$recherche_copie]) <> FileGetSize($chemin_source & "\" & $source[$i]) Then

            If FileGetAttrib($chemin_source & "\" & $source[$i]) <> "D" Then

                FileDelete($chemin_destination & "\" & $source[$i])

                FileCopy($chemin_source & "\" & $source[$i] & "\", $chemin_destination & "\" & $source[$i])

                FileSetTime($chemin_destination & "\" & $source[$i], FileGetTime($chemin_source & "\" & $source[$i], 0, 1), 0)

                FileOpen($log_copie, 1)

                FileWrite($log_copie, @MDAY & "/" & @MON & "-" & @HOUR & ":" & @MIN & " * " & "Rempl. " & $chemin_destination & "\" & $source[$i] & " - taille" & @CRLF)

                FileClose($log_copie)

                ConsoleWrite("Rempl. " & $chemin_destination & "\" & $source[$i] & " - timestamp" & @CR)

            EndIf

        EndIf

    Next

;~     2 - On efface ce qui est sur la cible mais qui n'est plus sur la source

    For $j = 1 To UBound($destination) - 1

        If _ArraySearch($source, $destination[$j]) = -1 Then

            FileDelete($chemin_destination & "\" & $destination[$j])

            DirRemove($chemin_destination & "\" & $destination[$j & "\"], 1)

            FileOpen($log_copie, 1)

            FileWrite($log_copie, @MDAY & "/" & @MON & "-" & @HOUR & ":" & @MIN & " * " & "Suppr. " & $chemin_destination & "\" & $destination[$j] & @CRLF)

            FileClose($log_copie)

            ConsoleWrite("Suppr. " & $chemin_destination & "\" & $destination[$j] & @CR)

        EndIf

    Next

    FileClose($log_copie)

EndFunc   ;==>_copie_compare