Sign in to follow this  
Followers 0
ViciousXUSMC

Some Help with FTPEx.au3

6 posts in this topic

#1 ·  Posted (edited)

So I have a project that has been sitting for a long time, and I think I just finally found the answer to the problem.  FTPEx.au3 but I am having some minor issues and would want to make sure I get some expert advice since this is going to be important that it works right if I implement it.

Goal: To have several computers in the field update a map file automatically every once in a while.

The map file is between 500MB and 1GB

I have basic FTP working so far to transfer a single file:

#Include <FTPEx.au3>
#Include <Array.au3>

$vFTPSes = _FTP_Open("PSFTP")
;MsgBox(0, "", @Error)
$vFTPSes2 = _FTP_Connect($vFTPSes, "my server", "my user", "my pw")
;MsgBox(0, "", @Error)
_FTP_FileGet($vFTPSes2, "/Tiburon FTP Update/Maps/test.txt", "C:\Users\frpatrmo\desktop\Get Map Update\Maps\test.txt", "True")
;MsgBox(0, "", @Error)
_FTP_Close($vFTPSes2)

My first issue is this, the "file" is actually a directory of MANY files and I cant find anywhere in the help files a way to transfer an entire directory instead of a file.  If that can be done, thats pretty much my largest hurdle right now.  Instead I bet that I will need to use a loop and an array of files.  I looked at the filelist to array functions like _FTP_ListToArray but it lists every file at the root of the FTP server, I need it to drill down to the specific directory where the files I need are located.

 

Other than that I assume that in a script that the file transfer will finish before the next command is run, this way I can ensure I do not put an incomplete download file into the application directory.  My logic tells me to download the file to @TempDir and when/if it completes the entire download to then have AutoIT move/copy the directory to the program location to be used.  This way if the download never finishes it never gets moved/copied.

 

After I get this initial trouble figured out, I then need to find the best way to make this run about 1 time a week silently and then not run again for another week on a multi user computer environment. 

 

As always appreciate the help. 

 

Edit: Ok found _FTP_DirSetCurrent() lets me set my desired folder as the current Dir and then the _FTP_ListToArray() will show me the correct files.

Still a long way to go however, since its a mix of folders and files and I have no idea how to loop it to get everything transferred. 

 

Edited by ViciousXUSMC

Share this post


Link to post
Share on other sites



#2 ·  Posted (edited)

The way to put a directory and sub directories is with:

_FTP_DirPutContents($vFTPSes2, $dirPath, $remotePath, 1) ; 1 = recursive

 

Edited by MikahS

Snips & Scripts


My Snips: graphCPUTemp ~ getENVvars
My Scripts: Short-Order Encrypter - message and file encryption V1.6.1 ~ AuPad - Notepad written entirely in AutoIt V1.9.4

Feel free to use any of my code for your own use.                                                                                                                                                           Forum FAQ

 

Share this post


Link to post
Share on other sites

Just wanted to add my crazy code, I have this working to move all the files and skip over the folders.

#Include <FTPEx.au3>
#Include <Array.au3>
$vFTPSes = _FTP_Open("PSFTP")
$vFTPSes2 = _FTP_Connect($vFTPSes, "server", "user", "pass")
_FTP_DirSetCurrent($vFTPSes2, "/Tiburon FTP Update/Maps/")
Local $hFTPFind
$aFList = _FTP_FindFileFirst($vFTPSes2, _FTP_DirGetCurrent($vFTPSes2), $hFTPFind)
While 1
    _FTP_FileGet($vFTPSes2, GetName(), "C:\Users\frpatrmo\desktop\Get Map Update\Maps\" & GetName(), "True")
    If @Error <> 0 Then ExitLoop
WEnd
_FTP_FindFileClose($hFTPFind)
_FTP_Close($vFTPSes2)
Func GetName()
    $aName = _FTP_FindFileNext($hFTPFind)
    If @Error <> 0 Then Return 1
    If $aName[1] = 16 Then
        Return "test.txt"
    Else
        Return $aName[10]
    EndIf
EndFunc

Share this post


Link to post
Share on other sites

The way to put a directory and sub directories is with:

_FTP_DirPutContents($vFTPSes2, $dirPath, $remotePath, 1) ; 1 = recursive

 

​Most unfortunatly what I really need is the opposite, a _FTP_DirGetContents() I found a user made UDF that states it does this but I am getting errors when trying to use it.

 

Share this post


Link to post
Share on other sites

#5 ·  Posted (edited)

Ok, as I was driving home from work the lightbulb came on and I got rid of that terrible code from yesterday, this is much cleaner.

#Include <FTPEx.au3>
#Include <Array.au3>

$vFTPSes = _FTP_Open("PSFTP")
$vFTPSes2 = _FTP_Connect($vFTPSes, "snip", "snip", "snip")
_FTP_DirSetCurrent($vFTPSes2, "/Tiburon FTP Update/Maps/")

$aFile = _FTP_ListToArray($vFTPSes2, 2)
For $i = 1 To UBound($aFile) - 1
    _FTP_ProgressDownload($vFTPSes2, "C:\Users\frpatrmo\desktop\Get Map Update\Maps\" & $aFile[$i], $aFile[$i])
Next

_FTP_Close($vFTPSes2)
MsgBox(0, "", "FTP Download Complete")

 

Now here is where I have a choice, I can manually create loops for the directories in the same fashion by just changing the _FTP_DirSetCurrent to one of those directories, but in the interest of getting better and learning I really want to find a way to make this recursive and do this on its own.

My best place to start is I think a _FTP_ListToArray($vFTPSes2, 1) so that it only captures the Directory names and then I need to pass that into a loop that will change the FTP Directory, the Save Local Save Location, and then loop through the files in that directory (also probably need to do a local DirCreate() but not sure on that)

As for my "how to check what version of the map, and if it downloaded fully" my idea was this one.  Place a text file in the FTP server with lines that correspond to the # of files, the size, and the version so that I can read those values and compare to the local download.  It is not fully completed by my testing snippet looks like this.

 

#Include <Array.au3>

$sDLSize = FileReadLine(@ScriptDir & "\Maps\Map Info.txt", 1)
$sDLCount = FileReadLine(@ScriptDir & "\Maps\Map Info.txt", 2)

$aLocalDL = DirGetSize(@ScriptDir & "\Maps\", 1)
;_ArrayDisplay($aLocalDL)

MsgBox(0, "", "Your Download Status Is" & @CRLF & "Proposed Download Size was " & $sDLSize & " Your Download was " & $aLocalDL[0])
MsgBox(0, "", "Your Download Status Is" & @CRLF & "Proposed Download File Count was " & $sDLCount & " Your Download was " & $aLocalDL[1])
If $sDLSize = $aLocalDL[0] Then
    MsgBox(0, "", "Size Matches")
Else
    MsgBox(0, "", "Size Does Not Match")
EndIf

If $sDLCount = $aLocalDL[1] Then
    MsgBox(0, "", "Count Matches")
Else
    MsgBox(0, "", "Count Does Not Match")
EndIf

 

Edited by ViciousXUSMC

Share this post


Link to post
Share on other sites

#6 ·  Posted (edited)

So close!

I have tried this like 3 different ways, and trying to change local, global, dim statments and even now went and changed the Download() function so that the local save path is a passed varible and for some reason while this is recursivily downloading all my files, all of the files are being saved to the home folder "Maps" and the Directories being created are empty.  

It's driving me mad because I cant fathom whats going on.

 

#Include <FTPEx.au3>
#Include <Array.au3>

$vFTPSes = _FTP_Open("PSFTP")
$vFTPSes2 = _FTP_Connect($vFTPSes, "snip", "snip", "snip")
_FTP_DirSetCurrent($vFTPSes2, "/Tiburon FTP Update/Maps/")

Global $aFile2 = _FTP_ListToArray($vFTPSes2, 1)
$sLocalSave = "C:\Users\frpatrmo\desktop\Get Map Update\Maps\"
DirCreate($sLocalSave)

Download()

;_ArrayDisplay($aFile2)

For $i2 = 1 To UBound($aFile2) - 1
    _FTP_DirSetCurrent($vFTPSes2, "/Tiburon FTP Update/Maps/" & $aFile2[$i2])
    $sLocalSaveNew = "C:\Users\frpatrmo\desktop\Get Map Update\Maps\" & $aFile2[$i2]
    DirCreate($sLocalSaveNew)
    MsgBox(0, "", "Inside Loop $localsavenew is " & $sLocalSaveNew)
    Download($sLocalSaveNew)
Next




_FTP_Close($vFTPSes2)


;MsgBox(0, "", "FTP Download Complete")


Func Download($sLocalSave = "C:\Users\frpatrmo\desktop\Get Map Update\Maps\")
$aFile = _FTP_ListToArray($vFTPSes2, 2)

For $i = 1 To UBound($aFile) - 1
    _FTP_ProgressDownload($vFTPSes2, $sLocalSave & $aFile[$i], $aFile[$i])
Next
EndFunc

Edit: Well played FTP Download looks like I was missing the ending "\" so it just defaulted to the last directory instead of giving an error. 

Edited by ViciousXUSMC

Share this post


Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!


Register a new account

Sign in

Already have an account? Sign in here.


Sign In Now
Sign in to follow this  
Followers 0

  • Similar Content

    • Sigmac
      By Sigmac
      I have used this code for a long time, but for a week or 2 it stopped working?
      Connection is ok, the put create the file on server if I delete it on the FTP server, but the file is empty and after 30 secondees the function return 0
      I have tested on 2 machines, Filezilla FTP client have no issue to the server.
      Firewall is disabled under test.
        If $writeFTP = True Then
            $Open=_FTPOpen('MyFTP Control')
            $Conn=_FTPConnect($Open, $destinationServer, $destinationUsername, $destinationPass)
       MsgBox(0,"start","start")
            $Ftpp=_FtpPutFile($Conn, $filePath&$name&".json", "httpdocs/p_calender/" & $name & ".json")
      MsgBox(0,"return","return"&$Ftpp)
      Exit
            $Ftpc=_FTPClose($Open)
           EndIf
       
      From the Lib:
      Func _FTPPutFile($l_FTPSession, $s_LocalFile, $s_RemoteFile, $l_Flags = 0, $l_Context = 0)
          Local $ai_FTPPutFile = DllCall('wininet.dll', 'int', 'FtpPutFile', 'long', $l_FTPSession, 'str', $s_LocalFile, 'str', $s_RemoteFile, 'long', $l_Flags, 'long', $l_Context)
          If @error OR $ai_FTPPutFile[0] = 0 Then
              SetError(-1)
              Return 0
          EndIf
          Return $ai_FTPPutFile[0]
      EndFunc ;==> _FTPPutFile()
       
    • mLipok
      By mLipok
      As for now I was using such kind of snippet:
      Local $aFTP_FileList = _FTP_ListToArray($hFTPSession, 2) For $iFTPFileSize_idx = 1 To $aFTP_FileList[0] ConsoleWrite('Pobieram informacje o pliku:' & $aFTP_FileList[$iFTPFileSize_idx] ) $iWielkoscPliku = _FTP_FileGetSize($hFTPSession, $aFTP_FileList[$iFTPFileSize_idx]) ConsoleWrite($iFTPFileSize_idx & ' : ' & $aFTP_FileList[$iFTPFileSize_idx] & ' rozmiar=' & $iWielkoscPliku) Sleep(200) Next  
      But from some time my clients start buying cheap WD MyCloud NAS, and my problems starts.
      On all others NAS there is no problem (Seagate BlackArmour, QNAP, SYNOLOGY .... ).

      When on list there is for example 20 files then first two of them are very fast checked and reported they FileSize.
      After 2 files there is about 20 sec stop....... and next two files are checked with no errors but FileSize == 0 
      again there is about 20 sec stop....... and next two files are checked with no errors but FileSize == 0 
      again there is about 20 sec stop....... and next two files are checked with no errors but FileSize == 0 
      again there is about 20 sec stop....... and next two files are checked with no errors but FileSize == 0 
      again there is about 20 sec stop....... and next two files are checked with no errors but FileSize == 0 
      .......
       
      In time when I process investigation I checked how :  _FTP_ListToArray2D and _FTP_ListToArrayEx works and I was shocked that they works super fast.
       
      Here are the questions:
      Q1: Why does the problem occur only on WD MyCloud NAS?
      Q2: What is the significant difference that makes using _FTP_ListToArray2D and _FTP_ListToArrayEx to retrieve file sizes is still fast?
      Q3: Why _FTP_FileGetSize() not reporting @errors but returned FileSize = 0 
       
      Regards,
      mLipok
       
    • mLipok
      By mLipok
      In documentation for:
       
      #include <FTPEx.au3> _FTP_Connect ( $hInternetSession, $sServerName, $sUsername, $sPassword [, $iPassive = 0 [, $iServerPort = 0 [, $iService = $INTERNET_SERVICE_FTP [, $iFlags = 0 [, $fuContext = 0]]]]] ) There are two parameters for Passive:
       
      My question is: 

      What is a difference beetwen  using :
      $iPassive = 1
      and
      $iFlags =     $INTERNET_FLAG_PASSIVE
      Regards,
      mLipok
       
    • Xandy
      By Xandy
      Screenshot program that can upload/FTP to website/storage with hotkey.
      Features GUI to display programmable keys.

      Set the hotkeys with this function to use, and display hotkeys.
      ; hotkey_set() Parameters: ; ----------------------------------------------------------- ; $aHotkey -                The array hotkeys are stored in. This function sets the values of this array[hotkey_id][$hotkey_data] ; $dHotkey_id -             The enum for this hotkey index ; $sHotkey_description -     The label displayed to the user to represent function of hotkey ; $sHotkey_name -            The hotkey it'self.  Whatever name string you want to give the key ; $dHotkey_key -             The _IsPressed keycode ;    Keycodes AT: https://www.autoitscript.com/autoit3/docs/libfunctions/_IsPressed.htm ; $dHotkey_shift -             Shift flag 0 or 1 Default off ; $dHotkey_ctrl -             Ctrl flag 0 or 1 Default off ; $dHotkey_alt -             Alt flag 0 or 1 Default off Func hotkey_set(ByRef $aHotkey, $dHotkey_id, $sHotkey_description, $sHotkey_name, $dHotkey_key, $dHotkey_shift = 0, $dHotkey_ctrl = 0, $dHotkey_alt = 0)     $aHotkey[$dHotkey_id][$eHotkey_data_key_description] = $sHotkey_description     $aHotkey[$dHotkey_id][$eHotkey_data_key_name] = $sHotkey_name     $aHotkey[$dHotkey_id][$eHotkey_data_key] = $dHotkey_key     $aHotkey[$dHotkey_id][$eHotkey_data_shift] = $dHotkey_shift     $aHotkey[$dHotkey_id][$eHotkey_data_ctrl] = $dHotkey_ctrl     $aHotkey[$dHotkey_id][$eHotkey_data_alt] = $dHotkey_alt EndFunc   ;==>hotkey_set ; You can set your hotkeys here ; Please visit the hotkey_set() function for parameter information hotkey_set($aHotkey, $eHotkey_screenshot_ftp, "Selected Window to FTP", "F12", "7B", 0, 1, 0); F12 hotkey_set($aHotkey, $eHotkey_screenshot_disk, "Selected Window to Disk", "S", "53", 1, 1, 1); S hotkey_set($aHotkey, $eHotkey_clipboard_send, "Send Clipboard keystrokes", "F10", "79", 1, 1, 1); F10  
      Configure settings dialog:

      Screenshot Filename and Screenshot Counter, are used to create simple unique filenames that can cycle. Copy URL to clipboard option. - For linking your screenshots. The screenshot file type is for local copy only. App always uses .JPG for FTP right now, but I could add FTP screenshot file type specification.  
      Any suggestions?  Did I break anything, what did I miss?
      Package uses TTS.au3 by Beege: 
       
      FTP_Screen.zip
      File includes:
         - FTP_Screen.au3
         - FTPScreen.ico
         - TTS.au3 - by Beege
    • drorshem
      By drorshem
      Hi,
      I'm looking to create a script which will download all *.txt files from a remote FTP server.
      Once downloaded, delete all *.txt files.
       
      Can this be achieved using AutoIt ?