Jump to content
CharlieH

FTP appears to be caching(?)

Recommended Posts

CharlieH

Hi,

 

I have written a small script to read a file from an FTP server and check its contents. This can be re-run by the press of a button, however, if the file is deleted from the ftp server between runs (with the .exe still live), the file is still "read" and written locally, which then passes the check.

 

If I run it initially without the file, it correctly fails and pops up my error message, but if the file is then added, it then seemingly gets cached (or similar) so that the app then always reports a success.

 

The below code snippet is just the function run when the "test" button is pressed. It includes a load of debug message boxes, and from that I think I've gathered a few (possibly) interesting/relevant things:

  • $Open and $Conn are 8 byte values, which increments (not by 1) when the FTP connection is not closed, but if the connection is closed, they stick at the value (presumably windows can re-use that session id if it's been closed

e.g:

1st run (file not present) $Open -> 0x00CC0004 $Conn -> 0x00CC0008

2nd run (file not present) $Open -> 0x00CC0010 $Conn -> 0x00CC0014

3rd run (file now present) $Open -> 0x00CC001C $Conn -> 0x00CC0020

4th run (file still present) $Open -> 0x00CC001C $Conn -> 0x00CC0020

  • $Ftp = _FTP_FileGet.... returns a 1 when file not present (in a run after it was present) and "test_transfer.txt" does get created and does contain the correct string

This is the key bit I dont understand, I dont know how/where it is getting the data to write this file when it literally no longer exists on the target FTP server...

  • resetting every variable used in the function each time it's run does work (in that they become 0), but it doesn't affect the putcome

I had thought perhaps some key values were being stored in the variables, but this doesn't seem to be the case

 

 

Is there any concept of clearing a cache when closing an ftp session? Or deleting any unknown temporary files windows might make?

 

Thanks all

 

Func Transfer()
    Local $connected = 0
    $Ftpp = 0           ;Trying to reset these every time function is called
    $file = 0
    $Open = 0
    $Conn = 0
    $Ftpc = 0

    ;Make a new "connecting..." window so that the user has feedback that a transfer is attempting to take place
    ;Otherwise it just runs in the background and there's no indication its doing anything
    $connection_window = GUICreate ("Ethernet Switch Test" , 300 , 160 , -1 , -1 , -1 , -1 , 0)
    GUISetBkColor(0xFFFFFF)
    GUISetFont(10 * _GDIPlus_GraphicsGetDPIRatio()[0], 400, Default, "Sans Serif")
    $connecting_label = GUICtrlCreateLabel("Connecting to board...", 0, 25, 300, -1, $SS_Center, "")
    GUISetState(@SW_SHOW, $connection_window)
    Sleep(100)

    ;Connect
    ;MsgBox(0, "DEBUG", "1" & $Conn)
    While $connected = 0
        $Open = _FTP_Open($count)
        ;MsgBox(0, "DEBUG", "open " & $Open)
        $Conn = _FTP_Connect($Open, $server, $username, $password)
        ;MsgBox(0, "DEBUG", "2" & $Conn)
        If $Conn = 0 then
            Local $retry = Msgbox(65, 'FTP Transfer', 'Connection failed' & @CRLF & "Retry?")
            If $retry = 2 Then
                MsgBox(0, "FTP Transfer", "Operation aborted")
                GUISetState(@SW_HIDE, $connection_window)
                Return
            EndIf
        Else
            $connected_label = GUICtrlCreateLabel("Connected!", 0, 45, 300, -1, $SS_Center, "")
            $connected = 1
            MsgBox(0, "DEBUG", "3" & $connected)
            Sleep(100)
        endIf
    WEnd

    $transfering_label = GUICtrlCreateLabel("Reading file....", 0, 45, 300, -1, $SS_Center, "")

    ;Read file from server
    ;MsgBox(0, "DEBUG", "5" & $Ftpp)
    ;MsgBox(0, "DEBUG", "flie " & $file)
    $Ftpp = _FTP_FileGet($Conn, 'test/test.txt', 'test_transfer.txt')
    ;MsgBox(0, "DEBUG", "6" & $Ftpp)
    If ($Ftpp) then
        $transfered_label = GUICtrlCreateLabel("Transfered, checking...", 0, 65, 300, -1, $SS_Center, "")
        ;MsgBox(0, "DEBUG", "flie " & $file)
        $file = FileRead("test_transfer.txt")
        ;MsgBox(0, "DEBUG", "flie " & $file)
        If Not StringInStr($file, 'this is a test string 12345') Then
            MsgBox(0, "File check", "Received file incorrect, test failed!")
            GUISetState(@SW_HIDE, $connection_window)
            Return
        Else
            $tested_label = GUICtrlCreateLabel("Tested and Passed!", 0, 85, 300, -1, $SS_Center, "")
            $Ftpc = _FTP_Close($Open)
            ;MsgBox(0, "DEBUG", "close" & $Ftpc)
            ;$count = $count+1
            $ok_button = GUICtrlCreateButton("OK", 125, 105, 50, -1)
            While 1
                Local $pressed = GUIGetMsg()
                If ($pressed = $ok_button) Then
                    FileDelete("test_transfer.txt")
                    GUISetState(@SW_HIDE, $connection_window)
                    ;$connection_window = 0
                    Return
                EndIf
            WEnd
        EndIf
    Else
        MsgBox(0, "Transfer", "Could not read file " & @error)
        GUISetState(@SW_HIDE, $connection_window)
        Return
    EndIf

EndFunc

 

Share this post


Link to post
Share on other sites
Andreik
Posted (edited)

You can use  $INTERNET_FLAG_RELOAD in _FTP_Open() to force the download from the origin server instead from cache.

Edited by Andreik

When the words fail... music speaks

Share this post


Link to post
Share on other sites
CharlieH
45 minutes ago, Andreik said:

You can use  $INTERNET_FLAG_RELOAD in _FTP_Open() to force the download from the origin server instead from cache.

Many thanks for the suggestion, I've now edited the _FTP_Open call:

$Open = _FTP_Open($count, $INTERNET_OPEN_TYPE_DIRECT, '', '', $INTERNET_FLAG_RELOAD)

However, this hasn't solved the issue I was having... :/

Is the above syntax correct? Can I avoid the extra overflow parameters or do I need all to send the iFlags?

Share this post


Link to post
Share on other sites
Andreik

Sorry, my mistake, I wanted to say to use this flag in _FTP_FileGet().

  • Like 1

When the words fail... music speaks

Share this post


Link to post
Share on other sites
CharlieH

Ah, amazing thanks! All sorted now.

Share this post


Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now

  • Similar Content

    • Sally1801
      By Sally1801
      Hello,
      i need help in deleting files from a server. The function "_FTP_DirDelete" only deletes a directory when its empty. I need to delete a non empty directory. I also can not delete the files in this directory first, because the files are PAG and DIR files in a .DAV directory and FTPEx.au3 doesnt like a directory starting with a ".".
      Any ideas?
      Thx, Sally
    • Sigmac
      By Sigmac
      I have used this code for a long time, but for a week or 2 it stopped working?
      Connection is ok, the put create the file on server if I delete it on the FTP server, but the file is empty and after 30 secondees the function return 0
      I have tested on 2 machines, Filezilla FTP client have no issue to the server.
      Firewall is disabled under test.
        If $writeFTP = True Then
            $Open=_FTPOpen('MyFTP Control')
            $Conn=_FTPConnect($Open, $destinationServer, $destinationUsername, $destinationPass)
       MsgBox(0,"start","start")
            $Ftpp=_FtpPutFile($Conn, $filePath&$name&".json", "httpdocs/p_calender/" & $name & ".json")
      MsgBox(0,"return","return"&$Ftpp)
      Exit
            $Ftpc=_FTPClose($Open)
           EndIf
       
      From the Lib:
      Func _FTPPutFile($l_FTPSession, $s_LocalFile, $s_RemoteFile, $l_Flags = 0, $l_Context = 0)
          Local $ai_FTPPutFile = DllCall('wininet.dll', 'int', 'FtpPutFile', 'long', $l_FTPSession, 'str', $s_LocalFile, 'str', $s_RemoteFile, 'long', $l_Flags, 'long', $l_Context)
          If @error OR $ai_FTPPutFile[0] = 0 Then
              SetError(-1)
              Return 0
          EndIf
          Return $ai_FTPPutFile[0]
      EndFunc ;==> _FTPPutFile()
       
    • mLipok
      By mLipok
      As for now I was using such kind of snippet:
      Local $aFTP_FileList = _FTP_ListToArray($hFTPSession, 2) For $iFTPFileSize_idx = 1 To $aFTP_FileList[0] ConsoleWrite('Pobieram informacje o pliku:' & $aFTP_FileList[$iFTPFileSize_idx] ) $iWielkoscPliku = _FTP_FileGetSize($hFTPSession, $aFTP_FileList[$iFTPFileSize_idx]) ConsoleWrite($iFTPFileSize_idx & ' : ' & $aFTP_FileList[$iFTPFileSize_idx] & ' rozmiar=' & $iWielkoscPliku) Sleep(200) Next  
      But from some time my clients start buying cheap WD MyCloud NAS, and my problems starts.
      On all others NAS there is no problem (Seagate BlackArmour, QNAP, SYNOLOGY .... ).

      When on list there is for example 20 files then first two of them are very fast checked and reported they FileSize.
      After 2 files there is about 20 sec stop....... and next two files are checked with no errors but FileSize == 0 
      again there is about 20 sec stop....... and next two files are checked with no errors but FileSize == 0 
      again there is about 20 sec stop....... and next two files are checked with no errors but FileSize == 0 
      again there is about 20 sec stop....... and next two files are checked with no errors but FileSize == 0 
      again there is about 20 sec stop....... and next two files are checked with no errors but FileSize == 0 
      .......
       
      In time when I process investigation I checked how :  _FTP_ListToArray2D and _FTP_ListToArrayEx works and I was shocked that they works super fast.
       
      Here are the questions:
      Q1: Why does the problem occur only on WD MyCloud NAS?
      Q2: What is the significant difference that makes using _FTP_ListToArray2D and _FTP_ListToArrayEx to retrieve file sizes is still fast?
      Q3: Why _FTP_FileGetSize() not reporting @errors but returned FileSize = 0 
       
      Regards,
      mLipok
       
    • mLipok
      By mLipok
      In documentation for:
       
      #include <FTPEx.au3> _FTP_Connect ( $hInternetSession, $sServerName, $sUsername, $sPassword [, $iPassive = 0 [, $iServerPort = 0 [, $iService = $INTERNET_SERVICE_FTP [, $iFlags = 0 [, $fuContext = 0]]]]] ) There are two parameters for Passive:
       
      My question is: 

      What is a difference beetwen  using :
      $iPassive = 1
      and
      $iFlags =     $INTERNET_FLAG_PASSIVE
      Regards,
      mLipok
       
    • Xandy
      By Xandy
      Screenshot program that can upload/FTP to website/storage with hotkey.
      Features GUI to display programmable keys.

      Set the hotkeys with this function to use, and display hotkeys.
      ; hotkey_set() Parameters: ; ----------------------------------------------------------- ; $aHotkey -                The array hotkeys are stored in. This function sets the values of this array[hotkey_id][$hotkey_data] ; $dHotkey_id -             The enum for this hotkey index ; $sHotkey_description -     The label displayed to the user to represent function of hotkey ; $sHotkey_name -            The hotkey it'self.  Whatever name string you want to give the key ; $dHotkey_key -             The _IsPressed keycode ;    Keycodes AT: https://www.autoitscript.com/autoit3/docs/libfunctions/_IsPressed.htm ; $dHotkey_shift -             Shift flag 0 or 1 Default off ; $dHotkey_ctrl -             Ctrl flag 0 or 1 Default off ; $dHotkey_alt -             Alt flag 0 or 1 Default off Func hotkey_set(ByRef $aHotkey, $dHotkey_id, $sHotkey_description, $sHotkey_name, $dHotkey_key, $dHotkey_shift = 0, $dHotkey_ctrl = 0, $dHotkey_alt = 0)     $aHotkey[$dHotkey_id][$eHotkey_data_key_description] = $sHotkey_description     $aHotkey[$dHotkey_id][$eHotkey_data_key_name] = $sHotkey_name     $aHotkey[$dHotkey_id][$eHotkey_data_key] = $dHotkey_key     $aHotkey[$dHotkey_id][$eHotkey_data_shift] = $dHotkey_shift     $aHotkey[$dHotkey_id][$eHotkey_data_ctrl] = $dHotkey_ctrl     $aHotkey[$dHotkey_id][$eHotkey_data_alt] = $dHotkey_alt EndFunc   ;==>hotkey_set ; You can set your hotkeys here ; Please visit the hotkey_set() function for parameter information hotkey_set($aHotkey, $eHotkey_screenshot_ftp, "Selected Window to FTP", "F12", "7B", 0, 1, 0); F12 hotkey_set($aHotkey, $eHotkey_screenshot_disk, "Selected Window to Disk", "S", "53", 1, 1, 1); S hotkey_set($aHotkey, $eHotkey_clipboard_send, "Send Clipboard keystrokes", "F10", "79", 1, 1, 1); F10  
      Configure settings dialog:

      Screenshot Filename and Screenshot Counter, are used to create simple unique filenames that can cycle. Copy URL to clipboard option. - For linking your screenshots. The screenshot file type is for local copy only. App always uses .JPG for FTP right now, but I could add FTP screenshot file type specification.  
      Any suggestions?  Did I break anything, what did I miss?
      Package uses TTS.au3 by Beege: 
       
      FTP_Screen.zip
      File includes:
         - FTP_Screen.au3
         - FTPScreen.ico
         - TTS.au3 - by Beege
×