From trac at ftputil.sschwarzer.net Sat Aug 21 10:57:50 2010 From: trac at ftputil.sschwarzer.net (ftputil) Date: Sat, 21 Aug 2010 08:57:50 -0000 Subject: [ftputil] #52: Main FTPHost session times out while downloading a large file Message-ID: <046.a214fb7b7308b3b1fef1df9987f97c44@ftputil.sschwarzer.net> #52: Main FTPHost session times out while downloading a large file -------------------------------------------+-------------------------------- Reporter: schwa | Owner: schwa Type: defect | Status: new Priority: major | Milestone: 2.5 Component: Library | Version: Keywords: timeout, main, child, session | -------------------------------------------+-------------------------------- If an upload or download is started whose duration exceeds the timeout setting of the server, the main FTP session which spawned the child session will time out even though the upload/download will succeed. That is, any direct access (that works on the server) to the original `FTPHost` object will result in a traceback. (problem [http://codespeak.net/pipermail/ftputil/2010q3/000317.html reported] by Henning Hraban Ramm) -- Ticket URL: ftputil Python FTP client library From trac at ftputil.sschwarzer.net Sat Aug 21 11:02:36 2010 From: trac at ftputil.sschwarzer.net (ftputil) Date: Sat, 21 Aug 2010 09:02:36 -0000 Subject: [ftputil] #52: Main FTPHost session times out while downloading a large file In-Reply-To: <046.a214fb7b7308b3b1fef1df9987f97c44@ftputil.sschwarzer.net> References: <046.a214fb7b7308b3b1fef1df9987f97c44@ftputil.sschwarzer.net> Message-ID: <055.150c2aff738c0c07874b6604d4c8601f@ftputil.sschwarzer.net> #52: Main FTPHost session times out while downloading a large file ----------------------+----------------------------------------------------- Reporter: schwa | Owner: schwa Type: defect | Status: new Priority: major | Milestone: 2.5 Component: Library | Version: Resolution: | Keywords: timeout, main, child, session ----------------------+----------------------------------------------------- Comment(by schwa): The traceback gotten by Henning is {{{ Traceback (most recent call last): File "./ftpsync.py", line 388, in host.rename(sourcepath, host.path.join(root, abgeholtdir, f)) File "/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.6 /site-packages/ftputil-2.4.2-py2.6.egg/ftputil/ftputil.py", line 746, in rename self._check_inaccessible_login_directory() File "/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.6 /site-packages/ftputil-2.4.2-py2.6.egg/ftputil/ftputil.py", line 535, in _check_inaccessible_login_directory self.chdir(presumable_login_dir) File "/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.6 /site-packages/ftputil-2.4.2-py2.6.egg/ftputil/ftputil.py", line 587, in chdir ftp_error._try_with_oserror(self._session.cwd, path) File "/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.6 /site-packages/ftputil-2.4.2-py2.6.egg/ftputil/ftp_error.py", line 146, in _try_with_oserror raise TemporaryError(*exc.args) ftputil.ftp_error.TemporaryError: 421 No Transfer Timeout (300 seconds): closing control connection. Debugging info: ftputil 2.4.2, Python 2.6.4 (darwin) }}} and he adds: The mentioned line (`host.rename`) is right after: `host.download_if_newer(sourcepath, targetpath, mode='b')` with host being a `ftputil.FTPHost` -- Ticket URL: ftputil Python FTP client library From trac at ftputil.sschwarzer.net Sat Aug 21 15:45:58 2010 From: trac at ftputil.sschwarzer.net (ftputil) Date: Sat, 21 Aug 2010 13:45:58 -0000 Subject: [ftputil] #44: Don't use timed-out child sessions for remote files In-Reply-To: <046.929282df6c1fdb2d59bb093b2d6a0ea7@ftputil.sschwarzer.net> References: <046.929282df6c1fdb2d59bb093b2d6a0ea7@ftputil.sschwarzer.net> Message-ID: <055.19ed5805c5ef864c1dac32400eeacd48@ftputil.sschwarzer.net> #44: Don't use timed-out child sessions for remote files ----------------------+----------------------------------------------------- Reporter: schwa | Owner: schwa Type: defect | Status: new Priority: minor | Milestone: 2.5 Component: Library | Version: 2.4.2 Resolution: | Keywords: open, file, child session, timeout ----------------------+----------------------------------------------------- Changes (by schwa): * milestone: => 2.5 -- Ticket URL: ftputil Python FTP client library From trac at ftputil.sschwarzer.net Thu Aug 26 19:03:10 2010 From: trac at ftputil.sschwarzer.net (ftputil) Date: Thu, 26 Aug 2010 17:03:10 -0000 Subject: [ftputil] #48: Instructions for running "real FTP access" test are unclear In-Reply-To: <049.a6060a6e478da29a08f21c23836ae634@ftputil.sschwarzer.net> References: <049.a6060a6e478da29a08f21c23836ae634@ftputil.sschwarzer.net> Message-ID: <058.2c16245260347d7eed191c50dd127fa1@ftputil.sschwarzer.net> #48: Instructions for running "real FTP access" test are unclear -----------------------+---------------------------------------------------- Reporter: ssteiner | Owner: schwa Type: defect | Status: closed Priority: major | Milestone: Component: Library | Version: 2.4.2 Resolution: fixed | Keywords: tests docs -----------------------+---------------------------------------------------- Changes (by schwa): * status: assigned => closed * resolution: => fixed Comment: I hope the workaround is good enough, so I close this bug for now. If someone strongly disagrees they may reopen the ticket. ;-) -- Ticket URL: ftputil Python FTP client library From trac at ftputil.sschwarzer.net Fri Aug 27 06:09:18 2010 From: trac at ftputil.sschwarzer.net (ftputil) Date: Fri, 27 Aug 2010 04:09:18 -0000 Subject: [ftputil] #15: Add support for FXP (FTP to FTP copy) In-Reply-To: <057.ccd6acfc7f01da6815edf970095d1b57@ftputil.sschwarzer.net> References: <057.ccd6acfc7f01da6815edf970095d1b57@ftputil.sschwarzer.net> Message-ID: <066.5a638add9955eaa328f7a7b524a67565@ftputil.sschwarzer.net> #15: Add support for FXP (FTP to FTP copy) -------------------------------+-------------------------------------------- Reporter: swordp at gmail.com | Owner: schwa Type: enhancement | Status: assigned Priority: major | Milestone: 2.6 Component: Library | Version: Resolution: | Keywords: FXP, FTP-to-FTP-copy -------------------------------+-------------------------------------------- Changes (by schwa): * milestone: => 2.6 -- Ticket URL: ftputil Python FTP client library From trac at ftputil.sschwarzer.net Sat Sep 18 13:27:35 2010 From: trac at ftputil.sschwarzer.net (ftputil) Date: Sat, 18 Sep 2010 11:27:35 -0000 Subject: [ftputil] #29: Distribute ftputil as a Debian/Ubuntu package In-Reply-To: <046.55dd1f0634bf00b870f56afca3014134@ftputil.sschwarzer.net> References: <046.55dd1f0634bf00b870f56afca3014134@ftputil.sschwarzer.net> Message-ID: <055.f6f12c13209a4b1126668055af278c7e@ftputil.sschwarzer.net> #29: Distribute ftputil as a Debian/Ubuntu package --------------------+------------------------------------------------------- Reporter: schwa | Owner: schwa Type: task | Status: assigned Priority: major | Milestone: 2.5 Component: Other | Version: 2.2.3 Resolution: | Keywords: Debian, package, Ubuntu --------------------+------------------------------------------------------- Comment(by schwa): Thanks to the help from Debian package maintainer Chris Silva, an ftputil package is now [http://svn.debian.org/viewsvn/python- modules/packages/ftputil/ included] in Debian's Subversion repository. It hasn't shown up in Sid (Debian Unstable) yet. Some information on getting Debian packages into Ubuntu is [https://wiki.ubuntu.com/UbuntuDevelopment/NewPackages available]. I plan to ask for a package sync after the ftputil package shows up in Debian Sid. As far as I understand, if I don't do this, ftputil will only get into the Ubuntu repository of the release ''after'' Ubuntu 10.10, i. e. in April 2011. -- Ticket URL: ftputil Python FTP client library From trac at ftputil.sschwarzer.net Sat Sep 18 13:44:27 2010 From: trac at ftputil.sschwarzer.net (ftputil) Date: Sat, 18 Sep 2010 11:44:27 -0000 Subject: [ftputil] #20: Allow to track upload and download progress In-Reply-To: <046.21a622275630bc674110e4dd7b858de8@ftputil.sschwarzer.net> References: <046.21a622275630bc674110e4dd7b858de8@ftputil.sschwarzer.net> Message-ID: <055.b711683d37c1b8fd071cbee786ddca6d@ftputil.sschwarzer.net> #20: Allow to track upload and download progress --------------------------+------------------------------------------------- Reporter: schwa | Owner: schwa Type: enhancement | Status: assigned Priority: major | Milestone: 2.5 Component: Library | Version: 2.2.1 Resolution: | Keywords: upload, download, progress, callable --------------------------+------------------------------------------------- Comment(by schwa): Callback functionality has been included as of revision [45c530a885e6]. The change still has to be documented. -- Ticket URL: ftputil Python FTP client library From trac at ftputil.sschwarzer.net Sat Sep 18 15:08:25 2010 From: trac at ftputil.sschwarzer.net (ftputil) Date: Sat, 18 Sep 2010 13:08:25 -0000 Subject: [ftputil] #44: Don't use timed-out child sessions for remote files In-Reply-To: <046.929282df6c1fdb2d59bb093b2d6a0ea7@ftputil.sschwarzer.net> References: <046.929282df6c1fdb2d59bb093b2d6a0ea7@ftputil.sschwarzer.net> Message-ID: <055.9781e18e633bfdd4fcb811f1ae57f1b6@ftputil.sschwarzer.net> #44: Don't use timed-out child sessions for remote files ----------------------+----------------------------------------------------- Reporter: schwa | Owner: schwa Type: defect | Status: closed Priority: minor | Milestone: 2.5 Component: Library | Version: 2.4.2 Resolution: fixed | Keywords: open, file, child session, timeout ----------------------+----------------------------------------------------- Changes (by schwa): * status: new => closed * resolution: => fixed Comment: Fixed in revision [22f536ed0c57]. -- Ticket URL: ftputil Python FTP client library From trac at ftputil.sschwarzer.net Sat Sep 18 15:11:27 2010 From: trac at ftputil.sschwarzer.net (ftputil) Date: Sat, 18 Sep 2010 13:11:27 -0000 Subject: [ftputil] #44: Don't use timed-out child sessions for remote files In-Reply-To: <046.929282df6c1fdb2d59bb093b2d6a0ea7@ftputil.sschwarzer.net> References: <046.929282df6c1fdb2d59bb093b2d6a0ea7@ftputil.sschwarzer.net> Message-ID: <055.b2b00823b1d84b9ff9b47b0c71efa3b1@ftputil.sschwarzer.net> #44: Don't use timed-out child sessions for remote files ----------------------+----------------------------------------------------- Reporter: schwa | Owner: schwa Type: defect | Status: closed Priority: minor | Milestone: 2.5 Component: Library | Version: 2.4.2 Resolution: fixed | Keywords: open, file, child session, timeout ----------------------+----------------------------------------------------- Comment(by schwa): I decided against removing the child cache as it will most likely save a lot of time if files are requested frequently (e. g. during series of uploads or downloads). This is especially true if the files are rather small, because then the time to re-establish a server connection would be relatively large with respect to the transfer time. -- Ticket URL: ftputil Python FTP client library From trac at ftputil.sschwarzer.net Sat Sep 18 15:41:56 2010 From: trac at ftputil.sschwarzer.net (ftputil) Date: Sat, 18 Sep 2010 13:41:56 -0000 Subject: [ftputil] #52: Main FTPHost session times out while downloading a large file In-Reply-To: <046.a214fb7b7308b3b1fef1df9987f97c44@ftputil.sschwarzer.net> References: <046.a214fb7b7308b3b1fef1df9987f97c44@ftputil.sschwarzer.net> Message-ID: <055.b74d494ddf582e028f369261838941b5@ftputil.sschwarzer.net> #52: Main FTPHost session times out while downloading a large file ----------------------+----------------------------------------------------- Reporter: schwa | Owner: schwa Type: defect | Status: closed Priority: major | Milestone: 2.5 Component: Library | Version: Resolution: invalid | Keywords: timeout, main, child, session ----------------------+----------------------------------------------------- Changes (by schwa): * status: new => closed * resolution: => invalid Comment: In my opinion, this isn't a defect in ftputil because FTP servers are free to let connections time out. I agree, though, that ftputil's behavior may seem confusing. Some background is [http://codespeak.net/pipermail/ftputil/2010q3/000318.html provided here]. -- Ticket URL: ftputil Python FTP client library From trac at ftputil.sschwarzer.net Sat Sep 18 15:45:57 2010 From: trac at ftputil.sschwarzer.net (ftputil) Date: Sat, 18 Sep 2010 13:45:57 -0000 Subject: [ftputil] #52: Main FTPHost session times out while downloading a large file In-Reply-To: <046.a214fb7b7308b3b1fef1df9987f97c44@ftputil.sschwarzer.net> References: <046.a214fb7b7308b3b1fef1df9987f97c44@ftputil.sschwarzer.net> Message-ID: <055.cc263a1057f90c30415e0e79dca891cf@ftputil.sschwarzer.net> #52: Main FTPHost session times out while downloading a large file ----------------------+----------------------------------------------------- Reporter: schwa | Owner: schwa Type: defect | Status: closed Priority: major | Milestone: 2.5 Component: Library | Version: Resolution: invalid | Keywords: timeout, main, child, session ----------------------+----------------------------------------------------- Comment(by schwa): To make it easier to keep the connection alive, I've added a `keep_alive` method in revision [ac645c973d1b]. Note that this only works on the "main" connection of the `FTPHost` instance. It will ''not'' help if a ''child'' session times out during a file transfer. -- Ticket URL: ftputil Python FTP client library From trac at ftputil.sschwarzer.net Sat Sep 18 15:49:02 2010 From: trac at ftputil.sschwarzer.net (ftputil) Date: Sat, 18 Sep 2010 13:49:02 -0000 Subject: [ftputil] #29: Distribute ftputil as a Debian/Ubuntu package In-Reply-To: <046.55dd1f0634bf00b870f56afca3014134@ftputil.sschwarzer.net> References: <046.55dd1f0634bf00b870f56afca3014134@ftputil.sschwarzer.net> Message-ID: <055.2e521678aa0dfe64d24f92a697df5f64@ftputil.sschwarzer.net> #29: Distribute ftputil as a Debian/Ubuntu package --------------------+------------------------------------------------------- Reporter: schwa | Owner: schwa Type: task | Status: assigned Priority: major | Milestone: 2.6 Component: Other | Version: 2.2.3 Resolution: | Keywords: Debian, package, Ubuntu --------------------+------------------------------------------------------- Changes (by schwa): * milestone: 2.5 => 2.6 Comment: Since the Debian packaging code in the ftputil repository is no longer used, the Debian package can only come out ''after'' ftputil 2.5 has been released, so I move the milestone of this ticket to version 2.6. -- Ticket URL: ftputil Python FTP client library From trac at ftputil.sschwarzer.net Sat Sep 18 23:24:37 2010 From: trac at ftputil.sschwarzer.net (ftputil) Date: Sat, 18 Sep 2010 21:24:37 -0000 Subject: [ftputil] #20: Allow to track upload and download progress In-Reply-To: <046.21a622275630bc674110e4dd7b858de8@ftputil.sschwarzer.net> References: <046.21a622275630bc674110e4dd7b858de8@ftputil.sschwarzer.net> Message-ID: <055.f22fb0b6215a4eb95d9b2fd6adf619d5@ftputil.sschwarzer.net> #20: Allow to track upload and download progress --------------------------+------------------------------------------------- Reporter: schwa | Owner: schwa Type: enhancement | Status: closed Priority: major | Milestone: 2.5 Component: Library | Version: 2.2.1 Resolution: fixed | Keywords: upload, download, progress, callable --------------------------+------------------------------------------------- Changes (by schwa): * status: assigned => closed * resolution: => fixed Comment: This is now documented in changeset [f7eba7e1ee1e]. -- Ticket URL: ftputil Python FTP client library