Re: [Twisted-Python] custom FTP server is blocking

2015-03-20 Thread Paul Wiseman
On 20 March 2015 at 12:19, Adi Roiban wrote: > On 20 March 2015 at 11:16, Paul Wiseman wrote: >> On 19 March 2015 at 20:38, Louis D. Burr wrote: >>> Hi Paul, >>> >>>> On Mar 19, 2015, at 1:18 PM, Paul Wiseman wrote: >>>> >> I want to

Re: [Twisted-Python] custom FTP server is blocking

2015-03-20 Thread Paul Wiseman
On 19 March 2015 at 20:38, Louis D. Burr wrote: > Hi Paul, > >> On Mar 19, 2015, at 1:18 PM, Paul Wiseman wrote: >> >> I have some blocking going on in a custom twisted ftp server and I'm >> trying to pin point what exactly is doing it. >> >> I t

[Twisted-Python] custom FTP server is blocking

2015-03-19 Thread Paul Wiseman
I have some blocking going on in a custom twisted ftp server and I'm trying to pin point what exactly is doing it. I think this line in openForReading on my FTPShell object could be the culprit: _FileReader(urllib2.urlopen(result.link,timeout=settings.GLOBAL_TIMEOUT)) (_FileReader is twisted.pro

Re: [Twisted-Python] FTP box disconnecting after 60 seconds

2014-07-10 Thread Paul Wiseman
On 9 July 2014 02:34, Werner Thie wrote: > On 7/8/14 6:30 AM, Paul Wiseman wrote: >> >> This is a google compute instance, so there is there firewall on >> there. I did at first think it could be a hidden firewall rule google >> have. >> >> I think I ca

Re: [Twisted-Python] FTP box disconnecting after 60 seconds

2014-07-08 Thread Paul Wiseman
the only thing I can think of is it is somehow being triggered by the traffic. On 8 July 2014 16:26, Phil Mayers wrote: > On 08/07/14 15:45, Paul Wiseman wrote: >> >> Hey, >> >> This is a bit of a stab in the dark, but I'm really not sure what to try >> next.

[Twisted-Python] FTP box disconnecting after 60 seconds

2014-07-08 Thread Paul Wiseman
Hey, This is a bit of a stab in the dark, but I'm really not sure what to try next. Basically I've got a custom twisted FTP server, recently (not sure when it started) I've noticed that connections to it seem to disconnect after 60 seconds if they haven't completed. This could be a slow LIST resp

Re: [Twisted-Python] Asynchronously reading posted data

2013-09-05 Thread Paul Wiseman
Ah awesome that clears it up, thanks! I've never had to deal with HTTP requests with content bodies before. I presumed that the .read() would be pulling bytes from the network. I presumed wrong :) Thanks! Paul On 5 September 2013 12:24, wrote: > On 08:50 am, poal...@gmail.com wrote: > >> Hey

Re: [Twisted-Python] Asynchronously reading posted data

2013-09-05 Thread Paul Wiseman
), if the client happens to be sending it very slowly this would block everything up right? - or would this not be an issue? Maybe because I have fairly small content bodies I wont have to worry? Payl On 4 September 2013 22:45, Glyph wrote: > > On Sep 4, 2013, at 10:48 AM, Paul Wis

[Twisted-Python] Asynchronously reading posted data

2013-09-04 Thread Paul Wiseman
I'm still pretty new to twisted and feel I'm slowly getting the hang of it, enough to realise that this line of code is probably going to block and not do me any favours, the line is the first line in a resource.Resource render_POST. json_request = json.loads(request.content.read()) The resource.

Re: [Twisted-Python] TaskStopped error, unsure of the cause and solution

2013-02-12 Thread Paul Wiseman
On 8 February 2013 19:03, wrote: > On 03:12 pm, poal...@gmail.com wrote: >> >>I've still not been able to reproduce this on demand.. the least >>amount of request I've seen before getting the error is 6500 :/ >> >>I've also seen this stack trace which I didn't notice before >> >>2013-02-08 10:07:

Re: [Twisted-Python] TaskStopped error, unsure of the cause and solution

2013-02-08 Thread Paul Wiseman
On 27 December 2012 14:49, Paul Wiseman wrote: > On 21 December 2012 18:08, wrote: >> On 04:12 pm, poal...@gmail.com wrote: >>>Hey, >>> >>>I'm getting the following error in my logs (lots and lots), but only >>>after the server has been runnin

Re: [Twisted-Python] TaskStopped error, unsure of the cause and solution

2012-12-27 Thread Paul Wiseman
On 21 December 2012 18:08, wrote: > On 04:12 pm, poal...@gmail.com wrote: >>Hey, >> >>I'm getting the following error in my logs (lots and lots), but only >>after the server has been running for some time, I'm not sure what the >>cause is or what I can do to remedy it. > > This seems like a bug i

Re: [Twisted-Python] utf-8 support for ftp

2012-11-22 Thread Paul Wiseman
On 22 November 2012 11:35, Adi Roiban wrote: > On 21 November 2012 19:45, Paul Wiseman wrote: > > On 21 November 2012 17:35, Paul Wiseman wrote: > >> > >> I know this has been asked before, I've found it in several trackers. > >> > >> h

Re: [Twisted-Python] utf-8 support for ftp

2012-11-21 Thread Paul Wiseman
On 21 November 2012 17:35, Paul Wiseman wrote: > > I know this has been asked before, I've found it in several trackers. > > http://twistedmatrix.com/trac/ticket/5411 > http://twistedmatrix.com/trac/ticket/4515 > http://twistedmatrix.com/trac/ticket/5100 > > Some of t

[Twisted-Python] utf-8 support for ftp

2012-11-21 Thread Paul Wiseman
I know this has been asked before, I've found it in several trackers. http://twistedmatrix.com/trac/ticket/5411 http://twistedmatrix.com/trac/ticket/4515 http://twistedmatrix.com/trac/ticket/5100 Some of these were created a while ago, some with patches. I wondered what the current status was wit

Re: [Twisted-Python] ftp passive mode returning internal IP

2012-11-20 Thread Paul Wiseman
r wrap the transport object to be sure but twisted is still pretty magic to me and I'm struggling to find out where this ProtocolWrapper object is originating from. > On 20 November 2012 22:47, Paul Wiseman wrote: > > This possibly has nothing to do with twisted, but maybe if not some

[Twisted-Python] ftp passive mode returning internal IP

2012-11-20 Thread Paul Wiseman
This possibly has nothing to do with twisted, but maybe if not someone may be able to point me in the right direction! Basically I've set up a twisted FTP server on ec2, and when a client tries to enter passive mode I'm getting this: Response: 227 Entering Passive Mode (x,x,x,x,159,122). Status:

Re: [Twisted-Python] passing exception object to log.err doesn't log traceback?

2012-11-15 Thread Paul Wiseman
Ah I doubted it was a bug but the behaviour surprised me. Thanks for explaining! On 15 November 2012 14:56, Itamar Turner-Trauring < ita...@futurefoundries.com> wrote: > > > On Thu, Nov 15, 2012 at 9:02 AM, Paul Wiseman wrote: > >> I was just looking at some logs and s

[Twisted-Python] passing exception object to log.err doesn't log traceback?

2012-11-15 Thread Paul Wiseman
I was just looking at some logs and some of the errors logged without tracebacks, I work out it was when I wasn't passing the error object to log.err- Is this by design? Here is some code which shows it logging and not logging the traceback import os from twisted.python import log from twisted.py

Re: [Twisted-Python] twisted thumbnail server

2012-11-02 Thread Paul Wiseman
On 2 November 2012 16:13, Phil Mayers wrote: > On 02/11/12 15:42, Paul Wiseman wrote: > > I hope this will be an easy question for some of you guys :) > > > > I'm trying to set up a simple server which will accept requests over GET > > to create a thumbnail for

Re: [Twisted-Python] twisted thumbnail server

2012-11-02 Thread Paul Wiseman
? I'd love to avoid blocking and keep it all in 1 thread, but I don't know of anyway to do the image resizing/rotation etc. without blocking. > > On Fri, Nov 2, 2012 at 4:42 PM, Paul Wiseman wrote: > >> I hope this will be an easy question for some of you guys :) >>

[Twisted-Python] twisted thumbnail server

2012-11-02 Thread Paul Wiseman
I hope this will be an easy question for some of you guys :) I'm trying to set up a simple server which will accept requests over GET to create a thumbnail for an image, and server it back as the response. The images are stored in two S3 buckets, the originals are in one bucket (store), and the g

Re: [Twisted-Python] dynamic FTP realm

2012-10-01 Thread Paul Wiseman
On 1 October 2012 16:52, Itamar Turner-Trauring wrote: > > > On Mon, Oct 1, 2012 at 5:38 AM, Paul Wiseman wrote: > >> >> I made an api for the web requests- the call isn't so straightforward, >> all the information is sent in POST formatted a certain way and

Re: [Twisted-Python] dynamic FTP realm

2012-10-01 Thread Paul Wiseman
On 30 September 2012 13:59, Itamar Turner-Trauring < ita...@futurefoundries.com> wrote: > > > On Sun, Sep 30, 2012 at 8:38 AM, Paul Wiseman wrote: > >> >> That is likely a much better idea! Will I need to use some threading if >> I'm making web calls

Re: [Twisted-Python] dynamic FTP realm

2012-09-30 Thread Paul Wiseman
On 29 September 2012 21:21, wrote: > On 07:44 pm, poal...@gmail.com wrote: > > > >Thank you. I've made quite a bit of progress and now have my own > >Portal, > >CredentialsChecker, Realm, Shell, and FilePath object. > > > >One thing I haven't been able to work out is, when I override, lets say >

Re: [Twisted-Python] dynamic FTP realm

2012-09-29 Thread Paul Wiseman
On 28 September 2012 15:32, Tom Sheffler wrote: > Hi Paul - > > I'm very new to twisted (I've only just started using it, so I apologise if >> anything I ask is seemingly obvious!). >> I'm looking to try and set up a FTP server which will serve a file >> structure and files which don't exists on

[Twisted-Python] dynamic FTP realm

2012-09-27 Thread Paul Wiseman
I'm very new to twisted (I've only just started using it, so I apologise if anything I ask is seemingly obvious!). I'm looking to try and set up a FTP server which will serve a file structure and files which don't exists on the server (the file structure information is stored on cassandra, and the