[py-dev] execnet hangs

holger krekel hpk at trillke.net
Fri Apr 8 13:44:54 MEST 2005


Hi Armin, 

On Fri, Apr 08, 2005 at 12:29 +0100, Armin Rigo wrote:
> Hi Holger,
> 
> Another solution if you want to avoid the problems of infinite thread creation
> would be to introduce a timeout-based approach: if all executor threads are
> busy and the next item on the executor queue doesn't get consumed for more
> than 0.05 seconds (for example), then a new executor thread is started.  This
> would make the process interruptible before it consumes all resources, and it
> would also discourage people from using remote_exec() to start a large number
> of threads.
> 
> Alternatively I could try to rewrite execnet to use greenlets internally :-)

Append an "optionally" to that and that would be great :-) Hey, and the 
twisted "we hate threads" folks would herold you, i guess.  If you
want the ultimate challenge then consider allowing a mix of os-threads 
and greenlets to keep the thing responsive if one greenlet doesn't 
cooperate nicely :-)   

    holger


More information about the py-dev mailing list