[py-dev] execnet hangs

[Armin Rigo]

Hi Holger,

On Thu, Apr 07, 2005 at 11:45:33PM +0200, holger krekel wrote:
> rather think about an adaptive scheme where we allow to
> specify "maxthreads" and default it to 10 or so. Would that 
> make sense to you?

Not really.  Anything that, like my example above, appears to work until some
small number (2 or 10) and completely deadlocks above that number is bound to
create surprises and bugs.

Why not create new 'executor' threads when none is available, with no upper
bound?  I'd much prefer buggy programs to trash the system with resource
consumption than nicely written programs deadlock because of an internal
limit.  It should be clear that remote_exec() creates a new thread on the
remote side, and that if you are going to do really a lot of remove_exec() you
should do only one and use channels.


Armin