What's your bottleneck? If it's just speaking with modems, POE can do that asynchronously. You may be able to simplify the design by pulling the jobs back into the main process.

--
Rocco Caputo - rcap...@pobox.com


On Nov 24, 2009, at 15:00, Simon Taylor wrote:

(updated)

I have built a POE app which forks children, executes some work, returns
status back up the parent. All works fine.

Currently this is all running from one Session.

I now have a requirement to execute jobs which connect to the same modem
bank together.

I was thinking I might structure it in the following way.

Assume 4 modem banks with 20 jobs per modem bank.



PARENT - Create Session + POE::Wheel::Run (PWR) one process per all jobs
which need to connect to modem bank

          CHILD 1 - Create Session + PWR

                                 CHILD 1.1 one process per job

                                   ......

                                 CHILD 1.20 one process per job

          .....

          CHILD 4 - Create Session + PWR one process per job



This way I can use the heap of each session to manage the child jobs
which are connected to each modem bank



When using this mechanism to control how many jobs are passed to PWR its
dependent on the heap content which in the original approach would
contain all jobs :-

while (keys(%{$heap->{task}}) < $PARALLELISM ) {



Is there a better/simpler way someone can think of to use PWR and the
Session Heap to continue to execute jobs against different devices
whilst always maintaining 4 simultaneous jobs in each PWR (until
complete)



Simon





Currently start and manage starting tasks this way:-



sub StartTasks {

=Head3 _start

Function called when POE wants to start tasks

Shouldnt start any more than
$self->GetBSHParalleism($SDU::BatchSectionsHandler::SectionName)

When it does it spawns children

Event handlers allow information to be passed back to the parent process

Mapping between state and function is done in the object states line in
the POE::Session->create in _IterateChildrenParallel



=cut

 my ($kernel, $self, $heap) = @_[KERNEL, OBJECT];

 my ($child, $task);



 $self->{_logger}->debug("Enter/Reentry");

 while (keys(%{$heap->{task}}) < $PARALLELISM ) {

     if (ref($self->{_children}) eq "ARRAY"){

         $child = shift @{$self->{_children}};

         last unless defined $child;

         $self->{_logger}->debug("ARRAY "."Child = $child");

         $task = POE::Wheel::Run->new(

             Program      => sub {local *__ANON__ =
"_StartTasksProgramSub";

                                  $self->_CreateChild($child);

                                  },

             StdoutEvent  => "TaskResult",

             StdoutFilter => POE::Filter::Reference->new(),

             StderrEvent  => "TaskError",

             CloseEvent   => "TaskDone",

           );

           $heap->{task}->{$task->ID} = $task;

           $self->{_logger}->info("Created child Task/PID
".$task->ID."/".$task->PID);

           $_[KERNEL]->sig_child($task->PID, 'sig_child');



           # Wheel events include the wheel's ID.

           $_[HEAP]{children_by_wid}{$task->ID} = $task;



           # Signal events include the process ID.

           $_[HEAP]{children_by_pid}{$task->PID} = $task;







    } elsif (ref($self->{_children}) eq "HASH") {

             $self->{_logger}->debug("HASH "."Child = $child");

             $self->_CreateChild($child);

    } else {

             $self->{_logger}->debug("SCALAR "."Child = $child");

             $self->_CreateChild($child);

    } # If end

 } # While end

}





Simon Taylor

Development Team Lead NMS Applications

Network Managed Services

Nortel Networks



(e) s...@nortel.com

(p) +44  1279 402291 ESN 6 742 2291

(m) +44 7740 533743 ESN 6 748 3743

(yim) setuk_nortel




Reply via email to