Hello, does anyone know how I can check if a streaming job (in Perl) has
failed or succeeded? The only way I can see at the moment is to check
the web interface for that jobID and parse out the '*Status:*' value.
Is it not possible to do this using 'hadoop job -status' ? I see there
is a count
here is how i do it (in perl). hadoop streaming is actually called by
a shell script, which in this case expects compressed input and
produces compressed output. but you get the idea:
(the mailer had messed-up the formatting somewhat)
sub runStreamingCompInCompOut {
my $mapper = shift @_;