Checking if a streaming job failed

2009-04-02 Thread Mayuran Yogarajah
Hello, does anyone know how I can check if a streaming job (in Perl) has failed or succeeded? The only way I can see at the moment is to check the web interface for that jobID and parse out the '*Status:*' value. Is it not possible to do this using 'hadoop job -status' ? I see there is a count

Re: Checking if a streaming job failed

2009-04-02 Thread Miles Osborne
here is how i do it (in perl). hadoop streaming is actually called by a shell script, which in this case expects compressed input and produces compressed output. but you get the idea: (the mailer had messed-up the formatting somewhat) sub runStreamingCompInCompOut { my $mapper = shift @_;