Thanks, Julien. I also added a couple of questions to the wiki.
Olga
-Original Message-
From: Julien Le Dem [mailto:led...@yahoo-inc.com]
Sent: Thursday, January 20, 2011 6:36 PM
To: dev@pig.apache.org
Subject: Re: Exception Handling in Pig Scripts
I've summed up the thread here:
al together? I think it would make
> it much easier then following email discussion.
>
> Thanks,
>
> Olga
>
> -Original Message-
> From: Dmitriy Ryaboy [mailto:dvrya...@gmail.com]
> Sent: Thursday, January 20, 2011 11:52 AM
> To: dev@pig.apache.org
> Subje
en Le Dem [mailto:led...@yahoo-inc.com]
Sent: Thursday, January 20, 2011 1:49 PM
To: dev@pig.apache.org
Subject: Re: Exception Handling in Pig Scripts
I see there is a PigErrorHandling, what about calling it
PigErrorHandlingInScripts ?
Julien
On 1/20/11 12:53 PM, "Olga Natkovich" wrote:
H
Sure :)
-Original Message-
From: Julien Le Dem [mailto:led...@yahoo-inc.com]
Sent: Thursday, January 20, 2011 1:49 PM
To: dev@pig.apache.org
Subject: Re: Exception Handling in Pig Scripts
I see there is a PigErrorHandling, what about calling it
PigErrorHandlingInScripts ?
Julien
On 1
AM
> To: dev@pig.apache.org
> Subject: Re: Exception Handling in Pig Scripts
>
> Right, what I am saying is that the tasks would not fail because we'd catch
> the errors.
>
> Thanks for the lmyit link.. learn something new every day.
>
> On Thu, Jan 20, 2011 at 11:31 AM, Ju
nks,
Olga
-Original Message-
From: Dmitriy Ryaboy [mailto:dvrya...@gmail.com]
Sent: Thursday, January 20, 2011 11:52 AM
To: dev@pig.apache.org
Subject: Re: Exception Handling in Pig Scripts
Right, what I am saying is that the tasks would not fail because we'd catch
the errors.
Thanks for
Subject: Re: Exception Handling in Pig Scripts
Right, what I am saying is that the tasks would not fail because we'd catch
the errors.
Thanks for the lmyit link.. learn something new every day.
On Thu, Jan 20, 2011 at 11:31 AM, Julien Le Dem wrote:
> Doesn't Hadoop discard the
gt; }
> > >
> > > I think this makes sense not to make a static method so that users
> could
> > > keep required state, and for example have the handler throw its own
> > > IOException of it's been invoked too many times.
> > >
> > > D
> >
ting this in the user realm is tricky as Dmitriy states.
> > > Sensitivity to error thresholds will require support from the system.
> We
> > can
> > > probably provide a taxonomy of records (good, bad, incomplete, etc.) to
> > let
> > > users classify each r
> >
> >
> > On Sat, Jan 15, 2011 at 11:53 PM, Santhosh Srinivasan > >wrote:
> >
> > > Thanks for the clarification Ashutosh.
> > >
> > > Implementing this in the user realm is tricky as Dmitriy states.
> > > Sensitivity to
he system can then track counts of each
> record
> > type to facilitate the computation of thresholds. The last part is to
> allow
> > users to specify thresholds and appropriate actions (interrupt, exit,
> > continue, etc.). A possible mechanism to realize this is the
> &g
ecify thresholds and appropriate actions (interrupt, exit,
> > continue, etc.). A possible mechanism to realize this is the
> > ErrorHandlingUDF described by Dmitriy.
> >
> > Santhosh
> >
> > -Original Message-
> > From: Ashutosh Chauhan [mailto:
..@apache.org]
> Sent: Friday, January 14, 2011 7:35 PM
> To: u...@pig.apache.org
> Subject: Re: Exception Handling in Pig Scripts
>
> Santhosh,
>
> The way you are proposing, it will kill the pig script. I think what user
> wants is to ignore few "bad records" and to process
continue, etc.). A possible mechanism to realize this is the
> ErrorHandlingUDF described by Dmitriy.
>
> Santhosh
>
> -Original Message-
> From: Ashutosh Chauhan [mailto:hashut...@apache.org]
> Sent: Friday, January 14, 2011 7:35 PM
> To: u...@pig.apache.org
&
mputation of thresholds. The last part is to allow
>> users to specify thresholds and appropriate actions (interrupt, exit,
>> continue, etc.). A possible mechanism to realize this is the
>> ErrorHandlingUDF described by Dmitriy.
>>
>> Santhosh
>>
>> -Original Message
shutosh Chauhan [mailto:hashut...@apache.org]
> Sent: Friday, January 14, 2011 7:35 PM
> To: u...@pig.apache.org
> Subject: Re: Exception Handling in Pig Scripts
>
> Santhosh,
>
> The way you are proposing, it will kill the pig script. I think what user
> wants is to ignore
16 matches
Mail list logo
