[ https://issues.apache.org/jira/browse/PIG-4976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Daniel Dai updated PIG-4976: ---------------------------- Attachment: PIG-4976-2.patch Yes, that's doable. At least we can signal error to the pipeline. > streaming job with store clause stuck if the script fail > -------------------------------------------------------- > > Key: PIG-4976 > URL: https://issues.apache.org/jira/browse/PIG-4976 > Project: Pig > Issue Type: Bug > Components: impl > Reporter: Daniel Dai > Assignee: Daniel Dai > Fix For: 0.17.0 > > Attachments: PIG-4976-1.patch, PIG-4976-2.patch > > > When investigating PIG-4972, I also notice Pig job stuck when the perl script > have syntax error. This happens if we have output clause in stream > specification (means use a file as staging). The bug exist in both Tez and > MR, and it is not a regression. > Here is an example: > {code} > define CMD `perl kk.pl` output('foo') ship('kk.pl'); > A = load 'studenttab10k' as (name, age, gpa); > B = foreach A generate name; > C = stream B through CMD; > store C into 'ooo'; > {code} > kk.pl is any perl script contain a syntax error. -- This message was sent by Atlassian JIRA (v6.3.4#6332)