Re: MROperPlan structure

MROperPlan is a graph containing all the MR jobs wrapped in MapReduceOper. You can write a MROpPlanVisitor visitor to traverse the MROperPlan. Inside the visitor, you can translate every MR job into your own framework operator. The other choice is to rewrite MRCompiler.java - the place Pig translat

Build failed in Jenkins: Pig-trunk #1845

See Changes: [knoguchi] PIG-3251 Bzip2TextInputFormat requires double the memory of maximum record size (knoguchi) -- [...truncated 2666 lines...] [ivy:resolve] unknown resolver chain [ivy:resolve]

MROperPlan structure

Hello, I am doing work on running Pig compiled Map Reduce jobs on our own MR framework with similar interface. Can someone point my to a person which can help me? (more details below) I have studied the source code however I want to be able to inspect the structure of MROperPlan structure for va

[jira] [Commented] (PIG-4533) Document error: Pig does support concatenated gz file

[ https://issues.apache.org/jira/browse/PIG-4533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14981383#comment-14981383 ] Rohini Palaniswamy commented on PIG-4533: - Ignore my previous comment. Missed the @T

[jira] [Commented] (PIG-4533) Document error: Pig does support concatenated gz file

[ https://issues.apache.org/jira/browse/PIG-4533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14981379#comment-14981379 ] Rohini Palaniswamy commented on PIG-4533: - [~daijy], Pig has been supporting conca

[jira] [Updated] (PIG-3251) Bzip2TextInputFormat requires double the memory of maximum record size

[ https://issues.apache.org/jira/browse/PIG-3251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-3251: -- Resolution: Fixed Release Note: With hadoop 2.X or later, pig will use hadoop's bzip codec to handle

[jira] [Commented] (PIG-3251) Bzip2TextInputFormat requires double the memory of maximum record size

[ https://issues.apache.org/jira/browse/PIG-3251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14981296#comment-14981296 ] Rohini Palaniswamy commented on PIG-3251: - +1 > Bzip2TextInputFormat requires doubl

[jira] [Updated] (PIG-3251) Bzip2TextInputFormat requires double the memory of maximum record size

[ https://issues.apache.org/jira/browse/PIG-3251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-3251: -- Attachment: pig-3251-trunk-v09.patch bq. Just noticed one more issue. -Dppig.bzip.use.hadoop.inputformat i

[jira] [Commented] (PIG-3251) Bzip2TextInputFormat requires double the memory of maximum record size

[ https://issues.apache.org/jira/browse/PIG-3251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14981093#comment-14981093 ] Rohini Palaniswamy commented on PIG-3251: - Just noticed one more issue. -Dppig.bzip

[jira] [Updated] (PIG-3251) Bzip2TextInputFormat requires double the memory of maximum record size

[ https://issues.apache.org/jira/browse/PIG-3251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-3251: -- Attachment: pig-3251-trunk-v08.patch {quote} Can you change the name of the constant as well to PIG_BZIP_

[jira] [Updated] (PIG-3251) Bzip2TextInputFormat requires double the memory of maximum record size

[ https://issues.apache.org/jira/browse/PIG-3251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-3251: -- Status: Patch Available (was: Open) > Bzip2TextInputFormat requires double the memory of maximum record s

Build failed in Jenkins: Pig-trunk #1844

See Changes: [daijy] PIG-4704: Customizable Error Handling for Storers in Pig -- [...truncated 144 lines...] [mkdir] Created dir:

[jira] [Commented] (PIG-4720) Spark related JARs are not included when importing project via IDE

[ https://issues.apache.org/jira/browse/PIG-4720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14980088#comment-14980088 ] Srikanth Sundarrajan commented on PIG-4720: --- Patch looks good. Verified build as w

[jira] [Commented] (PIG-4720) Spark related JARs are not included when importing project via IDE

[ https://issues.apache.org/jira/browse/PIG-4720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14980077#comment-14980077 ] Xianda Ke commented on PIG-4720: Hi [~sriksun] & [~xuefuz], patch file is attached. Would yo

[jira] [Updated] (PIG-4720) Spark related JARs are not included when importing project via IDE

[ https://issues.apache.org/jira/browse/PIG-4720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianda Ke updated PIG-4720: --- Attachment: PIG-4720.patch > Spark related JARs are not included when importing project via IDE > -

[jira] [Assigned] (PIG-4720) Spark related JARs are not included when importing project via IDE

[ https://issues.apache.org/jira/browse/PIG-4720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianda Ke reassigned PIG-4720: -- Assignee: Xianda Ke > Spark related JARs are not included when importing project via IDE > -

[jira] [Created] (PIG-4720) Spark related JARs are not included when importing project via IDE

Xianda Ke created PIG-4720: -- Summary: Spark related JARs are not included when importing project via IDE Key: PIG-4720 URL: https://issues.apache.org/jira/browse/PIG-4720 Project: Pig Issue Type:

[jira] Subscription: PIG patch available

Issue Subscription Filter: PIG patch available (27 issues) Subscriber: pigdaily Key Summary PIG-4684Exception should be changed to warning when job diagnostics cannot be fetched https://issues.apache.org/jira/browse/PIG-4684 PIG-4677Display failure information on stop