[jira] [Updated] (PIG-4771) Implement FR Join for spark engine

2016-03-21 Thread Pallavi Rao (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pallavi Rao updated PIG-4771: - Status: Patch Available (was: Open) > Implement FR Join for spark engine >

[jira] [Commented] (PIG-4842) Collected group doesn't work in some cases

2016-03-21 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15205805#comment-15205805 ] liyunzhang_intel commented on PIG-4842: --- [~kexianda]: Can you investigate why in mr mo

[jira] [Updated] (PIG-4846) Use pigmix to test the performance of pig on spark

2016-03-21 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-4846: -- Description: We can compare the performance between mr and spark mode by pigmix. The introduction

[jira] [Updated] (PIG-4846) Use pigmix to test the performance of pig on spark

2016-03-21 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-4846: -- Description: We can compare the performance between mr and spark mode by pigmix. The introduction

[jira] [Commented] (PIG-4846) Use pigmix to test the performance of pig on spark

2016-03-21 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15205708#comment-15205708 ] liyunzhang_intel commented on PIG-4846: --- The following is result comparing mr and spar

[jira] [Updated] (PIG-4846) Use pigmix to test the performance of pig on spark

2016-03-21 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-4846: -- Attachment: PIG-4846.patch The steps to use pigmix to test are 1. generate data #ant clean -Dharne

[jira] [Created] (PIG-4846) Use pigmix to test the performance of pig on spark

2016-03-21 Thread liyunzhang_intel (JIRA)
liyunzhang_intel created PIG-4846: - Summary: Use pigmix to test the performance of pig on spark Key: PIG-4846 URL: https://issues.apache.org/jira/browse/PIG-4846 Project: Pig Issue Type: Sub-

[jira] [Commented] (PIG-4845) Parallel instantiation of classes in Tez cause tasks to fail

2016-03-21 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15205477#comment-15205477 ] Daniel Dai commented on PIG-4845: - +1 > Parallel instantiation of classes in Tez cause task

[jira] [Updated] (PIG-4845) Parallel instantiation of classes in Tez cause tasks to fail

2016-03-21 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4845: Status: Patch Available (was: Open) > Parallel instantiation of classes in Tez cause tasks to

[jira] [Updated] (PIG-4845) Parallel instantiation of classes in Tez cause tasks to fail

2016-03-21 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4845: Attachment: PIG-4845-1.patch > Parallel instantiation of classes in Tez cause tasks to fail >

[jira] [Created] (PIG-4845) Parallel instantiation of classes in Tez cause tasks to fail

2016-03-21 Thread Rohini Palaniswamy (JIRA)
Rohini Palaniswamy created PIG-4845: --- Summary: Parallel instantiation of classes in Tez cause tasks to fail Key: PIG-4845 URL: https://issues.apache.org/jira/browse/PIG-4845 Project: Pig I

[jira] [Commented] (PIG-4843) Turn off combiner in reducer vertex for Tez if bags are in combine plan

2016-03-21 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15205228#comment-15205228 ] Daniel Dai commented on PIG-4843: - +1 > Turn off combiner in reducer vertex for Tez if bags

[jira] [Commented] (PIG-4843) Turn off combiner in reducer vertex for Tez if bags are in combine plan

2016-03-21 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15205227#comment-15205227 ] Rohini Palaniswamy commented on PIG-4843: - bq. Do you mean once MAPREDUCE-5221 is fi

[jira] [Updated] (PIG-4841) Inline-op with schema declaration fails with syntax error

2016-03-21 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-4841: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 0.16.0 Status: Resolved (wa

[jira] [Commented] (PIG-4841) Inline-op with schema declaration fails with syntax error

2016-03-21 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15205166#comment-15205166 ] Daniel Dai commented on PIG-4841: - +1 > Inline-op with schema declaration fails with syntax

[jira] [Commented] (PIG-3000) Optimize nested foreach

2016-03-21 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15205160#comment-15205160 ] Daniel Dai commented on PIG-3000: - I don't think [~chitnis] is working on that. We will need

[jira] [Commented] (PIG-4840) Do not turn off UnionOptimizer for unsupported storefuncs in case of no vertex groups

2016-03-21 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15205154#comment-15205154 ] Daniel Dai commented on PIG-4840: - +1 > Do not turn off UnionOptimizer for unsupported stor

[jira] [Resolved] (PIG-4832) Fix TestPrumeColumn NPE failure

2016-03-21 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-4832. - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 0.16.0 spark-branch T

[jira] [Resolved] (PIG-4731) NPE while executing a FetchOptimizer plan

2016-03-21 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-4731. - Resolution: Duplicate Addressed in PIG-4832. > NPE while executing a FetchOptimizer plan >

[jira] [Commented] (PIG-4843) Turn off combiner in reducer vertex for Tez if bags are in combine plan

2016-03-21 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15205118#comment-15205118 ] Daniel Dai commented on PIG-4843: - Do you mean once MAPREDUCE-5221 is fixed, we might see th

[jira] [Created] (PIG-4844) Tez AM runs out of memory when vertex has high number of outputs

2016-03-21 Thread Rohini Palaniswamy (JIRA)
Rohini Palaniswamy created PIG-4844: --- Summary: Tez AM runs out of memory when vertex has high number of outputs Key: PIG-4844 URL: https://issues.apache.org/jira/browse/PIG-4844 Project: Pig

[jira] [Updated] (PIG-4840) Do not turn off UnionOptimizer for unsupported storefuncs in case of no vertex groups

2016-03-21 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4840: Attachment: PIG-4840-1.patch Review board link - https://reviews.apache.org/r/45127/ Also fix

[jira] [Updated] (PIG-4840) Do not turn off UnionOptimizer for unsupported storefuncs in case of no vertex groups

2016-03-21 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4840: Status: Patch Available (was: Open) > Do not turn off UnionOptimizer for unsupported storefun

Review Request 45127: PIG-4840: Do not turn off UnionOptimizer for unsupported storefuncs in case of no vertex groups

2016-03-21 Thread Rohini Palaniswamy
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/45127/ --- Review request for pig and Daniel Dai. Bugs: PIG-4840 https://issues.apache

[jira] [Updated] (PIG-4843) Turn off combiner in reducer vertex for Tez if bags are in combine plan

2016-03-21 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4843: Attachment: PIG-4843-1.patch > Turn off combiner in reducer vertex for Tez if bags are in comb

[jira] [Updated] (PIG-4843) Turn off combiner in reducer vertex for Tez if bags are in combine plan

2016-03-21 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4843: Status: Patch Available (was: Open) > Turn off combiner in reducer vertex for Tez if bags are

[jira] [Updated] (PIG-4843) Turn off combiner in reducer vertex for Tez if bags are in combine plan

2016-03-21 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4843: Summary: Turn off combiner in reducer vertex for Tez if bags are in combine plan (was: Turn o

[jira] [Created] (PIG-4843) Turn off combiner in reducer vertex for Tez

2016-03-21 Thread Rohini Palaniswamy (JIRA)
Rohini Palaniswamy created PIG-4843: --- Summary: Turn off combiner in reducer vertex for Tez Key: PIG-4843 URL: https://issues.apache.org/jira/browse/PIG-4843 Project: Pig Issue Type: Improve

[jira] [Commented] (PIG-3000) Optimize nested foreach

2016-03-21 Thread Kevin J. Price (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15204921#comment-15204921 ] Kevin J. Price commented on PIG-3000: - Did this patch just get dropped? This is still a

[jira] [Commented] (PIG-4842) Collected group doesn't work in some cases

2016-03-21 Thread Xianda Ke (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15204134#comment-15204134 ] Xianda Ke commented on PIG-4842: Hi [~kellyzly], [~mohitsabharwal], [~pallavi.rao], [~xuefuz

[jira] [Updated] (PIG-4842) Collected group doesn't work in some cases

2016-03-21 Thread Xianda Ke (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianda Ke updated PIG-4842: --- Attachment: PIG-4842.patch Here, to avoid touching the logic of POCollectedGroup before spark branch is merged

[jira] [Commented] (PIG-4842) Collected group doesn't work in some cases

2016-03-21 Thread Xianda Ke (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15204127#comment-15204127 ] Xianda Ke commented on PIG-4842: It seems that the other PhysicalOperators might have the sa

[jira] [Commented] (PIG-4842) Collected group doesn't work in some cases

2016-03-21 Thread Xianda Ke (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15204121#comment-15204121 ] Xianda Ke commented on PIG-4842: root cause: Currently, when a predecessor(PhyscialOperator)

[jira] [Updated] (PIG-4842) Collected group doesn't work in some cases

2016-03-21 Thread Xianda Ke (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianda Ke updated PIG-4842: --- Description: Scenario: 1. input data: cat collectedgroup1 1 1 2 2. pig script: A = LOAD 'collectedgroup1' USING

[jira] [Updated] (PIG-4842) Collected group doesn't work in some cases

2016-03-21 Thread Xianda Ke (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianda Ke updated PIG-4842: --- Description: Scenario: 1. input data: cat collectedgroup1 {code} 1 1 2 {code} 2. pig script: {code} A = LOAD 'co

[jira] Subscription: PIG patch available

2016-03-21 Thread jira
Issue Subscription Filter: PIG patch available (30 issues) Subscriber: pigdaily Key Summary PIG-4841Inline-op with schema declaration fails with syntax error https://issues.apache.org/jira/browse/PIG-4841 PIG-4788the value BytesRead metric info always returns 0 even th