[jira] Subscription: PIG patch available

2015-01-21 Thread jira
Issue Subscription Filter: PIG patch available (25 issues) Subscriber: pigdaily Key Summary PIG-4389Flag to run selected test suites in e2e tests https://issues.apache.org/jira/browse/PIG-4389 PIG-4387Honor yarn settings in tez-site.xml and optimize dag status fetch

[jira] [Assigned] (PIG-4300) Enable unit test "TestSample" for spark

2015-01-21 Thread Ranjana Rajendran (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ranjana Rajendran reassigned PIG-4300: -- Assignee: Ranjana Rajendran > Enable unit test "TestSample" for spark > -

[jira] [Commented] (PIG-4341) Add CMX support to pig.tmpfilecompression.codec

2015-01-21 Thread fang fang chen (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14287000#comment-14287000 ] fang fang chen commented on PIG-4341: - Sure. Please open another jira and go ahead. Once

[jira] [Updated] (PIG-4266) Umbrella jira for unit tests for Spark

2015-01-21 Thread Praveen Rachabattuni (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Praveen Rachabattuni updated PIG-4266: -- Description: Get all unit tests running in spark mode. Single unit test can be run as: an

[jira] [Assigned] (PIG-4243) Enable unit test "TestStore" for spark

2015-01-21 Thread Ranjana Rajendran (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ranjana Rajendran reassigned PIG-4243: -- Assignee: Ranjana Rajendran (was: Brock Noland) > Enable unit test "TestStore" for spark

[jira] [Commented] (PIG-3851) Upgrade jline to 2.11

2015-01-21 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14286480#comment-14286480 ] Daniel Dai commented on PIG-3851: - Yes, Hive also have this issue: https://cwiki.apache.org

[jira] [Updated] (PIG-4389) Flag to run selected test suites in e2e tests

2015-01-21 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4389: Status: Patch Available (was: Open) > Flag to run selected test suites in e2e tests > ---

[jira] [Updated] (PIG-4389) Flag to run selected test suites in e2e tests

2015-01-21 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4389: Attachment: PIG-4389-1.patch > Flag to run selected test suites in e2e tests > ---

[jira] [Created] (PIG-4389) Flag to run selected test suites in e2e tests

2015-01-21 Thread Daniel Dai (JIRA)
Daniel Dai created PIG-4389: --- Summary: Flag to run selected test suites in e2e tests Key: PIG-4389 URL: https://issues.apache.org/jira/browse/PIG-4389 Project: Pig Issue Type: Improvement

[jira] [Commented] (PIG-4387) Honor yarn settings in tez-site.xml and optimize dag status fetch

2015-01-21 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14286385#comment-14286385 ] Daniel Dai commented on PIG-4387: - Thanks for explanation. +1 > Honor yarn settings in tez-

[jira] [Commented] (PIG-4387) Honor yarn settings in tez-site.xml and optimize dag status fetch

2015-01-21 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14286367#comment-14286367 ] Rohini Palaniswamy commented on PIG-4387: - this.tezConf = new TezConfiguration(conf)

[jira] [Updated] (PIG-4352) Port local mode tests to Tez - TestUnionOnSchema

2015-01-21 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4352: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Patch commit

[jira] [Commented] (PIG-4352) Port local mode tests to Tez - TestUnionOnSchema

2015-01-21 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14286351#comment-14286351 ] Rohini Palaniswamy commented on PIG-4352: - +1 > Port local mode tests to Tez - Test

[jira] [Commented] (PIG-4366) Port local mode tests to Tez - part5

2015-01-21 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14286342#comment-14286342 ] Daniel Dai commented on PIG-4366: - testNonExistingSecondDirectoryInSkewJoin.patch committed

[jira] [Commented] (PIG-4387) Honor yarn settings in tez-site.xml and optimize dag status fetch

2015-01-21 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14286266#comment-14286266 ] Daniel Dai commented on PIG-4387: - That's because tez-site.xml is introduced very late (cons

[jira] [Commented] (PIG-4352) Port local mode tests to Tez - TestUnionOnSchema

2015-01-21 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14286246#comment-14286246 ] Daniel Dai commented on PIG-4352: - The POStore is different however. The copy is created whe

[jira] [Updated] (PIG-4387) Honor yarn settings in tez-site.xml and optimize dag status fetch

2015-01-21 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4387: Status: Patch Available (was: Open) > Honor yarn settings in tez-site.xml and optimize dag st

[jira] [Updated] (PIG-4387) Honor yarn settings in tez-site.xml and optimize dag status fetch

2015-01-21 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4387: Summary: Honor yarn settings in tez-site.xml and optimize dag status fetch (was: Honor yarn s

[jira] [Updated] (PIG-4387) Honor yarn settings in tez-site.xml

2015-01-21 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4387: Attachment: PIG-4387-1.patch Created PIG-4388 to do cleanup of the PigContext properties and C

[jira] [Created] (PIG-4388) Cleanup and simplify usage of configuration and PigContext properties

2015-01-21 Thread Rohini Palaniswamy (JIRA)
Rohini Palaniswamy created PIG-4388: --- Summary: Cleanup and simplify usage of configuration and PigContext properties Key: PIG-4388 URL: https://issues.apache.org/jira/browse/PIG-4388 Project: Pig

[jira] [Created] (PIG-4387) Honor yarn settings in tez-site.xml

2015-01-21 Thread Rohini Palaniswamy (JIRA)
Rohini Palaniswamy created PIG-4387: --- Summary: Honor yarn settings in tez-site.xml Key: PIG-4387 URL: https://issues.apache.org/jira/browse/PIG-4387 Project: Pig Issue Type: Bug Affects

[jira] [Updated] (PIG-4375) ObjectCache should use ProcessorContext.getObjectRegistry()

2015-01-21 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4375: Assignee: Rohini Palaniswamy Status: Patch Available (was: Open) > ObjectCache should u

[jira] [Updated] (PIG-4375) ObjectCache should use ProcessorContext.getObjectRegistry()

2015-01-21 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4375: Attachment: PIG-4375-1.patch Also fixed another case of OOM with PigCombiner apart from the O

[jira] [Commented] (PIG-4366) Port local mode tests to Tez - part5

2015-01-21 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14286132#comment-14286132 ] Rohini Palaniswamy commented on PIG-4366: - +1. Thanks. Just noticed that the test

Re: Review Request 29644: Port local mode tests to Tez - part4

2015-01-21 Thread Daniel Dai
> On Jan. 20, 2015, 1:24 a.m., Rohini Palaniswamy wrote: > > trunk/test/tez-local-tests, line 74 > > > > > > TestStore should be in tez-tests right? Yes, it is already there. - Daniel --

Re: Can anyone to give me a sample script that a load has precessors?

2015-01-21 Thread Daniel Dai
Try the following script: a = load 'test/org/apache/pig/test/data/passwd'; store a into 'Pig-TestMultiQueryLocal1' using BinStorage(); a = load 'Pig-TestMultiQueryLocal1'; store a into 'Pig-TestMultiQueryLocal2'; a = load 'Pig-TestMultiQueryLocal1'; store a into 'Pig-TestMultiQueryLocal3'; If the

[jira] [Updated] (PIG-4366) Port local mode tests to Tez - part5

2015-01-21 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4366: Attachment: testNonExistingSecondDirectoryInSkewJoin.patch testNonExistingSecondDirectoryInSkewJoin get lost w

[jira] [Commented] (PIG-4366) Port local mode tests to Tez - part5

2015-01-21 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14285845#comment-14285845 ] Rohini Palaniswamy commented on PIG-4366: - PIG-3469 testNonExistingSecondDirectoryIn

[jira] [Assigned] (PIG-4208) Make merge-sparse join work with Spark

2015-01-21 Thread Praveen Rachabattuni (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Praveen Rachabattuni reassigned PIG-4208: - Assignee: Abhishek Agarwal > Make merge-sparse join work with Spark > -

[jira] [Commented] (PIG-4208) Make merge-sparse join work with Spark

2015-01-21 Thread Praveen Rachabattuni (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14285486#comment-14285486 ] Praveen Rachabattuni commented on PIG-4208: --- [~abhishek.agarwal] Sure, that would

[jira] [Commented] (PIG-4208) Make merge-sparse join work with Spark

2015-01-21 Thread Abhishek Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14285428#comment-14285428 ] Abhishek Agarwal commented on PIG-4208: --- since it is still unassigned, can I take it u

Can anyone to give me a sample script that a load has precessors?

2015-01-21 Thread Zhang, Liyun
Hi all I found that: org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MRCompiler#compile Line 384~433 this code is for dealing with the situation where a load has predecessors. Can anyone to give me a sample script that a load has precessors? else if (predecessors != null && predece

[jira] [Updated] (PIG-4362) Make ship work with spark

2015-01-21 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-4362: -- Attachment: ComputeSpec_mapred_benchmark_exectype.log [~praveenr019], i have tested according to y