[jira] [Commented] (PIG-4871) Not use OperatorPlan#forceConnect in MultiQueryOptimizationSpark

2016-06-16 Thread Xianda Ke (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15335444#comment-15335444 ] Xianda Ke commented on PIG-4871: LGTM. see the discussion in [PIG-4594 |

[jira] [Updated] (PIG-4810) Implement Merge join for spark engine

2016-06-16 Thread Xianda Ke (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianda Ke updated PIG-4810: --- Attachment: PIG-4810-7.patch PIG-4810-7.patch is slightly updated. uploaded to [RB |

[jira] [Updated] (PIG-4810) Implement Merge join for spark engine

2016-06-16 Thread Xianda Ke (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianda Ke updated PIG-4810: --- Attachment: (was: PIG-4810-7.patch) > Implement Merge join for spark engine >

[jira] [Updated] (PIG-4893) Task deserialization time is too long for spark on yarn mode

2016-06-16 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-4893: -- Attachment: PIG-4893_1.patch [~pallavi.rao]: upload latest patch and add review board for it,

[jira] [Commented] (PIG-4893) Task deserialization time is too long for spark on yarn mode

2016-06-16 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334954#comment-15334954 ] liyunzhang_intel commented on PIG-4893: --- [~pallavi.rao]: before we append all jars under lib/Pig and

[jira] [Created] (PIG-4931) Document IN operator

2016-06-16 Thread Rohini Palaniswamy (JIRA)
Rohini Palaniswamy created PIG-4931: --- Summary: Document IN operator Key: PIG-4931 URL: https://issues.apache.org/jira/browse/PIG-4931 Project: Pig Issue Type: Improvement

[jira] [Commented] (PIG-4930) Skewed Join Breaks On Empty Sampled Input When Key is From Map

2016-06-16 Thread William Butler (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334415#comment-15334415 ] William Butler commented on PIG-4930: - Attached empty_skew.diff This contains a test that errors as is

[jira] [Updated] (PIG-4930) Skewed Join Breaks On Empty Sampled Input When Key is From Map

2016-06-16 Thread William Butler (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] William Butler updated PIG-4930: Attachment: empty_skew.diff > Skewed Join Breaks On Empty Sampled Input When Key is From Map >

[jira] [Created] (PIG-4930) Skewed Join Breaks On Empty Sampled Input When Key is From Map

2016-06-16 Thread William Butler (JIRA)
William Butler created PIG-4930: --- Summary: Skewed Join Breaks On Empty Sampled Input When Key is From Map Key: PIG-4930 URL: https://issues.apache.org/jira/browse/PIG-4930 Project: Pig Issue

[jira] [Updated] (PIG-4929) del

2016-06-16 Thread Xianda Ke (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianda Ke updated PIG-4929: --- Description: (was: currently, the client code to construct a CryptoRandom or CryptoCipher looks like this:

[jira] [Created] (PIG-4929) improve factory api for constructing CryptoRandom & CryptoCipher

2016-06-16 Thread Xianda Ke (JIRA)
Xianda Ke created PIG-4929: -- Summary: improve factory api for constructing CryptoRandom & CryptoCipher Key: PIG-4929 URL: https://issues.apache.org/jira/browse/PIG-4929 Project: Pig Issue Type:

[jira] [Commented] (PIG-4893) Task deserialization time is too long for spark on yarn mode

2016-06-16 Thread Pallavi Rao (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15333428#comment-15333428 ] Pallavi Rao commented on PIG-4893: -- [~kellyzly], can you please upload the patch to review board for ease

[jira] [Commented] (PIG-4903) Avoid add all spark dependency jars to SPARK_YARN_DIST_FILES and SPARK_DIST_CLASSPATH

2016-06-16 Thread Srikanth Sundarrajan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15333410#comment-15333410 ] Srikanth Sundarrajan commented on PIG-4903: --- For spark mode, we should support yarn-client, mesos

[jira] [Commented] (PIG-4903) Avoid add all spark dependency jars to SPARK_YARN_DIST_FILES and SPARK_DIST_CLASSPATH

2016-06-16 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1595#comment-1595 ] liyunzhang_intel commented on PIG-4903: --- [~sriksun]: {quote} would this print a 0/1 on the console

[jira] [Commented] (PIG-4903) Avoid add all spark dependency jars to SPARK_YARN_DIST_FILES and SPARK_DIST_CLASSPATH

2016-06-16 Thread Srikanth Sundarrajan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1585#comment-1585 ] Srikanth Sundarrajan commented on PIG-4903: --- Sorry to nitpick [~kellyzly], would this print a 0/1

[jira] [Commented] (PIG-4927) Support stop.on.failure in spark mode

2016-06-16 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1584#comment-1584 ] liyunzhang_intel commented on PIG-4927: --- [~pallavi.rao],[~mohitsabharwal] and [~kexianda]:Can you help

[jira] [Updated] (PIG-4927) Support stop.on.failure in spark mode

2016-06-16 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-4927: -- Attachment: PIG-4927.patch Before we skip TestGrunt#testStopOnFailure in spark mode {code} @Test

[jira] Subscription: PIG patch available

2016-06-16 Thread jira
Issue Subscription Filter: PIG patch available (34 issues) Subscriber: pigdaily Key Summary PIG-4926Modify the content of start.xml for spark mode https://issues.apache.org/jira/browse/PIG-4926 PIG-4925Support for passing the bloom filter to the Bloom UDF