[jira] [Commented] (SPARK-20466) HadoopRDD#addLocalConfiguration throws NPE

[ https://issues.apache.org/jira/browse/SPARK-20466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16171009#comment-16171009 ] liyunzhang_intel commented on SPARK-20466: -- [~stakiar]: this exception happened on which query

[jira] [Commented] (SPARK-20466) HadoopRDD#addLocalConfiguration throws NPE

[ https://issues.apache.org/jira/browse/SPARK-20466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056991#comment-16056991 ] liyunzhang_intel commented on SPARK-20466: -- [~q79969786]: found the NPE when runing Hive on

[jira] [Updated] (SPARK-20466) HadoopRDD#addLocalConfiguration throws NPE

[ https://issues.apache.org/jira/browse/SPARK-20466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated SPARK-20466: - Attachment: NPE_log NPE_log describes the detailed info. >

[jira] [Created] (SPARK-20466) HadoopRDD#addLocalConfiguration throws NPE

liyunzhang_intel created SPARK-20466: Summary: HadoopRDD#addLocalConfiguration throws NPE Key: SPARK-20466 URL: https://issues.apache.org/jira/browse/SPARK-20466 Project: Spark Issue

[jira] [Commented] (SPARK-13955) Spark in yarn mode fails

[ https://issues.apache.org/jira/browse/SPARK-13955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736236#comment-15736236 ] liyunzhang_intel commented on SPARK-13955: -- [~jerryshao]: After testing, i can use

[jira] [Commented] (SPARK-13955) Spark in yarn mode fails

[ https://issues.apache.org/jira/browse/SPARK-13955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15734195#comment-15734195 ] liyunzhang_intel commented on SPARK-13955: -- [~jerryshao]: yes , the archive contains

[jira] [Commented] (SPARK-13955) Spark in yarn mode fails

[ https://issues.apache.org/jira/browse/SPARK-13955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15734082#comment-15734082 ] liyunzhang_intel commented on SPARK-13955: -- test pi in yarn-client mode by using

[jira] [Comment Edited] (SPARK-13955) Spark in yarn mode fails

[ https://issues.apache.org/jira/browse/SPARK-13955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15734082#comment-15734082 ] liyunzhang_intel edited comment on SPARK-13955 at 12/9/16 2:40 AM: ---

[jira] [Comment Edited] (SPARK-13955) Spark in yarn mode fails

[ https://issues.apache.org/jira/browse/SPARK-13955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15731574#comment-15731574 ] liyunzhang_intel edited comment on SPARK-13955 at 12/8/16 8:54 AM: ---

[jira] [Commented] (SPARK-13955) Spark in yarn mode fails

[ https://issues.apache.org/jira/browse/SPARK-13955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15731574#comment-15731574 ] liyunzhang_intel commented on SPARK-13955: -- [~jerryshao] &[~tzachz]: when i try to use

[jira] [Commented] (SPARK-5682) Add encrypted shuffle in spark

[ https://issues.apache.org/jira/browse/SPARK-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14611547#comment-14611547 ] liyunzhang_intel commented on SPARK-5682: - [~hujiayin]: thanks for your comment.

[jira] [Commented] (SPARK-5682) Add encrypted shuffle in spark

[ https://issues.apache.org/jira/browse/SPARK-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14612719#comment-14612719 ] liyunzhang_intel commented on SPARK-5682: - [~hujiayin]: {quote} the AES solution

[jira] [Commented] (SPARK-5682) Add encrypted shuffle in spark

[ https://issues.apache.org/jira/browse/SPARK-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14611491#comment-14611491 ] liyunzhang_intel commented on SPARK-5682: - [~hujiayin]: thanks for your comment

[jira] [Updated] (SPARK-5682) Add encrypted shuffle in spark

[ https://issues.apache.org/jira/browse/SPARK-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated SPARK-5682: Attachment: Design Document of Encrypted Spark Shuffle_20150506.docx Design Document of

[jira] [Commented] (SPARK-5682) Add encrypted shuffle in spark

[ https://issues.apache.org/jira/browse/SPARK-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390235#comment-14390235 ] liyunzhang_intel commented on SPARK-5682: - Hi all: Now there are two methods to

[jira] [Updated] (SPARK-5682) Add encrypted shuffle in spark

[ https://issues.apache.org/jira/browse/SPARK-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated SPARK-5682: Attachment: Design Document of Encrypted Spark Shuffle_20150401.docx Add encrypted shuffle

[jira] [Comment Edited] (SPARK-5682) Add encrypted shuffle in spark

[ https://issues.apache.org/jira/browse/SPARK-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390235#comment-14390235 ] liyunzhang_intel edited comment on SPARK-5682 at 4/2/15 1:34 AM:

[jira] [Updated] (SPARK-5682) Add encrypted shuffle in spark

[ https://issues.apache.org/jira/browse/SPARK-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated SPARK-5682: Attachment: (was: Design Document of Encrypted Spark Shuffle_20150401.docx) Add

[jira] [Updated] (SPARK-5682) Add encrypted shuffle in spark

[ https://issues.apache.org/jira/browse/SPARK-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated SPARK-5682: Attachment: Design Document of Encrypted Spark Shuffle_20150402.docx Add encrypted shuffle

[jira] [Created] (SPARK-6460) Implement OpensslAesCtrCryptoCodec to enable encrypted shuffle algorithms which openssl provides

liyunzhang_intel created SPARK-6460: --- Summary: Implement OpensslAesCtrCryptoCodec to enable encrypted shuffle algorithms which openssl provides Key: SPARK-6460 URL:

[jira] [Updated] (SPARK-6460) Implement OpensslAesCtrCryptoCodec to enable encrypted shuffle algorithms which openssl provides

[ https://issues.apache.org/jira/browse/SPARK-6460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated SPARK-6460: Issue Type: Sub-task (was: Bug) Parent: SPARK-5682 Implement

[jira] [Comment Edited] (SPARK-5682) Add encrypted shuffle in spark

[ https://issues.apache.org/jira/browse/SPARK-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14370631#comment-14370631 ] liyunzhang_intel edited comment on SPARK-5682 at 3/23/15 1:31 AM:

[jira] [Commented] (SPARK-5682) Add encrypted shuffle in spark

[ https://issues.apache.org/jira/browse/SPARK-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375430#comment-14375430 ] liyunzhang_intel commented on SPARK-5682: - Hi all:I have a question：is there any

[jira] [Updated] (SPARK-5682) Add encrypted shuffle in spark

[ https://issues.apache.org/jira/browse/SPARK-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated SPARK-5682: Description: Encrypted shuffle is enabled in hadoop 2.6 which make the process of shuffle

[jira] [Commented] (SPARK-5682) Add encrypted shuffle in spark

[ https://issues.apache.org/jira/browse/SPARK-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14368621#comment-14368621 ] liyunzhang_intel commented on SPARK-5682: - sorry to reply so late. If run spark on

[jira] [Updated] (SPARK-5682) Add encrypted shuffle in spark

[ https://issues.apache.org/jira/browse/SPARK-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated SPARK-5682: Attachment: Design Document of Encrypted Spark Shuffle_20150318.docx [~srowen], i have

[jira] [Commented] (SPARK-5682) Add encrypted shuffle in spark

[ https://issues.apache.org/jira/browse/SPARK-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14370631#comment-14370631 ] liyunzhang_intel commented on SPARK-5682: - Hi all: There are two methods to not

[jira] [Updated] (SPARK-5682) Add encrypted shuffle in spark

[ https://issues.apache.org/jira/browse/SPARK-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated SPARK-5682: Summary: Add encrypted shuffle in spark (was: Reuse hadoop encrypted shuffle algorithm to

[jira] [Commented] (SPARK-5682) Reuse hadoop encrypted shuffle algorithm to enable spark encrypted shuffle

[ https://issues.apache.org/jira/browse/SPARK-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14352396#comment-14352396 ] liyunzhang_intel commented on SPARK-5682: - Hi [~srowen]: Encrypted shuffle can

[jira] [Issue Comment Deleted] (SPARK-5682) Reuse hadoop encrypted shuffle algorithm to enable spark encrypted shuffle

[ https://issues.apache.org/jira/browse/SPARK-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated SPARK-5682: Comment: was deleted (was: encrypted_shuffle.patch.4 is how to reuse hadoop encrypted class

[jira] [Updated] (SPARK-5682) Reuse hadoop encrypted shuffle algorithm to enable spark encrypted shuffle

[ https://issues.apache.org/jira/browse/SPARK-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated SPARK-5682: Attachment: encrypted_shuffle.patch.4 encrypted_shuffle.patch.4 is how to reuse hadoop

[jira] [Updated] (SPARK-5682) Reuse hadoop encrypted shuffle algorithm to enable spark encrypted shuffle

[ https://issues.apache.org/jira/browse/SPARK-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated SPARK-5682: Attachment: (was: encrypted_shuffle.patch.4) Reuse hadoop encrypted shuffle algorithm

[jira] [Created] (SPARK-5682) Reuse hadoop encrypted shuffle algorithm to enable spark encrypted shuffle

liyunzhang_intel created SPARK-5682: --- Summary: Reuse hadoop encrypted shuffle algorithm to enable spark encrypted shuffle Key: SPARK-5682 URL: https://issues.apache.org/jira/browse/SPARK-5682