[jira] [Commented] (SPARK-2288) Hide ShuffleBlockManager behind ShuffleManager

2014-08-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14116249#comment-14116249 ] Reynold Xin commented on SPARK-2288: Thanks for the design doc, Raymond. Next time it

[jira] [Resolved] (SPARK-2288) Hide ShuffleBlockManager behind ShuffleManager

2014-08-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-2288. Resolution: Fixed Fix Version/s: 1.2.0 Hide ShuffleBlockManager behind ShuffleManager

[jira] [Resolved] (SPARK-3305) Remove unused import from UI classes.

2014-08-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-3305. Resolution: Fixed Fix Version/s: 1.2.0 Assignee: Kousuke Saruta Remove unused

[jira] [Created] (SPARK-3323) yarn website's Tracking UI links to the Standby RM

2014-08-30 Thread wangfei (JIRA)
wangfei created SPARK-3323: -- Summary: yarn website's Tracking UI links to the Standby RM Key: SPARK-3323 URL: https://issues.apache.org/jira/browse/SPARK-3323 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-3324) YARN module has nonstandard structure which cause compile error In IntelliJ

2014-08-30 Thread Yi Tian (JIRA)
Yi Tian created SPARK-3324: -- Summary: YARN module has nonstandard structure which cause compile error In IntelliJ Key: SPARK-3324 URL: https://issues.apache.org/jira/browse/SPARK-3324 Project: Spark

[jira] [Updated] (SPARK-3324) YARN module has nonstandard structure which cause compile error In IntelliJ

2014-08-30 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-3324: -- Description: The YARN module has nonstandard path structure like: {code} ${SPARK_HOME} |--yarn

[jira] [Commented] (SPARK-3324) YARN module has nonstandard structure which cause compile error In IntelliJ

2014-08-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14116278#comment-14116278 ] Sean Owen commented on SPARK-3324: -- I agree, I've had a similar problem and just resolved

[jira] [Created] (SPARK-3325) Add a parameter to the method print in class DStream.

2014-08-30 Thread Yadong Qi (JIRA)
Yadong Qi created SPARK-3325: Summary: Add a parameter to the method print in class DStream. Key: SPARK-3325 URL: https://issues.apache.org/jira/browse/SPARK-3325 Project: Spark Issue Type:

[jira] [Updated] (SPARK-3325) Add a parameter to the method print in class DStream.

2014-08-30 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Qi updated SPARK-3325: - Component/s: (was: Spark Core) Streaming Add a parameter to the method print in

[jira] [Commented] (SPARK-3325) Add a parameter to the method print in class DStream.

2014-08-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14116322#comment-14116322 ] Apache Spark commented on SPARK-3325: - User 'watermen' has created a pull request for

[jira] [Created] (SPARK-3326) can't access a static variable after init in mapper

2014-08-30 Thread Gavin Zhang (JIRA)
Gavin Zhang created SPARK-3326: -- Summary: can't access a static variable after init in mapper Key: SPARK-3326 URL: https://issues.apache.org/jira/browse/SPARK-3326 Project: Spark Issue Type:

[jira] [Commented] (SPARK-3326) can't access a static variable after init in mapper

2014-08-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14116327#comment-14116327 ] Sean Owen commented on SPARK-3326: -- The call to Foo.getSome() occurs remotely, on a

[jira] [Commented] (SPARK-3326) can't access a static variable after init in mapper

2014-08-30 Thread Gavin Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14116387#comment-14116387 ] Gavin Zhang commented on SPARK-3326: It works. Thanks! can't access a static

[jira] [Updated] (SPARK-3321) Defining a class within python main script

2014-08-30 Thread Shawn Guo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shawn Guo updated SPARK-3321: - Priority: Critical (was: Blocker) Defining a class within python main script

[jira] [Created] (SPARK-3327) Make broadcasted value mutable for caching useful information

2014-08-30 Thread Liang-Chi Hsieh (JIRA)
Liang-Chi Hsieh created SPARK-3327: -- Summary: Make broadcasted value mutable for caching useful information Key: SPARK-3327 URL: https://issues.apache.org/jira/browse/SPARK-3327 Project: Spark

[jira] [Commented] (SPARK-3327) Make broadcasted value mutable for caching useful information

2014-08-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14116532#comment-14116532 ] Apache Spark commented on SPARK-3327: - User 'viirya' has created a pull request for

[jira] [Commented] (SPARK-2356) Exception: Could not locate executable null\bin\winutils.exe in the Hadoop

2014-08-30 Thread Remus Rusanu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14116536#comment-14116536 ] Remus Rusanu commented on SPARK-2356: - HADOOP-11003 is requesting hadoop-common to

[jira] [Comment Edited] (SPARK-2356) Exception: Could not locate executable null\bin\winutils.exe in the Hadoop

2014-08-30 Thread Remus Rusanu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14116536#comment-14116536 ] Remus Rusanu edited comment on SPARK-2356 at 8/30/14 7:50 PM: --

[jira] [Resolved] (SPARK-2889) Spark creates Hadoop Configuration objects inconsistently

2014-08-30 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia resolved SPARK-2889. -- Resolution: Fixed Fix Version/s: 1.2.0 Spark creates Hadoop Configuration objects

[jira] [Updated] (SPARK-3318) The documentation for addFiles is wrong

2014-08-30 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated SPARK-3318: - Assignee: Holden Karau The documentation for addFiles is wrong

[jira] [Resolved] (SPARK-3318) The documentation for addFiles is wrong

2014-08-30 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia resolved SPARK-3318. -- Resolution: Fixed Fix Version/s: 1.2.0 The documentation for addFiles is wrong

[jira] [Updated] (SPARK-2885) All-pairs similarity via DIMSUM

2014-08-30 Thread Reza Zadeh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reza Zadeh updated SPARK-2885: -- Description: Build all-pairs similarity algorithm via DIMSUM. Given a dataset of sparse vector data,

[jira] [Updated] (SPARK-3324) YARN module has nonstandard structure which cause compile error In IntelliJ

2014-08-30 Thread Yi Tian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Tian updated SPARK-3324: --- Description: The YARN module has nonstandard path structure like: {code} ${SPARK_HOME} |--yarn

[jira] [Commented] (SPARK-2558) Mention --queue argument in YARN documentation

2014-08-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14116614#comment-14116614 ] Apache Spark commented on SPARK-2558: - User 'kramimus' has created a pull request for

[jira] [Commented] (SPARK-3324) YARN module has nonstandard structure which cause compile error In IntelliJ

2014-08-30 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14116616#comment-14116616 ] Patrick Wendell commented on SPARK-3324: Hi, I don't totally understand the

[jira] [Updated] (SPARK-3287) When ResourceManager High Availability is enabled, ApplicationMaster webUI is not displayed.

2014-08-30 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3287: --- Component/s: (was: Spark Core) When ResourceManager High Availability is enabled,

[jira] [Commented] (SPARK-1239) Don't fetch all map outputs at each reducer during shuffles

2014-08-30 Thread bc Wong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14116642#comment-14116642 ] bc Wong commented on SPARK-1239: Is anyone working on this? If so, could someone please

[jira] [Commented] (SPARK-2579) Reading from S3 returns an inconsistent number of items with Spark 0.9.1

2014-08-30 Thread Chris Fregly (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14116643#comment-14116643 ] Chris Fregly commented on SPARK-2579: - interesting and possibly-related blog post from