[jira] [Updated] (SPARK-1503) Implement Nesterov's accelerated first-order method

2014-10-09 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-1503: - Assignee: Aaron Staple (was: Xiangrui Meng) > Implement Nesterov's accelerated first-order method

[jira] [Commented] (SPARK-1503) Implement Nesterov's accelerated first-order method

2014-10-09 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14166465#comment-14166465 ] Xiangrui Meng commented on SPARK-1503: -- [~staple] Thanks for picking up this JIRA! TF

[jira] [Assigned] (SPARK-1503) Implement Nesterov's accelerated first-order method

2014-10-09 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reassigned SPARK-1503: Assignee: Xiangrui Meng > Implement Nesterov's accelerated first-order method > ---

[jira] [Created] (SPARK-3896) checkSpeculatableTasks fask quit loop, invoking checkSpeculatableTasks is expensive

2014-10-09 Thread sjk (JIRA)
sjk created SPARK-3896: -- Summary: checkSpeculatableTasks fask quit loop, invoking checkSpeculatableTasks is expensive Key: SPARK-3896 URL: https://issues.apache.org/jira/browse/SPARK-3896 Project: Spark

[jira] [Updated] (SPARK-3892) Map type should have typeName

2014-10-09 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3892: --- Component/s: SQL > Map type should have typeName > - > >

[jira] [Commented] (SPARK-3894) Scala style: line length increase to 160

2014-10-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14166417#comment-14166417 ] Sean Owen commented on SPARK-3894: -- This is an ancient religious war. At Google, it was t

[jira] [Commented] (SPARK-3895) Scala style: Indentation of method

2014-10-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14166415#comment-14166415 ] Sean Owen commented on SPARK-3895: -- To be clear, the second is correct because of line le

[jira] [Commented] (SPARK-3894) Scala style: line length increase to 160

2014-10-09 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14166410#comment-14166410 ] Josh Rosen commented on SPARK-3894: --- I'm not sure about this change. I think that most o

[jira] [Created] (SPARK-3895) Scala style: Indentation of method

2014-10-09 Thread sjk (JIRA)
sjk created SPARK-3895: -- Summary: Scala style: Indentation of method Key: SPARK-3895 URL: https://issues.apache.org/jira/browse/SPARK-3895 Project: Spark Issue Type: Sub-task Reporter: sjk

[jira] [Comment Edited] (SPARK-3854) Scala style: require spaces before `{`

2014-10-09 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14166379#comment-14166379 ] Kousuke Saruta edited comment on SPARK-3854 at 10/10/14 4:37 AM: ---

[jira] [Commented] (SPARK-3854) Scala style: require spaces before `{`

2014-10-09 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14166379#comment-14166379 ] Kousuke Saruta commented on SPARK-3854: --- I think, we have some exception cases like

[jira] [Commented] (SPARK-3854) Scala style: require spaces before `{`

2014-10-09 Thread sjk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14166362#comment-14166362 ] sjk commented on SPARK-3854: i think all the code after symbol should have one space length

[jira] [Created] (SPARK-3894) Scala style: line length increase to 160

2014-10-09 Thread sjk (JIRA)
sjk created SPARK-3894: -- Summary: Scala style: line length increase to 160 Key: SPARK-3894 URL: https://issues.apache.org/jira/browse/SPARK-3894 Project: Spark Issue Type: Sub-task Reporter:

[jira] [Created] (SPARK-3893) declare mutableMap/mutableSet explicitly

2014-10-09 Thread sjk (JIRA)
sjk created SPARK-3893: -- Summary: declare mutableMap/mutableSet explicitly Key: SPARK-3893 URL: https://issues.apache.org/jira/browse/SPARK-3893 Project: Spark Issue Type: Sub-task Components

[jira] [Created] (SPARK-3892) Map type should have typeName

2014-10-09 Thread Adrian Wang (JIRA)
Adrian Wang created SPARK-3892: -- Summary: Map type should have typeName Key: SPARK-3892 URL: https://issues.apache.org/jira/browse/SPARK-3892 Project: Spark Issue Type: Bug Reporter:

[jira] [Created] (SPARK-3891) Support Hive Percentile UDAF with array of percentile values

2014-10-09 Thread Anand Mohan Tumuluri (JIRA)
Anand Mohan Tumuluri created SPARK-3891: --- Summary: Support Hive Percentile UDAF with array of percentile values Key: SPARK-3891 URL: https://issues.apache.org/jira/browse/SPARK-3891 Project: Spa

[jira] [Updated] (SPARK-3795) Add scheduler hooks/heuristics for adding and removing executors

2014-10-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3795: - Affects Version/s: 1.1.0 > Add scheduler hooks/heuristics for adding and removing executors >

[jira] [Created] (SPARK-3890) remove redundant spark.executor.memory in doc

2014-10-09 Thread WangTaoTheTonic (JIRA)
WangTaoTheTonic created SPARK-3890: -- Summary: remove redundant spark.executor.memory in doc Key: SPARK-3890 URL: https://issues.apache.org/jira/browse/SPARK-3890 Project: Spark Issue Type: I

[jira] [Commented] (SPARK-1503) Implement Nesterov's accelerated first-order method

2014-10-09 Thread Aaron Staple (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14166168#comment-14166168 ] Aaron Staple commented on SPARK-1503: - Hi, I’d like to try working on this ticket. If

[jira] [Resolved] (SPARK-3834) Backticks not correctly handled in subquery aliases

2014-10-09 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3834. - Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 2737 [https:/

[jira] [Resolved] (SPARK-3824) Spark SQL should cache in MEMORY_AND_DISK by default

2014-10-09 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3824. - Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 2686 [https:/

[jira] [Updated] (SPARK-3811) More robust / standard Utils.deleteRecursively, Utils.createTempDir

2014-10-09 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-3811: Assignee: Sean Owen > More robust / standard Utils.deleteRecursively, Utils.createTempDir >

[jira] [Resolved] (SPARK-3811) More robust / standard Utils.deleteRecursively, Utils.createTempDir

2014-10-09 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3811. - Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 2670 [https:/

[jira] [Resolved] (SPARK-3798) Corrupted projection in Generator

2014-10-09 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3798. - Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 2656 [https:/

[jira] [Updated] (SPARK-3889) JVM dies with SIGBUS, resulting in ConnectionManager failed ACK

2014-10-09 Thread Aaron Davidson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Davidson updated SPARK-3889: -- Description: Here's the first part of the core dump, possibly caused by a job which shuffles a

[jira] [Created] (SPARK-3889) JVM dies with SIGBUS, resulting in ConnectionManager failed ACK

2014-10-09 Thread Aaron Davidson (JIRA)
Aaron Davidson created SPARK-3889: - Summary: JVM dies with SIGBUS, resulting in ConnectionManager failed ACK Key: SPARK-3889 URL: https://issues.apache.org/jira/browse/SPARK-3889 Project: Spark

[jira] [Created] (SPARK-3888) Limit the memory used by python worker

2014-10-09 Thread Davies Liu (JIRA)
Davies Liu created SPARK-3888: - Summary: Limit the memory used by python worker Key: SPARK-3888 URL: https://issues.apache.org/jira/browse/SPARK-3888 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-3887) ConnectionManager should log remote exception when reporting remote errors

2014-10-09 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-3887: - Summary: ConnectionManager should log remote exception when reporting remote errors Key: SPARK-3887 URL: https://issues.apache.org/jira/browse/SPARK-3887 Project: Spark

[jira] [Commented] (SPARK-3883) Provide SSL support for Akka and HttpServer based connections

2014-10-09 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165986#comment-14165986 ] Jacek Lewandowski commented on SPARK-3883: -- https://github.com/apache/spark/pull/

[jira] [Resolved] (SPARK-3772) RDD operation on IPython REPL failed with an illegal port number

2014-10-09 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-3772. --- Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 2651 [https://github.com/

[jira] [Created] (SPARK-3886) Choose the batch size of serializer based on size of object

2014-10-09 Thread Davies Liu (JIRA)
Davies Liu created SPARK-3886: - Summary: Choose the batch size of serializer based on size of object Key: SPARK-3886 URL: https://issues.apache.org/jira/browse/SPARK-3886 Project: Spark Issue Ty

[jira] [Commented] (SPARK-3873) Scala style: check import ordering

2014-10-09 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165916#comment-14165916 ] Marcelo Vanzin commented on SPARK-3873: --- Actually looking at this, since I've been p

[jira] [Resolved] (SPARK-3813) Support "case when" conditional functions in Spark SQL

2014-10-09 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3813. - Resolution: Fixed Issue resolved by pull request 2678 [https://github.com/apache/spark/pul

[jira] [Resolved] (SPARK-3858) SchemaRDD.generate ignores alias argument

2014-10-09 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3858. - Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 2721 [https:/

[jira] [Resolved] (SPARK-3412) Add Missing Types for Row API

2014-10-09 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3412. - Resolution: Fixed Issue resolved by pull request 2529 [https://github.com/apache/spark/pul

[jira] [Updated] (SPARK-3796) Create shuffle service for external block storage

2014-10-09 Thread Aaron Davidson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Davidson updated SPARK-3796: -- Description: This task will be broken up into two parts -- the first, being to refactor our int

[jira] [Resolved] (SPARK-3339) Support for skipping json lines that fail to parse

2014-10-09 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3339. - Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 2680 [https:/

[jira] [Commented] (SPARK-3835) Spark applications that are killed should show up as "KILLED" or "CANCELLED" in the Spark UI

2014-10-09 Thread Nan Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165815#comment-14165815 ] Nan Zhu commented on SPARK-3835: no...it cannot capture kill -9 > Spark applications that

[jira] [Commented] (SPARK-3835) Spark applications that are killed should show up as "KILLED" or "CANCELLED" in the Spark UI

2014-10-09 Thread Nan Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165807#comment-14165807 ] Nan Zhu commented on SPARK-3835: ah, I see, didn't look at your description closely

[jira] [Commented] (SPARK-3834) Backticks not correctly handled in subquery aliases

2014-10-09 Thread Ravindra Pesala (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165800#comment-14165800 ] Ravindra Pesala commented on SPARK-3834: https://github.com/apache/spark/pull/2737

[jira] [Reopened] (SPARK-2805) Update akka to version 2.3.4

2014-10-09 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-2805: I had to revert this because of a dependency issue with protobuf. > Update akka to version 2.3.

[jira] [Commented] (SPARK-3814) Bitwise & does not work in Hive

2014-10-09 Thread Ravindra Pesala (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165790#comment-14165790 ] Ravindra Pesala commented on SPARK-3814: https://github.com/apache/spark/pull/2736

[jira] [Commented] (SPARK-3835) Spark applications that are killed should show up as "KILLED" or "CANCELLED" in the Spark UI

2014-10-09 Thread Matt Cheah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165785#comment-14165785 ] Matt Cheah commented on SPARK-3835: --- This is the opposite problem, actually - a Spark co

[jira] [Commented] (SPARK-3884) If deploy mode is cluster, --driver-memory shouldn't apply to client JVM

2014-10-09 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165776#comment-14165776 ] Sandy Ryza commented on SPARK-3884: --- Accidentally assigned this to myself, but others sh

[jira] [Created] (SPARK-3885) Provide mechanism to remove accumulators once they are no longer used

2014-10-09 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-3885: - Summary: Provide mechanism to remove accumulators once they are no longer used Key: SPARK-3885 URL: https://issues.apache.org/jira/browse/SPARK-3885 Project: Spark

[jira] [Updated] (SPARK-3884) If deploy mode is cluster, --driver-memory shouldn't apply to client JVM

2014-10-09 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated SPARK-3884: -- Summary: If deploy mode is cluster, --driver-memory shouldn't apply to client JVM (was: Don't set SPARK

[jira] [Commented] (SPARK-3835) Spark applications that are killed should show up as "KILLED" or "CANCELLED" in the Spark UI

2014-10-09 Thread Nan Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165768#comment-14165768 ] Nan Zhu commented on SPARK-3835: this problem still exists? I once reported the same thing

[jira] [Created] (SPARK-3884) Don't set SPARK_SUBMIT_DRIVER_MEMORY if deploy mode is cluster

2014-10-09 Thread Sandy Ryza (JIRA)
Sandy Ryza created SPARK-3884: - Summary: Don't set SPARK_SUBMIT_DRIVER_MEMORY if deploy mode is cluster Key: SPARK-3884 URL: https://issues.apache.org/jira/browse/SPARK-3884 Project: Spark Issue

[jira] [Resolved] (SPARK-3853) JsonRDD does not support converting fields to type Timestamp

2014-10-09 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3853. - Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 2720 [https:/

[jira] [Comment Edited] (SPARK-3835) Spark applications that are killed should show up as "KILLED" or "CANCELLED" in the Spark UI

2014-10-09 Thread Matt Cheah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165722#comment-14165722 ] Matt Cheah edited comment on SPARK-3835 at 10/9/14 8:48 PM: An

[jira] [Updated] (SPARK-3868) Hard to recognize which module is tested from unit-tests.log

2014-10-09 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-3868: -- Assignee: cocoatomo (was: Josh Rosen) > Hard to recognize which module is tested from unit-tests.log >

[jira] [Commented] (SPARK-3835) Spark applications that are killed should show up as "KILLED" or "CANCELLED" in the Spark UI

2014-10-09 Thread Matt Cheah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165722#comment-14165722 ] Matt Cheah commented on SPARK-3835: --- Any updates on this? > Spark applications that are

[jira] [Assigned] (SPARK-3868) Hard to recognize which module is tested from unit-tests.log

2014-10-09 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-3868: - Assignee: Josh Rosen > Hard to recognize which module is tested from unit-tests.log > ---

[jira] [Resolved] (SPARK-3868) Hard to recognize which module is tested from unit-tests.log

2014-10-09 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-3868. --- Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 2724 [https://github.com/

[jira] [Commented] (SPARK-3376) Memory-based shuffle strategy to reduce overhead of disk I/O

2014-10-09 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165702#comment-14165702 ] Reynold Xin commented on SPARK-3376: It is definitely possible. We should evaluate the

[jira] [Resolved] (SPARK-3806) minor bug in CliSuite

2014-10-09 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3806. - Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 2666 [https:/

[jira] [Resolved] (SPARK-3752) Spark SQL needs more exhaustive tests for definite Hive UDF's

2014-10-09 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3752. - Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 2621 [https:/

[jira] [Resolved] (SPARK-3711) Optimize where in clause filter queries

2014-10-09 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3711. - Resolution: Fixed Fix Version/s: (was: 1.1.1) 1.2.0 Issue re

[jira] [Updated] (SPARK-3883) Provide SSL support for Akka and HttpServer based connections

2014-10-09 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3883: --- Issue Type: Improvement (was: Story) > Provide SSL support for Akka and HttpServer based conn

[jira] [Created] (SPARK-3883) Provide SSL support for Akka and HttpServer based connections

2014-10-09 Thread Jacek Lewandowski (JIRA)
Jacek Lewandowski created SPARK-3883: Summary: Provide SSL support for Akka and HttpServer based connections Key: SPARK-3883 URL: https://issues.apache.org/jira/browse/SPARK-3883 Project: Spark

[jira] [Comment Edited] (SPARK-3882) JobProgressListener gets permanently out of sync with long running job

2014-10-09 Thread Davis Shepherd (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165535#comment-14165535 ] Davis Shepherd edited comment on SPARK-3882 at 10/9/14 6:51 PM:

[jira] [Updated] (SPARK-3882) JobProgressListener gets permanently out of sync with long running job

2014-10-09 Thread Davis Shepherd (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davis Shepherd updated SPARK-3882: -- Attachment: Screen Shot 2014-10-03 at 12.50.59 PM.png Lots of orphaned jobs. > JobProgressListe

[jira] [Created] (SPARK-3882) JobProgressListener gets permanently out of sync with long running job

2014-10-09 Thread Davis Shepherd (JIRA)
Davis Shepherd created SPARK-3882: - Summary: JobProgressListener gets permanently out of sync with long running job Key: SPARK-3882 URL: https://issues.apache.org/jira/browse/SPARK-3882 Project: Spark

[jira] [Comment Edited] (SPARK-3736) Workers should reconnect to Master if disconnected

2014-10-09 Thread Matt Cheah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165513#comment-14165513 ] Matt Cheah edited comment on SPARK-3736 at 10/9/14 6:42 PM: Ar

[jira] [Commented] (SPARK-3736) Workers should reconnect to Master if disconnected

2014-10-09 Thread Matt Cheah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165513#comment-14165513 ] Matt Cheah commented on SPARK-3736: --- Are the two linked cases above different though? (

[jira] [Commented] (SPARK-3854) Scala style: require spaces before `{`

2014-10-09 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165507#comment-14165507 ] Josh Rosen commented on SPARK-3854: --- Hey [~sarutak], I don't really know anything about

[jira] [Commented] (SPARK-3644) REST API for Spark application info (jobs / stages / tasks / storage info)

2014-10-09 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165500#comment-14165500 ] Josh Rosen commented on SPARK-3644: --- I think that a REST/JSON API is going to share many

[jira] [Resolved] (SPARK-3741) ConnectionManager.sendMessage may not propagate errors to MessageStatus

2014-10-09 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-3741. --- Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 2593 [https://github.com/

[jira] [Commented] (SPARK-2429) Hierarchical Implementation of KMeans

2014-10-09 Thread RJ Nowling (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165480#comment-14165480 ] RJ Nowling commented on SPARK-2429: --- Great work, Yu! Ok, first off, let me make sure I

[jira] [Resolved] (SPARK-3881) This is a test JIRA

2014-10-09 Thread Spark User (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Spark User resolved SPARK-3881. --- Resolution: Invalid > This is a test JIRA > --- > > Key: SPARK-3881 >

[jira] [Updated] (SPARK-3880) HBase as data source to SparkSQL

2014-10-09 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-3880: --- Assignee: Yan > HBase as data source to SparkSQL > > >

[jira] [Updated] (SPARK-3881) This is a test JIRA

2014-10-09 Thread Spark User (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Spark User updated SPARK-3881: -- Fix Version/s: 1.2.0 > This is a test JIRA > --- > > Key: SPARK-3881 >

[jira] [Updated] (SPARK-3881) This is a test JIRA

2014-10-09 Thread Spark User (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Spark User updated SPARK-3881: -- Fix Version/s: 1.3.0 > This is a test JIRA > --- > > Key: SPARK-3881 >

[jira] [Updated] (SPARK-3881) This is a test JIRA

2014-10-09 Thread Spark User (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Spark User updated SPARK-3881: -- Fix Version/s: (was: 1.3.0) > This is a test JIRA > --- > > Key: SPA

[jira] [Updated] (SPARK-3881) This is a test JIRA

2014-10-09 Thread Spark User (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Spark User updated SPARK-3881: -- Fix Version/s: (was: 1.1.1) > This is a test JIRA > --- > > Key: SPA

[jira] [Updated] (SPARK-3881) This is a test JIRA

2014-10-09 Thread Spark User (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Spark User updated SPARK-3881: -- Fix Version/s: 1.3.0 > This is a test JIRA > --- > > Key: SPARK-3881 >

[jira] [Created] (SPARK-3881) This is a test JIRA

2014-10-09 Thread Spark User (JIRA)
Spark User created SPARK-3881: - Summary: This is a test JIRA Key: SPARK-3881 URL: https://issues.apache.org/jira/browse/SPARK-3881 Project: Spark Issue Type: Improvement Components: Spa

[jira] [Updated] (SPARK-3881) This is a test JIRA

2014-10-09 Thread Spark User (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Spark User updated SPARK-3881: -- Fix Version/s: (was: 1.2.0) 1.1.1 > This is a test JIRA > --- > >

[jira] [Commented] (SPARK-3644) REST API for Spark application info (jobs / stages / tasks / storage info)

2014-10-09 Thread Daniel Darabos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165364#comment-14165364 ] Daniel Darabos commented on SPARK-3644: --- Hi Dev, thanks for the offer! Have you seen

[jira] [Updated] (SPARK-3880) HBase as data source to SparkSQL

2014-10-09 Thread Yan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yan updated SPARK-3880: --- Attachment: HBaseOnSpark.docx Design Document > HBase as data source to SparkSQL > >

[jira] [Commented] (SPARK-3376) Memory-based shuffle strategy to reduce overhead of disk I/O

2014-10-09 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165359#comment-14165359 ] Nicholas Chammas commented on SPARK-3376: - [~matei], [~rxin], [~pwendell]: This is

[jira] [Updated] (SPARK-3880) HBase as data source to SparkSQL

2014-10-09 Thread Yan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yan updated SPARK-3880: --- Component/s: SQL Fix Version/s: (was: 1.3.0) > HBase as data source to SparkSQL > --

[jira] [Created] (SPARK-3880) HBase as data source to SparkSQL

2014-10-09 Thread Yan (JIRA)
Yan created SPARK-3880: -- Summary: HBase as data source to SparkSQL Key: SPARK-3880 URL: https://issues.apache.org/jira/browse/SPARK-3880 Project: Spark Issue Type: New Feature Reporter: Yan

[jira] [Updated] (SPARK-1486) Support multi-model training in MLlib

2014-10-09 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-1486: - Assignee: Burak Yavuz > Support multi-model training in MLlib > --

[jira] [Updated] (SPARK-1486) Support multi-model training in MLlib

2014-10-09 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-1486: - Assignee: (was: Burak Yavuz) > Support multi-model training in MLlib > ---

[jira] [Commented] (SPARK-3644) REST API for Spark application info (jobs / stages / tasks / storage info)

2014-10-09 Thread Dev Lakhani (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165293#comment-14165293 ] Dev Lakhani commented on SPARK-3644: Hi I am doing some work on the REST/JSON aspects

[jira] [Updated] (SPARK-3850) Scala style: disallow trailing spaces

2014-10-09 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-3850: Description: [Ted Yu on the dev list|http://mail-archives.apache.org/mod_mbox/spark-dev/2014

[jira] [Closed] (SPARK-3879) spark-shell.cmd fails giving error "!=x was unexpected at this time"

2014-10-09 Thread Venkata Ramana G (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Venkata Ramana G closed SPARK-3879. --- Resolution: Duplicate > spark-shell.cmd fails giving error "!=x was unexpected at this time" >

[jira] [Commented] (SPARK-3879) spark-shell.cmd fails giving error "!=x was unexpected at this time"

2014-10-09 Thread Venkata Ramana G (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165225#comment-14165225 ] Venkata Ramana G commented on SPARK-3879: - It was already fixed, under SPARK-3808.

[jira] [Commented] (SPARK-3879) spark-shell.cmd fails giving error "!=x was unexpected at this time"

2014-10-09 Thread Venkata Ramana G (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165209#comment-14165209 ] Venkata Ramana G commented on SPARK-3879: - I have fixed the same, about to submit

[jira] [Created] (SPARK-3879) spark-shell.cmd fails giving error "!=x was unexpected at this time"

2014-10-09 Thread Venkata Ramana G (JIRA)
Venkata Ramana G created SPARK-3879: --- Summary: spark-shell.cmd fails giving error "!=x was unexpected at this time" Key: SPARK-3879 URL: https://issues.apache.org/jira/browse/SPARK-3879 Project: Spa

[jira] [Updated] (SPARK-3850) Scala style: disallow trailing spaces

2014-10-09 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-3850: Summary: Scala style: disallow trailing spaces (was: Scala style: Disallow trailing spaces)

[jira] [Commented] (SPARK-3877) The exit code of spark-submit is still 0 when an yarn application fails

2014-10-09 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165124#comment-14165124 ] Thomas Graves commented on SPARK-3877: -- this looks like a dup of SPARK-2167. Or actu

[jira] [Commented] (SPARK-3781) code style format

2014-10-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165116#comment-14165116 ] Apache Spark commented on SPARK-3781: - User 'shijinkui' has created a pull request for

[jira] [Created] (SPARK-3878) Benchmarks and common tests for mllib algorithm

2014-10-09 Thread Egor Pakhomov (JIRA)
Egor Pakhomov created SPARK-3878: Summary: Benchmarks and common tests for mllib algorithm Key: SPARK-3878 URL: https://issues.apache.org/jira/browse/SPARK-3878 Project: Spark Issue Type: New

[jira] [Updated] (SPARK-2429) Hierarchical Implementation of KMeans

2014-10-09 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Ishikawa updated SPARK-2429: --- Attachment: (was: The Result of Benchmarking a Hierarchical Clustering.pdf) > Hierarchical Implem

[jira] [Updated] (SPARK-2429) Hierarchical Implementation of KMeans

2014-10-09 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Ishikawa updated SPARK-2429: --- Attachment: The Result of Benchmarking a Hierarchical Clustering.pdf Sorry for making some mistakes. I

[jira] [Commented] (SPARK-3877) The exit code of spark-submit is still 0 when an yarn application fails

2014-10-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14164993#comment-14164993 ] Apache Spark commented on SPARK-3877: - User 'zsxwing' has created a pull request for t

[jira] [Closed] (SPARK-3507) Create RegressionLearner trait and make some currect code implement it

2014-10-09 Thread Egor Pakhomov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Egor Pakhomov closed SPARK-3507. Resolution: Duplicate duplicate of SPARK-1856 > Create RegressionLearner trait and make some currec

[jira] [Created] (SPARK-3877) The exit code of spark-submit is still 0 when an yarn application fails

2014-10-09 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-3877: --- Summary: The exit code of spark-submit is still 0 when an yarn application fails Key: SPARK-3877 URL: https://issues.apache.org/jira/browse/SPARK-3877 Project: Spark

  1   2   >