[jira] [Commented] (SPARK-1547) Add gradient boosting algorithm to MLlib

[ https://issues.apache.org/jira/browse/SPARK-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14049659#comment-14049659 ] Hector Yee commented on SPARK-1547: --- Just generic log loss with L1 regularization should

[jira] [Closed] (SPARK-1525) TaskSchedulerImpl should decrease availableCpus by spark.task.cpus not 1

[ https://issues.apache.org/jira/browse/SPARK-1525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YanTang Zhai closed SPARK-1525. --- Resolution: Fixed TaskSchedulerImpl should decrease availableCpus by spark.task.cpus not 1

[jira] [Commented] (SPARK-786) Clean up old work directories in standalone worker

[ https://issues.apache.org/jira/browse/SPARK-786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14049671#comment-14049671 ] anurag tangri commented on SPARK-786: - Hi, We are also facing this issue. Could

[jira] [Created] (SPARK-2341) loadLibSVMFile doesn't handle regression datasets

Eustache created SPARK-2341: --- Summary: loadLibSVMFile doesn't handle regression datasets Key: SPARK-2341 URL: https://issues.apache.org/jira/browse/SPARK-2341 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-2339) SQL parser in sql-core is case sensitive, but a table alias is converted to lower case when we create Subquery

[ https://issues.apache.org/jira/browse/SPARK-2339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2339: Fix Version/s: 1.1.0 SQL parser in sql-core is case sensitive, but a table alias is

[jira] [Created] (SPARK-2342) Evaluation helper's output type doesn't conform to input type

Yijie Shen created SPARK-2342: - Summary: Evaluation helper's output type doesn't conform to input type Key: SPARK-2342 URL: https://issues.apache.org/jira/browse/SPARK-2342 Project: Spark Issue

[jira] [Updated] (SPARK-2342) Evaluation helper's output type doesn't conform to input type

[ https://issues.apache.org/jira/browse/SPARK-2342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yijie Shen updated SPARK-2342: -- Description: In sql/catalyst/org/apache/spark/sql/catalyst/expressions.scala {code}protected final def

[jira] [Commented] (SPARK-2341) loadLibSVMFile doesn't handle regression datasets

[ https://issues.apache.org/jira/browse/SPARK-2341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14049732#comment-14049732 ] Xiangrui Meng commented on SPARK-2341: -- Just set `multiclass = true` to load double

[jira] [Commented] (SPARK-2341) loadLibSVMFile doesn't handle regression datasets

[ https://issues.apache.org/jira/browse/SPARK-2341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14049755#comment-14049755 ] Eustache commented on SPARK-2341: - I see that LabelParser with multiclass=true works for

[jira] [Commented] (SPARK-2341) loadLibSVMFile doesn't handle regression datasets

[ https://issues.apache.org/jira/browse/SPARK-2341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14049765#comment-14049765 ] Xiangrui Meng commented on SPARK-2341: -- It is a little awkward to have both

[jira] [Comment Edited] (SPARK-2341) loadLibSVMFile doesn't handle regression datasets

[ https://issues.apache.org/jira/browse/SPARK-2341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14049765#comment-14049765 ] Xiangrui Meng edited comment on SPARK-2341 at 7/2/14 9:09 AM: --

[jira] [Updated] (SPARK-1681) Handle hive support correctly in ./make-distribution.sh

[ https://issues.apache.org/jira/browse/SPARK-1681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-1681: --- Summary: Handle hive support correctly in ./make-distribution.sh (was: Handle hive support

[jira] [Commented] (SPARK-2306) BoundedPriorityQueue is private and not registered with Kryo

[ https://issues.apache.org/jira/browse/SPARK-2306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14049818#comment-14049818 ] Daniel Darabos commented on SPARK-2306: --- You're the best, Ankit! Thanks!

[jira] [Commented] (SPARK-1884) Shark failed to start

[ https://issues.apache.org/jira/browse/SPARK-1884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14049877#comment-14049877 ] Pete MacKinnon commented on SPARK-1884: --- This is due to the version of protobuf-java

[jira] [Commented] (SPARK-1850) Bad exception if multiple jars exist when running PySpark

[ https://issues.apache.org/jira/browse/SPARK-1850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14049895#comment-14049895 ] Matthew Farrellee commented on SPARK-1850: -- [~andrewor14] - i think this should

[jira] [Commented] (SPARK-1550) Successive creation of spark context fails in pyspark, if the previous initialization of spark context had failed.

[ https://issues.apache.org/jira/browse/SPARK-1550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14049918#comment-14049918 ] Matthew Farrellee commented on SPARK-1550: -- this issue as reported is no longer

[jira] [Commented] (SPARK-1257) Endless running task when using pyspark with input file containing a long line

[ https://issues.apache.org/jira/browse/SPARK-1257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14049933#comment-14049933 ] Matthew Farrellee commented on SPARK-1257: -- recommend close as resolved w/ option

[jira] [Commented] (SPARK-1030) unneeded file required when running pyspark program using yarn-client

[ https://issues.apache.org/jira/browse/SPARK-1030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14049929#comment-14049929 ] Matthew Farrellee commented on SPARK-1030: -- using pyspark to submit is deprecated

[jira] [Commented] (SPARK-1284) pyspark hangs after IOError on Executor

[ https://issues.apache.org/jira/browse/SPARK-1284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14049937#comment-14049937 ] Matthew Farrellee commented on SPARK-1284: -- [~jblomo] - will you add a

[jira] [Commented] (SPARK-1473) Feature selection for high dimensional datasets

[ https://issues.apache.org/jira/browse/SPARK-1473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14049939#comment-14049939 ] Alexander Ulanov commented on SPARK-1473: - Does anybody work on this issue?

[jira] [Commented] (SPARK-2341) loadLibSVMFile doesn't handle regression datasets

[ https://issues.apache.org/jira/browse/SPARK-2341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14049942#comment-14049942 ] Sean Owen commented on SPARK-2341: -- I've been a bit uncomfortable with how the MLlib API

[jira] [Commented] (SPARK-1989) Exit executors faster if they get into a cycle of heavy GC

[ https://issues.apache.org/jira/browse/SPARK-1989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14050005#comment-14050005 ] Guoqiang Li commented on SPARK-1989: In this case should also triggers the driver

[jira] [Created] (SPARK-2343) QueueInputDStream with oneAtATime=false does not dequeue items

Manuel Laflamme created SPARK-2343: -- Summary: QueueInputDStream with oneAtATime=false does not dequeue items Key: SPARK-2343 URL: https://issues.apache.org/jira/browse/SPARK-2343 Project: Spark

[jira] [Commented] (SPARK-1850) Bad exception if multiple jars exist when running PySpark

[ https://issues.apache.org/jira/browse/SPARK-1850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14050318#comment-14050318 ] Andrew Or commented on SPARK-1850: -- Ye, I will change it. Bad exception if multiple

[jira] [Closed] (SPARK-1850) Bad exception if multiple jars exist when running PySpark

[ https://issues.apache.org/jira/browse/SPARK-1850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-1850. Resolution: Fixed Bad exception if multiple jars exist when running PySpark

[jira] [Resolved] (SPARK-2328) Add execution of `SHOW TABLES` before `TestHive.reset()`.

[ https://issues.apache.org/jira/browse/SPARK-2328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-2328. - Resolution: Fixed Fix Version/s: 1.1.0 1.0.1 Assignee:

[jira] [Resolved] (SPARK-2186) Spark SQL DSL support for simple aggregations such as SUM and AVG

[ https://issues.apache.org/jira/browse/SPARK-2186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-2186. - Resolution: Fixed Fix Version/s: 1.1.0 1.0.1 Spark SQL DSL

[jira] [Resolved] (SPARK-2287) Make ScalaReflection be able to handle Generic case classes.

[ https://issues.apache.org/jira/browse/SPARK-2287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-2287. - Resolution: Fixed Fix Version/s: 1.1.0 1.0.1 Assignee:

[jira] [Commented] (SPARK-2342) Evaluation helper's output type doesn't conform to input type

[ https://issues.apache.org/jira/browse/SPARK-2342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14050347#comment-14050347 ] Michael Armbrust commented on SPARK-2342: - This does look like a typo (though

[jira] [Commented] (SPARK-2277) Make TaskScheduler track whether there's host on a rack

[ https://issues.apache.org/jira/browse/SPARK-2277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14050381#comment-14050381 ] Chen He commented on SPARK-2277: This is interesting. I will take a look. Make

[jira] [Updated] (SPARK-1054) Get Cassandra support in Spark Core/Spark Cassandra Module

[ https://issues.apache.org/jira/browse/SPARK-1054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohit Rai updated SPARK-1054: - Summary: Get Cassandra support in Spark Core/Spark Cassandra Module (was: Contribute Calliope Core to

[jira] [Commented] (SPARK-1054) Get Cassandra support in Spark Core/Spark Cassandra Module

[ https://issues.apache.org/jira/browse/SPARK-1054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14050544#comment-14050544 ] Rohit Rai commented on SPARK-1054: -- With the

[jira] [Created] (SPARK-2345) ForEachDStream should have an option of running the foreachfunc on Spark

Hari Shreedharan created SPARK-2345: --- Summary: ForEachDStream should have an option of running the foreachfunc on Spark Key: SPARK-2345 URL: https://issues.apache.org/jira/browse/SPARK-2345

[jira] [Commented] (SPARK-2345) ForEachDStream should have an option of running the foreachfunc on Spark

[ https://issues.apache.org/jira/browse/SPARK-2345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14050659#comment-14050659 ] Hari Shreedharan commented on SPARK-2345: - Currently, the job (like saveAsTextFile

[jira] [Created] (SPARK-2346) Error parsing table names that starts from numbers

Alexander Albul created SPARK-2346: -- Summary: Error parsing table names that starts from numbers Key: SPARK-2346 URL: https://issues.apache.org/jira/browse/SPARK-2346 Project: Spark Issue

[jira] [Commented] (SPARK-2345) ForEachDStream should have an option of running the foreachfunc on Spark

[ https://issues.apache.org/jira/browse/SPARK-2345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14050670#comment-14050670 ] Hari Shreedharan commented on SPARK-2345: - Looks like we'd have to do this in a

[jira] [Updated] (SPARK-2346) Error parsing table names that starts from numbers

[ https://issues.apache.org/jira/browse/SPARK-2346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Albul updated SPARK-2346: --- Description: Looks like *org.apache.spark.sql.catalyst.SqlParser* cannot parse table names

[jira] [Created] (SPARK-2347) Graph object can not be set to StorageLevel.MEMORY_ONLY_SER

Baoxu Shi created SPARK-2347: Summary: Graph object can not be set to StorageLevel.MEMORY_ONLY_SER Key: SPARK-2347 URL: https://issues.apache.org/jira/browse/SPARK-2347 Project: Spark Issue

[jira] [Commented] (SPARK-2339) SQL parser in sql-core is case sensitive, but a table alias is converted to lower case when we create Subquery

[ https://issues.apache.org/jira/browse/SPARK-2339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14050721#comment-14050721 ] Yin Huai commented on SPARK-2339: - Also, names of those registered tables are case

[jira] [Created] (SPARK-2348) In Windows having a enviorinment variable named 'classpath' gives error

Chirag Todarka created SPARK-2348: - Summary: In Windows having a enviorinment variable named 'classpath' gives error Key: SPARK-2348 URL: https://issues.apache.org/jira/browse/SPARK-2348 Project:

[jira] [Issue Comment Deleted] (SPARK-1305) Support persisting RDD's directly to Tachyon

[ https://issues.apache.org/jira/browse/SPARK-1305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Saputra updated SPARK-1305: - Comment: was deleted (was: Sorry to comment on old JIRA but does anyone have PR for this

[jira] [Commented] (SPARK-2348) In Windows having a enviorinment variable named 'classpath' gives error

[ https://issues.apache.org/jira/browse/SPARK-2348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14050757#comment-14050757 ] Chirag Todarka commented on SPARK-2348: --- [~pwendell] [~cheffpj] Hi Patrick/Pat, I

[jira] [Updated] (SPARK-2346) Error parsing table names that starts with numbers

[ https://issues.apache.org/jira/browse/SPARK-2346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Albul updated SPARK-2346: --- Summary: Error parsing table names that starts with numbers (was: Error parsing table names

[jira] [Commented] (SPARK-1614) Move Mesos protobufs out of TaskState

[ https://issues.apache.org/jira/browse/SPARK-1614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14050804#comment-14050804 ] Martin Zapletal commented on SPARK-1614: I am considering moving the protobufs to

[jira] [Created] (SPARK-2349) Fix NPE in ExternalAppendOnlyMap

Andrew Or created SPARK-2349: Summary: Fix NPE in ExternalAppendOnlyMap Key: SPARK-2349 URL: https://issues.apache.org/jira/browse/SPARK-2349 Project: Spark Issue Type: Bug Components:

[jira] [Commented] (SPARK-2277) Make TaskScheduler track whether there's host on a rack

[ https://issues.apache.org/jira/browse/SPARK-2277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14050886#comment-14050886 ] Mridul Muralidharan commented on SPARK-2277: I am not sure I follow this

[jira] [Created] (SPARK-2350) Master throws NPE

Andrew Or created SPARK-2350: Summary: Master throws NPE Key: SPARK-2350 URL: https://issues.apache.org/jira/browse/SPARK-2350 Project: Spark Issue Type: Bug Components: Spark Core

[jira] [Updated] (SPARK-2350) Master throws NPE

[ https://issues.apache.org/jira/browse/SPARK-2350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2350: - Description: ... if we launch a driver and there are more waiting drivers to be launched. This is

[jira] [Updated] (SPARK-2350) Master throws NPE

[ https://issues.apache.org/jira/browse/SPARK-2350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2350: - Description: ... if we launch a driver and there are more waiting drivers to be launched. This is

[jira] [Updated] (SPARK-2350) Master throws NPE

[ https://issues.apache.org/jira/browse/SPARK-2350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2350: - Description: ... if we launch a driver and there are more waiting drivers to be launched. This is

[jira] [Commented] (SPARK-2350) Master throws NPE

[ https://issues.apache.org/jira/browse/SPARK-2350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14050891#comment-14050891 ] Andrew Or commented on SPARK-2350: -- In general, if Master dies because of an exception,

[jira] [Comment Edited] (SPARK-2350) Master throws NPE

[ https://issues.apache.org/jira/browse/SPARK-2350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14050891#comment-14050891 ] Andrew Or edited comment on SPARK-2350 at 7/3/14 12:07 AM: --- In

[jira] [Commented] (SPARK-2350) Master throws NPE

[ https://issues.apache.org/jira/browse/SPARK-2350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14050894#comment-14050894 ] Andrew Or commented on SPARK-2350: -- This is the root cause of SPARK-2154 Master throws

[jira] [Commented] (SPARK-2277) Make TaskScheduler track whether there's host on a rack

[ https://issues.apache.org/jira/browse/SPARK-2277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14050951#comment-14050951 ] Rui Li commented on SPARK-2277: --- Suppose task1 prefers node1 but node1 is not available at

[jira] [Commented] (SPARK-2277) Make TaskScheduler track whether there's host on a rack

[ https://issues.apache.org/jira/browse/SPARK-2277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14050952#comment-14050952 ] Rui Li commented on SPARK-2277: --- PR created at: https://github.com/apache/spark/pull/1212

[jira] [Comment Edited] (SPARK-2342) Evaluation helper's output type doesn't conform to input type

[ https://issues.apache.org/jira/browse/SPARK-2342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14050982#comment-14050982 ] Yijie Shen edited comment on SPARK-2342 at 7/3/14 1:52 AM: ---

[jira] [Comment Edited] (SPARK-2342) Evaluation helper's output type doesn't conform to input type

[ https://issues.apache.org/jira/browse/SPARK-2342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14050982#comment-14050982 ] Yijie Shen edited comment on SPARK-2342 at 7/3/14 1:51 AM: ---

[jira] [Comment Edited] (SPARK-2342) Evaluation helper's output type doesn't conform to input type

[ https://issues.apache.org/jira/browse/SPARK-2342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14050982#comment-14050982 ] Yijie Shen edited comment on SPARK-2342 at 7/3/14 1:52 AM: ---

[jira] [Created] (SPARK-2351) Add Artificial Neural Network (ANN) to Spark

Bert Greevenbosch created SPARK-2351: Summary: Add Artificial Neural Network (ANN) to Spark Key: SPARK-2351 URL: https://issues.apache.org/jira/browse/SPARK-2351 Project: Spark Issue

[jira] [Created] (SPARK-2352) Add Artificial Neural Network (ANN) to Spark

Bert Greevenbosch created SPARK-2352: Summary: Add Artificial Neural Network (ANN) to Spark Key: SPARK-2352 URL: https://issues.apache.org/jira/browse/SPARK-2352 Project: Spark Issue

[jira] [Closed] (SPARK-2351) Add Artificial Neural Network (ANN) to Spark

[ https://issues.apache.org/jira/browse/SPARK-2351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bert Greevenbosch closed SPARK-2351. Resolution: Duplicate Duplicate with SPARK-2352. Add Artificial Neural Network (ANN) to