[jira] [Resolved] (SPARK-1213) loss function error of logistic loss

2014-03-31 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-1213. -- Resolution: Fixed Fix Version/s: 0.9.0 > loss function error of logistic loss >

[jira] [Resolved] (SPARK-958) When iteration in ALS increases to 10 running in local mode, spark throws out error of StackOverflowError

2014-03-31 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-958. - Resolution: Duplicate > When iteration in ALS increases to 10 running in local mode, spark throws

[jira] [Resolved] (SPARK-1376) In the yarn-cluster submitter, rename "args" option to "arg"

2014-03-31 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1376. Resolution: Fixed > In the yarn-cluster submitter, rename "args" option to "arg" >

[jira] [Resolved] (SPARK-830) add DenseVector and SparseVector to mllib, and replace all Array[Double] with Vectors

2014-03-31 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-830. - Resolution: Fixed Fix Version/s: 1.0.0 Assignee: Xiangrui Meng MLlib v1.0 will sup

[jira] [Resolved] (SPARK-1226) Import breeze to Spark mllib

2014-03-31 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-1226. -- Resolution: Fixed Fix Version/s: 1.0.0 Assignee: Xiangrui Meng (was: Kun Yang)

[jira] [Commented] (SPARK-1378) Build error: org.eclipse.paho:mqtt-client

2014-03-31 Thread witgo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13956123#comment-13956123 ] witgo commented on SPARK-1378: -- Try this [PR25|https://github.com/apache/spark/pull/25], you

[jira] [Commented] (SPARK-1378) Build error: org.eclipse.paho:mqtt-client

2014-03-31 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13956117#comment-13956117 ] Patrick Wendell commented on SPARK-1378: I've had other people tell me this is an

[jira] [Resolved] (SPARK-1377) Upgrade Jetty to 8.1.14v20131031

2014-03-31 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1377. Resolution: Fixed > Upgrade Jetty to 8.1.14v20131031 > > >

[jira] [Commented] (SPARK-1363) Add streaming support for Spark SQL module

2014-03-31 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13956084#comment-13956084 ] Saisai Shao commented on SPARK-1363: Hi Michael, thanks for your advice, I've recreate

[jira] [Commented] (SPARK-1350) YARN ContainerLaunchContext should use cluster's JAVA_HOME

2014-03-31 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13956066#comment-13956066 ] Sandy Ryza commented on SPARK-1350: --- Ah, sorry. YARN doesn't have any configs for this.

[jira] [Commented] (SPARK-1363) Add streaming support for Spark SQL module

2014-03-31 Thread Jie Huang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13956062#comment-13956062 ] Jie Huang commented on SPARK-1363: -- [~marmbrus], It was originated from the apache/spark

[jira] [Updated] (SPARK-1374) Python API for running SQL queries

2014-03-31 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-1374: Fix Version/s: (was: 1.1.0) > Python API for running SQL queries >

[jira] [Created] (SPARK-1379) Calling .cache() on a SchemaRDD should do something more efficient than caching the individual row objects.

2014-03-31 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-1379: --- Summary: Calling .cache() on a SchemaRDD should do something more efficient than caching the individual row objects. Key: SPARK-1379 URL: https://issues.apache.org/jira/brow

[jira] [Updated] (SPARK-1374) Python API for running SQL queries

2014-03-31 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-1374: Fix Version/s: 1.0.0 > Python API for running SQL queries > ---

[jira] [Commented] (SPARK-1350) YARN ContainerLaunchContext should use cluster's JAVA_HOME

2014-03-31 Thread Mridul Muralidharan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13955997#comment-13955997 ] Mridul Muralidharan commented on SPARK-1350: You mistook my question; I meant

[jira] [Commented] (SPARK-1350) YARN ContainerLaunchContext should use cluster's JAVA_HOME

2014-03-31 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13955982#comment-13955982 ] Sandy Ryza commented on SPARK-1350: --- bq. Tom, is there a way to do this within context o

[jira] [Commented] (SPARK-1350) YARN ContainerLaunchContext should use cluster's JAVA_HOME

2014-03-31 Thread Mridul Muralidharan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13955978#comment-13955978 ] Mridul Muralidharan commented on SPARK-1350: We will need a way to configure

[jira] [Commented] (SPARK-1363) Add streaming support for Spark SQL module

2014-03-31 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13955936#comment-13955936 ] Michael Armbrust commented on SPARK-1363: - Thanks for publishing the code! Would

[jira] [Updated] (SPARK-1373) Compression for In-Memory Columnar storage

2014-03-31 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-1373: Assignee: Cheng Lian > Compression for In-Memory Columnar storage > ---

[jira] [Updated] (SPARK-1367) NPE when joining Parquet Relations

2014-03-31 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-1367: Assignee: Andre Schumacher > NPE when joining Parquet Relations > -

[jira] [Assigned] (SPARK-1374) Python API for running SQL queries

2014-03-31 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust reassigned SPARK-1374: --- Assignee: Michael Armbrust > Python API for running SQL queries > ---

[jira] [Updated] (SPARK-1374) Python API for running SQL queries

2014-03-31 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-1374: Assignee: Ahir Reddy (was: Michael Armbrust) > Python API for running SQL queries > --

[jira] [Commented] (SPARK-1378) Build error: org.eclipse.paho:mqtt-client

2014-03-31 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13955928#comment-13955928 ] Sean Owen commented on SPARK-1378: -- FWIW this builds fine for me from master right now. C

[jira] [Updated] (SPARK-1360) Add Timestamp Support

2014-03-31 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-1360: Assignee: Cheng Hao > Add Timestamp Support > - > > Key

[jira] [Updated] (SPARK-1355) Switch website to the Apache CMS

2014-03-31 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1355: --- Priority: Major (was: Critical) > Switch website to the Apache CMS > ---

[jira] [Commented] (SPARK-1355) Switch website to the Apache CMS

2014-03-31 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13955874#comment-13955874 ] Patrick Wendell commented on SPARK-1355: This decision should be driven by the pro

[jira] [Updated] (SPARK-1365) Fix RateLimitedOutputStream Test

2014-03-31 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1365: --- Fix Version/s: (was: 1.1.0) 1.0.0 > Fix RateLimitedOutputStream Test >

[jira] [Resolved] (SPARK-1365) Fix RateLimitedOutputStream Test

2014-03-31 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1365. Resolution: Fixed > Fix RateLimitedOutputStream Test > > >

[jira] [Commented] (SPARK-1378) Build error: org.eclipse.paho:mqtt-client

2014-03-31 Thread Ken Williams (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13955820#comment-13955820 ] Ken Williams commented on SPARK-1378: - This was issue https://spark-project.atlassian.

[jira] [Created] (SPARK-1378) Build error: org.eclipse.paho:mqtt-client

2014-03-31 Thread Ken Williams (JIRA)
Ken Williams created SPARK-1378: --- Summary: Build error: org.eclipse.paho:mqtt-client Key: SPARK-1378 URL: https://issues.apache.org/jira/browse/SPARK-1378 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-1377) Upgrade Jetty to 8.1.14v20131031

2014-03-31 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-1377: - Description: Previous version was 7.6.8v20121106. The only difference between Jetty 7 and Jetty 8 is that

[jira] [Resolved] (SPARK-1370) HashJoin should stream one relation

2014-03-31 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-1370. - Resolution: Fixed > HashJoin should stream one relation > ---

[jira] [Updated] (SPARK-1377) Upgrade Jetty to 8.1.14v20131031

2014-03-31 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-1377: - Issue Type: Bug (was: Improvement) > Upgrade Jetty to 8.1.14v20131031 >

[jira] [Updated] (SPARK-1377) Upgrade Jetty to 8.1.14v20131031

2014-03-31 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-1377: - Issue Type: Improvement (was: Bug) > Upgrade Jetty to 8.1.14v20131031 >

[jira] [Created] (SPARK-1377) Upgrade Jetty to 8.1.14v20131031

2014-03-31 Thread Andrew Or (JIRA)
Andrew Or created SPARK-1377: Summary: Upgrade Jetty to 8.1.14v20131031 Key: SPARK-1377 URL: https://issues.apache.org/jira/browse/SPARK-1377 Project: Spark Issue Type: Improvement Comp

[jira] [Updated] (SPARK-1252) On YARN, use container-log4j.properties for executors

2014-03-31 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1252: --- Reporter: Sandy Ryza (was: Sandy Pérez González) > On YARN, use container-log4j.properties f

[jira] [Updated] (SPARK-1252) On YARN, use container-log4j.properties for executors

2014-03-31 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1252: --- Priority: Critical (was: Major) > On YARN, use container-log4j.properties for executors > --

[jira] [Updated] (SPARK-1252) On YARN, use container-log4j.properties for executors

2014-03-31 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1252: --- Reporter: Sandy Ryza (was: Sandy Ryza) > On YARN, use container-log4j.properties for executo

[jira] [Updated] (SPARK-1252) On YARN, use container-log4j.properties for executors

2014-03-31 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1252: --- Fix Version/s: 1.0.0 > On YARN, use container-log4j.properties for executors > --

[jira] [Updated] (SPARK-1252) On YARN, use container-log4j.properties for executors

2014-03-31 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1252: --- Assignee: Sandy Ryza (was: Sandy Pérez González) > On YARN, use container-log4j.properties f

[jira] [Updated] (SPARK-1355) Switch website to the Apache CMS

2014-03-31 Thread Joe Schaefer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Schaefer updated SPARK-1355: Priority: Critical (was: Major) > Switch website to the Apache CMS > -

[jira] [Commented] (SPARK-1350) YARN ContainerLaunchContext should use cluster's JAVA_HOME

2014-03-31 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13955753#comment-13955753 ] Sandy Ryza commented on SPARK-1350: --- + [~pwendell] and [~mrid...@yahoo-inc.com] > YARN

[jira] [Commented] (SPARK-1355) Switch website to the Apache CMS

2014-03-31 Thread Joe Schaefer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13955739#comment-13955739 ] Joe Schaefer commented on SPARK-1355: - People are coming out of the woodwork to recomm

[jira] [Commented] (SPARK-1355) Switch website to the Apache CMS

2014-03-31 Thread Daniel Gruno (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13955702#comment-13955702 ] Daniel Gruno commented on SPARK-1355: - Some other benefits include being able to edit

[jira] [Commented] (SPARK-1376) In the yarn-cluster submitter, rename "args" option to "arg"

2014-03-31 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13955653#comment-13955653 ] Sandy Ryza commented on SPARK-1376: --- https://github.com/apache/spark/pull/279 > In the

[jira] [Created] (SPARK-1376) In the yarn-cluster submitter, rename "args" option to "arg"

2014-03-31 Thread Sandy Ryza (JIRA)
Sandy Ryza created SPARK-1376: - Summary: In the yarn-cluster submitter, rename "args" option to "arg" Key: SPARK-1376 URL: https://issues.apache.org/jira/browse/SPARK-1376 Project: Spark Issue T

[jira] [Updated] (SPARK-1375) spark-submit script additional cleanup

2014-03-31 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated SPARK-1375: -- Description: A couple small things: * accept "yarn-cluster" where "yarn-standalone" is accepted * As di

[jira] [Commented] (SPARK-1375) spark-submit script additional cleanup

2014-03-31 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13955640#comment-13955640 ] Sandy Ryza commented on SPARK-1375: --- https://github.com/apache/spark/pull/278 > spark-s

[jira] [Updated] (SPARK-1375) spark-submit script additional cleanup

2014-03-31 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated SPARK-1375: -- Summary: spark-submit script additional cleanup (was: In spark-submit script, where "yarn-standalone"

[jira] [Created] (SPARK-1375) In spark-submit script, where "yarn-standalone" is used, accept "yarn-cluster" as well

2014-03-31 Thread Sandy Ryza (JIRA)
Sandy Ryza created SPARK-1375: - Summary: In spark-submit script, where "yarn-standalone" is used, accept "yarn-cluster" as well Key: SPARK-1375 URL: https://issues.apache.org/jira/browse/SPARK-1375 Projec

[jira] [Updated] (SPARK-1365) Fix RateLimitedOutputStream Test

2014-03-31 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1365: --- Assignee: Patrick Wendell > Fix RateLimitedOutputStream Test > --

[jira] [Resolved] (SPARK-1352) Improve robustness of spark-submit script

2014-03-31 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1352. Resolution: Fixed > Improve robustness of spark-submit script > ---

[jira] [Commented] (SPARK-1355) Switch website to the Apache CMS

2014-03-31 Thread Jake Farrell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13955524#comment-13955524 ] Jake Farrell commented on SPARK-1355: - I've been down this road as well, Thrift starte

[jira] [Commented] (SPARK-1374) Python API for running SQL queries

2014-03-31 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13955502#comment-13955502 ] Michael Armbrust commented on SPARK-1374: - This is dependent on [SPARK-1333] > Py

[jira] [Created] (SPARK-1374) Python API for running SQL queries

2014-03-31 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-1374: --- Summary: Python API for running SQL queries Key: SPARK-1374 URL: https://issues.apache.org/jira/browse/SPARK-1374 Project: Spark Issue Type: Improvemen

[jira] [Created] (SPARK-1373) Compression for In-Memory Columnar storage

2014-03-31 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-1373: --- Summary: Compression for In-Memory Columnar storage Key: SPARK-1373 URL: https://issues.apache.org/jira/browse/SPARK-1373 Project: Spark Issue Type: Im

[jira] [Created] (SPARK-1372) Expose in-memory columnar caching for tables.

2014-03-31 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-1372: --- Summary: Expose in-memory columnar caching for tables. Key: SPARK-1372 URL: https://issues.apache.org/jira/browse/SPARK-1372 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-1370) HashJoin should stream one relation

2014-03-31 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust reassigned SPARK-1370: --- Assignee: Michael Armbrust > HashJoin should stream one relation > --

[jira] [Assigned] (SPARK-1371) HashAggregate should stream tuples and avoid doing an extra count

2014-03-31 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust reassigned SPARK-1371: --- Assignee: Michael Armbrust > HashAggregate should stream tuples and avoid doing an ex

[jira] [Created] (SPARK-1371) HashAggregate should stream tuples and avoid doing an extra count

2014-03-31 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-1371: --- Summary: HashAggregate should stream tuples and avoid doing an extra count Key: SPARK-1371 URL: https://issues.apache.org/jira/browse/SPARK-1371 Project: Spark

[jira] [Created] (SPARK-1370) HashJoin should stream one relation

2014-03-31 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-1370: --- Summary: HashJoin should stream one relation Key: SPARK-1370 URL: https://issues.apache.org/jira/browse/SPARK-1370 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-1355) Switch website to the Apache CMS

2014-03-31 Thread Joe Schaefer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13955463#comment-13955463 ] Joe Schaefer commented on SPARK-1355: - It will require a lot of soul searching to deal

[jira] [Created] (SPARK-1368) HiveTableScan is slow

2014-03-31 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-1368: --- Summary: HiveTableScan is slow Key: SPARK-1368 URL: https://issues.apache.org/jira/browse/SPARK-1368 Project: Spark Issue Type: Bug Component

[jira] [Created] (SPARK-1369) HiveUDF wrappers are slow

2014-03-31 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-1369: --- Summary: HiveUDF wrappers are slow Key: SPARK-1369 URL: https://issues.apache.org/jira/browse/SPARK-1369 Project: Spark Issue Type: Bug Compo

[jira] [Created] (SPARK-1367) NPE when joining Parquet Relations

2014-03-31 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-1367: --- Summary: NPE when joining Parquet Relations Key: SPARK-1367 URL: https://issues.apache.org/jira/browse/SPARK-1367 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-1350) YARN ContainerLaunchContext should use cluster's JAVA_HOME

2014-03-31 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13955443#comment-13955443 ] Thomas Graves commented on SPARK-1350: -- I agree it is weird, lets bring this back up

[jira] [Created] (SPARK-1366) The sql function should be consistent between different types of SQLContext

2014-03-31 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-1366: --- Summary: The sql function should be consistent between different types of SQLContext Key: SPARK-1366 URL: https://issues.apache.org/jira/browse/SPARK-1366 Proje

[jira] [Assigned] (SPARK-1333) Java API for running SQL queries

2014-03-31 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust reassigned SPARK-1333: --- Assignee: Michael Armbrust (was: Patrick Wendell) > Java API for running SQL queries

[jira] [Created] (SPARK-1365) Fix RateLimitedOutputStream Test

2014-03-31 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-1365: -- Summary: Fix RateLimitedOutputStream Test Key: SPARK-1365 URL: https://issues.apache.org/jira/browse/SPARK-1365 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-1350) YARN ContainerLaunchContext should use cluster's JAVA_HOME

2014-03-31 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13955422#comment-13955422 ] Sandy Ryza commented on SPARK-1350: --- bq. It actually does not use the same java as speci

[jira] [Created] (SPARK-1364) DataTypes missing from ScalaReflection

2014-03-31 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-1364: --- Summary: DataTypes missing from ScalaReflection Key: SPARK-1364 URL: https://issues.apache.org/jira/browse/SPARK-1364 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-1351) Documentation Improvements for Spark 1.0

2014-03-31 Thread Nan Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13955329#comment-13955329 ] Nan Zhu commented on SPARK-1351: Hi, I would like to be part of this work, I compiled a

[jira] [Resolved] (SPARK-1345) spark on yarn 0.23 using maven doesn't build

2014-03-31 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-1345. -- Resolution: Fixed Fix Version/s: 1.0.0 > spark on yarn 0.23 using maven doesn't build >

[jira] [Resolved] (SPARK-1232) maven hadoop 0.23 yarn-alpha build broken

2014-03-31 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-1232. -- Resolution: Fixed Fix Version/s: 1.0.0 > maven hadoop 0.23 yarn-alpha build broken > ---

[jira] [Commented] (SPARK-1350) YARN ContainerLaunchContext should use cluster's JAVA_HOME

2014-03-31 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13955209#comment-13955209 ] Thomas Graves commented on SPARK-1350: -- I assume you are referring to the one in Clie

[jira] [Comment Edited] (SPARK-1363) Add streaming support for Spark SQL module

2014-03-31 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13955098#comment-13955098 ] Saisai Shao edited comment on SPARK-1363 at 3/31/14 11:18 AM: --

[jira] [Commented] (SPARK-1188) GraphX triplets not working properly

2014-03-31 Thread Daniel Darabos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13955100#comment-13955100 ] Daniel Darabos commented on SPARK-1188: --- I've sent a pull request to eliminate the r

[jira] [Updated] (SPARK-1363) Add streaming support for Spark SQL module

2014-03-31 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-1363: --- Attachment: StreamSQLDesignDoc.pdf Here is is our early version of design doc, details will be change

[jira] [Created] (SPARK-1363) Add streaming support for Spark SQL module

2014-03-31 Thread Saisai Shao (JIRA)
Saisai Shao created SPARK-1363: -- Summary: Add streaming support for Spark SQL module Key: SPARK-1363 URL: https://issues.apache.org/jira/browse/SPARK-1363 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-1338) Create Additional Style Rules

2014-03-31 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13955067#comment-13955067 ] Prashant Sharma commented on SPARK-1338: Just realized it is doable. > Create Ad

[jira] [Created] (SPARK-1362) Web UI should provide page of showing statistics and stage list for a given job

2014-03-31 Thread wangfei (JIRA)
wangfei created SPARK-1362: -- Summary: Web UI should provide page of showing statistics and stage list for a given job Key: SPARK-1362 URL: https://issues.apache.org/jira/browse/SPARK-1362 Project: Spark

[jira] [Commented] (SPARK-1361) DAGScheduler throws NullPointerException occasionally

2014-03-31 Thread wangfei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13955046#comment-13955046 ] wangfei commented on SPARK-1361: this is an order issue of construction and starting of th

[jira] [Created] (SPARK-1361) DAGScheduler throws NullPointerException occasionally

2014-03-31 Thread wangfei (JIRA)
wangfei created SPARK-1361: -- Summary: DAGScheduler throws NullPointerException occasionally Key: SPARK-1361 URL: https://issues.apache.org/jira/browse/SPARK-1361 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-1338) Create Additional Style Rules

2014-03-31 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13955035#comment-13955035 ] Prashant Sharma commented on SPARK-1338: Can someone fix the Assignee and reporter

[jira] [Commented] (SPARK-1360) Add Timestamp Support

2014-03-31 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13955030#comment-13955030 ] Cheng Hao commented on SPARK-1360: -- I have created an PR to resolve this. [PR275|https:/

[jira] [Comment Edited] (SPARK-1360) Add Timestamp Support

2014-03-31 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13955030#comment-13955030 ] Cheng Hao edited comment on SPARK-1360 at 3/31/14 8:40 AM: --- I ha

[jira] [Commented] (SPARK-1358) Continuous integrated test should be involved in Spark ecosystem

2014-03-31 Thread Jie Huang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13955029#comment-13955029 ] Jie Huang commented on SPARK-1358: -- Do you mean this? Some similar project for Hadoop cal

[jira] [Updated] (SPARK-1360) Add Timestamp Support

2014-03-31 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Hao updated SPARK-1360: - Description: Add Timestamp Support for Catalyst/SQLParser/HiveQl (was: Add Timestamp Support for both Ca

[jira] [Created] (SPARK-1360) Add Timestamp Support

2014-03-31 Thread Cheng Hao (JIRA)
Cheng Hao created SPARK-1360: Summary: Add Timestamp Support Key: SPARK-1360 URL: https://issues.apache.org/jira/browse/SPARK-1360 Project: Spark Issue Type: New Feature Components: SQL

[jira] [Commented] (SPARK-1212) Support sparse data in MLlib

2014-03-31 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13955023#comment-13955023 ] Xiangrui Meng commented on SPARK-1212: -- Part II adds sparse data support to GLMs and

[jira] [Created] (SPARK-1359) SGD implementation is not efficient

2014-03-31 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-1359: Summary: SGD implementation is not efficient Key: SPARK-1359 URL: https://issues.apache.org/jira/browse/SPARK-1359 Project: Spark Issue Type: Improvement