[jira] [Commented] (SPARK-11385) Add foreach API to MLLib's vector API

2015-10-30 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982070#comment-14982070 ] DB Tsai commented on SPARK-11385: - ++Sean. I think `foreach` doesn't make sense for sparse vector. In

[jira] [Commented] (SPARK-11138) Flaky pyspark test: test_add_py_file

2015-10-30 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982135#comment-14982135 ] holdenk commented on SPARK-11138: - Makes sense, I guess I'll wait for it to fail again and grab the build

[jira] [Commented] (SPARK-11330) Filter operation on StringType after groupBy PERSISTED brings no results

2015-10-30 Thread Saif Addin Ellafi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14981981#comment-14981981 ] Saif Addin Ellafi commented on SPARK-11330: --- I can no longer reproduce the issue on 1.5.2-RC1

[jira] [Resolved] (SPARK-10342) Cooperative memory management

2015-10-30 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-10342. Resolution: Fixed > Cooperative memory management > - > >

[jira] [Resolved] (SPARK-10309) Some tasks failed with Unable to acquire memory

2015-10-30 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-10309. Resolution: Fixed > Some tasks failed with Unable to acquire memory >

[jira] [Comment Edited] (SPARK-11402) Allow to define a custom driver runner and executor runner

2015-10-30 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982030#comment-14982030 ] Jacek Lewandowski edited comment on SPARK-11402 at 10/30/15 7:18 AM: -

[jira] [Updated] (SPARK-11385) Add foreach API to MLLib's vector API

2015-10-30 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-11385: Assignee: Nakul Jindal > Add foreach API to MLLib's vector API > - > >

[jira] [Commented] (SPARK-11385) Make foreachActive public in MLLib's vector API

2015-10-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982090#comment-14982090 ] Sean Owen commented on SPARK-11385: --- OK the new description makes more sense, yes > Make foreachActive

[jira] [Commented] (SPARK-11416) Upgrade kryo package to version 3.0

2015-10-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982145#comment-14982145 ] Sean Owen commented on SPARK-11416: --- That's good, but it doesn't mean it doesn't break other things. I

[jira] [Commented] (SPARK-3630) Identify cause of Kryo+Snappy PARSING_ERROR

2015-10-30 Thread Alan Braithwaite (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14981966#comment-14981966 ] Alan Braithwaite commented on SPARK-3630: - Of course! I can provide more information tomorrow but

[jira] [Comment Edited] (SPARK-3630) Identify cause of Kryo+Snappy PARSING_ERROR

2015-10-30 Thread Alan Braithwaite (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14981966#comment-14981966 ] Alan Braithwaite edited comment on SPARK-3630 at 10/30/15 6:08 AM: --- Of

[jira] [Commented] (SPARK-11415) Catalyst DateType Shifts Input Data by Local Timezone

2015-10-30 Thread Russell Alexander Spitzer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14981968#comment-14981968 ] Russell Alexander Spitzer commented on SPARK-11415: --- Some tests are now, broken

[jira] [Updated] (SPARK-11416) Upgrade kryo package to version 3.0

2015-10-30 Thread Hitoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitoshi Ozawa updated SPARK-11416: -- Description: Would like to have Apache Spark upgrade kryo package from 2.x (current) to 3.x.

[jira] [Closed] (SPARK-11386) Refactor appropriate uses of Vector to use the new foreach API

2015-10-30 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk closed SPARK-11386. --- Resolution: Fixed > Refactor appropriate uses of Vector to use the new foreach API >

[jira] [Assigned] (SPARK-11419) WriteAheadLog recovery improvements for when closeFileAfterWrite is enabled

2015-10-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11419: Assignee: Apache Spark > WriteAheadLog recovery improvements for when closeFileAfterWrite

[jira] [Assigned] (SPARK-11419) WriteAheadLog recovery improvements for when closeFileAfterWrite is enabled

2015-10-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11419: Assignee: (was: Apache Spark) > WriteAheadLog recovery improvements for when

[jira] [Commented] (SPARK-11419) WriteAheadLog recovery improvements for when closeFileAfterWrite is enabled

2015-10-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14981975#comment-14981975 ] Apache Spark commented on SPARK-11419: -- User 'brkyvz' has created a pull request for this issue:

[jira] [Comment Edited] (SPARK-11415) Catalyst DateType Shifts Input Data by Local Timezone

2015-10-30 Thread Russell Alexander Spitzer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14981968#comment-14981968 ] Russell Alexander Spitzer edited comment on SPARK-11415 at 10/30/15 6:20 AM:

[jira] [Commented] (SPARK-11385) Add foreach API to MLLib's vector API

2015-10-30 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982073#comment-14982073 ] holdenk commented on SPARK-11385: - ah my misunderstanding then. > Add foreach API to MLLib's vector API

[jira] [Updated] (SPARK-11385) Make foreachActive public in MLLib's vector API

2015-10-30 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk updated SPARK-11385: Description: Make foreachActive public in MLLib's vector API (was: Add a foreach API to MLLib's vector.)

[jira] [Commented] (SPARK-11138) Flaky pyspark test: test_add_py_file

2015-10-30 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982103#comment-14982103 ] holdenk commented on SPARK-11138: - So with a non logged in view I don't see it on

[jira] [Commented] (SPARK-11416) Upgrade kryo package to version 3.0

2015-10-30 Thread Hitoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982171#comment-14982171 ] Hitoshi Ozawa commented on SPARK-11416: --- OK. Will do more checks and come back when we have more

[jira] [Commented] (SPARK-11421) Add the ability to add a jar to the current class loader

2015-10-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982037#comment-14982037 ] Apache Spark commented on SPARK-11421: -- User 'holdenk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11421) Add the ability to add a jar to the current class loader

2015-10-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11421: Assignee: (was: Apache Spark) > Add the ability to add a jar to the current class

[jira] [Assigned] (SPARK-11421) Add the ability to add a jar to the current class loader

2015-10-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11421: Assignee: Apache Spark > Add the ability to add a jar to the current class loader >

[jira] [Commented] (SPARK-10962) DataFrame "except" method...

2015-10-30 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982160#comment-14982160 ] Herman van Hovell commented on SPARK-10962: --- Do you want to know which row had a duplicate? If

[jira] [Created] (SPARK-11420) Changing Stddev support with Imperative Aggregate

2015-10-30 Thread Jihong MA (JIRA)
Jihong MA created SPARK-11420: - Summary: Changing Stddev support with Imperative Aggregate Key: SPARK-11420 URL: https://issues.apache.org/jira/browse/SPARK-11420 Project: Spark Issue Type:

[jira] [Updated] (SPARK-11420) Changing Stddev support with Imperative Aggregate

2015-10-30 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong MA updated SPARK-11420: -- Issue Type: Sub-task (was: Improvement) Parent: SPARK-10384 > Changing Stddev support with

[jira] [Comment Edited] (SPARK-11415) Catalyst DateType Shifts Input Data by Local Timezone

2015-10-30 Thread Russell Alexander Spitzer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982024#comment-14982024 ] Russell Alexander Spitzer edited comment on SPARK-11415 at 10/30/15 7:14 AM:

[jira] [Commented] (SPARK-11415) Catalyst DateType Shifts Input Data by Local Timezone

2015-10-30 Thread Russell Alexander Spitzer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982024#comment-14982024 ] Russell Alexander Spitzer commented on SPARK-11415: --- I added another commit to fix up

[jira] [Comment Edited] (SPARK-11193) Spark 1.5+ Kinesis Streaming - ClassCastException when starting KinesisReceiver

2015-10-30 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14974653#comment-14974653 ] Jean-Baptiste Onofré edited comment on SPARK-11193 at 10/30/15 6:13 AM:

[jira] [Commented] (SPARK-11193) Spark 1.5+ Kinesis Streaming - ClassCastException when starting KinesisReceiver

2015-10-30 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14981972#comment-14981972 ] Jean-Baptiste Onofré commented on SPARK-11193: -- Oh ok, so it makes sense ;) Let me fix

[jira] [Resolved] (SPARK-10929) Tungsten fails to acquire memory writing to HDFS

2015-10-30 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-10929. Resolution: Fixed Assignee: Davies Liu Fix Version/s: 1.6.0 Target

[jira] [Commented] (SPARK-11402) Allow to define a custom driver runner and executor runner

2015-10-30 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982030#comment-14982030 ] Jacek Lewandowski commented on SPARK-11402: --- That's right, this is not only introduction of

[jira] [Commented] (SPARK-11138) Flaky pyspark test: test_add_py_file

2015-10-30 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982087#comment-14982087 ] Marcelo Vanzin commented on SPARK-11138: The logs should be available on the "Build Artifacts"

[jira] [Commented] (SPARK-10946) JDBC - Use Statement.executeUpdate instead of PreparedStatement.executeUpdate for DDLs

2015-10-30 Thread somil deshmukh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982138#comment-14982138 ] somil deshmukh commented on SPARK-10946: I would like to work on this .pls assign to me > JDBC

[jira] [Commented] (SPARK-10946) JDBC - Use Statement.executeUpdate instead of PreparedStatement.executeUpdate for DDLs

2015-10-30 Thread somil deshmukh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982140#comment-14982140 ] somil deshmukh commented on SPARK-10946: Pull request is

[jira] [Comment Edited] (SPARK-11415) Catalyst DateType Shifts Input Data by Local Timezone

2015-10-30 Thread Russell Alexander Spitzer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982001#comment-14982001 ] Russell Alexander Spitzer edited comment on SPARK-11415 at 10/30/15 6:46 AM:

[jira] [Commented] (SPARK-11415) Catalyst DateType Shifts Input Data by Local Timezone

2015-10-30 Thread Russell Alexander Spitzer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982001#comment-14982001 ] Russell Alexander Spitzer commented on SPARK-11415: --- I've been thinking about this for

[jira] [Commented] (SPARK-11413) Java 8 build has problem with joda-time and s3 request, should bump joda-time version

2015-10-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982044#comment-14982044 ] Sean Owen commented on SPARK-11413: --- How about updating joda time to 2.8.1 everywhere? what are the

[jira] [Commented] (SPARK-11416) Upgrade kryo package to version 3.0

2015-10-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982043#comment-14982043 ] Sean Owen commented on SPARK-11416: --- [~hozawa] as you may see from a number of other issues, it is not

[jira] [Updated] (SPARK-11385) Make foreachActive public in MLLib's vector API

2015-10-30 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk updated SPARK-11385: Summary: Make foreachActive public in MLLib's vector API (was: Add foreach API to MLLib's vector API) >

[jira] [Commented] (SPARK-11416) Upgrade kryo package to version 3.0

2015-10-30 Thread Hitoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982094#comment-14982094 ] Hitoshi Ozawa commented on SPARK-11416: --- Sean, we have already tested and using kryo 3.0 with Spark

[jira] [Comment Edited] (SPARK-11402) Allow to define a custom driver runner and executor runner

2015-10-30 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982030#comment-14982030 ] Jacek Lewandowski edited comment on SPARK-11402 at 10/30/15 8:04 AM: -

[jira] [Commented] (SPARK-11138) Flaky pyspark test: test_add_py_file

2015-10-30 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982112#comment-14982112 ] Marcelo Vanzin commented on SPARK-11138: Hmm, interesting. I clicked on a few recent builds

[jira] [Created] (SPARK-11419) WriteAheadLog recovery improvements for when closeFileAfterWrite is enabled

2015-10-30 Thread Burak Yavuz (JIRA)
Burak Yavuz created SPARK-11419: --- Summary: WriteAheadLog recovery improvements for when closeFileAfterWrite is enabled Key: SPARK-11419 URL: https://issues.apache.org/jira/browse/SPARK-11419 Project:

[jira] [Created] (SPARK-11421) Add the ability to add a jar to the current class loader

2015-10-30 Thread holdenk (JIRA)
holdenk created SPARK-11421: --- Summary: Add the ability to add a jar to the current class loader Key: SPARK-11421 URL: https://issues.apache.org/jira/browse/SPARK-11421 Project: Spark Issue Type:

[jira] [Updated] (SPARK-11421) Add the ability to add a jar to the current class loader

2015-10-30 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk updated SPARK-11421: Component/s: Spark Core > Add the ability to add a jar to the current class loader >

[jira] [Resolved] (SPARK-11417) @Override is not supported by older version of Janino

2015-10-30 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-11417. Resolution: Fixed Fix Version/s: 1.5.2 1.6.0 Issue resolved by pull

[jira] [Reopened] (SPARK-11386) Refactor appropriate uses of Vector to use the new foreach API

2015-10-30 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk reopened SPARK-11386: - closed with wrong status > Refactor appropriate uses of Vector to use the new foreach API >

[jira] [Closed] (SPARK-11386) Refactor appropriate uses of Vector to use the new foreach API

2015-10-30 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk closed SPARK-11386. --- Resolution: Invalid > Refactor appropriate uses of Vector to use the new foreach API >

[jira] [Updated] (SPARK-11426) JDBCRDD should use JdbcDialect to probe for the existence of a table

2015-10-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11426: -- Priority: Minor (was: Major) Please set component. The specific change you are proposing is just

[jira] [Commented] (SPARK-8586) SQL add jar command does not work well with Scala REPL

2015-10-30 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983278#comment-14983278 ] holdenk commented on SPARK-8586: I've got a related fix in

[jira] [Commented] (SPARK-11430) DataFrame's except method does not work, returns 0

2015-10-30 Thread Ram Kandasamy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983437#comment-14983437 ] Ram Kandasamy commented on SPARK-11430: --- Thanks Sean, will do in the future > DataFrame's except

[jira] [Commented] (SPARK-11392) GroupedIterator's hasNext is not idempotent

2015-10-30 Thread Nakul Jindal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983487#comment-14983487 ] Nakul Jindal commented on SPARK-11392: -- [~yhuai], [~cloud_fan] - SPARK-11393 works around the

[jira] [Commented] (SPARK-11010) Fixes and enhancements addressing UDTs' api and several usability concerns

2015-10-30 Thread Rick Hillegas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983237#comment-14983237 ] Rick Hillegas commented on SPARK-11010: --- Linking this issue to SPARK-10855. The api for declaring

[jira] [Resolved] (SPARK-11423) Remove PrepareRDD

2015-10-30 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-11423. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9381

[jira] [Assigned] (SPARK-11432) Personalized PageRank shouldn't use uniform initialization

2015-10-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11432: Assignee: Apache Spark > Personalized PageRank shouldn't use uniform initialization >

[jira] [Commented] (SPARK-11432) Personalized PageRank shouldn't use uniform initialization

2015-10-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983544#comment-14983544 ] Apache Spark commented on SPARK-11432: -- User 'moustaki' has created a pull request for this issue:

[jira] [Updated] (SPARK-11382) Replace example code in mllib-decision-tree.md/mllib-ensembles.md using include_example

2015-10-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11382: -- Shepherd: Xusen Yin > Replace example code in mllib-decision-tree.md/mllib-ensembles.md using

[jira] [Closed] (SPARK-11418) Add link to the source file at the end of included example code

2015-10-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng closed SPARK-11418. - Resolution: Duplicate > Add link to the source file at the end of included example code >

[jira] [Commented] (SPARK-11337) Make example code in user guide testable

2015-10-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983569#comment-14983569 ] Xiangrui Meng commented on SPARK-11337: --- I totally forgot I already made one ... > Make example

[jira] [Commented] (SPARK-11337) Make example code in user guide testable

2015-10-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983570#comment-14983570 ] Xiangrui Meng commented on SPARK-11337: --- I totally forgot I already made one ... > Make example

[jira] [Commented] (SPARK-11337) Make example code in user guide testable

2015-10-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983568#comment-14983568 ] Xiangrui Meng commented on SPARK-11337: --- I totally forgot I already made one ... > Make example

[jira] [Comment Edited] (SPARK-11300) Support for string length when writing to JDBC

2015-10-30 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983631#comment-14983631 ] Suresh Thalamati edited comment on SPARK-11300 at 10/30/15 11:59 PM: -

[jira] [Created] (SPARK-11431) Allow exploding arrays of structs in DataFrames

2015-10-30 Thread Tycho Grouwstra (JIRA)
Tycho Grouwstra created SPARK-11431: --- Summary: Allow exploding arrays of structs in DataFrames Key: SPARK-11431 URL: https://issues.apache.org/jira/browse/SPARK-11431 Project: Spark Issue

[jira] [Commented] (SPARK-11392) GroupedIterator's hasNext is not idempotent

2015-10-30 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983490#comment-14983490 ] Yin Huai commented on SPARK-11392: -- I think it is not necessary to revert that. But, we may want to

[jira] [Assigned] (SPARK-11433) [SQL] Rule EliminateSubQueries does not clean the parent Project's qualifiers

2015-10-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11433: Assignee: (was: Apache Spark) > [SQL] Rule EliminateSubQueries does not clean the

[jira] [Commented] (SPARK-11433) [SQL] Rule EliminateSubQueries does not clean the parent Project's qualifiers

2015-10-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983489#comment-14983489 ] Apache Spark commented on SPARK-11433: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Updated] (SPARK-11425) Improve hybrid aggregation (sort-based after hash-based)

2015-10-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11425: -- Component/s: Spark Core > Improve hybrid aggregation (sort-based after hash-based) >

[jira] [Commented] (SPARK-11275) [SQL] Regression in rollup/cube

2015-10-30 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983324#comment-14983324 ] Xiao Li commented on SPARK-11275: - Hi, Andrew, Expression is not the root cause. The implementation of

[jira] [Created] (SPARK-11428) Schema Merging Broken for Some Queries

2015-10-30 Thread Brad Willard (JIRA)
Brad Willard created SPARK-11428: Summary: Schema Merging Broken for Some Queries Key: SPARK-11428 URL: https://issues.apache.org/jira/browse/SPARK-11428 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-11427) DataFrame's intersect method does not work, returns 1

2015-10-30 Thread Ram Kandasamy (JIRA)
Ram Kandasamy created SPARK-11427: - Summary: DataFrame's intersect method does not work, returns 1 Key: SPARK-11427 URL: https://issues.apache.org/jira/browse/SPARK-11427 Project: Spark

[jira] [Resolved] (SPARK-11348) Replace addOnCompleteCallback with addTaskCompletionListener() in UnsafeExternalSorter

2015-10-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11348. --- Resolution: Duplicate This was already covered by JIRAs like

[jira] [Commented] (SPARK-11430) DataFrame's except method does not work, returns 0

2015-10-30 Thread Ram Kandasamy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983416#comment-14983416 ] Ram Kandasamy commented on SPARK-11430: --- https://issues.apache.org/jira/browse/SPARK-10539 looks to

[jira] [Assigned] (SPARK-11433) [SQL] Rule EliminateSubQueries does not clean the parent Project's qualifiers

2015-10-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11433: Assignee: Apache Spark > [SQL] Rule EliminateSubQueries does not clean the parent

[jira] [Commented] (SPARK-11431) Allow exploding arrays of structs in DataFrames

2015-10-30 Thread Tycho Grouwstra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983488#comment-14983488 ] Tycho Grouwstra commented on SPARK-11431: - One might wonder if the similar-sounding issue

[jira] [Assigned] (SPARK-11432) Personalized PageRank shouldn't use uniform initialization

2015-10-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11432: Assignee: (was: Apache Spark) > Personalized PageRank shouldn't use uniform

[jira] [Updated] (SPARK-11420) Updating Stddev support with Imperative Aggregate

2015-10-30 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong MA updated SPARK-11420: -- Summary: Updating Stddev support with Imperative Aggregate (was: Changing Stddev support with

[jira] [Comment Edited] (SPARK-9836) Provide R-like summary statistics for ordinary least squares via normal equation solver

2015-10-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983272#comment-14983272 ] Xiangrui Meng edited comment on SPARK-9836 at 10/30/15 8:42 PM: Yes, this

[jira] [Updated] (SPARK-11340) Support setting driver properties when starting Spark from R programmatically or from RStudio

2015-10-30 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-11340: -- Assignee: Felix Cheung > Support setting driver properties when starting Spark

[jira] [Resolved] (SPARK-11340) Support setting driver properties when starting Spark from R programmatically or from RStudio

2015-10-30 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-11340. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Commented] (SPARK-11340) Support setting driver properties when starting Spark from R programmatically or from RStudio

2015-10-30 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983294#comment-14983294 ] Shivaram Venkataraman commented on SPARK-11340: --- [~felixcheung][~sunrui] It'll be great if

[jira] [Resolved] (SPARK-11429) Provide Number of Iterations used in ALS

2015-10-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11429. --- Resolution: Invalid As the caller, you'd already know that right? u...@spark.apache.org is the

[jira] [Commented] (SPARK-11236) Upgrade Tachyon dependency to 0.8.0

2015-10-30 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983630#comment-14983630 ] Yin Huai commented on SPARK-11236: -- I reverted the pr because it broke lots of hadoop 1 tests

[jira] [Commented] (SPARK-11300) Support for string length when writing to JDBC

2015-10-30 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983631#comment-14983631 ] Suresh Thalamati commented on SPARK-11300: -- Another related issue is Spark-10849, Fix will

[jira] [Updated] (SPARK-11432) Personalized PageRank shouldn't use uniform initialization

2015-10-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11432: -- Assignee: Yves Raimond > Personalized PageRank shouldn't use uniform initialization >

[jira] [Commented] (SPARK-11337) Make example code in user guide testable

2015-10-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983561#comment-14983561 ] Xiangrui Meng commented on SPARK-11337: --- I totally forgot I already made one ... > Make example

[jira] [Commented] (SPARK-11337) Make example code in user guide testable

2015-10-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983563#comment-14983563 ] Xiangrui Meng commented on SPARK-11337: --- I totally forgot I already made one ... > Make example

[jira] [Commented] (SPARK-10158) ALS should print better errors when given Long IDs

2015-10-30 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983644#comment-14983644 ] Bryan Cutler commented on SPARK-10158: -- The only way I can see handling this from the PySpark side

[jira] [Commented] (SPARK-11428) Schema Merging Broken for Some Queries

2015-10-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983377#comment-14983377 ] Sean Owen commented on SPARK-11428: --- Related to https://issues.apache.org/jira/browse/SPARK-11412 ? >

[jira] [Created] (SPARK-11429) Provide Number of Iterations used in ALS

2015-10-30 Thread Richard Garris (JIRA)
Richard Garris created SPARK-11429: -- Summary: Provide Number of Iterations used in ALS Key: SPARK-11429 URL: https://issues.apache.org/jira/browse/SPARK-11429 Project: Spark Issue Type: New

[jira] [Created] (SPARK-11430) DataFrame's except method does not work, returns 0

2015-10-30 Thread Ram Kandasamy (JIRA)
Ram Kandasamy created SPARK-11430: - Summary: DataFrame's except method does not work, returns 0 Key: SPARK-11430 URL: https://issues.apache.org/jira/browse/SPARK-11430 Project: Spark Issue

[jira] [Reopened] (SPARK-11430) DataFrame's except method does not work, returns 0

2015-10-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-11430: --- [~ramk256] the right resolution is duplicate > DataFrame's except method does not work, returns 0 >

[jira] [Resolved] (SPARK-11430) DataFrame's except method does not work, returns 0

2015-10-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11430. --- Resolution: Duplicate Fix Version/s: (was: 1.5.1) > DataFrame's except method does not

[jira] [Commented] (SPARK-11337) Make example code in user guide testable

2015-10-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983565#comment-14983565 ] Xiangrui Meng commented on SPARK-11337: --- I totally forgot I already made one ... > Make example

[jira] [Commented] (SPARK-11337) Make example code in user guide testable

2015-10-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983566#comment-14983566 ] Xiangrui Meng commented on SPARK-11337: --- I totally forgot I already made one ... > Make example

[jira] [Commented] (SPARK-11337) Make example code in user guide testable

2015-10-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983567#comment-14983567 ] Xiangrui Meng commented on SPARK-11337: --- I totally forgot I already made one ... > Make example

[jira] [Commented] (SPARK-10946) JDBC - Use Statement.executeUpdate instead of PreparedStatement.executeUpdate for DDLs

2015-10-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982224#comment-14982224 ] Sean Owen commented on SPARK-10946: --- [~somi...@us.ibm.com] you just need to open a pull request

[jira] [Updated] (SPARK-7673) DataSourceStrategy's buildPartitionedTableScan always list file status for all data files

2015-10-30 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-7673: -- Summary: DataSourceStrategy's buildPartitionedTableScan always list file status for all data files

  1   2   3   >