[jira] [Commented] (SPARK-11595) "ADD JAR" doesn't work if the given path contains URL scheme like "file:/" and "hdfs:/"

2015-11-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14996611#comment-14996611 ] Apache Spark commented on SPARK-11595: -- User 'liancheng' has created a pull request for this issue:

[jira] [Commented] (SPARK-7334) Implement RandomProjection for Dimensionality Reduction

2015-11-09 Thread Sebastian Alfers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14996470#comment-14996470 ] Sebastian Alfers commented on SPARK-7334: - It this still relevant? [~josephkb] I saw a

[jira] [Assigned] (SPARK-11595) "ADD JAR" doesn't work if the given path contains URL scheme like "file:/" and "hdfs:/"

2015-11-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11595: Assignee: Apache Spark (was: Cheng Lian) > "ADD JAR" doesn't work if the given path

[jira] [Commented] (SPARK-11590) use native json_tuple in lateral view

2015-11-09 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14996490#comment-14996490 ] Wenchen Fan commented on SPARK-11590: - https://github.com/apache/spark/pull/9562 > use native

[jira] [Issue Comment Deleted] (SPARK-11590) use native json_tuple in lateral view

2015-11-09 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-11590: Comment: was deleted (was: https://github.com/apache/spark/pull/9562) > use native json_tuple in

[jira] [Assigned] (SPARK-11595) "ADD JAR" doesn't work if the given path contains URL scheme like "file:/" and "hdfs:/"

2015-11-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11595: Assignee: Cheng Lian (was: Apache Spark) > "ADD JAR" doesn't work if the given path

[jira] [Commented] (SPARK-11595) "ADD JAR" doesn't work if the given path contains URL scheme like "file:/" and "hdfs:/"

2015-11-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14996527#comment-14996527 ] Apache Spark commented on SPARK-11595: -- User 'liancheng' has created a pull request for this issue:

[jira] [Updated] (SPARK-11530) Return eigenvalues with PCA model

2015-11-09 Thread Christos Iraklis Tsatsoulis (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christos Iraklis Tsatsoulis updated SPARK-11530: Component/s: MLlib > Return eigenvalues with PCA model >

[jira] [Commented] (SPARK-10309) Some tasks failed with Unable to acquire memory

2015-11-09 Thread Kristina Plazonic (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14996610#comment-14996610 ] Kristina Plazonic commented on SPARK-10309: --- Did anybody find a solution for this? I also get a

[jira] [Commented] (SPARK-11191) [1.5] Can't create UDF's using hive thrift service

2015-11-09 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14996519#comment-14996519 ] Cheng Lian commented on SPARK-11191: One of the problem here is SPARK-11595. However, after fixing

[jira] [Commented] (SPARK-10528) spark-shell throws java.lang.RuntimeException: The root scratch dir: /tmp/hive on HDFS should be writable.

2015-11-09 Thread Michel Lemay (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14996667#comment-14996667 ] Michel Lemay commented on SPARK-10528: -- Looks like the problem is still there with precompiled

[jira] [Resolved] (SPARK-11218) `./sbin/start-slave.sh --help` should print out the help message

2015-11-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11218. --- Resolution: Fixed Fix Version/s: 1.6.0 1.7.0 Issue resolved by pull

[jira] [Created] (SPARK-11595) "ADD JAR" doesn't work if the given path contains URL scheme like "file:/" and "hdfs:/"

2015-11-09 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-11595: -- Summary: "ADD JAR" doesn't work if the given path contains URL scheme like "file:/" and "hdfs:/" Key: SPARK-11595 URL: https://issues.apache.org/jira/browse/SPARK-11595

[jira] [Assigned] (SPARK-11594) Cannot create UDAF in REPL

2015-11-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11594: Assignee: (was: Apache Spark) > Cannot create UDAF in REPL >

[jira] [Assigned] (SPARK-11594) Cannot create UDAF in REPL

2015-11-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11594: Assignee: Apache Spark > Cannot create UDAF in REPL > -- > >

[jira] [Commented] (SPARK-11594) Cannot create UDAF in REPL

2015-11-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14996518#comment-14996518 ] Apache Spark commented on SPARK-11594: -- User 'hvanhovell' has created a pull request for this issue:

[jira] [Comment Edited] (SPARK-11530) Return eigenvalues with PCA model

2015-11-09 Thread Christos Iraklis Tsatsoulis (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14996533#comment-14996533 ] Christos Iraklis Tsatsoulis edited comment on SPARK-11530 at 11/9/15 1:40 PM:

[jira] [Updated] (SPARK-11218) `./sbin/start-slave.sh --help` should print out the help message

2015-11-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11218: -- Assignee: Charles Yeh > `./sbin/start-slave.sh --help` should print out the help message >

[jira] [Comment Edited] (SPARK-11530) Return eigenvalues with PCA model

2015-11-09 Thread Christos Iraklis Tsatsoulis (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14996533#comment-14996533 ] Christos Iraklis Tsatsoulis edited comment on SPARK-11530 at 11/9/15 1:45 PM:

[jira] [Comment Edited] (SPARK-11530) Return eigenvalues with PCA model

2015-11-09 Thread Christos Iraklis Tsatsoulis (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14996533#comment-14996533 ] Christos Iraklis Tsatsoulis edited comment on SPARK-11530 at 11/9/15 1:50 PM:

[jira] [Updated] (SPARK-11595) "ADD JAR" doesn't work if the given path contains URL scheme like "file:/" and "hdfs:/"

2015-11-09 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-11595: --- Description: When handling {{ADD JAR}}, Spark constructs a {{java.io.File}} first using the input

[jira] [Commented] (SPARK-11530) Return eigenvalues with PCA model

2015-11-09 Thread Christos Iraklis Tsatsoulis (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14996533#comment-14996533 ] Christos Iraklis Tsatsoulis commented on SPARK-11530: - I edited it to target both;

[jira] [Comment Edited] (SPARK-11530) Return eigenvalues with PCA model

2015-11-09 Thread Christos Iraklis Tsatsoulis (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14996533#comment-14996533 ] Christos Iraklis Tsatsoulis edited comment on SPARK-11530 at 11/9/15 1:37 PM:

[jira] [Resolved] (SPARK-10280) Add @since annotation to pyspark.ml.classification

2015-11-09 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-10280. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8690

[jira] [Updated] (SPARK-9297) covar_pop and covar_samp aggregate functions

2015-11-09 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-9297: Target Version/s: (was: 1.6.0) > covar_pop and covar_samp aggregate functions >

[jira] [Assigned] (SPARK-7841) Spark build should not use lib_managed for dependencies

2015-11-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7841: --- Assignee: Apache Spark > Spark build should not use lib_managed for dependencies >

[jira] [Assigned] (SPARK-7841) Spark build should not use lib_managed for dependencies

2015-11-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7841: --- Assignee: (was: Apache Spark) > Spark build should not use lib_managed for dependencies

[jira] [Commented] (SPARK-7841) Spark build should not use lib_managed for dependencies

2015-11-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14997489#comment-14997489 ] Apache Spark commented on SPARK-7841: - User 'JoshRosen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11599) NPE when resolve a non-existent function

2015-11-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11599: Assignee: (was: Apache Spark) > NPE when resolve a non-existent function >

[jira] [Assigned] (SPARK-11599) NPE when resolve a non-existent function

2015-11-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11599: Assignee: Apache Spark > NPE when resolve a non-existent function >

[jira] [Updated] (SPARK-11574) Spark should support StatsD sink out of box

2015-11-09 Thread Xiaofeng Lin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaofeng Lin updated SPARK-11574: - Affects Version/s: (was: 1.5.2) 1.5.1 > Spark should support StatsD

[jira] [Updated] (SPARK-9301) collect_set and collect_list aggregate functions

2015-11-09 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-9301: Target Version/s: (was: 1.6.0) > collect_set and collect_list aggregate functions >

[jira] [Updated] (SPARK-9300) histogram_numeric aggregate function

2015-11-09 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-9300: Target Version/s: (was: 1.6.0) > histogram_numeric aggregate function >

[jira] [Updated] (SPARK-9299) percentile and percentile_approx aggregate functions

2015-11-09 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-9299: Target Version/s: (was: 1.6.0) > percentile and percentile_approx aggregate functions >

[jira] [Commented] (SPARK-11599) NPE when resolve a non-existent function

2015-11-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14997501#comment-14997501 ] Apache Spark commented on SPARK-11599: -- User 'davies' has created a pull request for this issue:

[jira] [Updated] (SPARK-11587) SparkR can not use summary.glm from base R

2015-11-09 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11587: -- Priority: Critical (was: Major) > SparkR can not use summary.glm from base R >

[jira] [Commented] (SPARK-11326) Support for authentication and encryption in standalone mode

2015-11-09 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14997448#comment-14997448 ] Patrick Wendell commented on SPARK-11326: - There are a few related conversations here: 1. The

[jira] [Resolved] (SPARK-11508) Add Python API for repartition and sortWithinPartitions

2015-11-09 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-11508. -- Resolution: Fixed Assignee: Nong Li Fix Version/s: 1.6.0 It has been resolved by

[jira] [Updated] (SPARK-11574) Spark should support StatsD sink out of box

2015-11-09 Thread Xiaofeng Lin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaofeng Lin updated SPARK-11574: - Affects Version/s: 1.6.0 > Spark should support StatsD sink out of box >

[jira] [Resolved] (SPARK-11552) Replace example code in ml-decision-tree.md using include_example

2015-11-09 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-11552. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9539

[jira] [Updated] (SPARK-11552) Replace example code in ml-decision-tree.md using include_example

2015-11-09 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11552: -- Target Version/s: 1.6.0 Priority: Minor (was: Major) Component/s: ML >

[jira] [Resolved] (SPARK-11462) Add JavaStreamingListener

2015-11-09 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-11462. --- Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 1.6.0 > Add

[jira] [Created] (SPARK-11620) parquet.hadoop.ParquetOutputCommitter.commitJob() throws parquet.io.ParquetEncodingException

2015-11-09 Thread swetha k (JIRA)
swetha k created SPARK-11620: Summary: parquet.hadoop.ParquetOutputCommitter.commitJob() throws parquet.io.ParquetEncodingException Key: SPARK-11620 URL: https://issues.apache.org/jira/browse/SPARK-11620

[jira] [Commented] (SPARK-11587) SparkR can not use summary.glm from base R

2015-11-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14997842#comment-14997842 ] Apache Spark commented on SPARK-11587: -- User 'shivaram' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11587) SparkR can not use summary.glm from base R

2015-11-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11587: Assignee: (was: Apache Spark) > SparkR can not use summary.glm from base R >

[jira] [Assigned] (SPARK-11587) SparkR can not use summary.glm from base R

2015-11-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11587: Assignee: Apache Spark > SparkR can not use summary.glm from base R >

[jira] [Commented] (SPARK-11611) Python API for bisecting k-means

2015-11-09 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14997875#comment-14997875 ] Yu Ishikawa commented on SPARK-11611: - [~mengxr] can we change the target version from 1.7.0 to

[jira] [Issue Comment Deleted] (SPARK-8506) SparkR does not provide an easy way to depend on Spark Packages when performing init from inside of R

2015-11-09 Thread Girish Reddy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Girish Reddy updated SPARK-8506: Comment: was deleted (was: Hi [~holdenk] - I am getting an error when specifying multiple packages

[jira] [Comment Edited] (SPARK-11620) parquet.hadoop.ParquetOutputCommitter.commitJob() throws parquet.io.ParquetEncodingException

2015-11-09 Thread swetha k (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14998015#comment-14998015 ] swetha k edited comment on SPARK-11620 at 11/10/15 6:07 AM: I see the

[jira] [Commented] (SPARK-11620) parquet.hadoop.ParquetOutputCommitter.commitJob() throws parquet.io.ParquetEncodingException

2015-11-09 Thread swetha k (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14998015#comment-14998015 ] swetha k commented on SPARK-11620: -- I see the following Warning message when I use parquet-avro.

[jira] [Commented] (SPARK-11618) Refactoring of basic ML import/export

2015-11-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14998016#comment-14998016 ] Apache Spark commented on SPARK-11618: -- User 'jkbradley' has created a pull request for this issue:

[jira] [Resolved] (SPARK-11141) Batching of ReceivedBlockTrackerLogEvents for efficient WAL writes

2015-11-09 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-11141. --- Resolution: Fixed Assignee: Burak Yavuz Fix Version/s: 1.6.0 > Batching of

[jira] [Updated] (SPARK-11580) Just do final aggregation when there is no Exchange

2015-11-09 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11580: - Target Version/s: (was: 1.6.0) > Just do final aggregation when there is no Exchange >

[jira] [Commented] (SPARK-8506) SparkR does not provide an easy way to depend on Spark Packages when performing init from inside of R

2015-11-09 Thread Girish Reddy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14998000#comment-14998000 ] Girish Reddy commented on SPARK-8506: - Hi [~holdenk] - I am getting an error when specifying multiple

[jira] [Assigned] (SPARK-7675) PySpark spark.ml Params type conversions

2015-11-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7675: --- Assignee: Apache Spark > PySpark spark.ml Params type conversions >

[jira] [Commented] (SPARK-7675) PySpark spark.ml Params type conversions

2015-11-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14997814#comment-14997814 ] Apache Spark commented on SPARK-7675: - User 'holdenk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-7675) PySpark spark.ml Params type conversions

2015-11-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7675: --- Assignee: (was: Apache Spark) > PySpark spark.ml Params type conversions >

[jira] [Created] (SPARK-11618) Refactoring of basic ML import/export

2015-11-09 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-11618: - Summary: Refactoring of basic ML import/export Key: SPARK-11618 URL: https://issues.apache.org/jira/browse/SPARK-11618 Project: Spark Issue Type:

[jira] [Commented] (SPARK-11621) ORC filter pushdown not working properly after new unhandled filter interface.

2015-11-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14998014#comment-14998014 ] Hyukjin Kwon commented on SPARK-11621: -- I would like to work this. > ORC filter pushdown not

[jira] [Created] (SPARK-11621) ORC filter pushdown not working properly after new unhandled filter interface.

2015-11-09 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-11621: Summary: ORC filter pushdown not working properly after new unhandled filter interface. Key: SPARK-11621 URL: https://issues.apache.org/jira/browse/SPARK-11621

[jira] [Resolved] (SPARK-11587) SparkR can not use summary.glm from base R

2015-11-09 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-11587. --- Resolution: Fixed Fix Version/s: 1.6.0 Resolved by

[jira] [Assigned] (SPARK-11587) SparkR can not use summary.glm from base R

2015-11-09 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman reassigned SPARK-11587: - Assignee: Shivaram Venkataraman > SparkR can not use summary.glm from

[jira] [Commented] (SPARK-11587) SparkR can not use summary.glm from base R

2015-11-09 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14997967#comment-14997967 ] Shivaram Venkataraman commented on SPARK-11587: --- [~yanboliang] Let me know if the fix works

[jira] [Created] (SPARK-11617) MEMORY LEAK: ByteBuf.release() was not called before it's garbage-collected

2015-11-09 Thread LingZhou (JIRA)
LingZhou created SPARK-11617: Summary: MEMORY LEAK: ByteBuf.release() was not called before it's garbage-collected Key: SPARK-11617 URL: https://issues.apache.org/jira/browse/SPARK-11617 Project: Spark

[jira] [Assigned] (SPARK-11611) Python API for bisecting k-means

2015-11-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11611: Assignee: Apache Spark > Python API for bisecting k-means >

[jira] [Commented] (SPARK-11611) Python API for bisecting k-means

2015-11-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14997872#comment-14997872 ] Apache Spark commented on SPARK-11611: -- User 'yu-iskw' has created a pull request for this issue:

[jira] [Created] (SPARK-11619) cannot use UDTF in DataFrame.selectExpr

2015-11-09 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-11619: --- Summary: cannot use UDTF in DataFrame.selectExpr Key: SPARK-11619 URL: https://issues.apache.org/jira/browse/SPARK-11619 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-11191) [1.5] Can't create UDF's using hive thrift service

2015-11-09 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-11191: --- Target Version/s: 1.5.2, 1.5.3 (was: 1.5.2, 1.5.3, 1.6.0) > [1.5] Can't create UDF's using hive

[jira] [Updated] (SPARK-6728) Improve performance of py4j for large bytearray

2015-11-09 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-6728: -- Target Version/s: (was: 1.6.0) > Improve performance of py4j for large bytearray >

[jira] [Commented] (SPARK-10538) java.lang.NegativeArraySizeException during join

2015-11-09 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14997051#comment-14997051 ] Davies Liu commented on SPARK-10538: [~maver1ck] Could you reproduce this issue in master or 1.6

[jira] [Updated] (SPARK-9865) Flaky SparkR test: test_sparkSQL.R: sample on a DataFrame

2015-11-09 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9865: - Assignee: Felix Cheung > Flaky SparkR test: test_sparkSQL.R: sample on a

[jira] [Resolved] (SPARK-9865) Flaky SparkR test: test_sparkSQL.R: sample on a DataFrame

2015-11-09 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9865. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Commented] (SPARK-11319) PySpark silently Accepts null values in non-nullable DataFrame fields.

2015-11-09 Thread Daniel Jalova (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14997100#comment-14997100 ] Daniel Jalova commented on SPARK-11319: --- I would like to work on this. > PySpark silently Accepts

[jira] [Commented] (SPARK-11597) improve performance of array and map encoder

2015-11-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14997127#comment-14997127 ] Apache Spark commented on SPARK-11597: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11597) improve performance of array and map encoder

2015-11-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11597: Assignee: (was: Apache Spark) > improve performance of array and map encoder >

[jira] [Assigned] (SPARK-11597) improve performance of array and map encoder

2015-11-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11597: Assignee: Apache Spark > improve performance of array and map encoder >

[jira] [Created] (SPARK-11598) Add tests for ShuffledHashOuterJoin

2015-11-09 Thread Davies Liu (JIRA)
Davies Liu created SPARK-11598: -- Summary: Add tests for ShuffledHashOuterJoin Key: SPARK-11598 URL: https://issues.apache.org/jira/browse/SPARK-11598 Project: Spark Issue Type: Test

[jira] [Commented] (SPARK-5575) Artificial neural networks for MLlib deep learning

2015-11-09 Thread Narine Kokhlikyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14996706#comment-14996706 ] Narine Kokhlikyan commented on SPARK-5575: -- Hi [~avulanov] , I was trying out the current

[jira] [Commented] (SPARK-11191) [1.5] Can't create UDF's using hive thrift service

2015-11-09 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14997028#comment-14997028 ] Davies Liu commented on SPARK-11191: This should work in master and 1.6. > [1.5] Can't create UDF's

[jira] [Commented] (SPARK-11373) Add metrics to the History Server and providers

2015-11-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14997071#comment-14997071 ] Apache Spark commented on SPARK-11373: -- User 'steveloughran' has created a pull request for this

[jira] [Assigned] (SPARK-11373) Add metrics to the History Server and providers

2015-11-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11373: Assignee: Apache Spark > Add metrics to the History Server and providers >

[jira] [Updated] (SPARK-10790) Dynamic Allocation does not request any executors if first stage needs less than or equal to spark.dynamicAllocation.initialExecutors

2015-11-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10790: -- Affects Version/s: (was: 1.5.1) 1.5.0 > Dynamic Allocation does not request

[jira] [Updated] (SPARK-10790) Dynamic Allocation does not request any executors if first stage needs less than or equal to spark.dynamicAllocation.initialExecutors

2015-11-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10790: -- Affects Version/s: (was: 1.5.0) 1.5.1 > Dynamic Allocation does not request

[jira] [Updated] (SPARK-11362) Use Spark BitSet in BroadcastNestedLoopJoin

2015-11-09 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-11362: Fix Version/s: (was: 1.7.0) 1.6.0 > Use Spark BitSet in

[jira] [Resolved] (SPARK-10565) New /api/v1/[path] APIs don't contain as much information as original /json API

2015-11-09 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid resolved SPARK-10565. -- Resolution: Fixed Fix Version/s: 1.6.0 > New /api/v1/[path] APIs don't contain as much

[jira] [Resolved] (SPARK-10783) Do track the pointer array in UnsafeInMemorySorter

2015-11-09 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-10783. Resolution: Fixed Assignee: Davies Liu Fix Version/s: 1.6.0 Fixed by

[jira] [Updated] (SPARK-11151) Use Long internally for DecimalType with precision <= 18

2015-11-09 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-11151: --- Target Version/s: (was: 1.6.0) > Use Long internally for DecimalType with precision <= 18 >

[jira] [Closed] (SPARK-6728) Improve performance of py4j for large bytearray

2015-11-09 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu closed SPARK-6728. - Resolution: Won't Fix This can not be fixed without changes in Py4j, but this is not in the roadmap of

[jira] [Commented] (SPARK-11089) Add a option for thrift-server to share a single session across all connections

2015-11-09 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14997042#comment-14997042 ] Davies Liu commented on SPARK-11089: [~lian cheng] Could you help to look into this one? This is the

[jira] [Closed] (SPARK-10425) Add a regression test for SPARK-10379

2015-11-09 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu closed SPARK-10425. -- Resolution: Won't Fix Can't reproduce the failure (easily) > Add a regression test for SPARK-10379 >

[jira] [Closed] (SPARK-10424) ShuffleHashOuterJoin should consider condition

2015-11-09 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu closed SPARK-10424. -- Resolution: Invalid ShuffleHashOuterJoin actually support conpdition > ShuffleHashOuterJoin should

[jira] [Updated] (SPARK-10565) New /api/v1/[path] APIs don't contain as much information as original /json API

2015-11-09 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-10565: - Assignee: Charles Yeh > New /api/v1/[path] APIs don't contain as much information as original

[jira] [Commented] (SPARK-11587) SparkR can not use summary.glm from base R

2015-11-09 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14997035#comment-14997035 ] Shivaram Venkataraman commented on SPARK-11587: --- cc [~sunrui] We should fix this - We have

[jira] [Updated] (SPARK-11587) SparkR can not use summary.glm from base R

2015-11-09 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-11587: -- Component/s: SparkR > SparkR can not use summary.glm from base R >

[jira] [Assigned] (SPARK-11089) Add a option for thrift-server to share a single session across all connections

2015-11-09 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-11089: -- Assignee: Davies Liu > Add a option for thrift-server to share a single session across all >

[jira] [Commented] (SPARK-11560) Optimize KMeans implementation

2015-11-09 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14997103#comment-14997103 ] Joseph K. Bradley commented on SPARK-11560: --- Do we want to keep the implementation for the

[jira] [Created] (SPARK-11597) improve performance of array and map encoder

2015-11-09 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-11597: --- Summary: improve performance of array and map encoder Key: SPARK-11597 URL: https://issues.apache.org/jira/browse/SPARK-11597 Project: Spark Issue Type:

[jira] [Commented] (SPARK-11475) DataFrame API saveAsTable() does not work well for HDFS HA

2015-11-09 Thread Rekha Joshi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14997119#comment-14997119 ] Rekha Joshi commented on SPARK-11475: - glad, thanks for confirming [~zhangxiongfei] > DataFrame API

[jira] [Assigned] (SPARK-11598) Add tests for ShuffledHashOuterJoin

2015-11-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11598: Assignee: Davies Liu (was: Apache Spark) > Add tests for ShuffledHashOuterJoin >

[jira] [Updated] (SPARK-11362) Use Spark BitSet in BroadcastNestedLoopJoin

2015-11-09 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-11362: Assignee: Liang-Chi Hsieh > Use Spark BitSet in BroadcastNestedLoopJoin >

  1   2   3   4   >