[jira] [Updated] (SPARK-9480) Create an map abstract class MapData and a default implementation backed by 2 ArrayData

2015-08-01 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9480: --- Parent Issue: SPARK-9413 (was: SPARK-9389) > Create an map abstract class MapData and a default imple

[jira] [Resolved] (SPARK-9480) Create an map abstract class MapData and a default implementation backed by 2 ArrayData

2015-08-01 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9480. Resolution: Fixed Assignee: Wenchen Fan Fix Version/s: 1.5.0 > Create an map abstrac

[jira] [Commented] (SPARK-8887) Explicitly define which data types can be used as dynamic partition columns

2015-08-01 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650196#comment-14650196 ] Reynold Xin commented on SPARK-8887: [~lian cheng] can we put this in 1.5? > Explicit

[jira] [Created] (SPARK-9520) UnsafeFixedWidthAggregationMap should support in-place sorting of its own records

2015-08-01 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9520: -- Summary: UnsafeFixedWidthAggregationMap should support in-place sorting of its own records Key: SPARK-9520 URL: https://issues.apache.org/jira/browse/SPARK-9520 Project:

[jira] [Commented] (SPARK-9520) UnsafeFixedWidthAggregationMap should support in-place sorting of its own records

2015-08-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650201#comment-14650201 ] Apache Spark commented on SPARK-9520: - User 'rxin' has created a pull request for this

[jira] [Assigned] (SPARK-9520) UnsafeFixedWidthAggregationMap should support in-place sorting of its own records

2015-08-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9520: --- Assignee: Reynold Xin (was: Apache Spark) > UnsafeFixedWidthAggregationMap should support in

[jira] [Commented] (SPARK-8269) string function: initcap

2015-08-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650200#comment-14650200 ] Apache Spark commented on SPARK-8269: - User 'davies' has created a pull request for th

[jira] [Assigned] (SPARK-9520) UnsafeFixedWidthAggregationMap should support in-place sorting of its own records

2015-08-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9520: --- Assignee: Apache Spark (was: Reynold Xin) > UnsafeFixedWidthAggregationMap should support in

[jira] [Commented] (SPARK-8232) complex function: sort_array

2015-08-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650206#comment-14650206 ] Apache Spark commented on SPARK-8232: - User 'davies' has created a pull request for th

[jira] [Resolved] (SPARK-7446) Inverse transform for StringIndexer

2015-08-01 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-7446. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 6339 [https

[jira] [Updated] (SPARK-8873) Support cleaning up shuffle files when using shuffle service in Mesos

2015-08-01 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8873: - Priority: Blocker (was: Critical) > Support cleaning up shuffle files when using shuffle service in Mesos

[jira] [Created] (SPARK-9521) Require Maven 3.3.3+ in the build

2015-08-01 Thread Sean Owen (JIRA)
Sean Owen created SPARK-9521: Summary: Require Maven 3.3.3+ in the build Key: SPARK-9521 URL: https://issues.apache.org/jira/browse/SPARK-9521 Project: Spark Issue Type: Improvement Com

[jira] [Commented] (SPARK-9521) Require Maven 3.3.3+ in the build

2015-08-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650210#comment-14650210 ] Apache Spark commented on SPARK-9521: - User 'srowen' has created a pull request for th

[jira] [Assigned] (SPARK-9521) Require Maven 3.3.3+ in the build

2015-08-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9521: --- Assignee: Apache Spark (was: Sean Owen) > Require Maven 3.3.3+ in the build > --

[jira] [Created] (SPARK-9522) SparkSubmit process can not exit if kill application when HiveThriftServer was starting

2015-08-01 Thread Weizhong (JIRA)
Weizhong created SPARK-9522: --- Summary: SparkSubmit process can not exit if kill application when HiveThriftServer was starting Key: SPARK-9522 URL: https://issues.apache.org/jira/browse/SPARK-9522 Project:

[jira] [Assigned] (SPARK-9521) Require Maven 3.3.3+ in the build

2015-08-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9521: --- Assignee: Sean Owen (was: Apache Spark) > Require Maven 3.3.3+ in the build > --

[jira] [Updated] (SPARK-9522) SparkSubmit process can not exit if kill application when HiveThriftServer was starting

2015-08-01 Thread Weizhong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weizhong updated SPARK-9522: Component/s: SQL > SparkSubmit process can not exit if kill application when HiveThriftServer > was startin

[jira] [Assigned] (SPARK-9522) SparkSubmit process can not exit if kill application when HiveThriftServer was starting

2015-08-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9522: --- Assignee: Apache Spark > SparkSubmit process can not exit if kill application when HiveThrift

[jira] [Commented] (SPARK-9522) SparkSubmit process can not exit if kill application when HiveThriftServer was starting

2015-08-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650212#comment-14650212 ] Apache Spark commented on SPARK-9522: - User 'Sephiroth-Lin' has created a pull request

[jira] [Assigned] (SPARK-9522) SparkSubmit process can not exit if kill application when HiveThriftServer was starting

2015-08-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9522: --- Assignee: (was: Apache Spark) > SparkSubmit process can not exit if kill application when

[jira] [Updated] (SPARK-8999) Support non-temporal sequence in PrefixSpan

2015-08-01 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8999: - Assignee: Zhang JiaJin > Support non-temporal sequence in PrefixSpan > ---

[jira] [Resolved] (SPARK-8999) Support non-temporal sequence in PrefixSpan

2015-08-01 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-8999. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7818 [https://githu

[jira] [Commented] (SPARK-8505) Add settings to kick `lint-r` from `./dev/run-test.py`

2015-08-01 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650233#comment-14650233 ] Yu Ishikawa commented on SPARK-8505: [~srowen] Yes, I acknowledge how it is assigned,

[jira] [Resolved] (SPARK-8169) Add StopWordsRemover as a transformer

2015-08-01 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-8169. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 6742 [https://githu

[jira] [Created] (SPARK-9523) Receiver for Spark Streaming does not naturally support kryo serializer

2015-08-01 Thread John Chen (JIRA)
John Chen created SPARK-9523: Summary: Receiver for Spark Streaming does not naturally support kryo serializer Key: SPARK-9523 URL: https://issues.apache.org/jira/browse/SPARK-9523 Project: Spark

[jira] [Updated] (SPARK-9523) Receiver for Spark Streaming does not naturally support kryo serializer

2015-08-01 Thread John Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Chen updated SPARK-9523: - Affects Version/s: (was: 1.3.0) 1.3.1 The issue occurs in 1.3.1, not tested in

[jira] [Commented] (SPARK-8505) Add settings to kick `lint-r` from `./dev/run-test.py`

2015-08-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650262#comment-14650262 ] Sean Owen commented on SPARK-8505: -- If you open a pull request, the JIRA is marked as "In

[jira] [Commented] (SPARK-6873) Some Hive-Catalyst comparison tests fail due to unimportant order of some printed elements

2015-08-01 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650268#comment-14650268 ] Cheng Lian commented on SPARK-6873: --- It's not important. Internally, Hive just traverses

[jira] [Issue Comment Deleted] (SPARK-1902) Spark shell prints error when :4040 port already in use

2015-08-01 Thread Eugene Morozov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Morozov updated SPARK-1902: -- Comment: was deleted (was: It looks like package name has changed since and now log4j.properties

[jira] [Comment Edited] (SPARK-9000) Support generic item type in PrefixSpan

2015-08-01 Thread Masaki Rikitoku (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650301#comment-14650301 ] Masaki Rikitoku edited comment on SPARK-9000 at 8/1/15 12:33 PM: ---

[jira] [Commented] (SPARK-9000) Support generic item type in PrefixSpan

2015-08-01 Thread Masaki Rikitoku (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650301#comment-14650301 ] Masaki Rikitoku commented on SPARK-9000: Hi Xiangrui Meng Thanks for your commen

[jira] [Commented] (SPARK-9514) Add EventHubsReceiver to support Spark Streaming using Azure EventHubs

2015-08-01 Thread Nan Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650308#comment-14650308 ] Nan Zhu commented on SPARK-9514: I think the best way to do it is to add a new component i

[jira] [Commented] (SPARK-6227) PCA and SVD for PySpark

2015-08-01 Thread Manoj Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650314#comment-14650314 ] Manoj Kumar commented on SPARK-6227: [~mengxr] Can this be assigned to me? Since the b

[jira] [Created] (SPARK-9524) Latest Spark (8765665015ef47a23e00f7d01d4d280c31bb236d) breaks (pyspark)

2015-08-01 Thread Samuel Marks (JIRA)
Samuel Marks created SPARK-9524: --- Summary: Latest Spark (8765665015ef47a23e00f7d01d4d280c31bb236d) breaks (pyspark) Key: SPARK-9524 URL: https://issues.apache.org/jira/browse/SPARK-9524 Project: Spark

[jira] [Created] (SPARK-9525) Optimize SparseVector initializations in linalg

2015-08-01 Thread Manoj Kumar (JIRA)
Manoj Kumar created SPARK-9525: -- Summary: Optimize SparseVector initializations in linalg Key: SPARK-9525 URL: https://issues.apache.org/jira/browse/SPARK-9525 Project: Spark Issue Type: Improve

[jira] [Updated] (SPARK-9524) Latest Spark (8765665015ef47a23e00f7d01d4d280c31bb236d) breaks (pyspark)

2015-08-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9524: - Affects Version/s: (was: 1.5.0) Priority: Major (was: Blocker) [~SamuelMarks] please rea

[jira] [Resolved] (SPARK-9524) Latest Spark (8765665015ef47a23e00f7d01d4d280c31bb236d) breaks (pyspark)

2015-08-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9524. -- Resolution: Invalid This doesn't appear to be related to Spark. At least none of the error here shows a

[jira] [Assigned] (SPARK-9525) Optimize SparseVector initializations in linalg

2015-08-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9525: --- Assignee: Apache Spark > Optimize SparseVector initializations in linalg > --

[jira] [Assigned] (SPARK-9525) Optimize SparseVector initializations in linalg

2015-08-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9525: --- Assignee: (was: Apache Spark) > Optimize SparseVector initializations in linalg > ---

[jira] [Commented] (SPARK-9525) Optimize SparseVector initializations in linalg

2015-08-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650392#comment-14650392 ] Apache Spark commented on SPARK-9525: - User 'MechCoder' has created a pull request for

[jira] [Updated] (SPARK-9525) Optimize SparseVector initializations in linalg

2015-08-01 Thread Manoj Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Kumar updated SPARK-9525: --- Priority: Major (was: Minor) > Optimize SparseVector initializations in linalg >

[jira] [Resolved] (SPARK-8263) string function: substr/substring should also support binary type

2015-08-01 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8263. --- Resolution: Fixed Fix Version/s: 1.5.0 Target Version/s: (was: ) Issue resolved by

[jira] [Commented] (SPARK-9524) Latest Spark (8765665015ef47a23e00f7d01d4d280c31bb236d) breaks (pyspark)

2015-08-01 Thread Samuel Marks (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650413#comment-14650413 ] Samuel Marks commented on SPARK-9524: - You're welcome to close the issue, it was only

[jira] [Created] (SPARK-9526) Utilize ScalaCheck to reveal potential bugs in sql expressions

2015-08-01 Thread Yijie Shen (JIRA)
Yijie Shen created SPARK-9526: - Summary: Utilize ScalaCheck to reveal potential bugs in sql expressions Key: SPARK-9526 URL: https://issues.apache.org/jira/browse/SPARK-9526 Project: Spark Issue

[jira] [Commented] (SPARK-8999) Support non-temporal sequence in PrefixSpan

2015-08-01 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650415#comment-14650415 ] Xiangrui Meng commented on SPARK-8999: -- [~srowen] Thanks for your feedback! PrefixSpa

[jira] [Updated] (SPARK-9526) Utilize randomized testing to reveal potential bugs in sql expressions

2015-08-01 Thread Yijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yijie Shen updated SPARK-9526: -- Summary: Utilize randomized testing to reveal potential bugs in sql expressions (was: Utilize ScalaChec

[jira] [Updated] (SPARK-9526) Utilize randomized tests to reveal potential bugs in sql expressions

2015-08-01 Thread Yijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yijie Shen updated SPARK-9526: -- Summary: Utilize randomized tests to reveal potential bugs in sql expressions (was: Utilize randomized

[jira] [Created] (SPARK-9527) PrefixSpan.run should return a PrefixSpanModel instead of an RDD

2015-08-01 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-9527: Summary: PrefixSpan.run should return a PrefixSpanModel instead of an RDD Key: SPARK-9527 URL: https://issues.apache.org/jira/browse/SPARK-9527 Project: Spark

[jira] [Assigned] (SPARK-9526) Utilize randomized tests to reveal potential bugs in sql expressions

2015-08-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9526: --- Assignee: Apache Spark > Utilize randomized tests to reveal potential bugs in sql expressions

[jira] [Commented] (SPARK-9526) Utilize randomized tests to reveal potential bugs in sql expressions

2015-08-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650420#comment-14650420 ] Apache Spark commented on SPARK-9526: - User 'yjshen' has created a pull request for th

[jira] [Assigned] (SPARK-9526) Utilize randomized tests to reveal potential bugs in sql expressions

2015-08-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9526: --- Assignee: (was: Apache Spark) > Utilize randomized tests to reveal potential bugs in sql

[jira] [Commented] (SPARK-9526) Utilize randomized tests to reveal potential bugs in sql expressions

2015-08-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650421#comment-14650421 ] Sean Owen commented on SPARK-9526: -- [~yijieshen] at this point should we really be making

[jira] [Commented] (SPARK-9526) Utilize randomized tests to reveal potential bugs in sql expressions

2015-08-01 Thread Yijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650423#comment-14650423 ] Yijie Shen commented on SPARK-9526: --- [~srowen] thanks for reminding, the current randomi

[jira] [Commented] (SPARK-5754) Spark AM not launching on Windows

2015-08-01 Thread Carsten Blank (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650444#comment-14650444 ] Carsten Blank commented on SPARK-5754: -- Okay so I have thought about this more and ki

[jira] [Commented] (SPARK-9524) Latest Spark (8765665015ef47a23e00f7d01d4d280c31bb236d) breaks (pyspark)

2015-08-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650448#comment-14650448 ] Sean Owen commented on SPARK-9524: -- That's an error from ipython though, not Spark. It do

[jira] [Commented] (SPARK-8069) Add support for cutoff to RandomForestClassifier

2015-08-01 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650477#comment-14650477 ] holdenk commented on SPARK-8069: So I was looking at https://docs.google.com/document/d/1

[jira] [Commented] (SPARK-6873) Some Hive-Catalyst comparison tests fail due to unimportant order of some printed elements

2015-08-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650480#comment-14650480 ] Sean Owen commented on SPARK-6873: -- [~rxin] [~lian cheng] It's still a problem. Yes I'm s

[jira] [Commented] (SPARK-3166) Custom serialisers can't be shipped in application jars

2015-08-01 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650486#comment-14650486 ] Josh Rosen commented on SPARK-3166: --- Does anyone know if this is still an issue in newer

[jira] [Updated] (SPARK-9526) Utilize randomized tests to reveal potential bugs in sql expressions

2015-08-01 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9526: --- Priority: Minor (was: Blocker) > Utilize randomized tests to reveal potential bugs in sql expressions

[jira] [Updated] (SPARK-9526) Utilize randomized tests to reveal potential bugs in sql expressions

2015-08-01 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9526: --- Priority: Major (was: Minor) > Utilize randomized tests to reveal potential bugs in sql expressions >

[jira] [Commented] (SPARK-9526) Utilize randomized tests to reveal potential bugs in sql expressions

2015-08-01 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650498#comment-14650498 ] Reynold Xin commented on SPARK-9526: I downgraded it to major. While it is great to ha

[jira] [Closed] (SPARK-4751) Support dynamic allocation for standalone mode

2015-08-01 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4751. Resolution: Fixed Fix Version/s: 1.5.0 > Support dynamic allocation for standalone mode > ---

[jira] [Commented] (SPARK-8069) Add support for cutoff to RandomForestClassifier

2015-08-01 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650514#comment-14650514 ] Joseph K. Bradley commented on SPARK-8069: -- My final plan was to only have it for

[jira] [Created] (SPARK-9528) RandomForestClassifier should extend ProbabilisticClassifier

2015-08-01 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-9528: Summary: RandomForestClassifier should extend ProbabilisticClassifier Key: SPARK-9528 URL: https://issues.apache.org/jira/browse/SPARK-9528 Project: Spark

[jira] [Updated] (SPARK-9491) App running on secure YARN with no HBase config will hang

2015-08-01 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-9491: -- Assignee: Marcelo Vanzin Affects Version/s: 1.4.0 Target Version/s: 1.4.2, 1.5.

[jira] [Updated] (SPARK-9491) App running on secure YARN with no HBase config will hang

2015-08-01 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-9491: -- Fix Version/s: 1.4.2 > App running on secure YARN with no HBase config will hang > -

[jira] [Resolved] (SPARK-9491) App running on secure YARN with no HBase config will hang

2015-08-01 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-9491. --- Resolution: Fixed > App running on secure YARN with no HBase config will hang > --

[jira] [Resolved] (SPARK-9520) UnsafeFixedWidthAggregationMap should support in-place sorting of its own records

2015-08-01 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-9520. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7849 [https://github.com/

[jira] [Created] (SPARK-9529) Improve sort on Decimal

2015-08-01 Thread Davies Liu (JIRA)
Davies Liu created SPARK-9529: - Summary: Improve sort on Decimal Key: SPARK-9529 URL: https://issues.apache.org/jira/browse/SPARK-9529 Project: Spark Issue Type: Sub-task Components: SQ

[jira] [Assigned] (SPARK-9483) UTF8String.getPrefix only works in little-endian order

2015-08-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9483: --- Assignee: Matthew Brandyberry (was: Apache Spark) > UTF8String.getPrefix only works in littl

[jira] [Assigned] (SPARK-9495) Support prefix generation for date / timestamp data type

2015-08-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9495: --- Assignee: Apache Spark > Support prefix generation for date / timestamp data type > -

[jira] [Commented] (SPARK-9483) UTF8String.getPrefix only works in little-endian order

2015-08-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650522#comment-14650522 ] Apache Spark commented on SPARK-9483: - User 'davies' has created a pull request for th

[jira] [Commented] (SPARK-9495) Support prefix generation for date / timestamp data type

2015-08-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650523#comment-14650523 ] Apache Spark commented on SPARK-9495: - User 'davies' has created a pull request for th

[jira] [Assigned] (SPARK-9495) Support prefix generation for date / timestamp data type

2015-08-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9495: --- Assignee: (was: Apache Spark) > Support prefix generation for date / timestamp data type

[jira] [Assigned] (SPARK-9483) UTF8String.getPrefix only works in little-endian order

2015-08-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9483: --- Assignee: Apache Spark (was: Matthew Brandyberry) > UTF8String.getPrefix only works in littl

[jira] [Created] (SPARK-9530) ScalaDoc should not indicate LDAModel.descripeTopic and DistributedLDAModel.topDocumentsPerTopic as approximate.

2015-08-01 Thread Meihua Wu (JIRA)
Meihua Wu created SPARK-9530: Summary: ScalaDoc should not indicate LDAModel.descripeTopic and DistributedLDAModel.topDocumentsPerTopic as approximate. Key: SPARK-9530 URL: https://issues.apache.org/jira/browse/SPARK-

[jira] [Assigned] (SPARK-9529) Improve sort on Decimal

2015-08-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9529: --- Assignee: Davies Liu (was: Apache Spark) > Improve sort on Decimal > ---

[jira] [Commented] (SPARK-9529) Improve sort on Decimal

2015-08-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650540#comment-14650540 ] Apache Spark commented on SPARK-9529: - User 'davies' has created a pull request for th

[jira] [Updated] (SPARK-9530) ScalaDoc should not indicate LDAModel.describeTopics and DistributedLDAModel.topDocumentsPerTopic as approximate.

2015-08-01 Thread Meihua Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Meihua Wu updated SPARK-9530: - Summary: ScalaDoc should not indicate LDAModel.describeTopics and DistributedLDAModel.topDocumentsPerTopic

[jira] [Assigned] (SPARK-9529) Improve sort on Decimal

2015-08-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9529: --- Assignee: Apache Spark (was: Davies Liu) > Improve sort on Decimal > ---

[jira] [Updated] (SPARK-9530) ScalaDoc should not indicate LDAModel.describeTopics and DistributedLDAModel.topDocumentsPerTopic as approximate.

2015-08-01 Thread Meihua Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Meihua Wu updated SPARK-9530: - Description: Currently the ScalaDoc for LDAModel.describeTopics and DistributedLDAModel.topDocumentsPerTo

[jira] [Assigned] (SPARK-9530) ScalaDoc should not indicate LDAModel.describeTopics and DistributedLDAModel.topDocumentsPerTopic as approximate.

2015-08-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9530: --- Assignee: Apache Spark > ScalaDoc should not indicate LDAModel.describeTopics and > Distribu

[jira] [Commented] (SPARK-9530) ScalaDoc should not indicate LDAModel.describeTopics and DistributedLDAModel.topDocumentsPerTopic as approximate.

2015-08-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650543#comment-14650543 ] Apache Spark commented on SPARK-9530: - User 'rotationsymmetry' has created a pull requ

[jira] [Assigned] (SPARK-9530) ScalaDoc should not indicate LDAModel.describeTopics and DistributedLDAModel.topDocumentsPerTopic as approximate.

2015-08-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9530: --- Assignee: (was: Apache Spark) > ScalaDoc should not indicate LDAModel.describeTopics and

[jira] [Updated] (SPARK-9530) ScalaDoc should not indicate LDAModel.describeTopics and DistributedLDAModel.topDocumentsPerTopic as approximate.

2015-08-01 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9530: - Assignee: Meihua Wu Target Version/s: 1.3.2, 1.4.2, 1.5.0 > ScalaDoc should no

[jira] [Closed] (SPARK-9492) LogisticRegression should provide model statistics

2015-08-01 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley closed SPARK-9492. Resolution: Duplicate > LogisticRegression should provide model statistics > ---

[jira] [Updated] (SPARK-9492) LogisticRegression in R should provide model statistics

2015-08-01 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9492: - Summary: LogisticRegression in R should provide model statistics (was: LogisticRegression

[jira] [Updated] (SPARK-9492) LogisticRegression in R should provide model statistics

2015-08-01 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9492: - Component/s: R > LogisticRegression in R should provide model statistics > ---

[jira] [Reopened] (SPARK-9492) LogisticRegression should provide model statistics

2015-08-01 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley reopened SPARK-9492: -- Oops, I just realized this was for Spark R. I'll add those tags. > LogisticRegression shou

[jira] [Commented] (SPARK-5754) Spark AM not launching on Windows

2015-08-01 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650551#comment-14650551 ] Inigo Goiri commented on SPARK-5754: I overwrote the existing escapeForShell to use si

[jira] [Commented] (SPARK-8333) Spark failed to delete temp directory created by HiveContext

2015-08-01 Thread Sudhakar Thota (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650555#comment-14650555 ] Sudhakar Thota commented on SPARK-8333: --- Thanks for the clarification. I have used t

[jira] [Assigned] (SPARK-9528) RandomForestClassifier should extend ProbabilisticClassifier

2015-08-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9528: --- Assignee: Apache Spark (was: Joseph K. Bradley) > RandomForestClassifier should extend Proba

[jira] [Commented] (SPARK-9528) RandomForestClassifier should extend ProbabilisticClassifier

2015-08-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650558#comment-14650558 ] Apache Spark commented on SPARK-9528: - User 'jkbradley' has created a pull request for

[jira] [Assigned] (SPARK-9528) RandomForestClassifier should extend ProbabilisticClassifier

2015-08-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9528: --- Assignee: Joseph K. Bradley (was: Apache Spark) > RandomForestClassifier should extend Proba

[jira] [Updated] (SPARK-9530) ScalaDoc should not indicate LDAModel.describeTopics and DistributedLDAModel.topDocumentsPerTopic as approximate.

2015-08-01 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9530: - Target Version/s: 1.5.0 (was: 1.3.2, 1.4.2, 1.5.0) > ScalaDoc should not indicate LDAMode

[jira] [Resolved] (SPARK-9530) ScalaDoc should not indicate LDAModel.describeTopics and DistributedLDAModel.topDocumentsPerTopic as approximate.

2015-08-01 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-9530. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7858 [https

[jira] [Commented] (SPARK-9447) Update python API to include RandomForest as classifier changes.

2015-08-01 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650561#comment-14650561 ] Joseph K. Bradley commented on SPARK-9447: -- I'll do this once [SPARK-9528] gets f

[jira] [Created] (SPARK-9531) UnsafeFixedWidthAggregationMap should be able to turn itself into an UnsafeKVExternalSorter

2015-08-01 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9531: -- Summary: UnsafeFixedWidthAggregationMap should be able to turn itself into an UnsafeKVExternalSorter Key: SPARK-9531 URL: https://issues.apache.org/jira/browse/SPARK-9531

[jira] [Commented] (SPARK-9531) UnsafeFixedWidthAggregationMap should be able to turn itself into an UnsafeKVExternalSorter

2015-08-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650562#comment-14650562 ] Apache Spark commented on SPARK-9531: - User 'rxin' has created a pull request for this

[jira] [Assigned] (SPARK-9531) UnsafeFixedWidthAggregationMap should be able to turn itself into an UnsafeKVExternalSorter

2015-08-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9531: --- Assignee: Apache Spark (was: Reynold Xin) > UnsafeFixedWidthAggregationMap should be able to

  1   2   >