[jira] [Commented] (SPARK-8062) NullPointerException in SparkHadoopUtil.getFileSystemThreadStatistics

2015-06-02 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14570388#comment-14570388 ] Sandy Ryza commented on SPARK-8062: --- [~joshrosen] nothing sticks out to me past what you

[jira] [Created] (SPARK-8069) Add support for cutoff to RandomForestClassifier

2015-06-02 Thread holdenk (JIRA)
holdenk created SPARK-8069: -- Summary: Add support for cutoff to RandomForestClassifier Key: SPARK-8069 URL: https://issues.apache.org/jira/browse/SPARK-8069 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-7993) Improve DataFrame.show() output

2015-06-02 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14570358#comment-14570358 ] Reynold Xin commented on SPARK-7993: that sounds good. > Improve DataFrame.show() out

[jira] [Updated] (SPARK-8032) Make NumPy version checking in mllib/__init__.py

2015-06-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8032: - Affects Version/s: (was: 1.3.0) 1.4.0 1.0.2

[jira] [Updated] (SPARK-8032) Make NumPy version checking in mllib/__init__.py

2015-06-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8032: - Assignee: Manoj Kumar > Make NumPy version checking in mllib/__init__.py > ---

[jira] [Updated] (SPARK-8032) Make NumPy version checking in mllib/__init__.py

2015-06-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8032: - Fix Version/s: (was: 1.6.0) (was: 1.4.0) 1.5.0

[jira] [Resolved] (SPARK-8032) Make NumPy version checking in mllib/__init__.py

2015-06-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-8032. -- Resolution: Fixed Fix Version/s: 1.4.0 1.0.3 1.6.0

[jira] [Created] (SPARK-8068) Add confusionMatrix method at class MulticlassMetrics in pyspark/mllib

2015-06-02 Thread Ai He (JIRA)
Ai He created SPARK-8068: Summary: Add confusionMatrix method at class MulticlassMetrics in pyspark/mllib Key: SPARK-8068 URL: https://issues.apache.org/jira/browse/SPARK-8068 Project: Spark Issue T

[jira] [Updated] (SPARK-8068) Add confusionMatrix method at class MulticlassMetrics in pyspark/mllib

2015-06-02 Thread Ai He (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ai He updated SPARK-8068: - Component/s: PySpark > Add confusionMatrix method at class MulticlassMetrics in pyspark/mllib > --

[jira] [Comment Edited] (SPARK-7917) Spark doesn't clean up Application Directories (local dirs)

2015-06-02 Thread Weizhong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14570339#comment-14570339 ] Weizhong edited comment on SPARK-7917 at 6/3/15 6:20 AM: - On stand

[jira] [Updated] (SPARK-8043) update NaiveBayes and SVM examples in doc

2015-06-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8043: - Target Version/s: 1.4.1, 1.5.0 (was: 1.3.2, 1.4.1, 1.5.0) > update NaiveBayes and SVM examples in

[jira] [Updated] (SPARK-8043) update NaiveBayes and SVM examples in doc

2015-06-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8043: - Affects Version/s: (was: 1.3.1) > update NaiveBayes and SVM examples in doc >

[jira] [Updated] (SPARK-8043) update NaiveBayes and SVM examples in doc

2015-06-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8043: - Assignee: yuhao yang > update NaiveBayes and SVM examples in doc > ---

[jira] [Updated] (SPARK-8043) update NaiveBayes and SVM examples in doc

2015-06-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8043: - Target Version/s: 1.3.2, 1.4.1, 1.5.0 Affects Version/s: 1.3.1 > update NaiveBayes and SVM ex

[jira] [Commented] (SPARK-7917) Spark doesn't clean up Application Directories (local dirs)

2015-06-02 Thread Weizhong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14570339#comment-14570339 ] Weizhong commented on SPARK-7917: - On standalone mode, will kept one tmp dir on each execu

[jira] [Resolved] (SPARK-8043) update NaiveBayes and SVM examples in doc

2015-06-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-8043. -- Resolution: Fixed Fix Version/s: 1.4.1 1.5.0 Issue resolved by pull re

[jira] [Issue Comment Deleted] (SPARK-7980) Support SQLContext.range(end)

2015-06-02 Thread Animesh Baranawal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Animesh Baranawal updated SPARK-7980: - Comment: was deleted (was: Regarding the python support for range, I am unable to check th

[jira] [Resolved] (SPARK-8053) ElementwiseProduct scalingVec param name should match between ml,mllib

2015-06-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-8053. -- Resolution: Fixed Fix Version/s: 1.4.1 1.5.0 Issue resolved by pull re

[jira] [Closed] (SPARK-7963) order by should support aggregate functions

2015-06-02 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-7963. -- Resolution: Duplicate > order by should support aggregate functions > --

[jira] [Commented] (SPARK-7963) order by should support aggregate functions

2015-06-02 Thread Weizhong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14570317#comment-14570317 ] Weizhong commented on SPARK-7963: - Is it same as SPARK-6583? > order by should support ag

[jira] [Resolved] (SPARK-7691) Use type-specific row accessor functions in CatalystTypeConverters' toScala functions

2015-06-02 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-7691. Resolution: Fixed Fix Version/s: 1.5.0 > Use type-specific row accessor functions in Catalyst

[jira] [Commented] (SPARK-6797) Add support for YARN cluster mode

2015-06-02 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14570307#comment-14570307 ] Shivaram Venkataraman commented on SPARK-6797: -- You are right that we are ass

[jira] [Comment Edited] (SPARK-8020) Spark SQL conf in spark-defaults.conf make metadataHive get constructed too early

2015-06-02 Thread jeanlyn (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14570303#comment-14570303 ] jeanlyn edited comment on SPARK-8020 at 6/3/15 5:38 AM: I had trie

[jira] [Comment Edited] (SPARK-8020) Spark SQL conf in spark-defaults.conf make metadataHive get constructed too early

2015-06-02 Thread jeanlyn (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14570303#comment-14570303 ] jeanlyn edited comment on SPARK-8020 at 6/3/15 5:38 AM: I had trie

[jira] [Commented] (SPARK-8020) Spark SQL conf in spark-defaults.conf make metadataHive get constructed too early

2015-06-02 Thread jeanlyn (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14570303#comment-14570303 ] jeanlyn commented on SPARK-8020: I had tried to put the settings back to *spark-defaults.c

[jira] [Updated] (SPARK-8066) Add support for connecting to Hive 1.0 (0.14.1)

2015-06-02 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8066: --- Summary: Add support for connecting to Hive 1.0 (0.14.1) (was: Add support for connecting to Hive 1.0

[jira] [Created] (SPARK-8066) Add support for connecting to Hive 1.0

2015-06-02 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-8066: -- Summary: Add support for connecting to Hive 1.0 Key: SPARK-8066 URL: https://issues.apache.org/jira/browse/SPARK-8066 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-8065) Add support for connecting to Hive 0.14 metastore

2015-06-02 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-8065: -- Summary: Add support for connecting to Hive 0.14 metastore Key: SPARK-8065 URL: https://issues.apache.org/jira/browse/SPARK-8065 Project: Spark Issue Type: Sub-t

[jira] [Created] (SPARK-8067) Add support for connecting to Hive 1.1

2015-06-02 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-8067: -- Summary: Add support for connecting to Hive 1.1 Key: SPARK-8067 URL: https://issues.apache.org/jira/browse/SPARK-8067 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-8064) Upgrade Hive to 1.2

2015-06-02 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-8064: -- Summary: Upgrade Hive to 1.2 Key: SPARK-8064 URL: https://issues.apache.org/jira/browse/SPARK-8064 Project: Spark Issue Type: Sub-task Components: SQL

[jira] [Commented] (SPARK-8063) Spark master URL conflict between MASTER env variable and --master command line option

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14570272#comment-14570272 ] Apache Spark commented on SPARK-8063: - User 'sun-rui' has created a pull request for t

[jira] [Assigned] (SPARK-8063) Spark master URL conflict between MASTER env variable and --master command line option

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8063: --- Assignee: (was: Apache Spark) > Spark master URL conflict between MASTER env variable and

[jira] [Assigned] (SPARK-8063) Spark master URL conflict between MASTER env variable and --master command line option

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8063: --- Assignee: Apache Spark > Spark master URL conflict between MASTER env variable and --master c

[jira] [Created] (SPARK-8063) Spark master URL conflict between MASTER env variable and --master command line option

2015-06-02 Thread Sun Rui (JIRA)
Sun Rui created SPARK-8063: -- Summary: Spark master URL conflict between MASTER env variable and --master command line option Key: SPARK-8063 URL: https://issues.apache.org/jira/browse/SPARK-8063 Project: Spa

[jira] [Assigned] (SPARK-6909) Remove Hive Shim code

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6909: --- Assignee: Apache Spark > Remove Hive Shim code > - > > Ke

[jira] [Commented] (SPARK-6909) Remove Hive Shim code

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14570254#comment-14570254 ] Apache Spark commented on SPARK-6909: - User 'piaozhexiu' has created a pull request fo

[jira] [Assigned] (SPARK-6909) Remove Hive Shim code

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6909: --- Assignee: (was: Apache Spark) > Remove Hive Shim code > - > >

[jira] [Updated] (SPARK-7973) Increase the timeout of CliSuite's "Commands using SerDe provided in --jars" and "Single command with -e"

2015-06-02 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-7973: Description: Seems CliSuite's "Commands using SerDe provided in --jars" and "Single command with -e" may ti

[jira] [Updated] (SPARK-7973) Increase the timeout of CliSuite's "Commands using SerDe provided in --jars" and "Single command with -e"

2015-06-02 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-7973: Summary: Increase the timeout of CliSuite's "Commands using SerDe provided in --jars" and "Single command wi

[jira] [Updated] (SPARK-7973) Increase the timeout of CliSuite's "Commands using SerDe provided in --jars" and "Single command with -e"

2015-06-02 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-7973: Description: Seems CliSuite's "Commands using SerDe provided in --jars" and "Single command with -e" may ti

[jira] [Commented] (SPARK-8062) NullPointerException in SparkHadoopUtil.getFileSystemThreadStatistics

2015-06-02 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14570160#comment-14570160 ] Josh Rosen commented on SPARK-8062: --- [~sandyr], do you have any thoughts on what might b

[jira] [Created] (SPARK-8062) NullPointerException in SparkHadoopUtil.getFileSystemThreadStatistics

2015-06-02 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-8062: - Summary: NullPointerException in SparkHadoopUtil.getFileSystemThreadStatistics Key: SPARK-8062 URL: https://issues.apache.org/jira/browse/SPARK-8062 Project: Spark

[jira] [Updated] (SPARK-8061) Document how to use "hadoop provided" builds

2015-06-02 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-8061: --- Target Version/s: 1.4.1, 1.5.0 (was: 1.4.1) > Document how to use "hadoop provided" builds >

[jira] [Created] (SPARK-8061) Document how to use "hadoop provided" builds

2015-06-02 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-8061: -- Summary: Document how to use "hadoop provided" builds Key: SPARK-8061 URL: https://issues.apache.org/jira/browse/SPARK-8061 Project: Spark Issue Type: Im

[jira] [Commented] (SPARK-7558) Log test name when starting and finishing each test

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14570140#comment-14570140 ] Apache Spark commented on SPARK-7558: - User 'andrewor14' has created a pull request fo

[jira] [Resolved] (SPARK-7547) Example code for ElasticNet

2015-06-02 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-7547. -- Resolution: Fixed Fix Version/s: 1.4.1 1.5.0 Issue resolved by

[jira] [Updated] (SPARK-7547) Example code for ElasticNet

2015-06-02 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7547: - Target Version/s: 1.4.1, 1.5.0 (was: 1.4.0) > Example code for ElasticNet > -

[jira] [Commented] (SPARK-7547) Example code for ElasticNet

2015-06-02 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14570139#comment-14570139 ] Joseph K. Bradley commented on SPARK-7547: -- Updated target versions since this wo

[jira] [Commented] (SPARK-6797) Add support for YARN cluster mode

2015-06-02 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14570129#comment-14570129 ] Sun Rui commented on SPARK-6797: @shivaram, so you'd like to ship SparkR binary package to

[jira] [Resolved] (SPARK-7387) CrossValidator example code in Python

2015-06-02 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-7387. -- Resolution: Fixed Fix Version/s: 1.4.1 1.5.0 Issue resolved by

[jira] [Updated] (SPARK-7387) CrossValidator example code in Python

2015-06-02 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7387: - Target Version/s: 1.4.1, 1.5.0 (was: 1.4.0) > CrossValidator example code in Python > ---

[jira] [Commented] (SPARK-7387) CrossValidator example code in Python

2015-06-02 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14570125#comment-14570125 ] Joseph K. Bradley commented on SPARK-7387: -- Changing target versions since RC4 wi

[jira] [Assigned] (SPARK-8060) Improve Python reader/writer interface doc and testing

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8060: --- Assignee: Apache Spark (was: Reynold Xin) > Improve Python reader/writer interface doc and t

[jira] [Commented] (SPARK-8060) Improve Python reader/writer interface doc and testing

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14570105#comment-14570105 ] Apache Spark commented on SPARK-8060: - User 'rxin' has created a pull request for this

[jira] [Assigned] (SPARK-8060) Improve Python reader/writer interface doc and testing

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8060: --- Assignee: Reynold Xin (was: Apache Spark) > Improve Python reader/writer interface doc and t

[jira] [Created] (SPARK-8060) Improve Python reader/writer interface doc and testing

2015-06-02 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-8060: -- Summary: Improve Python reader/writer interface doc and testing Key: SPARK-8060 URL: https://issues.apache.org/jira/browse/SPARK-8060 Project: Spark Issue Type:

[jira] [Commented] (SPARK-8040) Remove Debian specific loopback address setting code

2015-06-02 Thread Yuta Kurosaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14570093#comment-14570093 ] Yuta Kurosaki commented on SPARK-8040: -- I am sorry that I couldn't explain well. With

[jira] [Commented] (SPARK-7879) KMeans API for spark.ml Pipelines

2015-06-02 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14570089#comment-14570089 ] Yu Ishikawa commented on SPARK-7879: I will implement it. > KMeans API for spark.ml P

[jira] [Assigned] (SPARK-8059) Reduce latency between executor requests and RM heartbeat

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8059: --- Assignee: (was: Apache Spark) > Reduce latency between executor requests and RM heartbeat

[jira] [Assigned] (SPARK-8059) Reduce latency between executor requests and RM heartbeat

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8059: --- Assignee: Apache Spark > Reduce latency between executor requests and RM heartbeat >

[jira] [Commented] (SPARK-8059) Reduce latency between executor requests and RM heartbeat

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14570073#comment-14570073 ] Apache Spark commented on SPARK-8059: - User 'vanzin' has created a pull request for th

[jira] [Created] (SPARK-8059) Reduce latency between executor requests and RM heartbeat

2015-06-02 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-8059: - Summary: Reduce latency between executor requests and RM heartbeat Key: SPARK-8059 URL: https://issues.apache.org/jira/browse/SPARK-8059 Project: Spark Iss

[jira] [Created] (SPARK-8058) Add tests for SPARK-7853 and SPARK-8020

2015-06-02 Thread Yin Huai (JIRA)
Yin Huai created SPARK-8058: --- Summary: Add tests for SPARK-7853 and SPARK-8020 Key: SPARK-8058 URL: https://issues.apache.org/jira/browse/SPARK-8058 Project: Spark Issue Type: Task Compon

[jira] [Assigned] (SPARK-8057) Call TaskAttemptContext.getTaskAttemptID using Reflection

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8057: --- Assignee: (was: Apache Spark) > Call TaskAttemptContext.getTaskAttemptID using Reflection

[jira] [Commented] (SPARK-8057) Call TaskAttemptContext.getTaskAttemptID using Reflection

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14570043#comment-14570043 ] Apache Spark commented on SPARK-8057: - User 'zsxwing' has created a pull request for t

[jira] [Assigned] (SPARK-8057) Call TaskAttemptContext.getTaskAttemptID using Reflection

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8057: --- Assignee: Apache Spark > Call TaskAttemptContext.getTaskAttemptID using Reflection >

[jira] [Updated] (SPARK-8057) Call TaskAttemptContext.getTaskAttemptID using Reflection

2015-06-02 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-8057: Affects Version/s: 1.3.1 > Call TaskAttemptContext.getTaskAttemptID using Reflection > -

[jira] [Created] (SPARK-8057) Call TaskAttemptContext.getTaskAttemptID using Reflection

2015-06-02 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-8057: --- Summary: Call TaskAttemptContext.getTaskAttemptID using Reflection Key: SPARK-8057 URL: https://issues.apache.org/jira/browse/SPARK-8057 Project: Spark Issue T

[jira] [Resolved] (SPARK-8026) Add Column.alias to Scala/Java API

2015-06-02 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8026. Resolution: Fixed Fix Version/s: 1.4.0 > Add Column.alias to Scala/Java API > ---

[jira] [Commented] (SPARK-7558) Log test name when starting and finishing each test

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14570033#comment-14570033 ] Apache Spark commented on SPARK-7558: - User 'andrewor14' has created a pull request fo

[jira] [Created] (SPARK-8056) Design an easier way to construct schema for both Scala and Python

2015-06-02 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-8056: -- Summary: Design an easier way to construct schema for both Scala and Python Key: SPARK-8056 URL: https://issues.apache.org/jira/browse/SPARK-8056 Project: Spark

[jira] [Updated] (SPARK-8049) OneVsRest's output includes a temp column

2015-06-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8049: - Fix Version/s: 1.5.0 1.4.1 > OneVsRest's output includes a temp column > --

[jira] [Commented] (SPARK-8055) Spark Launcher Improvements

2015-06-02 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1457#comment-1457 ] Marcelo Vanzin commented on SPARK-8055: --- /cc [~klmarkey] [~chester.c...@webwarecorp.

[jira] [Created] (SPARK-8055) Spark Launcher Improvements

2015-06-02 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-8055: - Summary: Spark Launcher Improvements Key: SPARK-8055 URL: https://issues.apache.org/jira/browse/SPARK-8055 Project: Spark Issue Type: Umbrella Co

[jira] [Commented] (SPARK-2551) Cleanup FilteringParquetRowInputFormat

2015-06-02 Thread Thomas Omans (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14569912#comment-14569912 ] Thomas Omans commented on SPARK-2551: - Wanted to chime in since I upgraded parquet re:

[jira] [Resolved] (SPARK-7529) Java compatibility check for MLlib 1.4

2015-06-02 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-7529. -- Resolution: Fixed Fix Version/s: 1.4.0 I'm marking this Fixed. Since the PR with

[jira] [Assigned] (SPARK-8054) Java compatibility fixes for MLlib 1.4

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8054: --- Assignee: Apache Spark (was: Joseph K. Bradley) > Java compatibility fixes for MLlib 1.4 > -

[jira] [Assigned] (SPARK-8054) Java compatibility fixes for MLlib 1.4

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8054: --- Assignee: Joseph K. Bradley (was: Apache Spark) > Java compatibility fixes for MLlib 1.4 > -

[jira] [Commented] (SPARK-8054) Java compatibility fixes for MLlib 1.4

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14569900#comment-14569900 ] Apache Spark commented on SPARK-8054: - User 'jkbradley' has created a pull request for

[jira] [Created] (SPARK-8054) Java compatibility fixes for MLlib 1.4

2015-06-02 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-8054: Summary: Java compatibility fixes for MLlib 1.4 Key: SPARK-8054 URL: https://issues.apache.org/jira/browse/SPARK-8054 Project: Spark Issue Type: Impr

[jira] [Assigned] (SPARK-7743) Upgrade parquet dependency

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7743: --- Assignee: (was: Apache Spark) > Upgrade parquet dependency > -- >

[jira] [Assigned] (SPARK-7743) Upgrade parquet dependency

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7743: --- Assignee: Apache Spark > Upgrade parquet dependency > -- > >

[jira] [Closed] (SPARK-8052) Hive on Spark: CAST string AS BIGINT produces wrong value

2015-06-02 Thread Andrey Kurochkin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Kurochkin closed SPARK-8052. --- Resolution: Invalid Applies to Hive. Wrong project. > Hive on Spark: CAST string AS BIGINT pr

[jira] [Commented] (SPARK-7743) Upgrade parquet dependency

2015-06-02 Thread Thomas Omans (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14569876#comment-14569876 ] Thomas Omans commented on SPARK-7743: - I've linked a PR to upgrade to 1.7.0. > Upgrad

[jira] [Assigned] (SPARK-8053) ElementwiseProduct scalingVec param name should match between ml,mllib

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8053: --- Assignee: Apache Spark (was: Joseph K. Bradley) > ElementwiseProduct scalingVec param name s

[jira] [Commented] (SPARK-8053) ElementwiseProduct scalingVec param name should match between ml,mllib

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14569860#comment-14569860 ] Apache Spark commented on SPARK-8053: - User 'jkbradley' has created a pull request for

[jira] [Assigned] (SPARK-8053) ElementwiseProduct scalingVec param name should match between ml,mllib

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8053: --- Assignee: Joseph K. Bradley (was: Apache Spark) > ElementwiseProduct scalingVec param name s

[jira] [Created] (SPARK-8053) ElementwiseProduct scalingVec param name should match between ml,mllib

2015-06-02 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-8053: Summary: ElementwiseProduct scalingVec param name should match between ml,mllib Key: SPARK-8053 URL: https://issues.apache.org/jira/browse/SPARK-8053 Project:

[jira] [Updated] (SPARK-8052) Hive on Spark: CAST string AS BIGINT produces wrong value

2015-06-02 Thread Andrey Kurochkin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Kurochkin updated SPARK-8052: Description: Example hive query: SELECT CAST("775983671874188101" as BIGINT) produces:

[jira] [Updated] (SPARK-8052) Hive on Spark: CAST string AS BIGINT produces wrong value

2015-06-02 Thread Andrey Kurochkin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Kurochkin updated SPARK-8052: Description: Example hive query: SELECT CAST("775983671874188101" as BIGINT) produces:

[jira] [Created] (SPARK-8052) Hive on Spark: CAST string AS BIGINT produces wrong value

2015-06-02 Thread Andrey Kurochkin (JIRA)
Andrey Kurochkin created SPARK-8052: --- Summary: Hive on Spark: CAST string AS BIGINT produces wrong value Key: SPARK-8052 URL: https://issues.apache.org/jira/browse/SPARK-8052 Project: Spark

[jira] [Assigned] (SPARK-8051) StringIndexerModel (and other models) shouldn't complain if the input column is missing.

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8051: --- Assignee: Apache Spark (was: Xiangrui Meng) > StringIndexerModel (and other models) shouldn'

[jira] [Assigned] (SPARK-8051) StringIndexerModel (and other models) shouldn't complain if the input column is missing.

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8051: --- Assignee: Xiangrui Meng (was: Apache Spark) > StringIndexerModel (and other models) shouldn'

[jira] [Commented] (SPARK-8051) StringIndexerModel (and other models) shouldn't complain if the input column is missing.

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14569796#comment-14569796 ] Apache Spark commented on SPARK-8051: - User 'mengxr' has created a pull request for th

[jira] [Commented] (SPARK-7991) Python DataFrame: support passing a list into describe

2015-06-02 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14569788#comment-14569788 ] Reynold Xin commented on SPARK-7991: Please go ahead. This one should be simple. > P

[jira] [Created] (SPARK-8051) StringIndexerModel (and other models) shouldn't complain if the input column is missing.

2015-06-02 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-8051: Summary: StringIndexerModel (and other models) shouldn't complain if the input column is missing. Key: SPARK-8051 URL: https://issues.apache.org/jira/browse/SPARK-8051

[jira] [Assigned] (SPARK-8050) Make Savable and Loader Java-friendly.

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8050: --- Assignee: Apache Spark (was: Xiangrui Meng) > Make Savable and Loader Java-friendly. > -

[jira] [Assigned] (SPARK-8050) Make Savable and Loader Java-friendly.

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8050: --- Assignee: Xiangrui Meng (was: Apache Spark) > Make Savable and Loader Java-friendly. > -

[jira] [Commented] (SPARK-8050) Make Savable and Loader Java-friendly.

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14569751#comment-14569751 ] Apache Spark commented on SPARK-8050: - User 'mengxr' has created a pull request for th

[jira] [Created] (SPARK-8050) Make Savable and Loader Java-friendly.

2015-06-02 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-8050: Summary: Make Savable and Loader Java-friendly. Key: SPARK-8050 URL: https://issues.apache.org/jira/browse/SPARK-8050 Project: Spark Issue Type: Improvement

  1   2   3   >