[jira] [Created] (SPARK-11907) Allowing errors as values in DataFrames (like 'Either Left/Right')

2015-11-22 Thread Tycho Grouwstra (JIRA)
Tycho Grouwstra created SPARK-11907: --- Summary: Allowing errors as values in DataFrames (like 'Either Left/Right') Key: SPARK-11907 URL: https://issues.apache.org/jira/browse/SPARK-11907 Project: Spa

[jira] [Updated] (SPARK-11907) Allowing errors as values in DataFrames (like 'Either Left/Right')

2015-11-22 Thread Tycho Grouwstra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tycho Grouwstra updated SPARK-11907: Description: I like Spark, but one thing I find funny about it is that it is picky about c

[jira] [Updated] (SPARK-11907) Allowing errors as values in DataFrames (like 'Either Left/Right')

2015-11-22 Thread Tycho Grouwstra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tycho Grouwstra updated SPARK-11907: Description: I like Spark, but one thing I find funny about it is that it is picky about c

[jira] [Created] (SPARK-11908) Add NullType support to RowEncoder

2015-11-22 Thread Liang-Chi Hsieh (JIRA)
Liang-Chi Hsieh created SPARK-11908: --- Summary: Add NullType support to RowEncoder Key: SPARK-11908 URL: https://issues.apache.org/jira/browse/SPARK-11908 Project: Spark Issue Type: Improvem

[jira] [Assigned] (SPARK-11908) Add NullType support to RowEncoder

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11908: Assignee: (was: Apache Spark) > Add NullType support to RowEncoder > -

[jira] [Commented] (SPARK-11908) Add NullType support to RowEncoder

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15020935#comment-15020935 ] Apache Spark commented on SPARK-11908: -- User 'viirya' has created a pull request for

[jira] [Assigned] (SPARK-11908) Add NullType support to RowEncoder

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11908: Assignee: Apache Spark > Add NullType support to RowEncoder >

[jira] [Commented] (SPARK-11065) IOException thrown at job submit shutdown

2015-11-22 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-11065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15020939#comment-15020939 ] Maciej Bryński commented on SPARK-11065: I have the same error. Job run successfu

[jira] [Created] (SPARK-11909) Spark Standalone's master URL accepts URLs without port (assuming default 7077)

2015-11-22 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-11909: --- Summary: Spark Standalone's master URL accepts URLs without port (assuming default 7077) Key: SPARK-11909 URL: https://issues.apache.org/jira/browse/SPARK-11909

[jira] [Commented] (SPARK-11909) Spark Standalone's master URL accepts URLs without port (assuming default 7077)

2015-11-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15020976#comment-15020976 ] Sean Owen commented on SPARK-11909: --- I disagree. The default is not a well-known port l

[jira] [Commented] (SPARK-11065) IOException thrown at job submit shutdown

2015-11-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15020977#comment-15020977 ] Sean Owen commented on SPARK-11065: --- Unless it's causing a problem, I'd ignore it. Shut

[jira] [Commented] (SPARK-11826) Subtract BlockMatrix

2015-11-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15020979#comment-15020979 ] Sean Owen commented on SPARK-11826: --- OK, given the existence of add(), this probably ma

[jira] [Commented] (SPARK-11065) IOException thrown at job submit shutdown

2015-11-22 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-11065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15020981#comment-15020981 ] Maciej Bryński commented on SPARK-11065: [~srowen] OK. But this issue is new in 1

[jira] [Commented] (SPARK-11065) IOException thrown at job submit shutdown

2015-11-22 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-11065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15020982#comment-15020982 ] Jean-Baptiste Onofré commented on SPARK-11065: -- It's not really a problem, b

[jira] [Commented] (SPARK-11906) Speculation Tasks Cause ProgressBar UI Overflow

2015-11-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15020990#comment-15020990 ] Sean Owen commented on SPARK-11906: --- Yes, can you open a PR? sounds like you already id

[jira] [Updated] (SPARK-11716) UDFRegistration Drops Input Type Information

2015-11-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11716: -- Assignee: Yin Huai > UDFRegistration Drops Input Type Information > ---

[jira] [Created] (SPARK-11910) Streaming programming guide references wrong dependency version

2015-11-22 Thread Luciano Resende (JIRA)
Luciano Resende created SPARK-11910: --- Summary: Streaming programming guide references wrong dependency version Key: SPARK-11910 URL: https://issues.apache.org/jira/browse/SPARK-11910 Project: Spark

[jira] [Assigned] (SPARK-11910) Streaming programming guide references wrong dependency version

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11910: Assignee: (was: Apache Spark) > Streaming programming guide references wrong dependenc

[jira] [Commented] (SPARK-11910) Streaming programming guide references wrong dependency version

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15021059#comment-15021059 ] Apache Spark commented on SPARK-11910: -- User 'lresende' has created a pull request f

[jira] [Assigned] (SPARK-11910) Streaming programming guide references wrong dependency version

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11910: Assignee: Apache Spark > Streaming programming guide references wrong dependency version >

[jira] [Assigned] (SPARK-10521) Utilize Docker to test DB2 JDBC Dialect support

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10521: Assignee: Apache Spark > Utilize Docker to test DB2 JDBC Dialect support > ---

[jira] [Assigned] (SPARK-10521) Utilize Docker to test DB2 JDBC Dialect support

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10521: Assignee: (was: Apache Spark) > Utilize Docker to test DB2 JDBC Dialect support >

[jira] [Commented] (SPARK-10521) Utilize Docker to test DB2 JDBC Dialect support

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15021061#comment-15021061 ] Apache Spark commented on SPARK-10521: -- User 'lresende' has created a pull request f

[jira] [Assigned] (SPARK-11783) When deployed against remote Hive metastore, HiveContext.executionHive points to wrong metastore

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11783: Assignee: Cheng Lian (was: Apache Spark) > When deployed against remote Hive metastore, H

[jira] [Commented] (SPARK-11847) Model export/import for spark.ml: LDA

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15021083#comment-15021083 ] Apache Spark commented on SPARK-11847: -- User 'hhbyyh' has created a pull request for

[jira] [Assigned] (SPARK-11783) When deployed against remote Hive metastore, HiveContext.executionHive points to wrong metastore

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11783: Assignee: Apache Spark (was: Cheng Lian) > When deployed against remote Hive metastore, H

[jira] [Assigned] (SPARK-11847) Model export/import for spark.ml: LDA

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11847: Assignee: Apache Spark (was: yuhao yang) > Model export/import for spark.ml: LDA > --

[jira] [Commented] (SPARK-11783) When deployed against remote Hive metastore, HiveContext.executionHive points to wrong metastore

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15021082#comment-15021082 ] Apache Spark commented on SPARK-11783: -- User 'liancheng' has created a pull request

[jira] [Assigned] (SPARK-11847) Model export/import for spark.ml: LDA

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11847: Assignee: yuhao yang (was: Apache Spark) > Model export/import for spark.ml: LDA > --

[jira] [Updated] (SPARK-11716) UDFRegistration Drops Input Type Information

2015-11-22 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-11716: - Assignee: Jean-Baptiste Onofré (was: Yin Huai) > UDFRegistration Drops Input Type Information >

[jira] [Resolved] (SPARK-11908) Add NullType support to RowEncoder

2015-11-22 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11908. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9891 [http

[jira] [Commented] (SPARK-11909) Spark Standalone's master URL accepts URLs without port (assuming default 7077)

2015-11-22 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15021153#comment-15021153 ] Jacek Laskowski commented on SPARK-11909: - _"The default is not a well-known port

[jira] [Commented] (SPARK-11909) Spark Standalone's master URL accepts URLs without port (assuming default 7077)

2015-11-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15021167#comment-15021167 ] Sean Owen commented on SPARK-11909: --- I think that cuts the other way. You're helping pe

[jira] [Commented] (SPARK-4514) SparkContext localProperties does not inherit property updates across thread reuse

2015-11-22 Thread Richard W. Eggert II (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15021185#comment-15021185 ] Richard W. Eggert II commented on SPARK-4514: - The unit test attached to this

[jira] [Commented] (SPARK-11909) Spark Standalone's master URL accepts URLs without port (assuming default 7077)

2015-11-22 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15021186#comment-15021186 ] Jacek Laskowski commented on SPARK-11909: - What about a WARN message about the po

[jira] [Comment Edited] (SPARK-11909) Spark Standalone's master URL accepts URLs without port (assuming default 7077)

2015-11-22 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15021186#comment-15021186 ] Jacek Laskowski edited comment on SPARK-11909 at 11/22/15 8:51 PM:

[jira] [Comment Edited] (SPARK-4514) SparkContext localProperties does not inherit property updates across thread reuse

2015-11-22 Thread Richard W. Eggert II (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15021185#comment-15021185 ] Richard W. Eggert II edited comment on SPARK-4514 at 11/22/15 8:54 PM: -

[jira] [Commented] (SPARK-4514) SparkContext localProperties does not inherit property updates across thread reuse

2015-11-22 Thread Richard W. Eggert II (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15021187#comment-15021187 ] Richard W. Eggert II commented on SPARK-4514: - This test, however, still fails

[jira] [Commented] (SPARK-4514) SparkContext localProperties does not inherit property updates across thread reuse

2015-11-22 Thread Richard W. Eggert II (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15021194#comment-15021194 ] Richard W. Eggert II commented on SPARK-4514: - I implemented a two-line fix th

[jira] [Assigned] (SPARK-4514) SparkContext localProperties does not inherit property updates across thread reuse

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-4514: --- Assignee: Josh Rosen (was: Apache Spark) > SparkContext localProperties does not inherit pro

[jira] [Commented] (SPARK-4514) SparkContext localProperties does not inherit property updates across thread reuse

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15021199#comment-15021199 ] Apache Spark commented on SPARK-4514: - User 'reggert' has created a pull request for t

[jira] [Assigned] (SPARK-4514) SparkContext localProperties does not inherit property updates across thread reuse

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-4514: --- Assignee: Apache Spark (was: Josh Rosen) > SparkContext localProperties does not inherit pro

[jira] [Updated] (SPARK-7539) Perf tests for Python MLlib

2015-11-22 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7539: Component/s: Tests > Perf tests for Python MLlib > --- > >

[jira] [Commented] (SPARK-10538) java.lang.NegativeArraySizeException during join

2015-11-22 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-10538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15021219#comment-15021219 ] Maciej Bryński commented on SPARK-10538: [~davies] I did a tests on 1.6.0-preview

[jira] [Comment Edited] (SPARK-10538) java.lang.NegativeArraySizeException during join

2015-11-22 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-10538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15021219#comment-15021219 ] Maciej Bryński edited comment on SPARK-10538 at 11/22/15 10:20 PM:

[jira] [Closed] (SPARK-10538) java.lang.NegativeArraySizeException during join

2015-11-22 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-10538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński closed SPARK-10538. -- Resolution: Cannot Reproduce > java.lang.NegativeArraySizeException during join > -

[jira] [Assigned] (SPARK-11906) Speculation Tasks Cause ProgressBar UI Overflow

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11906: Assignee: Apache Spark > Speculation Tasks Cause ProgressBar UI Overflow > ---

[jira] [Commented] (SPARK-11906) Speculation Tasks Cause ProgressBar UI Overflow

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15021228#comment-15021228 ] Apache Spark commented on SPARK-11906: -- User 'saurfang' has created a pull request f

[jira] [Assigned] (SPARK-11906) Speculation Tasks Cause ProgressBar UI Overflow

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11906: Assignee: (was: Apache Spark) > Speculation Tasks Cause ProgressBar UI Overflow >

[jira] [Created] (SPARK-11911) spark-perf test for MultilayerPerceptron

2015-11-22 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-11911: - Summary: spark-perf test for MultilayerPerceptron Key: SPARK-11911 URL: https://issues.apache.org/jira/browse/SPARK-11911 Project: Spark Issue Type

[jira] [Updated] (SPARK-11600) Spark MLlib 1.6 QA umbrella

2015-11-22 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-11600: -- Description: This JIRA lists tasks for the next MLlib release's QA period. h2. API *

[jira] [Commented] (SPARK-11861) Feature importances for decision trees

2015-11-22 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15021297#comment-15021297 ] Joseph K. Bradley commented on SPARK-11861: --- Exposing the single-tree API for t

[jira] [Commented] (SPARK-11730) Feature Importance for GBT

2015-11-22 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15021301#comment-15021301 ] Joseph K. Bradley commented on SPARK-11730: --- I wrote that note since I did not

[jira] [Commented] (SPARK-10129) math function: stddev_samp

2015-11-22 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15021319#comment-15021319 ] Yin Huai commented on SPARK-10129: -- We have stddev_samp in agg functions. Should we reso

[jira] [Comment Edited] (SPARK-10129) math function: stddev_samp

2015-11-22 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15021319#comment-15021319 ] Yin Huai edited comment on SPARK-10129 at 11/23/15 1:16 AM: W

[jira] [Commented] (SPARK-11206) Support SQL UI on the history server

2015-11-22 Thread Carson Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15021363#comment-15021363 ] Carson Wang commented on SPARK-11206: - To support SQL UI on the history server: 1. I

[jira] [Updated] (SPARK-11604) ML 1.6 QA: API: Python API coverage

2015-11-22 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-11604: Description: For new public APIs added to MLlib, we need to check the generated HTML doc and compa

[jira] [Updated] (SPARK-11604) ML 1.6 QA: API: Python API coverage

2015-11-22 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-11604: Description: For new public APIs added to MLlib, we need to check the generated HTML doc and compa

[jira] [Updated] (SPARK-11604) ML 1.6 QA: API: Python API coverage

2015-11-22 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-11604: Description: For new public APIs added to MLlib, we need to check the generated HTML doc and compa

[jira] [Created] (SPARK-11912) ml.feature.PCA minor refactor

2015-11-22 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-11912: --- Summary: ml.feature.PCA minor refactor Key: SPARK-11912 URL: https://issues.apache.org/jira/browse/SPARK-11912 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-11912) ml.feature.PCA minor refactor

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11912: Assignee: Apache Spark > ml.feature.PCA minor refactor > - > >

[jira] [Assigned] (SPARK-11912) ml.feature.PCA minor refactor

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11912: Assignee: (was: Apache Spark) > ml.feature.PCA minor refactor > --

[jira] [Commented] (SPARK-11912) ml.feature.PCA minor refactor

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15021428#comment-15021428 ] Apache Spark commented on SPARK-11912: -- User 'yanboliang' has created a pull request

[jira] [Updated] (SPARK-11912) ml.feature.PCA minor refactor

2015-11-22 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-11912: Description: Like SPARK-11852, k is params and we should save it under metadata/ rather than both u

[jira] [Updated] (SPARK-11912) ml.feature.PCA minor refactor

2015-11-22 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-11912: Description: Like SPARK-11852, k is params and we should save it under metadata/ rather than both u

[jira] [Created] (SPARK-11913) support typed aggregate for complex buffer schema

2015-11-22 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-11913: --- Summary: support typed aggregate for complex buffer schema Key: SPARK-11913 URL: https://issues.apache.org/jira/browse/SPARK-11913 Project: Spark Issue Type: S

[jira] [Assigned] (SPARK-11913) support typed aggregate for complex buffer schema

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11913: Assignee: Apache Spark > support typed aggregate for complex buffer schema > -

[jira] [Assigned] (SPARK-11913) support typed aggregate for complex buffer schema

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11913: Assignee: (was: Apache Spark) > support typed aggregate for complex buffer schema > --

[jira] [Commented] (SPARK-11913) support typed aggregate for complex buffer schema

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15021454#comment-15021454 ] Apache Spark commented on SPARK-11913: -- User 'cloud-fan' has created a pull request

[jira] [Created] (SPARK-11914) [SQL] Support coalesce and repartition in Dataset APIs

2015-11-22 Thread Xiao Li (JIRA)
Xiao Li created SPARK-11914: --- Summary: [SQL] Support coalesce and repartition in Dataset APIs Key: SPARK-11914 URL: https://issues.apache.org/jira/browse/SPARK-11914 Project: Spark Issue Type: Impr

[jira] [Assigned] (SPARK-11914) [SQL] Support coalesce and repartition in Dataset APIs

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11914: Assignee: (was: Apache Spark) > [SQL] Support coalesce and repartition in Dataset APIs

[jira] [Assigned] (SPARK-11914) [SQL] Support coalesce and repartition in Dataset APIs

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11914: Assignee: Apache Spark > [SQL] Support coalesce and repartition in Dataset APIs >

[jira] [Commented] (SPARK-11914) [SQL] Support coalesce and repartition in Dataset APIs

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15021478#comment-15021478 ] Apache Spark commented on SPARK-11914: -- User 'gatorsmile' has created a pull request

[jira] [Created] (SPARK-11915) Fix flaky python test pyspark.sql.group

2015-11-22 Thread Liang-Chi Hsieh (JIRA)
Liang-Chi Hsieh created SPARK-11915: --- Summary: Fix flaky python test pyspark.sql.group Key: SPARK-11915 URL: https://issues.apache.org/jira/browse/SPARK-11915 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-11915) Fix flaky python test pyspark.sql.group

2015-11-22 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh updated SPARK-11915: Description: The python test pyspark.sql.group will fail due to items' order in returned a

[jira] [Assigned] (SPARK-11915) Fix flaky python test pyspark.sql.group

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11915: Assignee: Apache Spark > Fix flaky python test pyspark.sql.group > ---

[jira] [Commented] (SPARK-11915) Fix flaky python test pyspark.sql.group

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15021498#comment-15021498 ] Apache Spark commented on SPARK-11915: -- User 'viirya' has created a pull request for

[jira] [Assigned] (SPARK-11915) Fix flaky python test pyspark.sql.group

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11915: Assignee: (was: Apache Spark) > Fix flaky python test pyspark.sql.group >

[jira] [Commented] (SPARK-9506) DataFrames Postgresql JDBC unable to support most of the Postgresql's Data Type

2015-11-22 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15021499#comment-15021499 ] Wenchen Fan commented on SPARK-9506: I think it's not a workaround, but the right thin

[jira] [Commented] (SPARK-9506) DataFrames Postgresql JDBC unable to support most of the Postgresql's Data Type

2015-11-22 Thread Marius Van Niekerk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15021500#comment-15021500 ] Marius Van Niekerk commented on SPARK-9506: --- Quite a few more additional types a

[jira] [Commented] (SPARK-11619) cannot use UDTF in DataFrame.selectExpr

2015-11-22 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15021509#comment-15021509 ] Wenchen Fan commented on SPARK-11619: - Actually this line: https://github.com/apache

[jira] [Commented] (SPARK-11903) Deprecate make-distribution.sh --skip-java-test

2015-11-22 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15021511#comment-15021511 ] Patrick Wendell commented on SPARK-11903: - I think it's simply dead code. SKIP_JA

[jira] [Comment Edited] (SPARK-11903) Deprecate make-distribution.sh --skip-java-test

2015-11-22 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15021511#comment-15021511 ] Patrick Wendell edited comment on SPARK-11903 at 11/23/15 4:29 AM:

[jira] [Commented] (SPARK-2336) Approximate k-NN Models for MLLib

2015-11-22 Thread Sen Fang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15021527#comment-15021527 ] Sen Fang commented on SPARK-2336: - I finally took a crack on the hybrid spill tree for kNN

[jira] [Commented] (SPARK-11757) Incorrect join output for joining two dataframes loaded from Parquet format

2015-11-22 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15021534#comment-15021534 ] Jeff Zhang commented on SPARK-11757: I tried it on master, seems this issue has been

[jira] [Assigned] (SPARK-11860) Invalid argument specification for registerFunction [Python]

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11860: Assignee: Apache Spark > Invalid argument specification for registerFunction [Python] > --

[jira] [Commented] (SPARK-11860) Invalid argument specification for registerFunction [Python]

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15021545#comment-15021545 ] Apache Spark commented on SPARK-11860: -- User 'zjffdu' has created a pull request for

[jira] [Assigned] (SPARK-11860) Invalid argument specification for registerFunction [Python]

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11860: Assignee: (was: Apache Spark) > Invalid argument specification for registerFunction [P

[jira] [Resolved] (SPARK-11895) Rename and possibly update DatasetExample in mllib/examples

2015-11-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-11895. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9873 [https://gi

[jira] [Resolved] (SPARK-6791) Model export/import for spark.ml: CrossValidator

2015-11-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-6791. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9848 [https://githu

[jira] [Resolved] (SPARK-11835) Add a menu to the documentation of MLlib

2015-11-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-11835. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9826 [https://gi

[jira] [Updated] (SPARK-11912) ml.feature.PCA minor refactor

2015-11-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11912: -- Target Version/s: 1.6.0 > ml.feature.PCA minor refactor > - > >

[jira] [Resolved] (SPARK-11912) ml.feature.PCA minor refactor

2015-11-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-11912. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9897 [https://gi

[jira] [Updated] (SPARK-11912) ml.feature.PCA minor refactor

2015-11-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11912: -- Assignee: Yanbo Liang > ml.feature.PCA minor refactor > - > >

[jira] [Updated] (SPARK-11902) Unhandled case in VectorAssembler#transform

2015-11-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11902: -- Assignee: Benjamin Fradet > Unhandled case in VectorAssembler#transform > -

[jira] [Resolved] (SPARK-11902) Unhandled case in VectorAssembler#transform

2015-11-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-11902. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9885 [https://gi

[jira] [Updated] (SPARK-11902) Unhandled case in VectorAssembler#transform

2015-11-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11902: -- Target Version/s: 1.6.0 > Unhandled case in VectorAssembler#transform > ---

[jira] [Created] (SPARK-11916) Expression TRIM/LTRIM/RTRIM to support specific trim word

2015-11-22 Thread Adrian Wang (JIRA)
Adrian Wang created SPARK-11916: --- Summary: Expression TRIM/LTRIM/RTRIM to support specific trim word Key: SPARK-11916 URL: https://issues.apache.org/jira/browse/SPARK-11916 Project: Spark Issue

[jira] [Commented] (SPARK-11916) Expression TRIM/LTRIM/RTRIM to support specific trim word

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15021606#comment-15021606 ] Apache Spark commented on SPARK-11916: -- User 'adrian-wang' has created a pull reques

[jira] [Assigned] (SPARK-11916) Expression TRIM/LTRIM/RTRIM to support specific trim word

2015-11-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11916: Assignee: (was: Apache Spark) > Expression TRIM/LTRIM/RTRIM to support specific trim w

  1   2   >