[jira] [Commented] (SPARK-16921) RDD/DataFrame persist() and cache() should return Python context managers

[ https://issues.apache.org/jira/browse/SPARK-16921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15414840#comment-15414840 ] Nick Pentreath commented on SPARK-16921: By the way for BC vars, I wonder if {{__

[jira] [Created] (SPARK-16991) Full outer join followed by inner join produces wrong results

Jonas Jarutis created SPARK-16991: - Summary: Full outer join followed by inner join produces wrong results Key: SPARK-16991 URL: https://issues.apache.org/jira/browse/SPARK-16991 Project: Spark

[jira] [Commented] (SPARK-4119) Don't rely on HIVE_DEV_HOME to find .q files

[ https://issues.apache.org/jira/browse/SPARK-4119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15414848#comment-15414848 ] Apache Spark commented on SPARK-4119: - User 'dongjoon-hyun' has created a pull request

[jira] [Assigned] (SPARK-4119) Don't rely on HIVE_DEV_HOME to find .q files

[ https://issues.apache.org/jira/browse/SPARK-4119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-4119: --- Assignee: Cheng Lian (was: Apache Spark) > Don't rely on HIVE_DEV_HOME to find .q files > --

[jira] [Assigned] (SPARK-4119) Don't rely on HIVE_DEV_HOME to find .q files

[ https://issues.apache.org/jira/browse/SPARK-4119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-4119: --- Assignee: Apache Spark (was: Cheng Lian) > Don't rely on HIVE_DEV_HOME to find .q files > --

[jira] [Closed] (SPARK-4119) Don't rely on HIVE_DEV_HOME to find .q files

[ https://issues.apache.org/jira/browse/SPARK-4119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-4119. -- Resolution: Not A Problem > Don't rely on HIVE_DEV_HOME to find .q files > -

[jira] [Commented] (SPARK-4119) Don't rely on HIVE_DEV_HOME to find .q files

[ https://issues.apache.org/jira/browse/SPARK-4119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15414870#comment-15414870 ] Dongjoon Hyun commented on SPARK-4119: -- Thank you, @rxin. > Don't rely on HIVE_DEV_H

[jira] [Resolved] (SPARK-16959) Table Comment in the CatalogTable returned from HiveMetastore is Always Empty

[ https://issues.apache.org/jira/browse/SPARK-16959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-16959. - Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 14550 [https://githu

[jira] [Updated] (SPARK-16959) Table Comment in the CatalogTable returned from HiveMetastore is Always Empty

[ https://issues.apache.org/jira/browse/SPARK-16959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-16959: Assignee: Xiao Li > Table Comment in the CatalogTable returned from HiveMetastore is Always Empty >

[jira] [Resolved] (SPARK-10601) Spark SQL - Support for MINUS

[ https://issues.apache.org/jira/browse/SPARK-10601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-10601. --- Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 2.1.0 > Spar

[jira] [Commented] (SPARK-16991) Full outer join followed by inner join produces wrong results

[ https://issues.apache.org/jira/browse/SPARK-16991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15414922#comment-15414922 ] Dongjoon Hyun commented on SPARK-16991: --- Hi, [~jjarutis]. Thank you for reproducibl

[jira] [Assigned] (SPARK-16921) RDD/DataFrame persist() and cache() should return Python context managers

[ https://issues.apache.org/jira/browse/SPARK-16921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16921: Assignee: Apache Spark > RDD/DataFrame persist() and cache() should return Python context

[jira] [Commented] (SPARK-16921) RDD/DataFrame persist() and cache() should return Python context managers

[ https://issues.apache.org/jira/browse/SPARK-16921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15414934#comment-15414934 ] Apache Spark commented on SPARK-16921: -- User 'MLnick' has created a pull request for

[jira] [Assigned] (SPARK-16921) RDD/DataFrame persist() and cache() should return Python context managers

[ https://issues.apache.org/jira/browse/SPARK-16921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16921: Assignee: (was: Apache Spark) > RDD/DataFrame persist() and cache() should return Pyth

[jira] [Created] (SPARK-16992) Pep8 code style

Semet created SPARK-16992: - Summary: Pep8 code style Key: SPARK-16992 URL: https://issues.apache.org/jira/browse/SPARK-16992 Project: Spark Issue Type: Improvement Reporter: Semet Add c

[jira] [Resolved] (SPARK-16522) [MESOS] Spark application throws exception on exit

[ https://issues.apache.org/jira/browse/SPARK-16522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16522. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 14575 [https://github.co

[jira] [Updated] (SPARK-16990) Define the data structure to hold the statistics for CBO

[ https://issues.apache.org/jira/browse/SPARK-16990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16990: -- Target Version/s: (was: 2.1.0) Fix Version/s: (was: 2.1.0) [~ron8hu] please read https://

[jira] [Resolved] (SPARK-16185) Unresolved Operator When Creating Table As Select Without Enabling Hive Support

[ https://issues.apache.org/jira/browse/SPARK-16185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-16185. - Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 13886 [https://githu

[jira] [Updated] (SPARK-16185) Unresolved Operator When Creating Table As Select Without Enabling Hive Support

[ https://issues.apache.org/jira/browse/SPARK-16185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-16185: Assignee: Xiao Li > Unresolved Operator When Creating Table As Select Without Enabling Hive > Supp

[jira] [Updated] (SPARK-6685) Use DSYRK to compute AtA in ALS

[ https://issues.apache.org/jira/browse/SPARK-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-6685: --- Shepherd: Yanbo Liang > Use DSYRK to compute AtA in ALS > --- > >

[jira] [Resolved] (SPARK-16927) Mesos Cluster Dispatcher default properties

[ https://issues.apache.org/jira/browse/SPARK-16927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16927. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 14511 [https://github.co

[jira] [Resolved] (SPARK-16923) Mesos cluster scheduler duplicates config vars by setting them in the environment and as --conf

[ https://issues.apache.org/jira/browse/SPARK-16923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16923. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 14511 https://github.com

[jira] [Resolved] (SPARK-16324) regexp_extract should doc that it returns empty string when match fails

[ https://issues.apache.org/jira/browse/SPARK-16324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16324. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue resolved by pull request

[jira] [Assigned] (SPARK-16324) regexp_extract should doc that it returns empty string when match fails

[ https://issues.apache.org/jira/browse/SPARK-16324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-16324: - Assignee: Sean Owen > regexp_extract should doc that it returns empty string when match fails >

[jira] [Updated] (SPARK-16324) regexp_extract should doc that it returns empty string when match fails

[ https://issues.apache.org/jira/browse/SPARK-16324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16324: -- Component/s: SQL > regexp_extract should doc that it returns empty string when match fails > --

[jira] [Resolved] (SPARK-16866) Basic infrastructure for file-based SQL end-to-end tests

[ https://issues.apache.org/jira/browse/SPARK-16866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-16866. - Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 14472 [https://githu

[jira] [Updated] (SPARK-16866) Basic infrastructure for file-based SQL end-to-end tests

[ https://issues.apache.org/jira/browse/SPARK-16866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-16866: Assignee: Peter Lee > Basic infrastructure for file-based SQL end-to-end tests > --

[jira] [Updated] (SPARK-16987) Add spark-default.conf property to define https port for spark history server

[ https://issues.apache.org/jira/browse/SPARK-16987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16987: -- Priority: Minor (was: Major) Issue Type: Improvement (was: Bug) > Add spark-default.conf proper

[jira] [Commented] (SPARK-16992) Pep8 code style

[ https://issues.apache.org/jira/browse/SPARK-16992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15415005#comment-15415005 ] Sean Owen commented on SPARK-16992: --- I generally agree with this for parity with scala/

[jira] [Updated] (SPARK-16988) spark history server log needs to be fixed to show https url when ssl is enabled

[ https://issues.apache.org/jira/browse/SPARK-16988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16988: -- Priority: Minor (was: Major) Component/s: Web UI > spark history server log needs to be fixed t

[jira] [Updated] (SPARK-16988) spark history server log needs to be fixed to show https url when ssl is enabled

[ https://issues.apache.org/jira/browse/SPARK-16988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16988: -- Component/s: (was: Web UI) Spark Shell > spark history server log needs to be fixe

[jira] [Created] (SPARK-16993) model.transform withot label column

Dulaj Rajitha created SPARK-16993: - Summary: model.transform withot label column Key: SPARK-16993 URL: https://issues.apache.org/jira/browse/SPARK-16993 Project: Spark Issue Type: Question

[jira] [Updated] (SPARK-16993) model.transform without label column in random forest regression

[ https://issues.apache.org/jira/browse/SPARK-16993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dulaj Rajitha updated SPARK-16993: -- Summary: model.transform without label column in random forest regression (was: model.transfor

[jira] [Updated] (SPARK-16993) model.transform without label column in random forest regression

[ https://issues.apache.org/jira/browse/SPARK-16993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dulaj Rajitha updated SPARK-16993: -- Description: I need to use a separate data set to prediction (Not as show in example's trainin

[jira] [Commented] (SPARK-16991) Full outer join followed by inner join produces wrong results

[ https://issues.apache.org/jira/browse/SPARK-16991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15415038#comment-15415038 ] Apache Spark commented on SPARK-16991: -- User 'dongjoon-hyun' has created a pull requ

[jira] [Assigned] (SPARK-16991) Full outer join followed by inner join produces wrong results

[ https://issues.apache.org/jira/browse/SPARK-16991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16991: Assignee: Apache Spark > Full outer join followed by inner join produces wrong results > -

[jira] [Assigned] (SPARK-16991) Full outer join followed by inner join produces wrong results

[ https://issues.apache.org/jira/browse/SPARK-16991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16991: Assignee: (was: Apache Spark) > Full outer join followed by inner join produces wrong

[jira] [Created] (SPARK-16994) Filter and limit are illegally permuted.

TobiasP created SPARK-16994: --- Summary: Filter and limit are illegally permuted. Key: SPARK-16994 URL: https://issues.apache.org/jira/browse/SPARK-16994 Project: Spark Issue Type: Bug Comp

[jira] [Commented] (SPARK-16993) model.transform without label column in random forest regression

[ https://issues.apache.org/jira/browse/SPARK-16993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15415050#comment-15415050 ] Sean Owen commented on SPARK-16993: --- Questions should go to user@. Can you clarify? whe

[jira] [Commented] (SPARK-16993) model.transform without label column in random forest regression

[ https://issues.apache.org/jira/browse/SPARK-16993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15415063#comment-15415063 ] Dulaj Rajitha commented on SPARK-16993: --- When using the RandomForestRegressor. I tr

[jira] [Commented] (SPARK-16993) model.transform without label column in random forest regression

[ https://issues.apache.org/jira/browse/SPARK-16993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15415070#comment-15415070 ] Sean Owen commented on SPARK-16993: --- You certainly need labels in your held out test se

[jira] [Commented] (SPARK-16993) model.transform without label column in random forest regression

[ https://issues.apache.org/jira/browse/SPARK-16993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15415081#comment-15415081 ] Dulaj Rajitha commented on SPARK-16993: --- I do not want to evaluate. I just need to

[jira] [Commented] (SPARK-16993) model.transform without label column in random forest regression

[ https://issues.apache.org/jira/browse/SPARK-16993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15415102#comment-15415102 ] Dulaj Rajitha commented on SPARK-16993: --- Is there a method to use do the prediction

[jira] [Commented] (SPARK-15044) spark-sql will throw "input path does not exist" exception if it handles a partition which exists in hive table, but the path is removed manually

[ https://issues.apache.org/jira/browse/SPARK-15044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15415118#comment-15415118 ] Artur commented on SPARK-15044: --- So if some Hive metadata is incorrect - we will always get

[jira] [Assigned] (SPARK-16992) Pep8 code style

[ https://issues.apache.org/jira/browse/SPARK-16992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16992: Assignee: (was: Apache Spark) > Pep8 code style > --- > >

[jira] [Commented] (SPARK-16992) Pep8 code style

[ https://issues.apache.org/jira/browse/SPARK-16992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15415123#comment-15415123 ] Apache Spark commented on SPARK-16992: -- User 'Stibbons' has created a pull request f

[jira] [Assigned] (SPARK-16992) Pep8 code style

[ https://issues.apache.org/jira/browse/SPARK-16992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16992: Assignee: Apache Spark > Pep8 code style > --- > > Key: SPARK-

[jira] [Commented] (SPARK-16992) Pep8 code style

[ https://issues.apache.org/jira/browse/SPARK-16992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15415127#comment-15415127 ] Semet commented on SPARK-16992: --- For the import statement ordering, this helped us a lot to

[jira] [Updated] (SPARK-16992) Pep8 code style

[ https://issues.apache.org/jira/browse/SPARK-16992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Semet updated SPARK-16992: -- Description: Add code style checks and auto formating into the Python code. Features: - add a {{.editconfig}}

[jira] [Comment Edited] (SPARK-16992) Pep8 code style

[ https://issues.apache.org/jira/browse/SPARK-16992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15415127#comment-15415127 ] Semet edited comment on SPARK-16992 at 8/10/16 11:15 AM: - For the

[jira] [Assigned] (SPARK-16367) Wheelhouse Support for PySpark

[ https://issues.apache.org/jira/browse/SPARK-16367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16367: Assignee: Apache Spark > Wheelhouse Support for PySpark > -- >

[jira] [Assigned] (SPARK-16367) Wheelhouse Support for PySpark

[ https://issues.apache.org/jira/browse/SPARK-16367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16367: Assignee: (was: Apache Spark) > Wheelhouse Support for PySpark > -

[jira] [Commented] (SPARK-12370) Documentation should link to examples from its own release version

[ https://issues.apache.org/jira/browse/SPARK-12370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15415178#comment-15415178 ] Jagadeesan A S commented on SPARK-12370: [~srowen] Can i take it up this JIRA..?

[jira] [Commented] (SPARK-12844) Spark documentation should be more precise about the algebraic properties of functions in various transformations

[ https://issues.apache.org/jira/browse/SPARK-12844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15415194#comment-15415194 ] Jagadeesan A S commented on SPARK-12844: Started working on this. > Spark docume

[jira] [Commented] (SPARK-12370) Documentation should link to examples from its own release version

[ https://issues.apache.org/jira/browse/SPARK-12370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15415200#comment-15415200 ] Sean Owen commented on SPARK-12370: --- The docs build does define a variable that indicat

[jira] [Created] (SPARK-16995) TreeNodeException when flat mapping RelationalGroupedDataset created from DataFrame containing a column created with lit/expr

Cédric Perriard created SPARK-16995: --- Summary: TreeNodeException when flat mapping RelationalGroupedDataset created from DataFrame containing a column created with lit/expr Key: SPARK-16995 URL: https://issues.

[jira] [Commented] (SPARK-16993) model.transform without label column in random forest regression

[ https://issues.apache.org/jira/browse/SPARK-16993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15415222#comment-15415222 ] Sean Owen commented on SPARK-16993: --- You need a label for training and evaluation. You

[jira] [Resolved] (SPARK-15899) file scheme should be used correctly

[ https://issues.apache.org/jira/browse/SPARK-15899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-15899. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Resolved by https://github.com

[jira] [Updated] (SPARK-16995) TreeNodeException when flat mapping RelationalGroupedDataset created from DataFrame containing a column created with lit/expr

[ https://issues.apache.org/jira/browse/SPARK-16995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cédric Perriard updated SPARK-16995: Description: A TreeNodeException is thrown when executing the following minimal example in

[jira] [Commented] (SPARK-16995) TreeNodeException when flat mapping RelationalGroupedDataset created from DataFrame containing a column created with lit/expr

[ https://issues.apache.org/jira/browse/SPARK-16995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15415243#comment-15415243 ] Sean Owen commented on SPARK-16995: --- You haven't shown the exception -- this is typical

[jira] [Updated] (SPARK-16989) fileSystem.getFileStatus throw exception in EventLoggingListener

[ https://issues.apache.org/jira/browse/SPARK-16989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16989: -- Priority: Minor (was: Major) Issue Type: Improvement (was: Bug) If the user specifies a log dir

[jira] [Updated] (SPARK-16995) TreeNodeException when flat mapping RelationalGroupedDataset created from DataFrame containing a column created with lit/expr

[ https://issues.apache.org/jira/browse/SPARK-16995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cédric Perriard updated SPARK-16995: Description: A TreeNodeException is thrown when executing the following minimal example in

[jira] [Commented] (SPARK-16995) TreeNodeException when flat mapping RelationalGroupedDataset created from DataFrame containing a column created with lit/expr

[ https://issues.apache.org/jira/browse/SPARK-16995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15415265#comment-15415265 ] Cédric Perriard commented on SPARK-16995: - I added it to the description. Should

[jira] [Created] (SPARK-16996) Hive ACID delta files not seen

Benjamin BONNET created SPARK-16996: --- Summary: Hive ACID delta files not seen Key: SPARK-16996 URL: https://issues.apache.org/jira/browse/SPARK-16996 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-16996) Hive ACID delta files not seen

[ https://issues.apache.org/jira/browse/SPARK-16996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15415279#comment-15415279 ] Sean Owen commented on SPARK-16996: --- I am not sure if this is supported, given the vers

[jira] [Commented] (SPARK-16949) Add lower/uppper bounds for AUC calculation

[ https://issues.apache.org/jira/browse/SPARK-16949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15415329#comment-15415329 ] Patrick Baier commented on SPARK-16949: --- Okay, maybe this should be really solved i

[jira] [Closed] (SPARK-16949) Add lower/uppper bounds for AUC calculation

[ https://issues.apache.org/jira/browse/SPARK-16949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Baier closed SPARK-16949. - Resolution: Won't Fix > Add lower/uppper bounds for AUC calculation > ---

[jira] [Commented] (SPARK-16951) Alternative implementation of NOT IN to Anti-join

[ https://issues.apache.org/jira/browse/SPARK-16951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15415340#comment-15415340 ] Nattavut Sutyanyong commented on SPARK-16951: - I think I will make this the l

[jira] [Comment Edited] (SPARK-16951) Alternative implementation of NOT IN to Anti-join

[ https://issues.apache.org/jira/browse/SPARK-16951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15415340#comment-15415340 ] Nattavut Sutyanyong edited comment on SPARK-16951 at 8/10/16 2:23 PM: -

[jira] [Commented] (SPARK-15882) Discuss distributed linear algebra in spark.ml package

[ https://issues.apache.org/jira/browse/SPARK-15882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15415345#comment-15415345 ] Yanbo Liang commented on SPARK-15882: - I think we should make this migration finished

[jira] [Commented] (SPARK-16951) Alternative implementation of NOT IN to Anti-join

[ https://issues.apache.org/jira/browse/SPARK-16951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15415350#comment-15415350 ] Nattavut Sutyanyong commented on SPARK-16951: - On the incorrect result in Cas

[jira] [Created] (SPARK-16997) Allow loading of JSON float values as TimestampType

Lukas Lalinsky created SPARK-16997: -- Summary: Allow loading of JSON float values as TimestampType Key: SPARK-16997 URL: https://issues.apache.org/jira/browse/SPARK-16997 Project: Spark Issue

[jira] [Commented] (SPARK-16997) Allow loading of JSON float values as TimestampType

[ https://issues.apache.org/jira/browse/SPARK-16997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15415373#comment-15415373 ] Apache Spark commented on SPARK-16997: -- User 'lalinsky' has created a pull request f

[jira] [Assigned] (SPARK-16997) Allow loading of JSON float values as TimestampType

[ https://issues.apache.org/jira/browse/SPARK-16997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16997: Assignee: Apache Spark > Allow loading of JSON float values as TimestampType > ---

[jira] [Assigned] (SPARK-16997) Allow loading of JSON float values as TimestampType

[ https://issues.apache.org/jira/browse/SPARK-16997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16997: Assignee: (was: Apache Spark) > Allow loading of JSON float values as TimestampType >

[jira] [Updated] (SPARK-15899) file scheme should be used correctly

[ https://issues.apache.org/jira/browse/SPARK-15899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-15899: -- Fix Version/s: (was: 2.0.1) > file scheme should be used correctly > --

[jira] [Commented] (SPARK-16929) Speculation-related synchronization bottleneck in checkSpeculatableTasks

[ https://issues.apache.org/jira/browse/SPARK-16929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15415490#comment-15415490 ] Nicholas Brown commented on SPARK-16929: One other thing, after looking at the co

[jira] [Created] (SPARK-16998) select($"column1", explode($"column2")) is extremely slow

TobiasP created SPARK-16998: --- Summary: select($"column1", explode($"column2")) is extremely slow Key: SPARK-16998 URL: https://issues.apache.org/jira/browse/SPARK-16998 Project: Spark Issue Type: B

[jira] [Commented] (SPARK-16994) Filter and limit are illegally permuted.

[ https://issues.apache.org/jira/browse/SPARK-16994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15415569#comment-15415569 ] Dongjoon Hyun commented on SPARK-16994: --- Hi, [~TPolzer]. Indeed, it is. `PushDownPr

[jira] [Resolved] (SPARK-15639) Try to push down filter at RowGroups level for parquet reader

[ https://issues.apache.org/jira/browse/SPARK-15639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-15639. Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Target Version/s

[jira] [Comment Edited] (SPARK-15639) Try to push down filter at RowGroups level for parquet reader

[ https://issues.apache.org/jira/browse/SPARK-15639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15415591#comment-15415591 ] Davies Liu edited comment on SPARK-15639 at 8/10/16 5:07 PM: -

[jira] [Assigned] (SPARK-16994) Filter and limit are illegally permuted.

[ https://issues.apache.org/jira/browse/SPARK-16994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16994: Assignee: (was: Apache Spark) > Filter and limit are illegally permuted. > ---

[jira] [Assigned] (SPARK-16994) Filter and limit are illegally permuted.

[ https://issues.apache.org/jira/browse/SPARK-16994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16994: Assignee: Apache Spark > Filter and limit are illegally permuted. > --

[jira] [Commented] (SPARK-16994) Filter and limit are illegally permuted.

[ https://issues.apache.org/jira/browse/SPARK-16994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15415605#comment-15415605 ] Apache Spark commented on SPARK-16994: -- User 'dongjoon-hyun' has created a pull requ

[jira] [Resolved] (SPARK-16710) SparkR spark.glm should support weightCol

[ https://issues.apache.org/jira/browse/SPARK-16710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-16710. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request

[jira] [Updated] (SPARK-16962) Unsafe accesses (Platform.getLong()) not supported on unaligned boundaries in SPARC/Solaris

[ https://issues.apache.org/jira/browse/SPARK-16962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suman Somasundar updated SPARK-16962: - Component/s: SQL Spark Core > Unsafe accesses (Platform.getLong()) not s

[jira] [Created] (SPARK-16999) Convert Keyword `path` of Data Source Tables to Lower Case

Xiao Li created SPARK-16999: --- Summary: Convert Keyword `path` of Data Source Tables to Lower Case Key: SPARK-16999 URL: https://issues.apache.org/jira/browse/SPARK-16999 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-16999) Convert Keyword `path` of Data Source Tables to Lower Case

[ https://issues.apache.org/jira/browse/SPARK-16999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16999: Assignee: (was: Apache Spark) > Convert Keyword `path` of Data Source Tables to Lower

[jira] [Commented] (SPARK-16999) Convert Keyword `path` of Data Source Tables to Lower Case

[ https://issues.apache.org/jira/browse/SPARK-16999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15415689#comment-15415689 ] Apache Spark commented on SPARK-16999: -- User 'gatorsmile' has created a pull request

[jira] [Commented] (SPARK-16802) joins.LongToUnsafeRowMap crashes with ArrayIndexOutOfBoundsException

[ https://issues.apache.org/jira/browse/SPARK-16802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15415698#comment-15415698 ] Miao Wang commented on SPARK-16802: --- Sorry for missing your comments. My email box does

[jira] [Assigned] (SPARK-16999) Convert Keyword `path` of Data Source Tables to Lower Case

[ https://issues.apache.org/jira/browse/SPARK-16999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16999: Assignee: Apache Spark > Convert Keyword `path` of Data Source Tables to Lower Case >

[jira] [Commented] (SPARK-14887) Generated SpecificUnsafeProjection Exceeds JVM Code Size Limits

[ https://issues.apache.org/jira/browse/SPARK-14887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15415710#comment-15415710 ] Davies Liu commented on SPARK-14887: Do you have a large CaseWhen in this query? > G

[jira] [Resolved] (SPARK-16579) Add a spark install function

[ https://issues.apache.org/jira/browse/SPARK-16579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-16579. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue

[jira] [Created] (SPARK-17000) Spark cannot connect to secure metastore when using custom metastore jars

Marcelo Vanzin created SPARK-17000: -- Summary: Spark cannot connect to secure metastore when using custom metastore jars Key: SPARK-17000 URL: https://issues.apache.org/jira/browse/SPARK-17000 Project

[jira] [Resolved] (SPARK-17000) Spark cannot connect to secure metastore when using custom metastore jars

[ https://issues.apache.org/jira/browse/SPARK-17000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-17000. Resolution: Duplicate My bad, duplicate. > Spark cannot connect to secure metastore when u

[jira] [Commented] (SPARK-16975) Spark-2.0.0 unable to infer schema for parquet data written by Spark-1.6.2

[ https://issues.apache.org/jira/browse/SPARK-16975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15415823#comment-15415823 ] Reynold Xin commented on SPARK-16975: - cc [~dongjoon] do you have time to look into t

[jira] [Commented] (SPARK-16975) Spark-2.0.0 unable to infer schema for parquet data written by Spark-1.6.2

[ https://issues.apache.org/jira/browse/SPARK-16975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15415831#comment-15415831 ] Dongjoon Hyun commented on SPARK-16975: --- Oh, sure. It's my pleasure. I'll take a lo

[jira] [Commented] (SPARK-16975) Spark-2.0.0 unable to infer schema for parquet data written by Spark-1.6.2

[ https://issues.apache.org/jira/browse/SPARK-16975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15415833#comment-15415833 ] Dongjoon Hyun commented on SPARK-16975: --- Thank you for pinging me. > Spark-2.0.0 u

[jira] [Created] (SPARK-17001) Enable standardScaler to standardize sparse vectors when withMean=True

Tobi Bosede created SPARK-17001: --- Summary: Enable standardScaler to standardize sparse vectors when withMean=True Key: SPARK-17001 URL: https://issues.apache.org/jira/browse/SPARK-17001 Project: Spark

[jira] [Commented] (SPARK-16975) Spark-2.0.0 unable to infer schema for parquet data written by Spark-1.6.2

[ https://issues.apache.org/jira/browse/SPARK-16975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15415903#comment-15415903 ] Dongjoon Hyun commented on SPARK-16975: --- Hi, [~immerrr]. I can not reproduce your s

  1   2   3   >