[jira] [Created] (SPARK-17662) Dedup UDAF

Ohad Raviv created SPARK-17662: -- Summary: Dedup UDAF Key: SPARK-17662 URL: https://issues.apache.org/jira/browse/SPARK-17662 Project: Spark Issue Type: New Feature Reporter: Ohad Rav

[jira] [Assigned] (SPARK-17661) Consolidate various listLeafFiles implementations

[ https://issues.apache.org/jira/browse/SPARK-17661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17661: Assignee: (was: Apache Spark) > Consolidate various listLeafFiles implementations > --

[jira] [Commented] (SPARK-17661) Consolidate various listLeafFiles implementations

[ https://issues.apache.org/jira/browse/SPARK-17661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15520314#comment-15520314 ] Apache Spark commented on SPARK-17661: -- User 'petermaxlee' has created a pull reques

[jira] [Assigned] (SPARK-17661) Consolidate various listLeafFiles implementations

[ https://issues.apache.org/jira/browse/SPARK-17661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17661: Assignee: Apache Spark > Consolidate various listLeafFiles implementations > -

[jira] [Created] (SPARK-17661) Consolidate various listLeafFiles implementations

Peter Lee created SPARK-17661: - Summary: Consolidate various listLeafFiles implementations Key: SPARK-17661 URL: https://issues.apache.org/jira/browse/SPARK-17661 Project: Spark Issue Type: Impro

[jira] [Assigned] (SPARK-17660) DESC FORMATTED for VIEW Lacks View Definition

[ https://issues.apache.org/jira/browse/SPARK-17660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17660: Assignee: (was: Apache Spark) > DESC FORMATTED for VIEW Lacks View Definition > --

[jira] [Assigned] (SPARK-17660) DESC FORMATTED for VIEW Lacks View Definition

[ https://issues.apache.org/jira/browse/SPARK-17660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17660: Assignee: Apache Spark > DESC FORMATTED for VIEW Lacks View Definition > -

[jira] [Commented] (SPARK-17660) DESC FORMATTED for VIEW Lacks View Definition

[ https://issues.apache.org/jira/browse/SPARK-17660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15520189#comment-15520189 ] Apache Spark commented on SPARK-17660: -- User 'gatorsmile' has created a pull request

[jira] [Created] (SPARK-17660) DESC FORMATTED for VIEW Lacks View Definition

Xiao Li created SPARK-17660: --- Summary: DESC FORMATTED for VIEW Lacks View Definition Key: SPARK-17660 URL: https://issues.apache.org/jira/browse/SPARK-17660 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-17659) Partitioned View is Not Supported In SHOW CREATE TABLE

[ https://issues.apache.org/jira/browse/SPARK-17659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15520095#comment-15520095 ] Apache Spark commented on SPARK-17659: -- User 'gatorsmile' has created a pull request

[jira] [Assigned] (SPARK-17659) Partitioned View is Not Supported In SHOW CREATE TABLE

[ https://issues.apache.org/jira/browse/SPARK-17659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17659: Assignee: Apache Spark > Partitioned View is Not Supported In SHOW CREATE TABLE >

[jira] [Assigned] (SPARK-17659) Partitioned View is Not Supported In SHOW CREATE TABLE

[ https://issues.apache.org/jira/browse/SPARK-17659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17659: Assignee: (was: Apache Spark) > Partitioned View is Not Supported In SHOW CREATE TABLE

[jira] [Created] (SPARK-17659) Partitioned View is Not Supported In SHOW CREATE TABLE

Xiao Li created SPARK-17659: --- Summary: Partitioned View is Not Supported In SHOW CREATE TABLE Key: SPARK-17659 URL: https://issues.apache.org/jira/browse/SPARK-17659 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-17631) Structured Streaming - Add Http Stream Sink

[ https://issues.apache.org/jira/browse/SPARK-17631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15519970#comment-15519970 ] zhangxinyu commented on SPARK-17631: h4. A short design for this feature h5. Goal Bu

[jira] [Commented] (SPARK-17653) Optimizer should remove unnecessary distincts (in multiple unions)

[ https://issues.apache.org/jira/browse/SPARK-17653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15519953#comment-15519953 ] Xiao Li commented on SPARK-17653: - Yeah. You are right. It does not work. : ) > Optimize

[jira] [Commented] (SPARK-17653) Optimizer should remove unnecessary distincts (in multiple unions)

[ https://issues.apache.org/jira/browse/SPARK-17653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15519950#comment-15519950 ] Xiao Li commented on SPARK-17653: - I see. After rethinking it, Union is special. My PR is

[jira] [Commented] (SPARK-17653) Optimizer should remove unnecessary distincts (in multiple unions)

[ https://issues.apache.org/jira/browse/SPARK-17653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15519923#comment-15519923 ] Reynold Xin commented on SPARK-17653: - [~smilegator] - I just took a quick look at #1

[jira] [Commented] (SPARK-17653) Optimizer should remove unnecessary distincts (in multiple unions)

[ https://issues.apache.org/jira/browse/SPARK-17653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15519710#comment-15519710 ] Reynold Xin commented on SPARK-17653: - There are different ways to fix this, from fai

[jira] [Updated] (SPARK-17609) SessionCatalog.tableExists should not check temp view

[ https://issues.apache.org/jira/browse/SPARK-17609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-17609: Fix Version/s: (was: 2.0.2) 2.0.1 > SessionCatalog.tableExists should not ch

[jira] [Updated] (SPARK-17640) Avoid using -1 as the default batchId for FileStreamSource.FileEntry

[ https://issues.apache.org/jira/browse/SPARK-17640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-17640: Fix Version/s: (was: 2.0.2) 2.0.1 > Avoid using -1 as the default batchId fo

[jira] [Updated] (SPARK-17502) Multiple Bugs in DDL Statements on Temporary Views

[ https://issues.apache.org/jira/browse/SPARK-17502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-17502: Fix Version/s: (was: 2.0.2) 2.0.1 > Multiple Bugs in DDL Statements on Tempo

[jira] [Updated] (SPARK-17210) sparkr.zip is not distributed to executors when run sparkr in RStudio

[ https://issues.apache.org/jira/browse/SPARK-17210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-17210: Fix Version/s: (was: 2.0.2) 2.0.1 > sparkr.zip is not distributed to executo

[jira] [Updated] (SPARK-16240) model loading backward compatibility for ml.clustering.LDA

[ https://issues.apache.org/jira/browse/SPARK-16240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16240: Fix Version/s: (was: 2.0.2) 2.0.1 > model loading backward compatibility for

[jira] [Updated] (SPARK-17651) Automate Spark version update for documentations

[ https://issues.apache.org/jira/browse/SPARK-17651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-17651: Fix Version/s: (was: 2.0.2) 2.0.1 > Automate Spark version update for docume

[jira] [Commented] (SPARK-17556) Executor side broadcast for broadcast joins

[ https://issues.apache.org/jira/browse/SPARK-17556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15519497#comment-15519497 ] Yan commented on SPARK-17556: - For 2), I think BitTorrent won't help in the case of all-to-a

[jira] [Updated] (SPARK-17631) Structured Streaming - Add Http Stream Sink

[ https://issues.apache.org/jira/browse/SPARK-17631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-17631: -- Fix Version/s: (was: 2.0.0) > Structured Streaming - Add Http Stream Sink > ---

[jira] [Commented] (SPARK-17499) make the default params in sparkR spark.mlp consistent with MultilayerPerceptronClassifier

[ https://issues.apache.org/jira/browse/SPARK-17499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15518938#comment-15518938 ] Apache Spark commented on SPARK-17499: -- User 'HyukjinKwon' has created a pull reques

[jira] [Assigned] (SPARK-17658) write.df API requires path which is not actually always nessasary in SparkR

[ https://issues.apache.org/jira/browse/SPARK-17658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17658: Assignee: (was: Apache Spark) > write.df API requires path which is not actually alway

[jira] [Commented] (SPARK-17658) write.df API requires path which is not actually always nessasary in SparkR

[ https://issues.apache.org/jira/browse/SPARK-17658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15518856#comment-15518856 ] Apache Spark commented on SPARK-17658: -- User 'HyukjinKwon' has created a pull reques

[jira] [Assigned] (SPARK-17658) write.df API requires path which is not actually always nessasary in SparkR

[ https://issues.apache.org/jira/browse/SPARK-17658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17658: Assignee: Apache Spark > write.df API requires path which is not actually always nessasary

[jira] [Created] (SPARK-17658) write.df API requires path which is not actually always nessasary in SparkR

Hyukjin Kwon created SPARK-17658: Summary: write.df API requires path which is not actually always nessasary in SparkR Key: SPARK-17658 URL: https://issues.apache.org/jira/browse/SPARK-17658 Project:

[jira] [Commented] (SPARK-17556) Executor side broadcast for broadcast joins

[ https://issues.apache.org/jira/browse/SPARK-17556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15518790#comment-15518790 ] Liang-Chi Hsieh commented on SPARK-17556: - For 1). It is true only if your driver

[jira] [Updated] (SPARK-17556) Executor side broadcast for broadcast joins

[ https://issues.apache.org/jira/browse/SPARK-17556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh updated SPARK-17556: Attachment: executor-side-broadcast.pdf > Executor side broadcast for broadcast joins > ---

[jira] [Commented] (SPARK-17556) Executor side broadcast for broadcast joins

[ https://issues.apache.org/jira/browse/SPARK-17556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15518598#comment-15518598 ] Yan commented on SPARK-17556: - A few comments of mine are as follows: 1) The "one-executor c

[jira] [Resolved] (SPARK-17057) ProbabilisticClassifierModels' thresholds should have at most one 0

[ https://issues.apache.org/jira/browse/SPARK-17057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17057. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 15149 [https://github.co

[jira] [Updated] (SPARK-17057) ProbabilisticClassifierModels' thresholds should have at most one 0

[ https://issues.apache.org/jira/browse/SPARK-17057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-17057: -- Issue Type: Improvement (was: Bug) Summary: ProbabilisticClassifierModels' thresholds should hav

[jira] [Updated] (SPARK-17656) Decide on the variant of @scala.annotation.varargs and use consistently

[ https://issues.apache.org/jira/browse/SPARK-17656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-17656: -- Affects Version/s: (was: 2.0.2) 2.0.0 Priority: Trivial (was: M

[jira] [Resolved] (SPARK-10835) Word2Vec should accept non-null string array, in addition to existing null string array

[ https://issues.apache.org/jira/browse/SPARK-10835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-10835. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.2 Issue resolved by pull request

[jira] [Commented] (SPARK-17653) Optimizer should remove unnecessary distincts (in multiple unions)

[ https://issues.apache.org/jira/browse/SPARK-17653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15518577#comment-15518577 ] Xiao Li commented on SPARK-17653: - [~rxin] I submitted a PR https://github.com/apache/spa

[jira] [Updated] (SPARK-10835) Word2Vec should accept non-null string array, in addition to existing null string array

[ https://issues.apache.org/jira/browse/SPARK-10835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10835: -- Summary: Word2Vec should accept non-null string array, in addition to existing null string array (was:

[jira] [Updated] (SPARK-10835) [SPARK-10835] [ML] Word2Vec should accept non-null string array, in addition to existing null string array

[ https://issues.apache.org/jira/browse/SPARK-10835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10835: -- Summary: [SPARK-10835] [ML] Word2Vec should accept non-null string array, in addition to existing null

[jira] [Updated] (SPARK-10835) Word2Vec should accept non-null string array, in addition to existing null string array

[ https://issues.apache.org/jira/browse/SPARK-10835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10835: -- Shepherd: Sean Owen (was: Joseph K. Bradley) > Word2Vec should accept non-null string array, in additi