[jira] [Resolved] (SPARK-23087) CheckCartesianProduct too restrictive when condition is constant folded to false/null

2018-01-20 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-23087. - Resolution: Fixed Assignee: Marco Gaido Fix Version/s: 2.3.0 > CheckCartesianProduct too

[jira] [Updated] (SPARK-23168) Hints for fact tables and unique columns

2018-01-20 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-23168: - Description: We already have fact table and unique column inferences in

[jira] [Updated] (SPARK-23168) Hints for fact tables and unique columns

2018-01-20 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-23168: - Environment: (was: We already have fact table and unique column inferences in

[jira] [Commented] (SPARK-23168) Hints for fact tables and unique columns

2018-01-20 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333402#comment-16333402 ] Takeshi Yamamuro commented on SPARK-23168: -- An example code is like:

[jira] [Created] (SPARK-23168) Hints for fact tables and unique columns

2018-01-20 Thread Takeshi Yamamuro (JIRA)
Takeshi Yamamuro created SPARK-23168: Summary: Hints for fact tables and unique columns Key: SPARK-23168 URL: https://issues.apache.org/jira/browse/SPARK-23168 Project: Spark Issue Type:

[jira] [Comment Edited] (SPARK-19217) Offer easy cast from vector to array

2018-01-20 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1698#comment-1698 ] Takeshi Yamamuro edited comment on SPARK-19217 at 1/21/18 5:32 AM: --- If

[jira] [Commented] (SPARK-19217) Offer easy cast from vector to array

2018-01-20 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1698#comment-1698 ] Takeshi Yamamuro commented on SPARK-19217: -- If it still makes some sense and nobody takes this,

[jira] [Commented] (SPARK-15467) Getting stack overflow when attempting to query a wide Dataset (>200 fields)

2018-01-20 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1694#comment-1694 ] Takeshi Yamamuro commented on SPARK-15467: -- I think this should be fixed in the master (that is,

[jira] [Commented] (SPARK-23167) Update TPCDS queries from v1.4 to v2.7 (latest)

2018-01-20 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1692#comment-1692 ] Takeshi Yamamuro commented on SPARK-23167: -- cc: [~smilegator] > Update TPCDS queries from v1.4

[jira] [Created] (SPARK-23167) Update TPCDS queries from v1.4 to v2.7 (latest)

2018-01-20 Thread Takeshi Yamamuro (JIRA)
Takeshi Yamamuro created SPARK-23167: Summary: Update TPCDS queries from v1.4 to v2.7 (latest) Key: SPARK-23167 URL: https://issues.apache.org/jira/browse/SPARK-23167 Project: Spark

[jira] [Assigned] (SPARK-11222) Add style checker rules to validate doc tests aren't included in docs

2018-01-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11222: Assignee: Apache Spark > Add style checker rules to validate doc tests aren't included in

[jira] [Commented] (SPARK-11222) Add style checker rules to validate doc tests aren't included in docs

2018-01-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1688#comment-1688 ] Apache Spark commented on SPARK-11222: -- User 'rekhajoshm' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11222) Add style checker rules to validate doc tests aren't included in docs

2018-01-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11222: Assignee: (was: Apache Spark) > Add style checker rules to validate doc tests aren't

[jira] [Commented] (SPARK-22958) Spark is stuck when the only one executor fails to register with driver

2018-01-20 Thread Shaoquan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1684#comment-1684 ] Shaoquan Zhang commented on SPARK-22958: Thanks for pointing it out. We found this issue is

[jira] [Created] (SPARK-23166) Add maxDF Parameter to CountVectorizer

2018-01-20 Thread Yacine Mazari (JIRA)
Yacine Mazari created SPARK-23166: - Summary: Add maxDF Parameter to CountVectorizer Key: SPARK-23166 URL: https://issues.apache.org/jira/browse/SPARK-23166 Project: Spark Issue Type:

[jira] [Commented] (SPARK-11630) ClosureCleaner incorrectly warns for class based closures

2018-01-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1666#comment-1666 ] Apache Spark commented on SPARK-11630: -- User 'rekhajoshm' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11630) ClosureCleaner incorrectly warns for class based closures

2018-01-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11630: Assignee: (was: Apache Spark) > ClosureCleaner incorrectly warns for class based

[jira] [Assigned] (SPARK-11630) ClosureCleaner incorrectly warns for class based closures

2018-01-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11630: Assignee: Apache Spark > ClosureCleaner incorrectly warns for class based closures >

[jira] [Resolved] (SPARK-22805) Use aliases for StorageLevel in event logs

2018-01-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22805. --- Resolution: Won't Fix > Use aliases for StorageLevel in event logs >

[jira] [Resolved] (SPARK-22763) SHS: Ignore unknown events and parse through the file

2018-01-20 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22763. - Resolution: Fixed Assignee: Gengliang Wang Fix Version/s: 2.3.0 > SHS: Ignore unknown

[jira] [Commented] (SPARK-18016) Code Generation: Constant Pool Past Limit for Wide/Nested Dataset

2018-01-20 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333298#comment-16333298 ] Kazuaki Ishizaki commented on SPARK-18016: -- Thank you for reporting an issue. Could you post a

[jira] [Commented] (SPARK-16803) SaveAsTable does not work when source DataFrame is built on a Hive Table

2018-01-20 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333297#comment-16333297 ] Xiao Li commented on SPARK-16803: - [~Tagar] It has been resolved by

[jira] [Resolved] (SPARK-23091) Incorrect unit test for approxQuantile

2018-01-20 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-23091. - Resolution: Fixed Assignee: Sean Owen Fix Version/s: 2.3.0 > Incorrect unit test for

[jira] [Updated] (SPARK-23165) Minor spelling mistake in quick-start doc

2018-01-20 Thread Shashwat Anand (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashwat Anand updated SPARK-23165: --- Summary: Minor spelling mistake in quick-start doc (was: Minor spelling mistake on

[jira] [Commented] (SPARK-23165) Minor spelling mistake on quick-start

2018-01-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333211#comment-16333211 ] Apache Spark commented on SPARK-23165: -- User 'ashashwat' has created a pull request for this issue:

[jira] [Commented] (SPARK-23148) spark.read.csv with multiline=true gives FileNotFoundException if path contains spaces

2018-01-20 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333210#comment-16333210 ] Hyukjin Kwon commented on SPARK-23148: -- Anyone want to open a PR with regression test for both JSON

[jira] [Commented] (SPARK-23088) History server not showing incomplete/running applications

2018-01-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333201#comment-16333201 ] Apache Spark commented on SPARK-23088: -- User 'pmackles' has created a pull request for this issue:

[jira] [Assigned] (SPARK-23088) History server not showing incomplete/running applications

2018-01-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23088: Assignee: Apache Spark > History server not showing incomplete/running applications >

[jira] [Assigned] (SPARK-23088) History server not showing incomplete/running applications

2018-01-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23088: Assignee: (was: Apache Spark) > History server not showing incomplete/running

[jira] [Assigned] (SPARK-21187) Complete support for remaining Spark data types in Arrow Converters

2018-01-20 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-21187: Assignee: Bryan Cutler > Complete support for remaining Spark data types in Arrow

[jira] [Commented] (SPARK-23164) Documentation error in quick-start

2018-01-20 Thread Shashwat Anand (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333198#comment-16333198 ] Shashwat Anand commented on SPARK-23164: [~srowen]  Got it.  Thanks.  > Documentation error in

[jira] [Commented] (SPARK-23165) Minor spelling mistake on quick-start

2018-01-20 Thread Shashwat Anand (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333197#comment-16333197 ] Shashwat Anand commented on SPARK-23165: [~srowen]  There is a doc bug, the one you referenced. 

[jira] [Resolved] (SPARK-23164) Documentation error in quick-start

2018-01-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-23164. --- Resolution: Not A Problem Please read [http://spark.apache.org/contributing.html] (This is not a

[jira] [Resolved] (SPARK-23165) Minor spelling mistake on quick-start

2018-01-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-23165. --- Resolution: Duplicate You opened the same issue twice > Minor spelling mistake on quick-start >

[jira] [Created] (SPARK-23165) Minor spelling mistake on quick-start

2018-01-20 Thread Shashwat Anand (JIRA)
Shashwat Anand created SPARK-23165: -- Summary: Minor spelling mistake on quick-start Key: SPARK-23165 URL: https://issues.apache.org/jira/browse/SPARK-23165 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-23164) Documentation error in quick-start

2018-01-20 Thread Shashwat Anand (JIRA)
Shashwat Anand created SPARK-23164: -- Summary: Documentation error in quick-start Key: SPARK-23164 URL: https://issues.apache.org/jira/browse/SPARK-23164 Project: Spark Issue Type: Bug