[jira] [Updated] (SPARK-21795) Broadcast hint ignored when dataframe is cached

2017-08-20 Thread Lior Chaga (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lior Chaga updated SPARK-21795: --- Description: Not sure if it's a bug or by design, but if a DF is cached, the broadcast hint is

[jira] [Created] (SPARK-21795) Broadcast hint ignored when dataframe is cached

2017-08-20 Thread Lior Chaga (JIRA)
Lior Chaga created SPARK-21795: -- Summary: Broadcast hint ignored when dataframe is cached Key: SPARK-21795 URL: https://issues.apache.org/jira/browse/SPARK-21795 Project: Spark Issue Type: Bug

[jira] [Closed] (SPARK-20711) MultivariateOnlineSummarizer incorrect min/max for identical NaN feature

2017-08-20 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng closed SPARK-20711. Resolution: Not A Problem > MultivariateOnlineSummarizer incorrect min/max for identical NaN

[jira] [Commented] (SPARK-21674) Support double/single-quoted strings for alias names in SQL

2017-08-20 Thread Chin Han Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16134681#comment-16134681 ] Chin Han Yu commented on SPARK-21674: - Found that back quote is working fine for alias names. Do we

[jira] [Commented] (SPARK-21674) Support double/single-quoted strings for alias names in SQL

2017-08-20 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16134680#comment-16134680 ] Takeshi Yamamuro commented on SPARK-21674: -- Thanks. Before making a pr, it seems you better

[jira] [Comment Edited] (SPARK-21674) Support double/single-quoted strings for alias names in SQL

2017-08-20 Thread Chin Han Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16134669#comment-16134669 ] Chin Han Yu edited comment on SPARK-21674 at 8/21/17 3:37 AM: -- Hi, I would

[jira] [Commented] (SPARK-21674) Support double/single-quoted strings for alias names in SQL

2017-08-20 Thread Chin Han Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16134669#comment-16134669 ] Chin Han Yu commented on SPARK-21674: - Hi, I would like to work on this ticket. Since it's common to

[jira] [Commented] (SPARK-19552) Upgrade Netty version to 4.1.8 final

2017-08-20 Thread Andrew Ash (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16134657#comment-16134657 ] Andrew Ash commented on SPARK-19552: Heads up the next time someone attempts this: Upgrading to

[jira] [Commented] (SPARK-21725) spark thriftserver insert overwrite table partition select

2017-08-20 Thread xinzhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16134642#comment-16134642 ] xinzhang commented on SPARK-21725: -- Ok. I will retry the version of current master. > spark

[jira] [Commented] (SPARK-21603) The wholestage codegen will be much slower then wholestage codegen is closed when the function is too long

2017-08-20 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16134603#comment-16134603 ] Takeshi Yamamuro commented on SPARK-21603: -- Just for your information, I checked the performance

[jira] [Comment Edited] (SPARK-12216) Spark failed to delete temp directory

2017-08-20 Thread Mark S (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16134527#comment-16134527 ] Mark S edited comment on SPARK-12216 at 8/20/17 8:12 PM: - I seem to have same

[jira] [Commented] (SPARK-12216) Spark failed to delete temp directory

2017-08-20 Thread Mark S (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16134527#comment-16134527 ] Mark S commented on SPARK-12216: I seem to have same issue on my Windows 10 environment, when I am

[jira] [Commented] (SPARK-21756) Add JSON option to allow unquoted control characters

2017-08-20 Thread Vinod KC (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16134515#comment-16134515 ] Vinod KC commented on SPARK-21756: -- https://github.com/apache/spark/pull/19008 > Add JSON option to

[jira] [Commented] (SPARK-21783) Turn on ORC filter push-down by default

2017-08-20 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16134507#comment-16134507 ] Dongjoon Hyun commented on SPARK-21783: --- PR is ready. > Turn on ORC filter push-down by default >

[jira] [Commented] (SPARK-21756) Add JSON option to allow unquoted control characters

2017-08-20 Thread Vinod KC (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16134484#comment-16134484 ] Vinod KC commented on SPARK-21756: -- [~bryanch] I'm planning to work on this . Can you please share your

[jira] [Commented] (SPARK-21794) exception about reading task serial data(broadcast) value when the storage memory is not enough to unroll

2017-08-20 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16134440#comment-16134440 ] Kazuaki Ishizaki commented on SPARK-21794: -- Thank you for reporting this issue. Could you please

[jira] [Commented] (SPARK-21725) spark thriftserver insert overwrite table partition select

2017-08-20 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16134424#comment-16134424 ] Marco Gaido commented on SPARK-21725: - [~zhangxin0112zx] I followed your instructions, but I am

[jira] [Updated] (SPARK-21794) exception about reading task serial data(broadcast) value when the storage memory is not enough to unroll

2017-08-20 Thread roncenzhao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] roncenzhao updated SPARK-21794: --- Attachment: error stack.png > exception about reading task serial data(broadcast) value when the

[jira] [Created] (SPARK-21794) exception about reading task serial data(broadcast) value when the storage memory is not enough to unroll

2017-08-20 Thread roncenzhao (JIRA)
roncenzhao created SPARK-21794: -- Summary: exception about reading task serial data(broadcast) value when the storage memory is not enough to unroll Key: SPARK-21794 URL:

[jira] [Assigned] (SPARK-21773) Should Install mkdocs if missing in the path in SQL documentation build

2017-08-20 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-21773: Assignee: Hyukjin Kwon > Should Install mkdocs if missing in the path in SQL

[jira] [Resolved] (SPARK-21773) Should Install mkdocs if missing in the path in SQL documentation build

2017-08-20 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-21773. -- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 18984

[jira] [Resolved] (SPARK-21793) Correct validateAndTransformSchema in GaussianMixture and AFTSurvivalRegression

2017-08-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21793. --- Resolution: Fixed Fix Version/s: 2.1.2 2.3.0 2.2.1

[jira] [Assigned] (SPARK-21793) Correct validateAndTransformSchema in GaussianMixture and AFTSurvivalRegression

2017-08-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-21793: - Assignee: Cedric Pelvet (was: Sean Owen) Affects Version/s: 2.1.1

[jira] [Created] (SPARK-21793) Correct validateAndTransformSchema in GaussianMixture and AFTSurvivalRegression

2017-08-20 Thread Sean Owen (JIRA)
Sean Owen created SPARK-21793: - Summary: Correct validateAndTransformSchema in GaussianMixture and AFTSurvivalRegression Key: SPARK-21793 URL: https://issues.apache.org/jira/browse/SPARK-21793 Project:

[jira] [Closed] (SPARK-17414) Set type is not supported for creating data frames

2017-08-20 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro closed SPARK-17414. Resolution: Fixed Fix Version/s: 2.3.0 > Set type is not supported for creating

[jira] [Commented] (SPARK-21792) Document Spark Streaming Dynamic Allocation Configuration

2017-08-20 Thread Karthik Palaniappan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16134329#comment-16134329 ] Karthik Palaniappan commented on SPARK-21792: - The author of the file is [~tdas]. >

[jira] [Commented] (SPARK-21752) Config spark.jars.packages is ignored in SparkSession config

2017-08-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16134327#comment-16134327 ] Sean Owen commented on SPARK-21752: --- This is an interesting discussion about what happens to work when,

[jira] [Commented] (SPARK-21742) BisectingKMeans generate different models with/without caching

2017-08-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16134326#comment-16134326 ] Sean Owen commented on SPARK-21742: --- I haven't noticed test failures in Jenkins. Is it something that

[jira] [Updated] (SPARK-21792) Document Spark Streaming Dynamic Allocation Configuration

2017-08-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-21792: -- Priority: Minor (was: Major) Not Major. Not all params are meant to be public; these may be

[jira] [Created] (SPARK-21792) Document Spark Streaming Dynamic Allocation Configuration

2017-08-20 Thread Karthik Palaniappan (JIRA)
Karthik Palaniappan created SPARK-21792: --- Summary: Document Spark Streaming Dynamic Allocation Configuration Key: SPARK-21792 URL: https://issues.apache.org/jira/browse/SPARK-21792 Project:

[jira] [Assigned] (SPARK-21790) Running Docker-based Integration Test Suites throws exception

2017-08-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-21790: - Assignee: Yuming Wang > Running Docker-based Integration Test Suites throws exception >

[jira] [Commented] (SPARK-21646) BinaryComparison shouldn't auto cast string to int/long

2017-08-20 Thread Wei Zheng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16134311#comment-16134311 ] Wei Zheng commented on SPARK-21646: --- [~q79969786] Please refer to Hive logic for dealing with