[jira] [Comment Edited] (SPARK-22876) spark.yarn.am.attemptFailuresValidityInterval does not work correctly

2018-03-23 Thread MIN-FU YANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16412379#comment-16412379 ] MIN-FU YANG edited comment on SPARK-22876 at 3/24/18 3:00 AM: -- I found that

[jira] [Commented] (SPARK-22876) spark.yarn.am.attemptFailuresValidityInterval does not work correctly

2018-03-23 Thread MIN-FU YANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16412379#comment-16412379 ] MIN-FU YANG commented on SPARK-22876: - I found that current Yarn implementation doesn't expose number

[jira] [Commented] (SPARK-22876) spark.yarn.am.attemptFailuresValidityInterval does not work correctly

2018-03-23 Thread MIN-FU YANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16412228#comment-16412228 ] MIN-FU YANG commented on SPARK-22876: - Hi, I also encounter this problem. Please assign it to me, I

[jira] [Commented] (SPARK-16280) Implement histogram_numeric SQL function

2016-07-20 Thread MIN-FU YANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386787#comment-15386787 ] MIN-FU YANG commented on SPARK-16280: - I implemented histogram_numeric according to the Algorithm I &

[jira] [Commented] (SPARK-16280) Implement histogram_numeric SQL function

2016-07-09 Thread MIN-FU YANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15369417#comment-15369417 ] MIN-FU YANG commented on SPARK-16280: - I'll submit PR in few days > Implement histogram_numeric SQL

[jira] [Commented] (SPARK-16282) Implement percentile SQL function

2016-06-29 Thread MIN-FU YANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15355228#comment-15355228 ] MIN-FU YANG commented on SPARK-16282: - I can work on this, too. > Implement percentile SQL function

[jira] [Commented] (SPARK-16280) Implement histogram_numeric SQL function

2016-06-29 Thread MIN-FU YANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15355220#comment-15355220 ] MIN-FU YANG commented on SPARK-16280: - I can working on this > Implement histogram_numeric SQL

[jira] [Comment Edited] (SPARK-15516) Schema merging in driver fails for parquet when merging LongType and IntegerType

2016-06-25 Thread MIN-FU YANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15349855#comment-15349855 ] MIN-FU YANG edited comment on SPARK-15516 at 6/25/16 11:23 PM: --- Hi,

[jira] [Comment Edited] (SPARK-15516) Schema merging in driver fails for parquet when merging LongType and IntegerType

2016-06-25 Thread MIN-FU YANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15349855#comment-15349855 ] MIN-FU YANG edited comment on SPARK-15516 at 6/25/16 11:07 PM: --- Hi,

[jira] [Commented] (SPARK-15516) Schema merging in driver fails for parquet when merging LongType and IntegerType

2016-06-25 Thread MIN-FU YANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15349855#comment-15349855 ] MIN-FU YANG commented on SPARK-15516: - [~holdenk], I found a test case in DataTypeSuite.scala

[jira] [Comment Edited] (SPARK-15516) Schema merging in driver fails for parquet when merging LongType and IntegerType

2016-06-25 Thread MIN-FU YANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15349520#comment-15349520 ] MIN-FU YANG edited comment on SPARK-15516 at 6/25/16 9:11 AM: -- [~holdenk] I

[jira] [Commented] (SPARK-15516) Schema merging in driver fails for parquet when merging LongType and IntegerType

2016-06-25 Thread MIN-FU YANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15349520#comment-15349520 ] MIN-FU YANG commented on SPARK-15516: - [~holdenk] I am wondering the banning on schema merge on

[jira] [Comment Edited] (SPARK-15516) Schema merging in driver fails for parquet when merging LongType and IntegerType

2016-06-25 Thread MIN-FU YANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15347465#comment-15347465 ] MIN-FU YANG edited comment on SPARK-15516 at 6/25/16 8:35 AM: -- OK, I've

[jira] [Comment Edited] (SPARK-15516) Schema merging in driver fails for parquet when merging LongType and IntegerType

2016-06-25 Thread MIN-FU YANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15347465#comment-15347465 ] MIN-FU YANG edited comment on SPARK-15516 at 6/25/16 8:35 AM: -- OK, I've

[jira] [Commented] (SPARK-15516) Schema merging in driver fails for parquet when merging LongType and IntegerType

2016-06-23 Thread MIN-FU YANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15347465#comment-15347465 ] MIN-FU YANG commented on SPARK-15516: - OK, I've reproduced the problem with following code: ```

[jira] [Issue Comment Deleted] (SPARK-15516) Schema merging in driver fails for parquet when merging LongType and IntegerType

2016-06-23 Thread MIN-FU YANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MIN-FU YANG updated SPARK-15516: Comment: was deleted (was: I would like to look into this issue) > Schema merging in driver fails

[jira] [Commented] (SPARK-15516) Schema merging in driver fails for parquet when merging LongType and IntegerType

2016-06-23 Thread MIN-FU YANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15347428#comment-15347428 ] MIN-FU YANG commented on SPARK-15516: - Do you have any sample code? > Schema merging in driver fails

[jira] [Commented] (SPARK-15516) Schema merging in driver fails for parquet when merging LongType and IntegerType

2016-06-22 Thread MIN-FU YANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15343791#comment-15343791 ] MIN-FU YANG commented on SPARK-15516: - I would like to look into this issue > Schema merging in

[jira] [Created] (SPARK-16124) Throws exception when executing query on `build/sbt hive/console`

2016-06-21 Thread MIN-FU YANG (JIRA)
MIN-FU YANG created SPARK-16124: --- Summary: Throws exception when executing query on `build/sbt hive/console` Key: SPARK-16124 URL: https://issues.apache.org/jira/browse/SPARK-16124 Project: Spark

[jira] [Commented] (SPARK-14172) Hive table partition predicate not passed down correctly

2016-06-21 Thread MIN-FU YANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15343121#comment-15343121 ] MIN-FU YANG commented on SPARK-14172: - I cannot reproduce it on 1.6.1 either. Could you give more

[jira] [Comment Edited] (SPARK-14172) Hive table partition predicate not passed down correctly

2016-06-21 Thread MIN-FU YANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15343121#comment-15343121 ] MIN-FU YANG edited comment on SPARK-14172 at 6/22/16 12:48 AM: --- I cannot

[jira] [Commented] (SPARK-14172) Hive table partition predicate not passed down correctly

2016-06-21 Thread MIN-FU YANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342917#comment-15342917 ] MIN-FU YANG commented on SPARK-14172: - Hi, I cannot reproduce the problem in master branch. Maybe

[jira] [Commented] (SPARK-15326) Doing multiple unions on a Dataframe will result in a very inefficient query plan

2016-06-21 Thread MIN-FU YANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342850#comment-15342850 ] MIN-FU YANG commented on SPARK-15326: - I'll look into it. > Doing multiple unions on a Dataframe

[jira] [Updated] (SPARK-15906) Complementary Naive Bayes Algorithm Implementation

2016-06-15 Thread MIN-FU YANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MIN-FU YANG updated SPARK-15906: Description: Improve the Naive Bayes algorithm on skew data according to "Tackling the Poor

[jira] [Updated] (SPARK-15906) Complementary Naive Bayes Algorithm Implementation

2016-06-15 Thread MIN-FU YANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MIN-FU YANG updated SPARK-15906: Description: Improve the Naive Bayes algorithm on skew data according to "Tackling the Poor

[jira] [Commented] (SPARK-15906) Complementary Naive Bayes Algorithm Implementation

2016-06-15 Thread MIN-FU YANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15333098#comment-15333098 ] MIN-FU YANG commented on SPARK-15906: - OK, the description is updated. > Complementary Naive Bayes

[jira] [Commented] (SPARK-15906) Complementary Naive Bayes Algorithm Implementation

2016-06-12 Thread MIN-FU YANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15326685#comment-15326685 ] MIN-FU YANG commented on SPARK-15906: - tilumi has pr: https://github.com/apache/spark/pull/13627 for

[jira] [Issue Comment Deleted] (SPARK-15906) Complementary Naive Bayes Algorithm Implementation

2016-06-12 Thread MIN-FU YANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MIN-FU YANG updated SPARK-15906: Comment: was deleted (was: tilumi has pr: https://github.com/apache/spark/pull/13627 for this

[jira] [Created] (SPARK-15906) Complementary Naive Bayes Algorithm Implementation

2016-06-12 Thread MIN-FU YANG (JIRA)
MIN-FU YANG created SPARK-15906: --- Summary: Complementary Naive Bayes Algorithm Implementation Key: SPARK-15906 URL: https://issues.apache.org/jira/browse/SPARK-15906 Project: Spark Issue Type: