[GitHub] spark issue #17192: [SPARK-19849][SQL] Support ArrayType in to_json to produ...

2017-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17192 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74811/ Test FAILed. ---

[GitHub] spark issue #16626: [SPARK-19261][SQL] Alter add columns for Hive serde and ...

2017-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16626 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74810/ Test FAILed. ---

[GitHub] spark issue #16596: [SPARK-19237][SPARKR][CORE] On Windows spark-submit shou...

2017-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16596 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74808/ Test FAILed. ---

[GitHub] spark issue #16626: [SPARK-19261][SQL] Alter add columns for Hive serde and ...

2017-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16626 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16596: [SPARK-19237][SPARKR][CORE] On Windows spark-submit shou...

2017-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16596 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17192: [SPARK-19849][SQL] Support ArrayType in to_json to produ...

2017-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17192 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17138: [SPARK-17080] [SQL] join reorder

2017-03-19 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/17138 Found a very interesting paper for analyzing the existing DP algorithms for join reordering with a new solution in VLDB 2006. [Analysis of Two Existing and One New Dynamic Programming Algorit

[GitHub] spark issue #17331: [SPARK-19994][SQL] Wrong outputOrdering for right/full o...

2017-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17331 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74809/ Test FAILed. ---

[GitHub] spark issue #17344: [SPARK-19990][TEST][test-maven][WIP] Use the database af...

2017-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17344 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17344: [SPARK-19990][TEST][test-maven][WIP] Use the database af...

2017-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17344 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74807/ Test FAILed. ---

[GitHub] spark issue #17331: [SPARK-19994][SQL] Wrong outputOrdering for right/full o...

2017-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17331 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16596: [SPARK-19237][SPARKR][CORE] On Windows spark-submit shou...

2017-03-19 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/16596 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #16596: [SPARK-19237][SPARKR][CORE] On Windows spark-submit shou...

2017-03-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16596 **[Test build #74812 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74812/testReport)** for PR 16596 at commit [`e33b50a`](https://github.com/apache/spark/commit/e3

[GitHub] spark issue #17343: [SPARK-20014] Optimize mergeSpillsWithFileStream method

2017-03-19 Thread mridulm
Github user mridulm commented on the issue: https://github.com/apache/spark/pull/17343 If we make flush() noop, then buffered (uncommitted) data wont be written to the stream; am I missing something here, or is this change broken ? --- If your project is set up for it, you can reply

[GitHub] spark issue #17343: [SPARK-20014] Optimize mergeSpillsWithFileStream method

2017-03-19 Thread mridulm
Github user mridulm commented on the issue: https://github.com/apache/spark/pull/17343 Background - you need to do a flush() to ensure the indices generated are valid. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If y

[GitHub] spark issue #17330: [SPARK-19993][SQL] Caching logical plans containing subq...

2017-03-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17330 **[Test build #74813 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74813/testReport)** for PR 17330 at commit [`0c64245`](https://github.com/apache/spark/commit/0c

[GitHub] spark issue #17192: [SPARK-19849][SQL] Support ArrayType in to_json to produ...

2017-03-19 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/17192 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes s

[GitHub] spark issue #17192: [SPARK-19849][SQL] Support ArrayType in to_json to produ...

2017-03-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17192 **[Test build #74814 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74814/testReport)** for PR 17192 at commit [`6ac57d3`](https://github.com/apache/spark/commit/6a

[GitHub] spark issue #17344: [SPARK-19990][TEST][test-maven][WIP] Use the database af...

2017-03-19 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/17344 This test case passed, but we still have multiple other test cases failed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #17343: [SPARK-20014] Optimize mergeSpillsWithFileStream method

2017-03-19 Thread mridulm
Github user mridulm commented on the issue: https://github.com/apache/spark/pull/17343 Ah, looks like I missed that CountingOutputStream was introduced after BOS and not before. Looks good to me. --- If your project is set up for it, you can reply to this email and have your repl

[GitHub] spark issue #17179: [SPARK-19067][SS] Processing-time-based timeout in MapGr...

2017-03-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17179 **[Test build #74815 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74815/testReport)** for PR 17179 at commit [`497646e`](https://github.com/apache/spark/commit/49

[GitHub] spark pull request #17345: [SPARK-20011][ML][DOCS] Clarify documentation for...

2017-03-19 Thread snowch
GitHub user snowch opened a pull request: https://github.com/apache/spark/pull/17345 [SPARK-20011][ML][DOCS] Clarify documentation for ALS 'rank' parameter ## What changes were proposed in this pull request? API documentation and collaborative filtering documentation page ch

[GitHub] spark issue #17345: [SPARK-20011][ML][DOCS] Clarify documentation for ALS 'r...

2017-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17345 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request #17219: [SPARK-19876][SS][WIP] OneTime Trigger Executor

2017-03-19 Thread lw-lin
Github user lw-lin commented on a diff in the pull request: https://github.com/apache/spark/pull/17219#discussion_r106800936 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/BatchCommitLog.scala --- @@ -0,0 +1,80 @@ +/* + * Licensed to the Apache

[GitHub] spark issue #16626: [SPARK-19261][SQL] Alter add columns for Hive serde and ...

2017-03-19 Thread xwu0226
Github user xwu0226 commented on the issue: https://github.com/apache/spark/pull/16626 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, o

[GitHub] spark issue #16626: [SPARK-19261][SQL] Alter add columns for Hive serde and ...

2017-03-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16626 **[Test build #74816 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74816/testReport)** for PR 16626 at commit [`1eb7cd3`](https://github.com/apache/spark/commit/1e

[GitHub] spark issue #17331: [SPARK-19994][SQL] Wrong outputOrdering for right/full o...

2017-03-19 Thread wzhfy
Github user wzhfy commented on the issue: https://github.com/apache/spark/pull/17331 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #17331: [SPARK-19994][SQL] Wrong outputOrdering for right/full o...

2017-03-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17331 **[Test build #74817 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74817/testReport)** for PR 17331 at commit [`e4c41dc`](https://github.com/apache/spark/commit/e4

[GitHub] spark issue #17338: [SPARK-19990][SQL][test-maven]create a temp file for fil...

2017-03-19 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/17338 @gatorsmile what do you think of this vs https://github.com/apache/spark/pull/17344 ? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark issue #16596: [SPARK-19237][SPARKR][CORE] On Windows spark-submit shou...

2017-03-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16596 **[Test build #74812 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74812/testReport)** for PR 16596 at commit [`e33b50a`](https://github.com/apache/spark/commit/e

[GitHub] spark issue #16596: [SPARK-19237][SPARKR][CORE] On Windows spark-submit shou...

2017-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16596 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16596: [SPARK-19237][SPARKR][CORE] On Windows spark-submit shou...

2017-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16596 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74812/ Test FAILed. ---

[GitHub] spark issue #17330: [SPARK-19993][SQL] Caching logical plans containing subq...

2017-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17330 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74813/ Test PASSed. ---

[GitHub] spark issue #17330: [SPARK-19993][SQL] Caching logical plans containing subq...

2017-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17330 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17192: [SPARK-19849][SQL] Support ArrayType in to_json to produ...

2017-03-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17192 **[Test build #74814 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74814/testReport)** for PR 17192 at commit [`6ac57d3`](https://github.com/apache/spark/commit/6

[GitHub] spark issue #17192: [SPARK-19849][SQL] Support ArrayType in to_json to produ...

2017-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17192 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74814/ Test PASSed. ---

[GitHub] spark issue #17192: [SPARK-19849][SQL] Support ArrayType in to_json to produ...

2017-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17192 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17179: [SPARK-19067][SS] Processing-time-based timeout in MapGr...

2017-03-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17179 **[Test build #74815 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74815/testReport)** for PR 17179 at commit [`497646e`](https://github.com/apache/spark/commit/4

[GitHub] spark issue #17179: [SPARK-19067][SS] Processing-time-based timeout in MapGr...

2017-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17179 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17179: [SPARK-19067][SS] Processing-time-based timeout in MapGr...

2017-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17179 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74815/ Test PASSed. ---

[GitHub] spark issue #17344: [SPARK-19990][TEST][test-maven][WIP] Use the database af...

2017-03-19 Thread windpiger
Github user windpiger commented on the issue: https://github.com/apache/spark/pull/17344 LGTM,but why maven test has this problem? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fe

[GitHub] spark issue #17331: [SPARK-19994][SQL] Wrong outputOrdering for right/full o...

2017-03-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17331 **[Test build #74817 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74817/testReport)** for PR 17331 at commit [`e4c41dc`](https://github.com/apache/spark/commit/e

[GitHub] spark issue #17331: [SPARK-19994][SQL] Wrong outputOrdering for right/full o...

2017-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17331 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17331: [SPARK-19994][SQL] Wrong outputOrdering for right/full o...

2017-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17331 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74817/ Test FAILed. ---

[GitHub] spark issue #17345: [SPARK-20011][ML][DOCS] Clarify documentation for ALS 'r...

2017-03-19 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/17345 Jenkins test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #17345: [SPARK-20011][ML][DOCS] Clarify documentation for ALS 'r...

2017-03-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17345 **[Test build #74818 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74818/testReport)** for PR 17345 at commit [`1359e07`](https://github.com/apache/spark/commit/13

[GitHub] spark issue #17346: [WIP] DataFrame batch reader may fail to infer partition...

2017-03-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17346 **[Test build #74819 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74819/testReport)** for PR 17346 at commit [`19d0d48`](https://github.com/apache/spark/commit/19

[GitHub] spark pull request #17346: [WIP] DataFrame batch reader may fail to infer pa...

2017-03-19 Thread lw-lin
GitHub user lw-lin opened a pull request: https://github.com/apache/spark/pull/17346 [WIP] DataFrame batch reader may fail to infer partitions when reading FileStreamSink's output WIP of SPARK-19965 ## What changes were proposed in this pull request? (Please fill i

[GitHub] spark issue #17346: [WIP] DataFrame batch reader may fail to infer partition...

2017-03-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17346 **[Test build #74819 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74819/testReport)** for PR 17346 at commit [`19d0d48`](https://github.com/apache/spark/commit/1

[GitHub] spark issue #17346: [WIP] DataFrame batch reader may fail to infer partition...

2017-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17346 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74819/ Test FAILed. ---

[GitHub] spark issue #17346: [WIP] DataFrame batch reader may fail to infer partition...

2017-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17346 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17345: [SPARK-20011][ML][DOCS] Clarify documentation for ALS 'r...

2017-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17345 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74818/ Test PASSed. ---

[GitHub] spark issue #17345: [SPARK-20011][ML][DOCS] Clarify documentation for ALS 'r...

2017-03-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17345 **[Test build #74818 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74818/testReport)** for PR 17345 at commit [`1359e07`](https://github.com/apache/spark/commit/1

[GitHub] spark issue #17345: [SPARK-20011][ML][DOCS] Clarify documentation for ALS 'r...

2017-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17345 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16626: [SPARK-19261][SQL] Alter add columns for Hive serde and ...

2017-03-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16626 **[Test build #74816 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74816/testReport)** for PR 16626 at commit [`1eb7cd3`](https://github.com/apache/spark/commit/1

[GitHub] spark issue #16626: [SPARK-19261][SQL] Alter add columns for Hive serde and ...

2017-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16626 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74816/ Test PASSed. ---

[GitHub] spark issue #16626: [SPARK-19261][SQL] Alter add columns for Hive serde and ...

2017-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16626 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17346: [WIP] DataFrame batch reader may fail to infer partition...

2017-03-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17346 **[Test build #74820 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74820/testReport)** for PR 17346 at commit [`0e35db7`](https://github.com/apache/spark/commit/0e

[GitHub] spark pull request #17347: [SPARK-19980][SQL] Add NULL checks in Bean serial...

2017-03-19 Thread maropu
GitHub user maropu opened a pull request: https://github.com/apache/spark/pull/17347 [SPARK-19980][SQL] Add NULL checks in Bean serializer ## What changes were proposed in this pull request? A Bean serializer in `ExpressionEncoder` could change values when Beans having NULL. A

[GitHub] spark issue #17347: [SPARK-19980][SQL] Add NULL checks in Bean serializer

2017-03-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17347 **[Test build #74821 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74821/testReport)** for PR 17347 at commit [`093b4e3`](https://github.com/apache/spark/commit/09

[GitHub] spark issue #17347: [SPARK-19980][SQL] Add NULL checks in Bean serializer

2017-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17347 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74821/ Test FAILed. ---

[GitHub] spark issue #17347: [SPARK-19980][SQL] Add NULL checks in Bean serializer

2017-03-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17347 **[Test build #74821 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74821/testReport)** for PR 17347 at commit [`093b4e3`](https://github.com/apache/spark/commit/0

[GitHub] spark issue #17347: [SPARK-19980][SQL] Add NULL checks in Bean serializer

2017-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17347 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17191: [SPARK-14471][SQL] Aliases in SELECT could be used in GR...

2017-03-19 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/17191 @gatorsmile How about this? It seems we have the same behaviour; ``` // PostgreSQL postgres=# select gkey1 AS "2", gkey2, count(value) from t2 group by "2", 2; 2 | gkey2 | count

[GitHub] spark issue #17170: [SPARK-19825][R][ML] spark.ml R API for FPGrowth

2017-03-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17170 **[Test build #74823 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74823/testReport)** for PR 17170 at commit [`dd7822e`](https://github.com/apache/spark/commit/dd

[GitHub] spark issue #17347: [SPARK-19980][SQL] Add NULL checks in Bean serializer

2017-03-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17347 **[Test build #74822 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74822/testReport)** for PR 17347 at commit [`77458a0`](https://github.com/apache/spark/commit/77

[GitHub] spark issue #17170: [SPARK-19825][R][ML] spark.ml R API for FPGrowth

2017-03-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17170 **[Test build #74823 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74823/testReport)** for PR 17170 at commit [`dd7822e`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #17170: [SPARK-19825][R][ML] spark.ml R API for FPGrowth

2017-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17170 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74823/ Test PASSed. ---

[GitHub] spark issue #17170: [SPARK-19825][R][ML] spark.ml R API for FPGrowth

2017-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17170 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #17315: [SPARK-19949][SQL] unify bad record handling in C...

2017-03-19 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/17315#discussion_r106806437 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/UnivocityParser.scala --- @@ -233,81 +187,39 @@ class UnivocityParser(

[GitHub] spark issue #17346: [WIP] DataFrame batch reader may fail to infer partition...

2017-03-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17346 **[Test build #74820 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74820/testReport)** for PR 17346 at commit [`0e35db7`](https://github.com/apache/spark/commit/0

[GitHub] spark issue #17346: [WIP] DataFrame batch reader may fail to infer partition...

2017-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17346 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74820/ Test PASSed. ---

[GitHub] spark issue #17346: [WIP] DataFrame batch reader may fail to infer partition...

2017-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17346 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #17348: [SPARK-20018][SQL] Pivot with timestamp and count...

2017-03-19 Thread HyukjinKwon
GitHub user HyukjinKwon opened a pull request: https://github.com/apache/spark/pull/17348 [SPARK-20018][SQL] Pivot with timestamp and count should not print internal representation ## What changes were proposed in this pull request? Currently, when we perform count with tim

[GitHub] spark issue #17348: [SPARK-20018][SQL] Pivot with timestamp and count should...

2017-03-19 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/17348 cc @aray and @cloud-fan, could you take a look and see if it makes sense? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #17348: [SPARK-20018][SQL] Pivot with timestamp and count should...

2017-03-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17348 **[Test build #74824 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74824/testReport)** for PR 17348 at commit [`3c619df`](https://github.com/apache/spark/commit/3c

[GitHub] spark issue #12004: [SPARK-7481] [build] Add spark-cloud module to pull in o...

2017-03-19 Thread steveloughran
Github user steveloughran commented on the issue: https://github.com/apache/spark/pull/12004 I haven't forgotten this; I've just been trying to make the module POM-only, while adding support for Hadoop 2.6 builds, which is causing some issues downstream. Specifically, my downstream c

[GitHub] spark pull request #17349: [MINOR][R] Reorder `Collate` fields in DESCRIPTIO...

2017-03-19 Thread HyukjinKwon
GitHub user HyukjinKwon opened a pull request: https://github.com/apache/spark/pull/17349 [MINOR][R] Reorder `Collate` fields in DESCRIPTION file ## What changes were proposed in this pull request? It seems cran check scripts corrects `R/pkg/DESCRIPTION` and follows the ord

[GitHub] spark issue #17349: [MINOR][R] Reorder `Collate` fields in DESCRIPTION file

2017-03-19 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/17349 @felixcheung, could you check this? I just realised that running this script keeps producing this small diff in my local. --- If your project is set up for it, you can reply to this email and h

[GitHub] spark issue #17349: [MINOR][R] Reorder `Collate` fields in DESCRIPTION file

2017-03-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17349 **[Test build #74825 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74825/testReport)** for PR 17349 at commit [`18b18b0`](https://github.com/apache/spark/commit/18

[GitHub] spark issue #17347: [SPARK-19980][SQL] Add NULL checks in Bean serializer

2017-03-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17347 **[Test build #74822 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74822/testReport)** for PR 17347 at commit [`77458a0`](https://github.com/apache/spark/commit/7

[GitHub] spark issue #17347: [SPARK-19980][SQL] Add NULL checks in Bean serializer

2017-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17347 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17347: [SPARK-19980][SQL] Add NULL checks in Bean serializer

2017-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17347 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74822/ Test PASSed. ---

[GitHub] spark issue #17349: [MINOR][R] Reorder `Collate` fields in DESCRIPTION file

2017-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17349 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17349: [MINOR][R] Reorder `Collate` fields in DESCRIPTION file

2017-03-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17349 **[Test build #74825 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74825/testReport)** for PR 17349 at commit [`18b18b0`](https://github.com/apache/spark/commit/1

[GitHub] spark issue #17349: [MINOR][R] Reorder `Collate` fields in DESCRIPTION file

2017-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17349 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74825/ Test PASSed. ---

[GitHub] spark issue #17348: [SPARK-20018][SQL] Pivot with timestamp and count should...

2017-03-19 Thread aray
Github user aray commented on the issue: https://github.com/apache/spark/pull/17348 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark issue #17348: [SPARK-20018][SQL] Pivot with timestamp and count should...

2017-03-19 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/17348 Thank you for your sign-off @aray. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enab

[GitHub] spark issue #17343: [SPARK-20014] Optimize mergeSpillsWithFileStream method

2017-03-19 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/17343 Can you add some documentation inline so in the future we'd know why specific implementations were chosen? --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark issue #16867: [SPARK-16929] Improve performance when check speculatabl...

2017-03-19 Thread jinxing64
Github user jinxing64 commented on the issue: https://github.com/apache/spark/pull/16867 @mridulm Thanks a lot for helping review this : ) really appreciate. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pr

[GitHub] spark issue #17170: [SPARK-19825][R][ML] spark.ml R API for FPGrowth

2017-03-19 Thread zero323
Github user zero323 commented on the issue: https://github.com/apache/spark/pull/17170 Done. I marked it as blocked by SPARK-19899 and leave it to be retested once #17321 is merged. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHu

[GitHub] spark issue #17170: [SPARK-19825][R][ML] spark.ml R API for FPGrowth

2017-03-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17170 **[Test build #74826 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74826/testReport)** for PR 17170 at commit [`706514d`](https://github.com/apache/spark/commit/70

[GitHub] spark issue #17170: [SPARK-19825][R][ML] spark.ml R API for FPGrowth

2017-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17170 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17170: [SPARK-19825][R][ML] spark.ml R API for FPGrowth

2017-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17170 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74826/ Test FAILed. ---

[GitHub] spark issue #17170: [SPARK-19825][R][ML] spark.ml R API for FPGrowth

2017-03-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17170 **[Test build #74826 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74826/testReport)** for PR 17170 at commit [`706514d`](https://github.com/apache/spark/commit/7

[GitHub] spark issue #17218: [SPARK-19281][PYTHON][ML] spark.ml Python API for FPGrow...

2017-03-19 Thread zero323
Github user zero323 commented on the issue: https://github.com/apache/spark/pull/17218 __Note__: should be retested after #17321 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17218: [SPARK-19281][PYTHON][ML] spark.ml Python API for FPGrow...

2017-03-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17218 **[Test build #74827 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74827/testReport)** for PR 17218 at commit [`0a3798d`](https://github.com/apache/spark/commit/0a

[GitHub] spark issue #17218: [SPARK-19281][PYTHON][ML] spark.ml Python API for FPGrow...

2017-03-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17218 **[Test build #74827 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74827/testReport)** for PR 17218 at commit [`0a3798d`](https://github.com/apache/spark/commit/0

[GitHub] spark issue #17218: [SPARK-19281][PYTHON][ML] spark.ml Python API for FPGrow...

2017-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17218 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74827/ Test FAILed. ---

[GitHub] spark issue #17218: [SPARK-19281][PYTHON][ML] spark.ml Python API for FPGrow...

2017-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17218 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

  1   2   3   4   >