[GitHub] spark pull request #18193: [SPARK-15616] [SQL] Metastore relation should fal...

2017-06-04 Thread lianhuiwang
GitHub user lianhuiwang opened a pull request: https://github.com/apache/spark/pull/18193 [SPARK-15616] [SQL] Metastore relation should fallback to HDFS size of partitions that are involved in Query for JoinSelection. ## What changes were proposed in this pull request? Currently

[GitHub] spark issue #18159: [SPARK-20703][SQL] Associate metrics with data writes on...

2017-06-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18159 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13373: [SPARK-15616] [SQL] Metastore relation should fallback t...

2017-06-04 Thread lianhuiwang
Github user lianhuiwang commented on the issue: https://github.com/apache/spark/pull/13373 @HyukjinKwon @cloud-fan I will close this PR and create new PR #18193 for it. Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as w

[GitHub] spark pull request #13373: [SPARK-15616] [SQL] Metastore relation should fal...

2017-06-04 Thread lianhuiwang
Github user lianhuiwang closed the pull request at: https://github.com/apache/spark/pull/13373 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature i

[GitHub] spark issue #18159: [SPARK-20703][SQL] Associate metrics with data writes on...

2017-06-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18159 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77710/ Test FAILed. ---

[GitHub] spark issue #18159: [SPARK-20703][SQL] Associate metrics with data writes on...

2017-06-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18159 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77708/ Test FAILed. ---

[GitHub] spark issue #18159: [SPARK-20703][SQL] Associate metrics with data writes on...

2017-06-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18159 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77709/ Test FAILed. ---

[GitHub] spark issue #18159: [SPARK-20703][SQL] Associate metrics with data writes on...

2017-06-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18159 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18159: [SPARK-20703][SQL] Associate metrics with data writes on...

2017-06-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18159 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18159: [SPARK-20703][SQL] Associate metrics with data writes on...

2017-06-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18159 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77707/ Test FAILed. ---

[GitHub] spark issue #18159: [SPARK-20703][SQL] Associate metrics with data writes on...

2017-06-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18159 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18193: [SPARK-15616] [SQL] CatalogRelation should fallback to H...

2017-06-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18193 **[Test build #77711 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77711/testReport)** for PR 18193 at commit [`5591a1c`](https://github.com/apache/spark/commit/55

[GitHub] spark issue #18159: [SPARK-20703][SQL] Associate metrics with data writes on...

2017-06-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18159 **[Test build #77712 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77712/testReport)** for PR 18159 at commit [`32f49ea`](https://github.com/apache/spark/commit/32

[GitHub] spark issue #18186: [SPARK-20966][WEB-UI][SQL]Table data is not sorted by st...

2017-06-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18186 **[Test build #3776 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3776/testReport)** for PR 18186 at commit [`4c3dbeb`](https://github.com/apache/spark/commit/4

[GitHub] spark issue #18186: [SPARK-20966][WEB-UI][SQL]Table data is not sorted by st...

2017-06-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18186 **[Test build #3776 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3776/testReport)** for PR 18186 at commit [`4c3dbeb`](https://github.com/apache/spark/commit/

[GitHub] spark issue #18193: [SPARK-15616] [SQL] CatalogRelation should fallback to H...

2017-06-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18193 **[Test build #77711 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77711/testReport)** for PR 18193 at commit [`5591a1c`](https://github.com/apache/spark/commit/5

[GitHub] spark issue #18193: [SPARK-15616] [SQL] CatalogRelation should fallback to H...

2017-06-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18193 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18193: [SPARK-15616] [SQL] CatalogRelation should fallback to H...

2017-06-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18193 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77711/ Test PASSed. ---

[GitHub] spark issue #18159: [SPARK-20703][SQL] Associate metrics with data writes on...

2017-06-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18159 **[Test build #77713 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77713/testReport)** for PR 18159 at commit [`3137566`](https://github.com/apache/spark/commit/31

[GitHub] spark issue #18159: [SPARK-20703][SQL] Associate metrics with data writes on...

2017-06-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18159 **[Test build #77712 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77712/testReport)** for PR 18159 at commit [`32f49ea`](https://github.com/apache/spark/commit/3

[GitHub] spark issue #18159: [SPARK-20703][SQL] Associate metrics with data writes on...

2017-06-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18159 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18159: [SPARK-20703][SQL] Associate metrics with data writes on...

2017-06-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18159 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77712/ Test FAILed. ---

[GitHub] spark issue #18159: [SPARK-20703][SQL] Associate metrics with data writes on...

2017-06-04 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/18159 @cloud-fan @rxin I've removed about 200+ lines from this. Please take a look if you have time. Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #18159: [SPARK-20703][SQL] Associate metrics with data writes on...

2017-06-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18159 **[Test build #77714 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77714/testReport)** for PR 18159 at commit [`e8acb49`](https://github.com/apache/spark/commit/e8

[GitHub] spark issue #18108: [SPARK-20884] Spark' masters will be both standby due to...

2017-06-04 Thread liu-zhaokun
Github user liu-zhaokun commented on the issue: https://github.com/apache/spark/pull/18108 @srowen Could you help me review this PR? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this f

[GitHub] spark pull request #18194: [WIP][SPARK-20824][SQL] Generate code to get valu...

2017-06-04 Thread kiszk
GitHub user kiszk opened a pull request: https://github.com/apache/spark/pull/18194 [WIP][SPARK-20824][SQL] Generate code to get value from table cache with wider column in ColumnarBatch ## What changes were proposed in this pull request? This PR waits for merging #18066

[GitHub] spark issue #18194: [WIP][SPARK-20824][SQL] Generate code to get value from ...

2017-06-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18194 **[Test build #77715 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77715/testReport)** for PR 18194 at commit [`0c22730`](https://github.com/apache/spark/commit/0c

[GitHub] spark issue #18192: [SPARK-20944][SHUFFLE] Move shouldBypassMergeSort from S...

2017-06-04 Thread zhengcanbin
Github user zhengcanbin commented on the issue: https://github.com/apache/spark/pull/18192 Tks @HyukjinKwon --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #18194: [WIP][SPARK-20824][SQL] Generate code to get value from ...

2017-06-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18194 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18194: [WIP][SPARK-20824][SQL] Generate code to get value from ...

2017-06-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18194 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77715/ Test FAILed. ---

[GitHub] spark issue #18194: [WIP][SPARK-20824][SQL] Generate code to get value from ...

2017-06-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18194 **[Test build #77715 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77715/testReport)** for PR 18194 at commit [`0c22730`](https://github.com/apache/spark/commit/0

[GitHub] spark issue #18194: [WIP][SPARK-20824][SQL] Generate code to get value from ...

2017-06-04 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/18194 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishe

[GitHub] spark pull request #13171: [SPARK-15380][SQL][WIP] Generate code that stores...

2017-06-04 Thread kiszk
Github user kiszk closed the pull request at: https://github.com/apache/spark/pull/13171 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark issue #13171: [SPARK-15380][SQL][WIP] Generate code that stores a floa...

2017-06-04 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/13171 @HyukjinKwon Thank you for your gentle ping. While there is no follow-up PR for this, this is out-of-date. Let me close this for now. --- If your project is set up for it, you can reply to this e

[GitHub] spark issue #18194: [WIP][SPARK-20824][SQL] Generate code to get value from ...

2017-06-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18194 **[Test build #77716 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77716/testReport)** for PR 18194 at commit [`0c22730`](https://github.com/apache/spark/commit/0c

[GitHub] spark pull request #16986: [SPARK-18891][SQL] Support for Scala Map collecti...

2017-06-04 Thread michalsenkyr
Github user michalsenkyr commented on a diff in the pull request: https://github.com/apache/spark/pull/16986#discussion_r120009967 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/objects/objects.scala --- @@ -652,6 +653,299 @@ case class MapObjects

[GitHub] spark issue #18194: [WIP][SPARK-20824][SQL] Generate code to get value from ...

2017-06-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18194 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77716/ Test FAILed. ---

[GitHub] spark issue #18194: [WIP][SPARK-20824][SQL] Generate code to get value from ...

2017-06-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18194 **[Test build #77716 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77716/testReport)** for PR 18194 at commit [`0c22730`](https://github.com/apache/spark/commit/0

[GitHub] spark issue #18194: [WIP][SPARK-20824][SQL] Generate code to get value from ...

2017-06-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18194 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #16986: [SPARK-18891][SQL] Support for Scala Map collecti...

2017-06-04 Thread michalsenkyr
Github user michalsenkyr commented on a diff in the pull request: https://github.com/apache/spark/pull/16986#discussion_r120010289 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/objects/objects.scala --- @@ -652,6 +653,299 @@ case class MapObjects

[GitHub] spark pull request #16986: [SPARK-18891][SQL] Support for Scala Map collecti...

2017-06-04 Thread michalsenkyr
Github user michalsenkyr commented on a diff in the pull request: https://github.com/apache/spark/pull/16986#discussion_r120010461 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/objects/objects.scala --- @@ -652,6 +653,299 @@ case class MapObjects

[GitHub] spark issue #18159: [SPARK-20703][SQL] Associate metrics with data writes on...

2017-06-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18159 **[Test build #77713 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77713/testReport)** for PR 18159 at commit [`3137566`](https://github.com/apache/spark/commit/3

[GitHub] spark issue #18159: [SPARK-20703][SQL] Associate metrics with data writes on...

2017-06-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18159 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #16986: [SPARK-18891][SQL] Support for Scala Map collecti...

2017-06-04 Thread michalsenkyr
Github user michalsenkyr commented on a diff in the pull request: https://github.com/apache/spark/pull/16986#discussion_r120010531 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/objects/objects.scala --- @@ -652,6 +653,299 @@ case class MapObjects

[GitHub] spark issue #18159: [SPARK-20703][SQL] Associate metrics with data writes on...

2017-06-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18159 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77713/ Test PASSed. ---

[GitHub] spark issue #18159: [SPARK-20703][SQL] Associate metrics with data writes on...

2017-06-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18159 **[Test build #77717 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77717/testReport)** for PR 18159 at commit [`de069e7`](https://github.com/apache/spark/commit/de

[GitHub] spark issue #18159: [SPARK-20703][SQL] Associate metrics with data writes on...

2017-06-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18159 **[Test build #77714 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77714/testReport)** for PR 18159 at commit [`e8acb49`](https://github.com/apache/spark/commit/e

[GitHub] spark issue #18159: [SPARK-20703][SQL] Associate metrics with data writes on...

2017-06-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18159 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18159: [SPARK-20703][SQL] Associate metrics with data writes on...

2017-06-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18159 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77714/ Test PASSed. ---

[GitHub] spark issue #18159: [SPARK-20703][SQL] Associate metrics with data writes on...

2017-06-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18159 **[Test build #77718 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77718/testReport)** for PR 18159 at commit [`82de2a3`](https://github.com/apache/spark/commit/82

[GitHub] spark issue #18159: [SPARK-20703][SQL] Associate metrics with data writes on...

2017-06-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18159 **[Test build #77719 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77719/testReport)** for PR 18159 at commit [`ba1070b`](https://github.com/apache/spark/commit/ba

[GitHub] spark pull request #18195: [SPARK-20921][SQL][WIP] Support can config Oracle...

2017-06-04 Thread wangyum
GitHub user wangyum opened a pull request: https://github.com/apache/spark/pull/18195 [SPARK-20921][SQL][WIP] Support can config OracleDialect whether convert number(1) to BooleanType ## What changes were proposed in this pull request? Support can config OracleDialect wheth

[GitHub] spark issue #18195: [SPARK-20921][SQL][WIP] Support can config OracleDialect...

2017-06-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18195 **[Test build #77720 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77720/testReport)** for PR 18195 at commit [`febdf69`](https://github.com/apache/spark/commit/fe

[GitHub] spark issue #18159: [SPARK-20703][SQL] Associate metrics with data writes on...

2017-06-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18159 **[Test build #77721 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77721/testReport)** for PR 18159 at commit [`775d2c2`](https://github.com/apache/spark/commit/77

[GitHub] spark issue #18195: [SPARK-20921][SQL][WIP] Support can config OracleDialect...

2017-06-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18195 **[Test build #77720 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77720/testReport)** for PR 18195 at commit [`febdf69`](https://github.com/apache/spark/commit/f

[GitHub] spark issue #18195: [SPARK-20921][SQL][WIP] Support can config OracleDialect...

2017-06-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18195 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77720/ Test FAILed. ---

[GitHub] spark issue #18195: [SPARK-20921][SQL][WIP] Support can config OracleDialect...

2017-06-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18195 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18159: [SPARK-20703][SQL] Associate metrics with data writes on...

2017-06-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18159 **[Test build #77717 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77717/testReport)** for PR 18159 at commit [`de069e7`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #18159: [SPARK-20703][SQL] Associate metrics with data writes on...

2017-06-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18159 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18159: [SPARK-20703][SQL] Associate metrics with data writes on...

2017-06-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18159 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77717/ Test PASSed. ---

[GitHub] spark pull request #16986: [SPARK-18891][SQL] Support for Scala Map collecti...

2017-06-04 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16986#discussion_r120014990 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/objects/objects.scala --- @@ -652,6 +653,299 @@ case class MapObjects pri

[GitHub] spark pull request #16986: [SPARK-18891][SQL] Support for Scala Map collecti...

2017-06-04 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16986#discussion_r120015031 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/objects/objects.scala --- @@ -652,6 +653,299 @@ case class MapObjects pri

[GitHub] spark pull request #16986: [SPARK-18891][SQL] Support for Scala Map collecti...

2017-06-04 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16986#discussion_r120015023 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/objects/objects.scala --- @@ -652,6 +653,299 @@ case class MapObjects pri

[GitHub] spark pull request #18193: [SPARK-15616] [SQL] CatalogRelation should fallba...

2017-06-04 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18193#discussion_r120015133 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/PruneFileSourcePartitions.scala --- @@ -59,7 +60,10 @@ private[sql] object P

[GitHub] spark issue #17953: [SPARK-20680][SQL] Spark-sql do not support for void col...

2017-06-04 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/17953 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #17953: [SPARK-20680][SQL] Spark-sql do not support for void col...

2017-06-04 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/17953 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] spark issue #18183: [SPARK-20961][SQL] generalize the dictionary in ColumnVe...

2017-06-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18183 **[Test build #77722 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77722/testReport)** for PR 18183 at commit [`88a0b24`](https://github.com/apache/spark/commit/88

[GitHub] spark issue #17953: [SPARK-20680][SQL] Spark-sql do not support for void col...

2017-06-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17953 **[Test build #77723 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77723/testReport)** for PR 17953 at commit [`fda353f`](https://github.com/apache/spark/commit/fd

[GitHub] spark issue #18159: [SPARK-20703][SQL] Associate metrics with data writes on...

2017-06-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18159 **[Test build #77718 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77718/testReport)** for PR 18159 at commit [`82de2a3`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #18159: [SPARK-20703][SQL] Associate metrics with data writes on...

2017-06-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18159 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18159: [SPARK-20703][SQL] Associate metrics with data writes on...

2017-06-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18159 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77718/ Test PASSed. ---

[GitHub] spark issue #18159: [SPARK-20703][SQL] Associate metrics with data writes on...

2017-06-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18159 **[Test build #77719 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77719/testReport)** for PR 18159 at commit [`ba1070b`](https://github.com/apache/spark/commit/b

[GitHub] spark issue #18159: [SPARK-20703][SQL] Associate metrics with data writes on...

2017-06-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18159 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18159: [SPARK-20703][SQL] Associate metrics with data writes on...

2017-06-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18159 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77719/ Test PASSed. ---

[GitHub] spark issue #18159: [SPARK-20703][SQL] Associate metrics with data writes on...

2017-06-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18159 **[Test build #77721 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77721/testReport)** for PR 18159 at commit [`775d2c2`](https://github.com/apache/spark/commit/7

[GitHub] spark issue #18128: [SPARK-20906][SparkR]:Constrained Logistic Regression fo...

2017-06-04 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/18128 ok, thanks, i guess it could be set as `0L` but this is good. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark issue #18159: [SPARK-20703][SQL] Associate metrics with data writes on...

2017-06-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18159 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18159: [SPARK-20703][SQL] Associate metrics with data writes on...

2017-06-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18159 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77721/ Test PASSed. ---

[GitHub] spark issue #17953: [SPARK-20680][SQL] Spark-sql do not support for void col...

2017-06-04 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/17953 shall we add a test case for `CREATE TABLE t(a void)` to make sure it still fails? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark issue #17953: [SPARK-20680][SQL] Spark-sql do not support for void col...

2017-06-04 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/17953 I think a safer fix is to just handle "void" specially in `HiveClientImpl.fromHiveColumn` --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark issue #17953: [SPARK-20680][SQL] Spark-sql do not support for void col...

2017-06-04 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/17953 oh actually users can still create a table with null type column via `Catalog.createTable`, seems it's ok to support "void" in our parser, but add a new rule to throw exception if users wanna crea

[GitHub] spark issue #13171: [SPARK-15380][SQL][WIP] Generate code that stores a floa...

2017-06-04 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/13171 Yea, I just happened to ping here and there. Thanks for bearing with my ping. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark issue #17953: [SPARK-20680][SQL] Spark-sql do not support for void col...

2017-06-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17953 **[Test build #77723 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77723/testReport)** for PR 17953 at commit [`fda353f`](https://github.com/apache/spark/commit/f

[GitHub] spark issue #17953: [SPARK-20680][SQL] Spark-sql do not support for void col...

2017-06-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17953 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17953: [SPARK-20680][SQL] Spark-sql do not support for void col...

2017-06-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17953 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77723/ Test FAILed. ---

[GitHub] spark issue #18183: [SPARK-20961][SQL] generalize the dictionary in ColumnVe...

2017-06-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18183 **[Test build #77722 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77722/testReport)** for PR 18183 at commit [`88a0b24`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #18183: [SPARK-20961][SQL] generalize the dictionary in ColumnVe...

2017-06-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18183 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18183: [SPARK-20961][SQL] generalize the dictionary in ColumnVe...

2017-06-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18183 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77722/ Test PASSed. ---

[GitHub] spark issue #16986: [SPARK-18891][SQL] Support for Scala Map collection type...

2017-06-04 Thread michalsenkyr
Github user michalsenkyr commented on the issue: https://github.com/apache/spark/pull/16986 So I tried to simplify the code as much as possible, removing unneeded parameters. I must admit I am not entirely sure about whether I am handling all the data types correctly but everything se

[GitHub] spark issue #18189: [SPARK-20972][SQL] rename HintInfo.isBroadcastable to fo...

2017-06-04 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/18189 But isn't it in a hint? If you are worried about user, I'd just change it to "broadcast". --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well

[GitHub] spark issue #18183: [SPARK-20961][SQL] generalize the dictionary in ColumnVe...

2017-06-04 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/18183 Thanks! Merging to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and w

[GitHub] spark pull request #18183: [SPARK-20961][SQL] generalize the dictionary in C...

2017-06-04 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/18183 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request #18196: [SPARK-20976] [SQL] Unify Error Messages for FAIL...

2017-06-04 Thread gatorsmile
GitHub user gatorsmile opened a pull request: https://github.com/apache/spark/pull/18196 [SPARK-20976] [SQL] Unify Error Messages for FAILFAST mode ### What changes were proposed in this pull request? Before 2.2, we indicate the job was terminated because of `FAILFAST` mode.

[GitHub] spark pull request #18196: [SPARK-20976] [SQL] Unify Error Messages for FAIL...

2017-06-04 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/18196#discussion_r120020584 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/json/JacksonParser.scala --- @@ -278,7 +278,7 @@ class JacksonParser( //

[GitHub] spark issue #18196: [SPARK-20976] [SQL] Unify Error Messages for FAILFAST mo...

2017-06-04 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/18196 cc @cloud-fan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #18196: [SPARK-20976] [SQL] Unify Error Messages for FAILFAST mo...

2017-06-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18196 **[Test build #77724 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77724/testReport)** for PR 18196 at commit [`091062a`](https://github.com/apache/spark/commit/09

[GitHub] spark pull request #16928: [SPARK-18699][SQL] Put malformed tokens into a ne...

2017-06-04 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16928#discussion_r120021921 --- Diff: python/pyspark/sql/readwriter.py --- @@ -191,10 +191,13 @@ def json(self, path, schema=None, primitivesAsString=None, prefersDecimal=None,

[GitHub] spark pull request #16986: [SPARK-18891][SQL] Support for Scala Map collecti...

2017-06-04 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16986#discussion_r120022281 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/objects/objects.scala --- @@ -652,6 +653,218 @@ case class MapObjects pri

[GitHub] spark pull request #16986: [SPARK-18891][SQL] Support for Scala Map collecti...

2017-06-04 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16986#discussion_r120022295 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/objects/objects.scala --- @@ -652,6 +653,218 @@ case class MapObjects pri

[GitHub] spark pull request #16986: [SPARK-18891][SQL] Support for Scala Map collecti...

2017-06-04 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16986#discussion_r120022302 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/SQLImplicits.scala --- @@ -166,6 +167,10 @@ abstract class SQLImplicits extends LowPrioritySQLImpl

  1   2   3   >