[GitHub] spark issue #16818: [SPARK-19451][SQL][Core] Underlying integer overflow in ...

2017-02-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16818 **[Test build #72569 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72569/testReport)** for PR 16818 at commit [`268ba58`](https://github.com/apache/spark/commit/26

[GitHub] spark pull request #16837: [SPARK-19359][SQL] renaming partition should not ...

2017-02-07 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/16837#discussion_r18693 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/PartitionProviderCompatibilitySuite.scala --- @@ -481,4 +484,30 @@ class PartitionProviderCompat

[GitHub] spark issue #16497: [SPARK-19118] [SQL] Percentile support for frequency dis...

2017-02-07 Thread tanejagagan
Github user tanejagagan commented on the issue: https://github.com/apache/spark/pull/16497 Thanks to you for including the changes --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this featur

[GitHub] spark issue #16843: [SPARK-18609][SPARK-18841][SQL] Fix redundant Alias remo...

2017-02-07 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/16843 Merging this to 2.1. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #16757: [SPARK-18609][SPARK-18841][SQL] Fix redundant Alias remo...

2017-02-07 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/16757 It had a merge conflict, so I opened: https://github.com/apache/spark/pull/16843 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. I

[GitHub] spark issue #16740: [SPARK-19400][ML] Allow GLM to handle intercept only mod...

2017-02-07 Thread actuaryzhang
Github user actuaryzhang commented on the issue: https://github.com/apache/spark/pull/16740 @jkbradley Thanks much for the review and suggestion. I updated the error message. Please let me know if there's anything else needed for this PR. Thanks. --- If your project is set up for it,

[GitHub] spark pull request #16736: [SPARK-19265][SQL][Follow-up] Configurable `table...

2017-02-07 Thread lw-lin
Github user lw-lin commented on a diff in the pull request: https://github.com/apache/spark/pull/16736#discussion_r13797 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/internal/SQLConfEntrySuite.scala --- @@ -164,6 +164,18 @@ class SQLConfEntrySuite extends SparkFunSui

[GitHub] spark pull request #16776: [SPARK-19436][SQL] Add missing tests for approxQu...

2017-02-07 Thread zhengruifeng
Github user zhengruifeng commented on a diff in the pull request: https://github.com/apache/spark/pull/16776#discussion_r13717 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/DataFrameStatFunctions.scala --- @@ -63,44 +63,49 @@ final class DataFrameStatFunctions private[

[GitHub] spark issue #16851: [SPARK-19508][Core] Improve error message when binding s...

2017-02-07 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/16851 cc @srowen @andrewor14 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #16386: [SPARK-18352][SQL] Support parsing multiline json files

2017-02-07 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/16386 Hi @NathanHowell , do you have time to work on it? thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request #16736: [SPARK-19265][SQL][Follow-up] Configurable `table...

2017-02-07 Thread lw-lin
Github user lw-lin commented on a diff in the pull request: https://github.com/apache/spark/pull/16736#discussion_r13250 --- Diff: core/src/test/scala/org/apache/spark/internal/config/ConfigEntrySuite.scala --- @@ -128,6 +128,25 @@ class ConfigEntrySuite extends SparkFunSuite {

[GitHub] spark issue #16664: [SPARK-18120 ][SQL] Call QueryExecutionListener callback...

2017-02-07 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/16664 I think it's ok to enable the listener for `DataFrameWriter` first, we can think about DDL commands later --- If your project is set up for it, you can reply to this email and have your reply app

[GitHub] spark pull request #16674: [SPARK-19331][SQL][TESTS] Improve the test covera...

2017-02-07 Thread jiangxb1987
Github user jiangxb1987 commented on a diff in the pull request: https://github.com/apache/spark/pull/16674#discussion_r12542 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/SQLViewSuite.scala --- @@ -452,311 +506,96 @@ class SQLViewSuite extends QueryTest with

[GitHub] spark pull request #16674: [SPARK-19331][SQL][TESTS] Improve the test covera...

2017-02-07 Thread jiangxb1987
Github user jiangxb1987 commented on a diff in the pull request: https://github.com/apache/spark/pull/16674#discussion_r12779 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/SQLViewSuite.scala --- @@ -452,311 +506,96 @@ class SQLViewSuite extends QueryTest with

[GitHub] spark pull request #16674: [SPARK-19331][SQL][TESTS] Improve the test covera...

2017-02-07 Thread jiangxb1987
Github user jiangxb1987 commented on a diff in the pull request: https://github.com/apache/spark/pull/16674#discussion_r12271 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/SQLViewSuite.scala --- @@ -452,311 +506,96 @@ class SQLViewSuite extends QueryTest with

[GitHub] spark pull request #16674: [SPARK-19331][SQL][TESTS] Improve the test covera...

2017-02-07 Thread jiangxb1987
Github user jiangxb1987 commented on a diff in the pull request: https://github.com/apache/spark/pull/16674#discussion_r12255 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/SQLViewSuite.scala --- @@ -427,15 +481,15 @@ class SQLViewSuite extends QueryTest with

[GitHub] spark pull request #16674: [SPARK-19331][SQL][TESTS] Improve the test covera...

2017-02-07 Thread jiangxb1987
Github user jiangxb1987 commented on a diff in the pull request: https://github.com/apache/spark/pull/16674#discussion_r12125 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/SQLViewSuite.scala --- @@ -398,26 +472,6 @@ class SQLViewSuite extends QueryTest with S

[GitHub] spark pull request #16674: [SPARK-19331][SQL][TESTS] Improve the test covera...

2017-02-07 Thread jiangxb1987
Github user jiangxb1987 commented on a diff in the pull request: https://github.com/apache/spark/pull/16674#discussion_r12440 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/SQLViewSuite.scala --- @@ -452,311 +506,96 @@ class SQLViewSuite extends QueryTest with

[GitHub] spark pull request #16674: [SPARK-19331][SQL][TESTS] Improve the test covera...

2017-02-07 Thread jiangxb1987
Github user jiangxb1987 commented on a diff in the pull request: https://github.com/apache/spark/pull/16674#discussion_r12647 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/SQLViewSuite.scala --- @@ -452,311 +506,96 @@ class SQLViewSuite extends QueryTest with

[GitHub] spark pull request #16674: [SPARK-19331][SQL][TESTS] Improve the test covera...

2017-02-07 Thread jiangxb1987
Github user jiangxb1987 commented on a diff in the pull request: https://github.com/apache/spark/pull/16674#discussion_r12487 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/SQLViewSuite.scala --- @@ -452,311 +506,96 @@ class SQLViewSuite extends QueryTest with

[GitHub] spark issue #16851: [SPARK-19508][Core] Improve error message when binding s...

2017-02-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16851 **[Test build #72568 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72568/testReport)** for PR 16851 at commit [`1fce3d5`](https://github.com/apache/spark/commit/1f

[GitHub] spark pull request #16851: [SPARK-19508][Core] Improve error message when bi...

2017-02-07 Thread viirya
GitHub user viirya opened a pull request: https://github.com/apache/spark/pull/16851 [SPARK-19508][Core] Improve error message when binding service fails ## What changes were proposed in this pull request? Utils provides a helper function to bind service on port. This functi

[GitHub] spark issue #16760: [SPARK-18872][SQL][TESTS] New test cases for EXISTS subq...

2017-02-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16760 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16760: [SPARK-18872][SQL][TESTS] New test cases for EXISTS subq...

2017-02-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16760 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72558/ Test FAILed. ---

[GitHub] spark issue #16674: [SPARK-19331][SQL][TESTS] Improve the test coverage of S...

2017-02-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16674 **[Test build #72567 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72567/testReport)** for PR 16674 at commit [`2e201c2`](https://github.com/apache/spark/commit/2e

[GitHub] spark issue #16760: [SPARK-18872][SQL][TESTS] New test cases for EXISTS subq...

2017-02-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16760 **[Test build #72558 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72558/testReport)** for PR 16760 at commit [`2473e0c`](https://github.com/apache/spark/commit/2

[GitHub] spark issue #16837: [SPARK-19359][SQL] renaming partition should not leave u...

2017-02-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16837 **[Test build #72566 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72566/testReport)** for PR 16837 at commit [`329886e`](https://github.com/apache/spark/commit/32

[GitHub] spark pull request #16776: [SPARK-19436][SQL] Add missing tests for approxQu...

2017-02-07 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16776#discussion_r10590 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/DataFrameStatFunctions.scala --- @@ -63,44 +63,49 @@ final class DataFrameStatFunctions private[sq

[GitHub] spark issue #16848: [SPARK-19279][SQL][Follow-up] Infer Schema for Hive Serd...

2017-02-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16848 **[Test build #72565 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72565/testReport)** for PR 16848 at commit [`1146f26`](https://github.com/apache/spark/commit/11

[GitHub] spark issue #16848: [SPARK-19279][SQL][Follow-up] Infer Schema for Hive Serd...

2017-02-07 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16848 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] spark pull request #16776: [SPARK-19436][SQL] Add missing tests for approxQu...

2017-02-07 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16776#discussion_r9962 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/DataFrameStatFunctions.scala --- @@ -63,44 +63,49 @@ final class DataFrameStatFunctions private[sql

[GitHub] spark pull request #16834: [SPARK-19488][SQL]fix csv infer schema when the f...

2017-02-07 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16834 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #16740: [SPARK-19400][ML] Allow GLM to handle intercept only mod...

2017-02-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16740 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16740: [SPARK-19400][ML] Allow GLM to handle intercept only mod...

2017-02-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16740 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72559/ Test PASSed. ---

[GitHub] spark issue #16740: [SPARK-19400][ML] Allow GLM to handle intercept only mod...

2017-02-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16740 **[Test build #72559 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72559/testReport)** for PR 16740 at commit [`5a0ff27`](https://github.com/apache/spark/commit/5

[GitHub] spark issue #16834: [SPARK-19488][SQL]fix csv infer schema when the field is...

2017-02-07 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/16834 thanks, merging to master! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wi

[GitHub] spark pull request #16837: [SPARK-19359][SQL] renaming partition should not ...

2017-02-07 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16837#discussion_r9328 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala --- @@ -892,21 +892,59 @@ private[spark] class HiveExternalCatalog(co

[GitHub] spark issue #16787: [WIP][SPARK-19448][SQL]optimize some duplication functio...

2017-02-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16787 **[Test build #72564 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72564/testReport)** for PR 16787 at commit [`a3c9f5e`](https://github.com/apache/spark/commit/a3

[GitHub] spark pull request #16845: [SPARK-19505][Python] AttributeError on Exception...

2017-02-07 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/16845#discussion_r9008 --- Diff: python/pyspark/broadcast.py --- @@ -82,7 +82,7 @@ def dump(self, value, f): except pickle.PickleError: raise

[GitHub] spark issue #16787: [WIP][SPARK-19448][SQL]optimize some duplication functio...

2017-02-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16787 **[Test build #72563 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72563/testReport)** for PR 16787 at commit [`22140f0`](https://github.com/apache/spark/commit/22

[GitHub] spark pull request #16736: [SPARK-19265][SQL][Follow-up] Configurable `table...

2017-02-07 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16736#discussion_r8761 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/internal/SQLConfEntrySuite.scala --- @@ -164,6 +164,18 @@ class SQLConfEntrySuite extends SparkFunS

[GitHub] spark issue #16845: [SPARK-19505][Python] AttributeError on Exception.messag...

2017-02-07 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16845 Yes, up to my knowledge, `message` attribute is deprecated from 2.6 and removed in 3.x. It seems reasonable. Let me please @holdenk. --- If your project is set up for it, you can reply to this

[GitHub] spark pull request #16736: [SPARK-19265][SQL][Follow-up] Configurable `table...

2017-02-07 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16736#discussion_r8593 --- Diff: core/src/test/scala/org/apache/spark/internal/config/ConfigEntrySuite.scala --- @@ -128,6 +128,25 @@ class ConfigEntrySuite extends SparkFunSuite

[GitHub] spark pull request #16837: [SPARK-19359][SQL] renaming partition should not ...

2017-02-07 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/16837#discussion_r8413 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala --- @@ -892,21 +892,59 @@ private[spark] class HiveExternalCatalog(conf:

[GitHub] spark pull request #16844: [SPARK-19500] [SQL] Fix off-by-one bug in BytesTo...

2017-02-07 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/16844#discussion_r8291 --- Diff: core/src/main/java/org/apache/spark/unsafe/map/BytesToBytesMap.java --- @@ -742,7 +742,7 @@ public boolean append(Object kbase, long koff, int klen

[GitHub] spark issue #16848: [SPARK-19279][SQL][Follow-up] Infer Schema for Hive Serd...

2017-02-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16848 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72556/ Test FAILed. ---

[GitHub] spark issue #16476: [SPARK-19084][SQL] Implement expression field

2017-02-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16476 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16848: [SPARK-19279][SQL][Follow-up] Infer Schema for Hive Serd...

2017-02-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16848 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16848: [SPARK-19279][SQL][Follow-up] Infer Schema for Hive Serd...

2017-02-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16848 **[Test build #72556 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72556/testReport)** for PR 16848 at commit [`1146f26`](https://github.com/apache/spark/commit/1

[GitHub] spark issue #16476: [SPARK-19084][SQL] Implement expression field

2017-02-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16476 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72554/ Test PASSed. ---

[GitHub] spark issue #16476: [SPARK-19084][SQL] Implement expression field

2017-02-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16476 **[Test build #72554 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72554/testReport)** for PR 16476 at commit [`c23deb5`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #16828: [SPARK-19484][SQL]continue work to create hive table wit...

2017-02-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16828 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72557/ Test FAILed. ---

[GitHub] spark issue #16828: [SPARK-19484][SQL]continue work to create hive table wit...

2017-02-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16828 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16828: [SPARK-19484][SQL]continue work to create hive table wit...

2017-02-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16828 **[Test build #72557 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72557/testReport)** for PR 16828 at commit [`cc5141a`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #16736: [SPARK-19265][SQL][Follow-up] Configurable `tableRelatio...

2017-02-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16736 **[Test build #72562 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72562/testReport)** for PR 16736 at commit [`cb6db57`](https://github.com/apache/spark/commit/cb

[GitHub] spark issue #16620: [SPARK-19263] DAGScheduler should avoid sending conflict...

2017-02-07 Thread jinxing64
Github user jinxing64 commented on the issue: https://github.com/apache/spark/pull/16620 @markhamstra @squito @kayousterhout It would be great if you can give more comments about above and I can continue working on this : ) --- If your project is set up for it, you can reply to

[GitHub] spark issue #16736: [SPARK-19265][SQL][Follow-up] Configurable `tableRelatio...

2017-02-07 Thread lw-lin
Github user lw-lin commented on the issue: https://github.com/apache/spark/pull/16736 Jenkins retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishe

[GitHub] spark issue #16736: [SPARK-19265][SQL][Follow-up] Configurable `tableRelatio...

2017-02-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16736 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72561/ Test FAILed. ---

[GitHub] spark issue #16736: [SPARK-19265][SQL][Follow-up] Configurable `tableRelatio...

2017-02-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16736 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #16836: remove parenthesis in readStream() on kafka struc...

2017-02-07 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16836 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #16736: [SPARK-19265][SQL][Follow-up] Configurable `tableRelatio...

2017-02-07 Thread lw-lin
Github user lw-lin commented on the issue: https://github.com/apache/spark/pull/16736 Jenkins retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishe

[GitHub] spark issue #16834: [SPARK-19488][SQL]fix csv infer schema when the field is...

2017-02-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16834 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72552/ Test PASSed. ---

[GitHub] spark issue #16834: [SPARK-19488][SQL]fix csv infer schema when the field is...

2017-02-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16834 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16834: [SPARK-19488][SQL]fix csv infer schema when the field is...

2017-02-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16834 **[Test build #72552 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72552/testReport)** for PR 16834 at commit [`452df9d`](https://github.com/apache/spark/commit/4

[GitHub] spark issue #16836: remove parenthesis in readStream() on kafka structured s...

2017-02-07 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/16836 LGTM. Merging to master and 2.1 since this only touches docs. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #16836: remove parenthesis in readStream() on kafka structured s...

2017-02-07 Thread tdas
Github user tdas commented on the issue: https://github.com/apache/spark/pull/16836 Aah, since readStream in python is marked as property, @manugarri may be right about it not working. I remember that i did not verify the code by running them. @zsxwing did you? --- If your project

[GitHub] spark issue #16850: [SPARK-19413][SS] MapGroupsWithState for arbitrary state...

2017-02-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16850 **[Test build #72560 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72560/testReport)** for PR 16850 at commit [`5025cb7`](https://github.com/apache/spark/commit/50

[GitHub] spark pull request #16849: [SPARK-19413][SS] MapGroupsWithState for arbitrar...

2017-02-07 Thread tdas
Github user tdas closed the pull request at: https://github.com/apache/spark/pull/16849 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[GitHub] spark pull request #16850: [SPARK-19413][SS] MapGroupsWithState for arbitrar...

2017-02-07 Thread tdas
GitHub user tdas opened a pull request: https://github.com/apache/spark/pull/16850 [SPARK-19413][SS] MapGroupsWithState for arbitrary stateful operations ## What changes were proposed in this pull request? `mapGroupsWithState` is a new API for arbitrary stateful operations i

[GitHub] spark pull request #16849: [SPARK-19413][SS] MapGroupsWithState for arbitrar...

2017-02-07 Thread tdas
GitHub user tdas opened a pull request: https://github.com/apache/spark/pull/16849 [SPARK-19413][SS] MapGroupsWithState for arbitrary stateful operations for branch-2.1 ## What changes were proposed in this pull request? `mapGroupsWithState` is a new API for arbitrary state

[GitHub] spark issue #16837: [SPARK-19359][SQL] renaming partition should not leave u...

2017-02-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16837 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16837: [SPARK-19359][SQL] renaming partition should not leave u...

2017-02-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16837 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72555/ Test FAILed. ---

[GitHub] spark issue #16837: [SPARK-19359][SQL] renaming partition should not leave u...

2017-02-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16837 **[Test build #72555 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72555/testReport)** for PR 16837 at commit [`d8f2ba5`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #16740: [SPARK-19400][ML] Allow GLM to handle intercept only mod...

2017-02-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16740 **[Test build #72559 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72559/testReport)** for PR 16740 at commit [`5a0ff27`](https://github.com/apache/spark/commit/5a

[GitHub] spark issue #16844: [SPARK-19500] [SQL] Fix off-by-one bug in BytesToBytesMa...

2017-02-07 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/16844 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the featur

[GitHub] spark issue #16733: [SPARK-19392][SQL] Fix the bug that throws an exception ...

2017-02-07 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/16733 Yea, I sent the e-mail, but I didn't get a reply from him; http://apache-spark-developers-list.1001551.n3.nabble.com/Re-Oracle-JDBC-Spark-SQL-Key-Not-Found-Scale-td20835.html --- If your project is

[GitHub] spark pull request #16828: [SPARK-19484][SQL]continue work to create hive ta...

2017-02-07 Thread windpiger
Github user windpiger closed the pull request at: https://github.com/apache/spark/pull/16828 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16828: [SPARK-19484][SQL]continue work to create hive table wit...

2017-02-07 Thread windpiger
Github user windpiger commented on the issue: https://github.com/apache/spark/pull/16828 ok, I will close it. Thanks! @cloud-fan @gatorsmile --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #16828: [SPARK-19484][SQL]continue work to create hive table wit...

2017-02-07 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16828 The later potential problems? If we do not unify `toHiveTable`, are you able to write a test case to hit this issue? --- If your project is set up for it, you can reply to this email and have yo

[GitHub] spark issue #16828: [SPARK-19484][SQL]continue work to create hive table wit...

2017-02-07 Thread windpiger
Github user windpiger commented on the issue: https://github.com/apache/spark/pull/16828 I think this is also an improvement to avoid some later potential problems, can we keep it? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHu

[GitHub] spark issue #16760: [SPARK-18872][SQL][TESTS] New test cases for EXISTS subq...

2017-02-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16760 **[Test build #72558 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72558/testReport)** for PR 16760 at commit [`2473e0c`](https://github.com/apache/spark/commit/24

[GitHub] spark issue #16760: [SPARK-18872][SQL][TESTS] New test cases for EXISTS subq...

2017-02-07 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16760 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] spark pull request #16664: [SPARK-18120 ][SQL] Call QueryExecutionListener c...

2017-02-07 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16664#discussion_r1981 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/DataFrameWriter.scala --- @@ -218,7 +247,14 @@ final class DataFrameWriter[T] private[sql](ds: Dat

[GitHub] spark pull request #16828: [SPARK-19484][SQL]continue work to create hive ta...

2017-02-07 Thread windpiger
Github user windpiger commented on a diff in the pull request: https://github.com/apache/spark/pull/16828#discussion_r1790 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveClientImpl.scala --- @@ -832,7 +833,10 @@ private[hive] class HiveClientImpl(

[GitHub] spark issue #16828: [SPARK-19484][SQL]continue work to create hive table wit...

2017-02-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16828 **[Test build #72557 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72557/testReport)** for PR 16828 at commit [`cc5141a`](https://github.com/apache/spark/commit/cc

[GitHub] spark pull request #16664: [SPARK-18120 ][SQL] Call QueryExecutionListener c...

2017-02-07 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16664#discussion_r1251 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/DataFrameWriter.scala --- @@ -218,7 +247,14 @@ final class DataFrameWriter[T] private[sql](ds: Dat

[GitHub] spark pull request #16828: [SPARK-19484][SQL]continue work to create hive ta...

2017-02-07 Thread windpiger
Github user windpiger commented on a diff in the pull request: https://github.com/apache/spark/pull/16828#discussion_r1169 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveClientImpl.scala --- @@ -832,7 +833,10 @@ private[hive] class HiveClientImpl(

[GitHub] spark issue #16828: [SPARK-19484][SQL]continue work to create hive table wit...

2017-02-07 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/16828 looks like this PR is not so self-contained, can you embed it to your PR about unifying `toHiveTable`? --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark issue #16848: [SPARK-19279][SQL][Follow-up] Infer Schema for Hive Serd...

2017-02-07 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/16848 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the fea

[GitHub] spark issue #16638: [SPARK-19115] [SQL] Supporting Create External Table Lik...

2017-02-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16638 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72550/ Test PASSed. ---

[GitHub] spark issue #16638: [SPARK-19115] [SQL] Supporting Create External Table Lik...

2017-02-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16638 Build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #16840: [SPARK-19499][SS]Add more notes in the comments of Sink....

2017-02-07 Thread CodingCat
Github user CodingCat commented on the issue: https://github.com/apache/spark/pull/16840 thanks --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the f

[GitHub] spark issue #16828: [SPARK-19484][SQL]continue work to create hive table wit...

2017-02-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16828 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16638: [SPARK-19115] [SQL] Supporting Create External Table Lik...

2017-02-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16638 **[Test build #72550 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72550/testReport)** for PR 16638 at commit [`71f1d12`](https://github.com/apache/spark/commit/7

[GitHub] spark issue #16828: [SPARK-19484][SQL]continue work to create hive table wit...

2017-02-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16828 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72551/ Test PASSed. ---

[GitHub] spark issue #16620: [SPARK-19263] DAGScheduler should avoid sending conflict...

2017-02-07 Thread jinxing64
Github user jinxing64 commented on the issue: https://github.com/apache/spark/pull/16620 As @squito mentioned: >Before this, the DAGScheduler didn't really know anything about taskSetManagers. (In its current form, this pr uses a "leaked" handle via rootPool.getSortedTaskSetQueue)

[GitHub] spark pull request #16712: [SPARK-18873][SQL][TEST] New test cases for scala...

2017-02-07 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16712 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #16828: [SPARK-19484][SQL]continue work to create hive table wit...

2017-02-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16828 **[Test build #72551 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72551/testReport)** for PR 16828 at commit [`cf2c382`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #16712: [SPARK-18873][SQL][TEST] New test cases for scalar subqu...

2017-02-07 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16712 : ) Let me merge it to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #16797: [SPARK-19455][SQL] Add option for case-insensitive Parqu...

2017-02-07 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/16797 For better user experience, we should automatically infer the schema and write it back to metastore, if there is no case-sensitive table schema in metastore. This has the cost of detection the nee

  1   2   3   4   5   6   7   >