[GitHub] spark issue #17346: [SPARK-19965][SS] DataFrame batch reader may fail to inf...

2017-05-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17346 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17346: [SPARK-19965][SS] DataFrame batch reader may fail to inf...

2017-05-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17346 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76408/ Test PASSed. ---

[GitHub] spark issue #17346: [SPARK-19965][SS] DataFrame batch reader may fail to inf...

2017-05-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17346 **[Test build #76408 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76408/testReport)** for PR 17346 at commit

[GitHub] spark pull request #17838: [SPARK-20567] Lazily bind in GenerateExec

2017-05-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/17838 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #17836: [SPARK-20566][SQL] ColumnVector should support `appendFl...

2017-05-02 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/17836 cc @michal-databricks --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #17838: [SPARK-20567] Lazily bind in GenerateExec

2017-05-02 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/17838 LGTM - merging to master/2.2 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #17770: [SPARK-20392][SQL] Set barrier to prevent re-entering a ...

2017-05-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17770 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17770: [SPARK-20392][SQL] Set barrier to prevent re-entering a ...

2017-05-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17770 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76407/ Test PASSed. ---

[GitHub] spark issue #17770: [SPARK-20392][SQL] Set barrier to prevent re-entering a ...

2017-05-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17770 **[Test build #76407 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76407/testReport)** for PR 17770 at commit

[GitHub] spark issue #17819: [SPARK-20542][ML][SQL] Add a Bucketizer that can bin mul...

2017-05-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17819 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17819: [SPARK-20542][ML][SQL] Add a Bucketizer that can bin mul...

2017-05-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17819 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76406/ Test PASSed. ---

[GitHub] spark issue #17819: [SPARK-20542][ML][SQL] Add a Bucketizer that can bin mul...

2017-05-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17819 **[Test build #76406 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76406/testReport)** for PR 17819 at commit

[GitHub] spark pull request #17832: [SPARK-20557][SQL] Support for db column type TIM...

2017-05-02 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/17832#discussion_r114472869 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JdbcUtils.scala --- @@ -223,6 +223,9 @@ object JdbcUtils extends

[GitHub] spark issue #17838: [SPARK-20567] Lazily bind in GenerateExec

2017-05-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17838 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76405/ Test PASSed. ---

[GitHub] spark issue #17838: [SPARK-20567] Lazily bind in GenerateExec

2017-05-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17838 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17838: [SPARK-20567] Lazily bind in GenerateExec

2017-05-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17838 **[Test build #76405 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76405/testReport)** for PR 17838 at commit

[GitHub] spark issue #17736: [SPARK-20399][SQL] Can't use same regex pattern between ...

2017-05-02 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/17736 > This also seems unreasonable to me because so many backslashes are confusing and it seems to me that no other systems have similar behavior Like I said before, it's because java string

[GitHub] spark issue #17100: [SPARK-13947][SQL] PySpark DataFrames: The error message...

2017-05-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17100 Build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #17100: [SPARK-13947][SQL] PySpark DataFrames: The error message...

2017-05-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17100 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76401/ Test PASSed. ---

[GitHub] spark issue #17100: [SPARK-13947][SQL] PySpark DataFrames: The error message...

2017-05-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17100 **[Test build #76401 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76401/testReport)** for PR 17100 at commit

[GitHub] spark pull request #17346: [SPARK-19965][SS] DataFrame batch reader may fail...

2017-05-02 Thread lw-lin
Github user lw-lin commented on a diff in the pull request: https://github.com/apache/spark/pull/17346#discussion_r114468906 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/InMemoryFileIndex.scala --- @@ -36,20 +37,27 @@ import

[GitHub] spark pull request #17346: [SPARK-19965][SS] DataFrame batch reader may fail...

2017-05-02 Thread lw-lin
Github user lw-lin commented on a diff in the pull request: https://github.com/apache/spark/pull/17346#discussion_r114468833 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/streaming/FileStreamSinkSuite.scala --- @@ -145,6 +147,41 @@ class FileStreamSinkSuite extends

[GitHub] spark pull request #17346: [SPARK-19965][SS] DataFrame batch reader may fail...

2017-05-02 Thread lw-lin
Github user lw-lin commented on a diff in the pull request: https://github.com/apache/spark/pull/17346#discussion_r114468801 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/FileStreamSink.scala --- @@ -53,6 +53,29 @@ object FileStreamSink extends

[GitHub] spark pull request #17346: [SPARK-19965][SS] DataFrame batch reader may fail...

2017-05-02 Thread lw-lin
Github user lw-lin commented on a diff in the pull request: https://github.com/apache/spark/pull/17346#discussion_r114468821 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/FileStreamSink.scala --- @@ -53,6 +53,29 @@ object FileStreamSink extends

[GitHub] spark issue #17346: [SPARK-19965][SS] DataFrame batch reader may fail to inf...

2017-05-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17346 **[Test build #76408 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76408/testReport)** for PR 17346 at commit

[GitHub] spark issue #17251: [SPARK-19910][SQL] `stack` should not reject NULL values...

2017-05-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17251 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17251: [SPARK-19910][SQL] `stack` should not reject NULL values...

2017-05-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17251 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76403/ Test PASSed. ---

[GitHub] spark issue #17251: [SPARK-19910][SQL] `stack` should not reject NULL values...

2017-05-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17251 **[Test build #76403 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76403/testReport)** for PR 17251 at commit

[GitHub] spark issue #17836: [SPARK-20566][SQL] ColumnVector should support `appendFl...

2017-05-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17836 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17836: [SPARK-20566][SQL] ColumnVector should support `appendFl...

2017-05-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17836 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76404/ Test PASSed. ---

[GitHub] spark issue #17836: [SPARK-20566][SQL] ColumnVector should support `appendFl...

2017-05-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17836 **[Test build #76404 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76404/testReport)** for PR 17836 at commit

[GitHub] spark issue #17736: [SPARK-20399][SQL] Can't use same regex pattern between ...

2017-05-02 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/17736 For the regex, currently users need to write something like `df.filter("value rlike '^x20[x20-x23]+$'")`. This seems unreasonable to me and it is this patch tries to fix. --- If your

[GitHub] spark issue #17819: [SPARK-20542][ML][SQL] Add a Bucketizer that can bin mul...

2017-05-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17819 **[Test build #76406 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76406/testReport)** for PR 17819 at commit

[GitHub] spark issue #17770: [SPARK-20392][SQL] Set barrier to prevent re-entering a ...

2017-05-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17770 **[Test build #76407 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76407/testReport)** for PR 17770 at commit

[GitHub] spark issue #17736: [SPARK-20399][SQL] Can't use same regex pattern between ...

2017-05-02 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/17736 yea, much clearer now, and the string literal in Spark 2.0 looks more reasonable. For the regex, I think it's unfair to compare `df.filter("value rlike '^\\x20[\\x20-\\x23]+$'")` with

[GitHub] spark issue #17836: [SPARK-20566][SQL] ColumnVector should support `appendFl...

2017-05-02 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/17836 Thank you for review, @kiszk --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17836: [SPARK-20566][SQL] ColumnVector should support `appendFl...

2017-05-02 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/17836 LGTM cc: @sameeragarwal @cloud-fan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17698: [SPARK-20403][SQL][Documentation]Modify the instructions...

2017-05-02 Thread 10110346
Github user 10110346 commented on the issue: https://github.com/apache/spark/pull/17698 @rxin, would you help me review it again?thanks --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #17838: [SPARK-20567] Lazily bind in GenerateExec

2017-05-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17838 **[Test build #76405 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76405/testReport)** for PR 17838 at commit

[GitHub] spark issue #17736: [SPARK-20399][SQL] Can't use same regex pattern between ...

2017-05-02 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/17736 @cloud-fan I've updated the example. Please check if it is better for you. Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark issue #17838: [SPARK-20567] Lazily bind in GenerateExec

2017-05-02 Thread brkyvz
Github user brkyvz commented on the issue: https://github.com/apache/spark/pull/17838 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #17838: [SPARK-20567] Lazily bind in GenerateExec

2017-05-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17838 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76399/ Test FAILed. ---

[GitHub] spark issue #17838: [SPARK-20567] Lazily bind in GenerateExec

2017-05-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17838 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17838: [SPARK-20567] Lazily bind in GenerateExec

2017-05-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17838 **[Test build #76399 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76399/testReport)** for PR 17838 at commit

[GitHub] spark issue #17735: [SPARK-20441][SPARK-20432][SS] Within the same streaming...

2017-05-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17735 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17735: [SPARK-20441][SPARK-20432][SS] Within the same streaming...

2017-05-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17735 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76398/ Test PASSed. ---

[GitHub] spark issue #17735: [SPARK-20441][SPARK-20432][SS] Within the same streaming...

2017-05-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17735 **[Test build #76398 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76398/testReport)** for PR 17735 at commit

[GitHub] spark issue #17794: [SPARK-20518][CORE]Supplement the new blockidsuite unit ...

2017-05-02 Thread heary-cao
Github user heary-cao commented on the issue: https://github.com/apache/spark/pull/17794 @jerryshao I have been updated it. please review it again. thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request #17833: [SPARK-20558][CORE] clear InheritableThreadLocal ...

2017-05-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/17833 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #17833: [SPARK-20558][CORE] clear InheritableThreadLocal variabl...

2017-05-02 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/17833 merging to master/2.2/2.1/2.0 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #17833: [SPARK-20558][CORE] clear InheritableThreadLocal variabl...

2017-05-02 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/17833 > I think it only cleans localProperties in the current thread. localProperties overrides childValue and always clones a new Properties for child threads. Yea, that's true. If some child

[GitHub] spark issue #17100: [SPARK-13947][SQL] PySpark DataFrames: The error message...

2017-05-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17100 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76402/ Test FAILed. ---

[GitHub] spark issue #17100: [SPARK-13947][SQL] PySpark DataFrames: The error message...

2017-05-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17100 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17100: [SPARK-13947][SQL] PySpark DataFrames: The error message...

2017-05-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17100 **[Test build #76402 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76402/testReport)** for PR 17100 at commit

[GitHub] spark pull request #17556: [SPARK-16957][MLlib] Use midpoints for split valu...

2017-05-02 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/17556#discussion_r114457816 --- Diff: mllib/src/main/scala/org/apache/spark/ml/tree/impl/RandomForest.scala --- @@ -1037,7 +1042,8 @@ private[spark] object RandomForest extends Logging

[GitHub] spark pull request #17835: [SPARK-20557] [SQL] Improve the error message for...

2017-05-02 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/17835#discussion_r114460827 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JdbcUtils.scala --- @@ -230,7 +230,9 @@ object JdbcUtils extends

[GitHub] spark issue #17723: [SPARK-20434][YARN][CORE] Move kerberos delegation token...

2017-05-02 Thread mridulm
Github user mridulm commented on the issue: https://github.com/apache/spark/pull/17723 @vanzin: > @mridulm the main argument for just dealing with Hadoop security is that it's been sufficient since the inception of Spark. I have never seen anyone ask for integration with any

[GitHub] spark issue #16677: [SPARK-19355][SQL] Use map output statistices to improve...

2017-05-02 Thread watermen
Github user watermen commented on the issue: https://github.com/apache/spark/pull/16677 When we create a DataSource table like below ```sql create table t1 using parquet select * from src limit 1000; ``` It will call `CollectLimitExec.doExecute`, it also use

[GitHub] spark issue #17251: [SPARK-19910][SQL] `stack` should not reject NULL values...

2017-05-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17251 **[Test build #76403 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76403/testReport)** for PR 17251 at commit

[GitHub] spark issue #17251: [SPARK-19910][SQL] `stack` should not reject NULL values...

2017-05-02 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/17251 Retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #17836: [SPARK-20566][SQL] ColumnVector should support `appendFl...

2017-05-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17836 **[Test build #76404 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76404/testReport)** for PR 17836 at commit

[GitHub] spark issue #17540: [SPARK-20213][SQL][UI] Fix DataFrameWriter operations in...

2017-05-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17540 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17540: [SPARK-20213][SQL][UI] Fix DataFrameWriter operations in...

2017-05-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17540 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76396/ Test FAILed. ---

[GitHub] spark issue #17825: [SPARK-20550][SPARKR] R wrapper for Dataset.alias

2017-05-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17825 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76400/ Test PASSed. ---

[GitHub] spark issue #17540: [SPARK-20213][SQL][UI] Fix DataFrameWriter operations in...

2017-05-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17540 **[Test build #76396 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76396/testReport)** for PR 17540 at commit

[GitHub] spark issue #17825: [SPARK-20550][SPARKR] R wrapper for Dataset.alias

2017-05-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17825 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17825: [SPARK-20550][SPARKR] R wrapper for Dataset.alias

2017-05-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17825 **[Test build #76400 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76400/testReport)** for PR 17825 at commit

[GitHub] spark issue #17821: [SPARK-20529][Core]Allow worker and master work with a p...

2017-05-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17821 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76392/ Test FAILed. ---

[GitHub] spark issue #17821: [SPARK-20529][Core]Allow worker and master work with a p...

2017-05-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17821 **[Test build #76392 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76392/testReport)** for PR 17821 at commit

[GitHub] spark issue #17821: [SPARK-20529][Core]Allow worker and master work with a p...

2017-05-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17821 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #17825: [SPARK-20550][SPARKR] R wrapper for Dataset.alias

2017-05-02 Thread zero323
Github user zero323 commented on a diff in the pull request: https://github.com/apache/spark/pull/17825#discussion_r114457011 --- Diff: R/pkg/R/column.R --- @@ -132,17 +132,24 @@ createMethods() #' alias #' -#' Set a new name for a column +#' Set a new name

[GitHub] spark issue #17100: [SPARK-13947][SQL] PySpark DataFrames: The error message...

2017-05-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17100 **[Test build #76402 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76402/testReport)** for PR 17100 at commit

[GitHub] spark issue #17825: [SPARK-20550][SPARKR] R wrapper for Dataset.alias

2017-05-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17825 **[Test build #76400 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76400/testReport)** for PR 17825 at commit

[GitHub] spark issue #17100: [SPARK-13947][SQL] PySpark DataFrames: The error message...

2017-05-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17100 **[Test build #76401 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76401/testReport)** for PR 17100 at commit

[GitHub] spark issue #17838: [SPARK-20567] Lazily bind in GenerateExec

2017-05-02 Thread brkyvz
Github user brkyvz commented on the issue: https://github.com/apache/spark/pull/17838 LGTM! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #17818: [SPARK-20544] R wrapper for input_file_name

2017-05-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17818 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76397/ Test PASSed. ---

[GitHub] spark issue #17818: [SPARK-20544] R wrapper for input_file_name

2017-05-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17818 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17838: [SPARK-20567] Lazily bind in GenerateExec

2017-05-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17838 **[Test build #76399 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76399/testReport)** for PR 17838 at commit

[GitHub] spark issue #17818: [SPARK-20544] R wrapper for input_file_name

2017-05-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17818 **[Test build #76397 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76397/testReport)** for PR 17818 at commit

[GitHub] spark pull request #17838: [SPARK-20567] Lazily bind in GenerateExec

2017-05-02 Thread marmbrus
GitHub user marmbrus opened a pull request: https://github.com/apache/spark/pull/17838 [SPARK-20567] Lazily bind in GenerateExec It is not valid to eagerly bind with the child's output as this causes failures when we attempt to canonicalize the plan (replacing the attribute

[GitHub] spark pull request #17735: [SPARK-20441][SPARK-20432][SS] Within the same st...

2017-05-02 Thread lw-lin
Github user lw-lin commented on a diff in the pull request: https://github.com/apache/spark/pull/17735#discussion_r114453379 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/streaming/StreamSuite.scala --- @@ -120,6 +141,32 @@ class StreamSuite extends StreamTest {

[GitHub] spark issue #17735: [SPARK-20441][SPARK-20432][SS] Within the same streaming...

2017-05-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17735 **[Test build #76398 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76398/testReport)** for PR 17735 at commit

[GitHub] spark issue #9699: [SPARK-2344] [MLlib] Add fuzzifier (m) parameter to KMean...

2017-05-02 Thread LuciferWong
Github user LuciferWong commented on the issue: https://github.com/apache/spark/pull/9699 This is what I wrote it myself : https://github.com/LuciferWong/spark --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #17835: [SPARK-20557] [SQL] Improve the error message for unsupp...

2017-05-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17835 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17835: [SPARK-20557] [SQL] Improve the error message for unsupp...

2017-05-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17835 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76393/ Test PASSed. ---

[GitHub] spark issue #17835: [SPARK-20557] [SQL] Improve the error message for unsupp...

2017-05-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17835 **[Test build #76393 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76393/testReport)** for PR 17835 at commit

[GitHub] spark issue #17818: [SPARK-20544] R wrapper for input_file_name

2017-05-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17818 **[Test build #76397 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76397/testReport)** for PR 17818 at commit

[GitHub] spark pull request #17818: [SPARK-20544] R wrapper for input_file_name

2017-05-02 Thread zero323
Github user zero323 commented on a diff in the pull request: https://github.com/apache/spark/pull/17818#discussion_r114450054 --- Diff: R/pkg/R/functions.R --- @@ -3890,3 +3890,23 @@ setMethod("not", jc <- callJStatic("org.apache.spark.sql.functions", "not", x@jc)

[GitHub] spark pull request #17818: [SPARK-20544] R wrapper for input_file_name

2017-05-02 Thread zero323
Github user zero323 commented on a diff in the pull request: https://github.com/apache/spark/pull/17818#discussion_r114450006 --- Diff: R/pkg/R/functions.R --- @@ -3974,3 +3974,23 @@ setMethod("grouping_id", jc <- callJStatic("org.apache.spark.sql.functions",

[GitHub] spark issue #17831: [SPARK-18777][PYTHON][SQL] Return UDF from udf.register

2017-05-02 Thread zero323
Github user zero323 commented on the issue: https://github.com/apache/spark/pull/17831 @gatorsmile This sounds reasonable but I am not sure if I fully understand your concerns. If anything this brings PySpark closer to the Scala API. At this moment we have ```

[GitHub] spark issue #17540: [SPARK-20213][SQL][UI] Fix DataFrameWriter operations in...

2017-05-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17540 **[Test build #76396 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76396/testReport)** for PR 17540 at commit

[GitHub] spark issue #17836: [SPARK-20566] ColumnVector should support `appendFloats`...

2017-05-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17836 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76394/ Test PASSed. ---

[GitHub] spark issue #17836: [SPARK-20566] ColumnVector should support `appendFloats`...

2017-05-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17836 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17836: [SPARK-20566] ColumnVector should support `appendFloats`...

2017-05-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17836 **[Test build #76394 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76394/testReport)** for PR 17836 at commit

[GitHub] spark pull request #17821: [SPARK-20529][Core]Allow worker and master work w...

2017-05-02 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/17821#discussion_r114446352 --- Diff: core/src/main/scala/org/apache/spark/deploy/worker/Worker.scala --- @@ -266,7 +289,8 @@ private[deploy] class Worker( if

[GitHub] spark issue #17540: [SPARK-20213][SQL][UI] Fix DataFrameWriter operations in...

2017-05-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17540 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17540: [SPARK-20213][SQL][UI] Fix DataFrameWriter operations in...

2017-05-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17540 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76395/ Test FAILed. ---

[GitHub] spark issue #17540: [SPARK-20213][SQL][UI] Fix DataFrameWriter operations in...

2017-05-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17540 **[Test build #76395 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76395/testReport)** for PR 17540 at commit

[GitHub] spark issue #17100: [SPARK-13947][SQL] PySpark DataFrames: The error message...

2017-05-02 Thread rberenguel
Github user rberenguel commented on the issue: https://github.com/apache/spark/pull/17100 @gatorsmile Thanks for the pointers, finally found some time to come back to this. I'm not sure if my approach to get the `SQLConf` into `checkAnalysis` is the correct one in my current local

[GitHub] spark issue #17831: [SPARK-18777][PYTHON][SQL] Return UDF from udf.register

2017-05-02 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/17831 I feel like that's an unrelated challenge. I'm happy to see other improvements but I'm worried that we will hold up changes for things which aren't happening soon - is there a JIRA for these

  1   2   3   4   >