[GitHub] spark issue #13373: [SPARK-15616] [SQL] Metastore relation should fallback t...

2016-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13373 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/6/ Test FAILed. ---

[GitHub] spark issue #13373: [SPARK-15616] [SQL] Metastore relation should fallback t...

2016-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13373 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13373: [SPARK-15616] [SQL] Metastore relation should fallback t...

2016-10-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13373 **[Test build #6 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/6/consoleFull)** for PR 13373 at commit

[GitHub] spark issue #13373: [SPARK-15616] [SQL] Metastore relation should fallback t...

2016-10-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13373 **[Test build #6 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/6/consoleFull)** for PR 13373 at commit

[GitHub] spark issue #15669: [SPARK-18160][CORE][YARN] SparkContext.addFile doesn't w...

2016-10-29 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/15669 Quite strange `--files` in yarn-client will fall into `SparkContext`? AFAIK it will be handled by yarn#client to add to distributed cache, it will not involve SparkContext's addFiles. --- If

[GitHub] spark issue #15683: [SPARK-18166][MLib] Fix Poisson GLM bug due to wrong req...

2016-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15683 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #15683: [SPARK-18166][MLib] Fix Poisson GLM bug due to wr...

2016-10-29 Thread actuaryzhang
GitHub user actuaryzhang opened a pull request: https://github.com/apache/spark/pull/15683 [SPARK-18166][MLib] Fix Poisson GLM bug due to wrong requirement of response values ## What changes were proposed in this pull request? The current implementation of Poisson GLM

[GitHub] spark pull request #15637: [SPARK-18000] [SQL] Aggregation function for comp...

2016-10-29 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15637#discussion_r85652094 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/MapAggregate.scala --- @@ -0,0 +1,324 @@ +/* + *

[GitHub] spark issue #15666: [SPARK-11421] [Core][Python][R] Added ability for addJar...

2016-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15666 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15666: [SPARK-11421] [Core][Python][R] Added ability for addJar...

2016-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15666 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67776/ Test PASSed. ---

[GitHub] spark issue #15666: [SPARK-11421] [Core][Python][R] Added ability for addJar...

2016-10-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15666 **[Test build #67776 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67776/consoleFull)** for PR 15666 at commit

[GitHub] spark issue #15659: [SPARK-1267][SPARK-18129] Allow PySpark to be pip instal...

2016-10-29 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/15659 Dropping WIP since the jenkins integration appears to be functioning now. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #15682: [SPARK-18169][SQL] Suppress warnings when dropping views...

2016-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15682 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67775/ Test PASSed. ---

[GitHub] spark issue #15682: [SPARK-18169][SQL] Suppress warnings when dropping views...

2016-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15682 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15682: [SPARK-18169][SQL] Suppress warnings when dropping views...

2016-10-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15682 **[Test build #67775 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67775/consoleFull)** for PR 15682 at commit

[GitHub] spark issue #15666: [SPARK-11421] [Core][Python][R] Added ability for addJar...

2016-10-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15666 **[Test build #67776 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67776/consoleFull)** for PR 15666 at commit

[GitHub] spark pull request #15417: [SPARK-17851][SQL][TESTS] Make sure all test sqls...

2016-10-29 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15417#discussion_r85650659 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/FilterPushdownSuite.scala --- @@ -1016,6 +1016,8 @@ class

[GitHub] spark pull request #15417: [SPARK-17851][SQL][TESTS] Make sure all test sqls...

2016-10-29 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15417#discussion_r85650553 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/FilterPushdownSuite.scala --- @@ -1016,6 +1016,8 @@ class

[GitHub] spark issue #15682: [SPARK-18169][SQL] Suppress warnings when dropping views...

2016-10-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15682 **[Test build #67775 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67775/consoleFull)** for PR 15682 at commit

[GitHub] spark pull request #15682: [SPARK-18169][SQL] Suppress warnings when droppin...

2016-10-29 Thread dongjoon-hyun
GitHub user dongjoon-hyun opened a pull request: https://github.com/apache/spark/pull/15682 [SPARK-18169][SQL] Suppress warnings when dropping views on a dropped table ## What changes were proposed in this pull request? Apache Spark 2.0.0 ~ 2.0.2-rc1 shows an

[GitHub] spark issue #15666: [SPARK-11421] [Core][Python][R] Added ability for addJar...

2016-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15666 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67774/ Test FAILed. ---

[GitHub] spark issue #15666: [SPARK-11421] [Core][Python][R] Added ability for addJar...

2016-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15666 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15666: [SPARK-11421] [Core][Python][R] Added ability for addJar...

2016-10-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15666 **[Test build #67774 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67774/consoleFull)** for PR 15666 at commit

[GitHub] spark issue #15673: [SPARK-17992][SQL] Return all partitions from HiveShim w...

2016-10-29 Thread ericl
Github user ericl commented on the issue: https://github.com/apache/spark/pull/15673 For large tables, the degraded performance should be considered a bug as well. How about this. 1) If direct sql is disabled, log a warning about degraded performance with this flag and

[GitHub] spark issue #14937: [SPARK-8519][SPARK-11560] [ML] [MLlib] Optimize KMeans i...

2016-10-29 Thread sethah
Github user sethah commented on the issue: https://github.com/apache/spark/pull/14937 @yanboliang I began to run some performance tests on this patch today. With this patch the way it is, I am seeing a huge performance **_degradation_**. The most critical reason is the slicing

[GitHub] spark issue #15538: [SPARK-17993][SQL] Fix Parquet log output redirection

2016-10-29 Thread mallman
Github user mallman commented on the issue: https://github.com/apache/spark/pull/15538 Actually, this may not be working for remote executors. I tested this patch running in local mode, but in running a version of this with actual remote executors I'm seeing the original parquet log

[GitHub] spark issue #15673: [SPARK-17992][SQL] Return all partitions from HiveShim w...

2016-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15673 Build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #15673: [SPARK-17992][SQL] Return all partitions from HiveShim w...

2016-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15673 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67772/ Test PASSed. ---

[GitHub] spark issue #15673: [SPARK-17992][SQL] Return all partitions from HiveShim w...

2016-10-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15673 **[Test build #67772 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67772/consoleFull)** for PR 15673 at commit

[GitHub] spark issue #15666: [SPARK-11421] [Core][Python][R] Added ability for addJar...

2016-10-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15666 **[Test build #67774 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67774/consoleFull)** for PR 15666 at commit

[GitHub] spark pull request #11374: [SPARK-12042] Python API for mllib.stat.test.Stre...

2016-10-29 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/11374#discussion_r85647470 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/api/python/PythonMLLibAPI.scala --- @@ -1358,6 +1363,41 @@ private[spark] abstract class

[GitHub] spark pull request #11374: [SPARK-12042] Python API for mllib.stat.test.Stre...

2016-10-29 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/11374#discussion_r85647311 --- Diff: examples/src/main/python/mllib/streaming_test_example.py --- @@ -0,0 +1,57 @@ +# +# Licensed to the Apache Software Foundation (ASF)

[GitHub] spark pull request #11374: [SPARK-12042] Python API for mllib.stat.test.Stre...

2016-10-29 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/11374#discussion_r85647567 --- Diff: python/pyspark/mllib/stat/test.py --- @@ -80,3 +85,118 @@ class KolmogorovSmirnovTestResult(TestResult): """ Contains test

[GitHub] spark pull request #11374: [SPARK-12042] Python API for mllib.stat.test.Stre...

2016-10-29 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/11374#discussion_r85647915 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/stat/test/TestResult.scala --- @@ -114,7 +114,7 @@ class KolmogorovSmirnovTestResult

[GitHub] spark pull request #11374: [SPARK-12042] Python API for mllib.stat.test.Stre...

2016-10-29 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/11374#discussion_r85647656 --- Diff: python/pyspark/mllib/tests.py --- @@ -1688,6 +1689,44 @@ def test_binary_term_freqs(self): ": expected

[GitHub] spark pull request #11374: [SPARK-12042] Python API for mllib.stat.test.Stre...

2016-10-29 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/11374#discussion_r85647664 --- Diff: python/pyspark/mllib/tests.py --- @@ -1688,6 +1689,44 @@ def test_binary_term_freqs(self): ": expected

[GitHub] spark pull request #11374: [SPARK-12042] Python API for mllib.stat.test.Stre...

2016-10-29 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/11374#discussion_r85647454 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/api/python/PythonMLLibAPI.scala --- @@ -1358,6 +1363,41 @@ private[spark] abstract class

[GitHub] spark pull request #11374: [SPARK-12042] Python API for mllib.stat.test.Stre...

2016-10-29 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/11374#discussion_r85647843 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/api/python/PythonMLLibAPI.scala --- @@ -1576,17 +1616,49 @@ private[spark] object SerDe extends

[GitHub] spark pull request #11374: [SPARK-12042] Python API for mllib.stat.test.Stre...

2016-10-29 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/11374#discussion_r85647607 --- Diff: python/pyspark/mllib/stat/test.py --- @@ -80,3 +85,118 @@ class KolmogorovSmirnovTestResult(TestResult): """ Contains test

[GitHub] spark pull request #11374: [SPARK-12042] Python API for mllib.stat.test.Stre...

2016-10-29 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/11374#discussion_r85647232 --- Diff: examples/src/main/python/mllib/streaming_test_example.py --- @@ -0,0 +1,57 @@ +# +# Licensed to the Apache Software Foundation (ASF)

[GitHub] spark pull request #11374: [SPARK-12042] Python API for mllib.stat.test.Stre...

2016-10-29 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/11374#discussion_r85647320 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/api/python/PythonMLLibAPI.scala --- @@ -44,7 +44,7 @@ import org.apache.spark.mllib.regression._

[GitHub] spark pull request #11374: [SPARK-12042] Python API for mllib.stat.test.Stre...

2016-10-29 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/11374#discussion_r85647221 --- Diff: examples/src/main/python/mllib/streaming_test_example.py --- @@ -0,0 +1,57 @@ +# +# Licensed to the Apache Software Foundation (ASF)

[GitHub] spark pull request #11374: [SPARK-12042] Python API for mllib.stat.test.Stre...

2016-10-29 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/11374#discussion_r85647632 --- Diff: python/pyspark/mllib/tests.py --- @@ -1688,6 +1689,44 @@ def test_binary_term_freqs(self): ": expected

[GitHub] spark pull request #11374: [SPARK-12042] Python API for mllib.stat.test.Stre...

2016-10-29 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/11374#discussion_r85647207 --- Diff: examples/src/main/python/mllib/streaming_test_example.py --- @@ -0,0 +1,57 @@ +# +# Licensed to the Apache Software Foundation (ASF)

[GitHub] spark pull request #11374: [SPARK-12042] Python API for mllib.stat.test.Stre...

2016-10-29 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/11374#discussion_r85647534 --- Diff: python/pyspark/mllib/stat/test.py --- @@ -15,10 +15,15 @@ # limitations under the License. # +from collections import

[GitHub] spark pull request #11374: [SPARK-12042] Python API for mllib.stat.test.Stre...

2016-10-29 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/11374#discussion_r85647905 --- Diff: python/pyspark/mllib/stat/test.py --- @@ -80,3 +85,118 @@ class KolmogorovSmirnovTestResult(TestResult): """ Contains test

[GitHub] spark pull request #11374: [SPARK-12042] Python API for mllib.stat.test.Stre...

2016-10-29 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/11374#discussion_r85647272 --- Diff: examples/src/main/python/mllib/streaming_test_example.py --- @@ -0,0 +1,57 @@ +# +# Licensed to the Apache Software Foundation (ASF)

[GitHub] spark pull request #11374: [SPARK-12042] Python API for mllib.stat.test.Stre...

2016-10-29 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/11374#discussion_r85647289 --- Diff: examples/src/main/python/mllib/streaming_test_example.py --- @@ -0,0 +1,57 @@ +# +# Licensed to the Apache Software Foundation (ASF)

[GitHub] spark issue #15666: [SPARK-11421] [Core][Python][R] Added ability for addJar...

2016-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15666 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15666: [SPARK-11421] [Core][Python][R] Added ability for addJar...

2016-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15666 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67773/ Test FAILed. ---

[GitHub] spark issue #15666: [SPARK-11421] [Core][Python][R] Added ability for addJar...

2016-10-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15666 **[Test build #67773 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67773/consoleFull)** for PR 15666 at commit

[GitHub] spark issue #15666: [SPARK-11421] [Core][Python][R] Added ability for addJar...

2016-10-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15666 **[Test build #67773 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67773/consoleFull)** for PR 15666 at commit

[GitHub] spark issue #15673: [SPARK-17992][SQL] Return all partitions from HiveShim w...

2016-10-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15673 **[Test build #67772 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67772/consoleFull)** for PR 15673 at commit

[GitHub] spark issue #15673: [SPARK-17992][SQL] Return all partitions from HiveShim w...

2016-10-29 Thread mallman
Github user mallman commented on the issue: https://github.com/apache/spark/pull/15673 The current merge conflict is from d2d438d1d549628a0183e468ed11d6e85b5d6061, which touches the same code. I'll wait for that to be settled before rebasing. --- If your project is set up for it,

[GitHub] spark issue #15673: [SPARK-17992][SQL] Return all partitions from HiveShim w...

2016-10-29 Thread mallman
Github user mallman commented on the issue: https://github.com/apache/spark/pull/15673 > Could we enable this fallback only when the conf is set to false? Otherwise, it might mask legitimate bugs. Certainly, but my intent with this PR is to prevent a (painful and confusing)

[GitHub] spark pull request #15637: [SPARK-18000] [SQL] Aggregation function for comp...

2016-10-29 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15637#discussion_r85646444 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/MapAggregate.scala --- @@ -0,0 +1,324 @@ +/* + *

[GitHub] spark issue #15538: [SPARK-17993][SQL] Fix Parquet log output redirection

2016-10-29 Thread mallman
Github user mallman commented on the issue: https://github.com/apache/spark/pull/15538 @srowen I ran my manual tests for this build and they worked as expected. Can you merge this PR? --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #12257: [SPARK-14483][WEBUI] Display user name for each job and ...

2016-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/12257 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67770/ Test PASSed. ---

[GitHub] spark issue #12257: [SPARK-14483][WEBUI] Display user name for each job and ...

2016-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/12257 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #12257: [SPARK-14483][WEBUI] Display user name for each job and ...

2016-10-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/12257 **[Test build #67770 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67770/consoleFull)** for PR 12257 at commit

[GitHub] spark pull request #15637: [SPARK-18000] [SQL] Aggregation function for comp...

2016-10-29 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15637#discussion_r85646119 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/MapAggregate.scala --- @@ -0,0 +1,324 @@ +/* + *

[GitHub] spark issue #13373: [SPARK-15616] [SQL] Metastore relation should fallback t...

2016-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13373 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67771/ Test FAILed. ---

[GitHub] spark issue #13373: [SPARK-15616] [SQL] Metastore relation should fallback t...

2016-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13373 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13373: [SPARK-15616] [SQL] Metastore relation should fallback t...

2016-10-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13373 **[Test build #67771 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67771/consoleFull)** for PR 13373 at commit

[GitHub] spark pull request #15637: [SPARK-18000] [SQL] Aggregation function for comp...

2016-10-29 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15637#discussion_r85645925 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/MapAggregate.scala --- @@ -0,0 +1,324 @@ +/* + *

[GitHub] spark pull request #15637: [SPARK-18000] [SQL] Aggregation function for comp...

2016-10-29 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15637#discussion_r85645802 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/MapAggregateQuerySuite.scala --- @@ -0,0 +1,124 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request #15637: [SPARK-18000] [SQL] Aggregation function for comp...

2016-10-29 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15637#discussion_r85645776 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/MapAggregateQuerySuite.scala --- @@ -0,0 +1,124 @@ +/* + * Licensed to the Apache Software

[GitHub] spark issue #15637: [SPARK-18000] [SQL] Aggregation function for computing e...

2016-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15637 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67769/ Test PASSed. ---

[GitHub] spark issue #15637: [SPARK-18000] [SQL] Aggregation function for computing e...

2016-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15637 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13866: [SPARK-16160] [STREAMING] Clear last remembered metadata...

2016-10-29 Thread ahmed-mahran
Github user ahmed-mahran commented on the issue: https://github.com/apache/spark/pull/13866 Related PR #512 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #15637: [SPARK-18000] [SQL] Aggregation function for computing e...

2016-10-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15637 **[Test build #67769 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67769/consoleFull)** for PR 15637 at commit

[GitHub] spark issue #13866: [SPARK-16160] [STREAMING] Clear last remembered metadata...

2016-10-29 Thread ahmed-mahran
Github user ahmed-mahran commented on the issue: https://github.com/apache/spark/pull/13866 @zsxwing, it is great that you have pointed to unallocated blocks, I've missed those. **What to clean?** So, there are three kinds of stored blocks here: *unallocated stream

[GitHub] spark issue #15673: [SPARK-17992][SQL] Return all partitions from HiveShim w...

2016-10-29 Thread ericl
Github user ericl commented on the issue: https://github.com/apache/spark/pull/15673 Could we enable this fallback only when the conf is set to false? Otherwise, it might mask legitimate bugs. I also wonder if some of our flaky tests around this issue are due to the conf

[GitHub] spark pull request #15637: [SPARK-18000] [SQL] Aggregation function for comp...

2016-10-29 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15637#discussion_r85645394 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/MapAggregate.scala --- @@ -0,0 +1,324 @@ +/* + *

[GitHub] spark pull request #15651: [SPARK-17972][SQL] Add Dataset.checkpoint() to tr...

2016-10-29 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/15651#discussion_r85645164 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/ExistingRDD.scala --- @@ -130,17 +130,40 @@ case class ExternalRDDScanExec[T]( /**

[GitHub] spark pull request #15651: [SPARK-17972][SQL] Add Dataset.checkpoint() to tr...

2016-10-29 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/15651#discussion_r85645138 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/ExistingRDD.scala --- @@ -130,17 +130,40 @@ case class ExternalRDDScanExec[T]( /**

[GitHub] spark issue #13373: [SPARK-15616] [SQL] Metastore relation should fallback t...

2016-10-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13373 **[Test build #67771 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67771/consoleFull)** for PR 13373 at commit

[GitHub] spark issue #15471: [SPARK-17919] Make timeout to RBackend configurable in S...

2016-10-29 Thread shivaram
Github user shivaram commented on the issue: https://github.com/apache/spark/pull/15471 Thanks @HyukjinKwon - The appveyor tests seem to pass as well Change LGTM to merge to master. @felixcheung Any other comments ? --- If your project is set up for it, you can reply to this

[GitHub] spark pull request #15677: [SPARK-17963][SQL][Documentation] Add examples (e...

2016-10-29 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15677#discussion_r85644253 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/datetimeExpressions.scala --- @@ -148,8 +171,15 @@ case class

[GitHub] spark issue #15677: [SPARK-17963][SQL][Documentation] Add examples (extend) ...

2016-10-29 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15677 How about splitting this PR to two parts? One is the document improvement (fixing typos and adding examples). Another is to add argument descriptions (many parts are not clearly defined. More

[GitHub] spark issue #15681: [Minor][Streaming][Kafka] Kafka010 .createRDD() scala AP...

2016-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15681 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67763/ Test PASSed. ---

[GitHub] spark issue #15681: [Minor][Streaming][Kafka] Kafka010 .createRDD() scala AP...

2016-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15681 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15681: [Minor][Streaming][Kafka] Kafka010 .createRDD() scala AP...

2016-10-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15681 **[Test build #67763 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67763/consoleFull)** for PR 15681 at commit

[GitHub] spark issue #15677: [SPARK-17963][SQL][Documentation] Add examples (extend) ...

2016-10-29 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15677 @srowen If the newly added contents are not right, should we commit them and fix them later? If this PR does not add argument descriptions, I am fine to merge it (after one more pass)

[GitHub] spark issue #12257: [SPARK-14483][WEBUI] Display user name for each job and ...

2016-10-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/12257 **[Test build #67770 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67770/consoleFull)** for PR 12257 at commit

[GitHub] spark issue #15603: [WEBUI][MINOR] Remove unused appUIAddress in SparkUI + c...

2016-10-29 Thread jaceklaskowski
Github user jaceklaskowski commented on the issue: https://github.com/apache/spark/pull/15603 The test failure doesn't seem to be due to my change. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #12257: [SPARK-14483][WEBUI] Display user name for each job and ...

2016-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/12257 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #12257: [SPARK-14483][WEBUI] Display user name for each job and ...

2016-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/12257 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67764/ Test FAILed. ---

[GitHub] spark issue #12257: [SPARK-14483][WEBUI] Display user name for each job and ...

2016-10-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/12257 **[Test build #67764 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67764/consoleFull)** for PR 12257 at commit

[GitHub] spark issue #15637: [SPARK-18000] [SQL] Aggregation function for computing e...

2016-10-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15637 **[Test build #67769 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67769/consoleFull)** for PR 15637 at commit

[GitHub] spark issue #15637: [SPARK-18000] [SQL] Aggregation function for computing e...

2016-10-29 Thread wzhfy
Github user wzhfy commented on the issue: https://github.com/apache/spark/pull/15637 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #15679: [SPARK-16312][Follow-up][STREAMING][KAFKA][DOC] Add java...

2016-10-29 Thread koeninger
Github user koeninger commented on the issue: https://github.com/apache/spark/pull/15679 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #15679: [SPARK-16312][Follow-up][STREAMING][KAFKA][DOC] Add java...

2016-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15679 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67767/ Test PASSed. ---

[GitHub] spark issue #15679: [SPARK-16312][Follow-up][STREAMING][KAFKA][DOC] Add java...

2016-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15679 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15679: [SPARK-16312][Follow-up][STREAMING][KAFKA][DOC] Add java...

2016-10-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15679 **[Test build #67767 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67767/consoleFull)** for PR 15679 at commit

[GitHub] spark issue #15679: [SPARK-16312][Follow-up][STREAMING][KAFKA][DOC] Add java...

2016-10-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15679 **[Test build #67766 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67766/consoleFull)** for PR 15679 at commit

[GitHub] spark issue #15679: [SPARK-16312][Follow-up][STREAMING][KAFKA][DOC] Add java...

2016-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15679 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67766/ Test PASSed. ---

[GitHub] spark issue #15679: [SPARK-16312][Follow-up][STREAMING][KAFKA][DOC] Add java...

2016-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15679 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15672: [SPARK-18148][SQL] Misleading Error Message for Aggregat...

2016-10-29 Thread jiangxb1987
Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/15672 The failed test case looks not related to our change here. It didn't fail in my local envirement. --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark issue #13373: [SPARK-15616] [SQL] Metastore relation should fallback t...

2016-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13373 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

  1   2   3   >