[GitHub] spark issue #21734: [SPARK-24149][YARN][FOLLOW-UP] Add a config to control a...

2018-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21734 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21728: [SPARK-24759] [SQL] No reordering keys for broadcast has...

2018-07-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21728 **[Test build #92732 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92732/testReport)** for PR 21728 at commit [`194991b`](https://github.com/apache/spark/commit/1

[GitHub] spark issue #21733: [SPARK-24763][SS] Remove redundant key data from value i...

2018-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21733 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21734: [SPARK-24149][YARN][FOLLOW-UP] Add a config to control a...

2018-07-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21734 **[Test build #92736 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92736/testReport)** for PR 21734 at commit [`8885fff`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #21733: [SPARK-24763][SS] Remove redundant key data from value i...

2018-07-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21733 **[Test build #92735 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92735/testReport)** for PR 21733 at commit [`89a30ab`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #21734: [SPARK-24149][YARN][FOLLOW-UP] Add a config to control a...

2018-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21734 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92736/ Test FAILed. ---

[GitHub] spark issue #21733: [SPARK-24763][SS] Remove redundant key data from value i...

2018-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21733 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92735/ Test FAILed. ---

[GitHub] spark issue #21732: [SPARK-24762][SQL] Aggregator should be able to use Opti...

2018-07-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21732 **[Test build #92729 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92729/testReport)** for PR 21732 at commit [`e1b5dee`](https://github.com/apache/spark/commit/e

[GitHub] spark issue #21073: [SPARK-23936][SQL] Implement map_concat

2018-07-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21073 **[Test build #92733 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92733/testReport)** for PR 21073 at commit [`03328a4`](https://github.com/apache/spark/commit/0

[GitHub] spark issue #21073: [SPARK-23936][SQL] Implement map_concat

2018-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21073 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21073: [SPARK-23936][SQL] Implement map_concat

2018-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21073 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92733/ Test FAILed. ---

[GitHub] spark issue #21732: [SPARK-24762][SQL] Aggregator should be able to use Opti...

2018-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21732 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21728: [SPARK-24759] [SQL] No reordering keys for broadcast has...

2018-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21728 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21728: [SPARK-24759] [SQL] No reordering keys for broadcast has...

2018-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21728 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92732/ Test FAILed. ---

[GitHub] spark issue #21732: [SPARK-24762][SQL] Aggregator should be able to use Opti...

2018-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21732 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92729/ Test FAILed. ---

[GitHub] spark issue #21073: [SPARK-23936][SQL] Implement map_concat

2018-07-09 Thread ueshin
Github user ueshin commented on the issue: https://github.com/apache/spark/pull/21073 Jenkins, retest this please. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: r

[GitHub] spark issue #21732: [SPARK-24762][SQL] Aggregator should be able to use Opti...

2018-07-09 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/21732 retest this please. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h.

[GitHub] spark issue #21734: [SPARK-24149][YARN][FOLLOW-UP] Add a config to control a...

2018-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21734 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21260: [SPARK-23529][K8s] Support mounting volumes

2018-07-09 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/21260 ok that makes sense. could we get some clear guidance in SPARK-24434 on how to decide what should be a conf and what should be in an external template file? --- ---

[GitHub] spark issue #21734: [SPARK-24149][YARN][FOLLOW-UP] Add a config to control a...

2018-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21734 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/764/

[GitHub] spark issue #21732: [SPARK-24762][SQL] Aggregator should be able to use Opti...

2018-07-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21732 **[Test build #92739 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92739/testReport)** for PR 21732 at commit [`e1b5dee`](https://github.com/apache/spark/commit/e1

[GitHub] spark issue #21734: [SPARK-24149][YARN][FOLLOW-UP] Add a config to control a...

2018-07-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21734 **[Test build #92737 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92737/testReport)** for PR 21734 at commit [`50ef3c9`](https://github.com/apache/spark/commit/50

[GitHub] spark issue #21073: [SPARK-23936][SQL] Implement map_concat

2018-07-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21073 **[Test build #92740 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92740/testReport)** for PR 21073 at commit [`03328a4`](https://github.com/apache/spark/commit/03

[GitHub] spark issue #21733: [SPARK-24763][SS] Remove redundant key data from value i...

2018-07-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21733 **[Test build #92738 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92738/testReport)** for PR 21733 at commit [`bb5f672`](https://github.com/apache/spark/commit/bb

[GitHub] spark issue #21732: [SPARK-24762][SQL] Aggregator should be able to use Opti...

2018-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21732 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21732: [SPARK-24762][SQL] Aggregator should be able to use Opti...

2018-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21732 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/765/

[GitHub] spark issue #21728: [SPARK-24759] [SQL] No reordering keys for broadcast has...

2018-07-09 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/21728 retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews

[GitHub] spark issue #21728: [SPARK-24759] [SQL] No reordering keys for broadcast has...

2018-07-09 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/21728 cc @cloud-fan @hvanhovell --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #21734: [SPARK-24149][YARN][FOLLOW-UP] Add a config to control a...

2018-07-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21734 **[Test build #92737 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92737/testReport)** for PR 21734 at commit [`50ef3c9`](https://github.com/apache/spark/commit/5

[GitHub] spark issue #21734: [SPARK-24149][YARN][FOLLOW-UP] Add a config to control a...

2018-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21734 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21734: [SPARK-24149][YARN][FOLLOW-UP] Add a config to control a...

2018-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21734 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92737/ Test FAILed. ---

[GitHub] spark issue #21582: [SPARK-24576][BUILD] Upgrade Apache ORC to 1.5.2

2018-07-09 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/21582 It occurs when we uses `classifier`. This PR uses `nohive` classifier for `orc-core`. If you try the above commands on this PR, the build fails for `sbt` only. --- -

[GitHub] spark issue #21728: [SPARK-24759] [SQL] No reordering keys for broadcast has...

2018-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21728 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21728: [SPARK-24759] [SQL] No reordering keys for broadcast has...

2018-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21728 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/766/

[GitHub] spark issue #21728: [SPARK-24759] [SQL] No reordering keys for broadcast has...

2018-07-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21728 **[Test build #92741 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92741/testReport)** for PR 21728 at commit [`194991b`](https://github.com/apache/spark/commit/19

[GitHub] spark issue #21734: [SPARK-24149][YARN][FOLLOW-UP] Add a config to control a...

2018-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21734 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21734: [SPARK-24149][YARN][FOLLOW-UP] Add a config to control a...

2018-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21734 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/767/

[GitHub] spark issue #21734: [SPARK-24149][YARN][FOLLOW-UP] Add a config to control a...

2018-07-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21734 **[Test build #92742 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92742/testReport)** for PR 21734 at commit [`da1e389`](https://github.com/apache/spark/commit/da

[GitHub] spark pull request #21582: [SPARK-24576][BUILD] Upgrade Apache ORC to 1.5.2

2018-07-09 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/21582#discussion_r200908434 --- Diff: sql/core/pom.xml --- @@ -90,11 +90,39 @@ org.apache.orc orc-core ${orc.classifier} + +

[GitHub] spark issue #21582: [SPARK-24576][BUILD] Upgrade Apache ORC to 1.5.2

2018-07-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21582 **[Test build #92743 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92743/testReport)** for PR 21582 at commit [`8fe3f11`](https://github.com/apache/spark/commit/8f

[GitHub] spark issue #21582: [SPARK-24576][BUILD] Upgrade Apache ORC to 1.5.2

2018-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21582 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/768/

[GitHub] spark issue #21582: [SPARK-24576][BUILD] Upgrade Apache ORC to 1.5.2

2018-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21582 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21073: [SPARK-23936][SQL] Implement map_concat

2018-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21073 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21073: [SPARK-23936][SQL] Implement map_concat

2018-07-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21073 **[Test build #92740 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92740/testReport)** for PR 21073 at commit [`03328a4`](https://github.com/apache/spark/commit/0

[GitHub] spark issue #21073: [SPARK-23936][SQL] Implement map_concat

2018-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21073 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92740/ Test FAILed. ---

[GitHub] spark issue #20208: [SPARK-23007][SQL][TEST] Add schema evolution test suite...

2018-07-09 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/20208 Retest this please. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: rev

[GitHub] spark issue #21734: [SPARK-24149][YARN][FOLLOW-UP] Add a config to control a...

2018-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21734 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21734: [SPARK-24149][YARN][FOLLOW-UP] Add a config to control a...

2018-07-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21734 **[Test build #92742 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92742/testReport)** for PR 21734 at commit [`da1e389`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #21734: [SPARK-24149][YARN][FOLLOW-UP] Add a config to control a...

2018-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21734 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92742/ Test PASSed. ---

[GitHub] spark issue #20208: [SPARK-23007][SQL][TEST] Add schema evolution test suite...

2018-07-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20208 **[Test build #92744 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92744/testReport)** for PR 20208 at commit [`ebd239e`](https://github.com/apache/spark/commit/eb

[GitHub] spark issue #20208: [SPARK-23007][SQL][TEST] Add schema evolution test suite...

2018-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20208 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/769/

[GitHub] spark issue #20208: [SPARK-23007][SQL][TEST] Add schema evolution test suite...

2018-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20208 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21073: [SPARK-23936][SQL] Implement map_concat

2018-07-09 Thread ueshin
Github user ueshin commented on the issue: https://github.com/apache/spark/pull/21073 Jenkins, retest this please. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: r

[GitHub] spark issue #21073: [SPARK-23936][SQL] Implement map_concat

2018-07-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21073 **[Test build #92745 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92745/testReport)** for PR 21073 at commit [`03328a4`](https://github.com/apache/spark/commit/03

[GitHub] spark pull request #21733: [SPARK-24763][SS] Remove redundant key data from ...

2018-07-09 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/21733#discussion_r200920142 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/streaming/StreamingAggregationSuite.scala --- @@ -53,7 +54,30 @@ class StreamingAggregationSuite

[GitHub] spark issue #21734: [SPARK-24149][YARN][FOLLOW-UP] Add a config to control a...

2018-07-09 Thread wangyum
Github user wangyum commented on the issue: https://github.com/apache/spark/pull/21734 cc @mgaido91 @vanzin --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews

[GitHub] spark pull request #21542: [SPARK-24529][Build][test-maven] Add spotbugs int...

2018-07-09 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/21542#discussion_r200922589 --- Diff: pom.xml --- @@ -2606,6 +2606,28 @@ + +com.github.spotbugs +spotbugs-maven

[GitHub] spark pull request #21733: [SPARK-24763][SS] Remove redundant key data from ...

2018-07-09 Thread HeartSaVioR
Github user HeartSaVioR commented on a diff in the pull request: https://github.com/apache/spark/pull/21733#discussion_r200923851 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/streaming/StreamingAggregationSuite.scala --- @@ -53,7 +54,30 @@ class StreamingAggregationSuite

[GitHub] spark pull request #21061: [SPARK-23914][SQL] Add array_union function

2018-07-09 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/21061#discussion_r200925450 --- Diff: python/pyspark/sql/functions.py --- @@ -2013,6 +2013,25 @@ def array_distinct(col): return Column(sc._jvm.functions.array_distinct(_to_java_

[GitHub] spark pull request #21542: [SPARK-24529][Build][test-maven] Add spotbugs int...

2018-07-09 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/21542#discussion_r200926335 --- Diff: pom.xml --- @@ -2606,6 +2606,28 @@ + +com.github.spotbugs +spotbugs-maven

[GitHub] spark issue #21734: [SPARK-24149][YARN][FOLLOW-UP] Add a config to control a...

2018-07-09 Thread mgaido91
Github user mgaido91 commented on the issue: https://github.com/apache/spark/pull/21734 @wangyum I am not sure about this. It seems an env issue to me. Anyway, if you want to access that namespace, you have to add it to the list of file system to access, so the problem is the same. If

[GitHub] spark issue #21542: [SPARK-24529][Build][test-maven] Add spotbugs into maven...

2018-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21542 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21542: [SPARK-24529][Build][test-maven] Add spotbugs into maven...

2018-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21542 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/770/

[GitHub] spark issue #21542: [SPARK-24529][Build][test-maven] Add spotbugs into maven...

2018-07-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21542 **[Test build #92746 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92746/testReport)** for PR 21542 at commit [`6b747c3`](https://github.com/apache/spark/commit/6b

[GitHub] spark issue #21321: [SPARK-24268][SQL] Use datatype.simpleString in error me...

2018-07-09 Thread mgaido91
Github user mgaido91 commented on the issue: https://github.com/apache/spark/pull/21321 sorry for the late answer @HyukjinKwon. I just rebased it, thanks. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apach

[GitHub] spark issue #21321: [SPARK-24268][SQL] Use datatype.simpleString in error me...

2018-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21321 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21321: [SPARK-24268][SQL] Use datatype.simpleString in error me...

2018-07-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21321 **[Test build #92747 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92747/testReport)** for PR 21321 at commit [`781b64d`](https://github.com/apache/spark/commit/78

[GitHub] spark issue #21321: [SPARK-24268][SQL] Use datatype.simpleString in error me...

2018-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21321 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/771/

[GitHub] spark issue #21732: [SPARK-24762][SQL] Aggregator should be able to use Opti...

2018-07-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21732 **[Test build #92739 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92739/testReport)** for PR 21732 at commit [`e1b5dee`](https://github.com/apache/spark/commit/e

[GitHub] spark issue #21732: [SPARK-24762][SQL] Aggregator should be able to use Opti...

2018-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21732 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92739/ Test FAILed. ---

[GitHub] spark issue #21732: [SPARK-24762][SQL] Aggregator should be able to use Opti...

2018-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21732 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark pull request #21733: [SPARK-24763][SS] Remove redundant key data from ...

2018-07-09 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/21733#discussion_r200932324 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/streaming/StreamingAggregationSuite.scala --- @@ -53,7 +54,30 @@ class StreamingAggregationSuite

[GitHub] spark issue #21734: [SPARK-24149][YARN][FOLLOW-UP] Add a config to control a...

2018-07-09 Thread wangyum
Github user wangyum commented on the issue: https://github.com/apache/spark/pull/21734 @mgaido91 Yes. it's a env issue. I think it is mainly compatible with the previous Spark. If it fails since SPARK-24149, we only can do is change the `hdfs-site.xml`. This risk is a bit big. ---

[GitHub] spark pull request #21156: [SPARK-24087][SQL] Avoid shuffle when join keys a...

2018-07-09 Thread mgaido91
Github user mgaido91 commented on a diff in the pull request: https://github.com/apache/spark/pull/21156#discussion_r200933998 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/joins/SortMergeJoinExec.scala --- @@ -76,8 +76,36 @@ case class SortMergeJoinExec(

[GitHub] spark pull request #21156: [SPARK-24087][SQL] Avoid shuffle when join keys a...

2018-07-09 Thread mgaido91
Github user mgaido91 commented on a diff in the pull request: https://github.com/apache/spark/pull/21156#discussion_r200934272 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/sources/BucketedReadSuite.scala --- @@ -334,8 +334,7 @@ abstract class BucketedReadSuite extends Que

[GitHub] spark pull request #21542: [SPARK-24529][Build][test-maven] Add spotbugs int...

2018-07-09 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/21542#discussion_r200934983 --- Diff: pom.xml --- @@ -2606,6 +2606,28 @@ + +com.github.spotbugs +spotbugs

[GitHub] spark pull request #21733: [SPARK-24763][SS] Remove redundant key data from ...

2018-07-09 Thread HeartSaVioR
Github user HeartSaVioR commented on a diff in the pull request: https://github.com/apache/spark/pull/21733#discussion_r200934841 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/streaming/StreamingAggregationSuite.scala --- @@ -53,7 +54,30 @@ class StreamingAggregationSuite

[GitHub] spark pull request #21156: [SPARK-24087][SQL] Avoid shuffle when join keys a...

2018-07-09 Thread yucai
Github user yucai commented on a diff in the pull request: https://github.com/apache/spark/pull/21156#discussion_r200937190 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/joins/SortMergeJoinExec.scala --- @@ -76,8 +76,36 @@ case class SortMergeJoinExec(

[GitHub] spark pull request #21156: [SPARK-24087][SQL] Avoid shuffle when join keys a...

2018-07-09 Thread mgaido91
Github user mgaido91 commented on a diff in the pull request: https://github.com/apache/spark/pull/21156#discussion_r200938314 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/joins/SortMergeJoinExec.scala --- @@ -76,8 +76,36 @@ case class SortMergeJoinExec(

[GitHub] spark pull request #21156: [SPARK-24087][SQL] Avoid shuffle when join keys a...

2018-07-09 Thread mgaido91
Github user mgaido91 commented on a diff in the pull request: https://github.com/apache/spark/pull/21156#discussion_r200940409 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/joins/SortMergeJoinExec.scala --- @@ -76,8 +76,36 @@ case class SortMergeJoinExec(

[GitHub] spark pull request #21156: [SPARK-24087][SQL] Avoid shuffle when join keys a...

2018-07-09 Thread yucai
Github user yucai commented on a diff in the pull request: https://github.com/apache/spark/pull/21156#discussion_r200940424 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/joins/SortMergeJoinExec.scala --- @@ -76,8 +76,36 @@ case class SortMergeJoinExec(

[GitHub] spark issue #21732: [SPARK-24762][SQL] Aggregator should be able to use Opti...

2018-07-09 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/21732 retest this please. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h.

[GitHub] spark pull request #21156: [SPARK-24087][SQL] Avoid shuffle when join keys a...

2018-07-09 Thread mgaido91
Github user mgaido91 commented on a diff in the pull request: https://github.com/apache/spark/pull/21156#discussion_r200941904 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/joins/SortMergeJoinExec.scala --- @@ -76,8 +76,36 @@ case class SortMergeJoinExec(

[GitHub] spark pull request #21735: [MINOR] Add Sphinx into dev/requirements.txt

2018-07-09 Thread HyukjinKwon
GitHub user HyukjinKwon opened a pull request: https://github.com/apache/spark/pull/21735 [MINOR] Add Sphinx into dev/requirements.txt ## What changes were proposed in this pull request? Not a big deal but this PR adds `sphinx` into `dev/requirements.txt` since we found it

[GitHub] spark issue #21535: [SPARK-23596][SQL] Test interpreted path on encoders tes...

2018-07-09 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/21535 ping @hvanhovell @cloud-fan --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: r

[GitHub] spark issue #21735: [MINOR] Add Sphinx into dev/requirements.txt

2018-07-09 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/21735 cc @felixcheung --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-

[GitHub] spark issue #21704: [SPARK-24734][SQL] Fix containsNull of Concat for array ...

2018-07-09 Thread ueshin
Github user ueshin commented on the issue: https://github.com/apache/spark/pull/21704 Note: we will be able to use `NonPrimitiveTypeMergingExpression` in #21687. --- - To unsubscribe, e-mail: reviews-unsubscr...@spar

[GitHub] spark pull request #21156: [SPARK-24087][SQL] Avoid shuffle when join keys a...

2018-07-09 Thread yucai
Github user yucai commented on a diff in the pull request: https://github.com/apache/spark/pull/21156#discussion_r200945621 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/joins/SortMergeJoinExec.scala --- @@ -76,8 +76,36 @@ case class SortMergeJoinExec(

[GitHub] spark pull request #21736: [SPARK-24605][SQL][FOLLOWUP] Simplify conf retrie...

2018-07-09 Thread mgaido91
GitHub user mgaido91 opened a pull request: https://github.com/apache/spark/pull/21736 [SPARK-24605][SQL][FOLLOWUP] Simplify conf retrieval in size ## What changes were proposed in this pull request? The PR simplifies the retrieval of config in `size`, as we can access them

[GitHub] spark pull request #21156: [SPARK-24087][SQL] Avoid shuffle when join keys a...

2018-07-09 Thread mgaido91
Github user mgaido91 commented on a diff in the pull request: https://github.com/apache/spark/pull/21156#discussion_r200947380 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/joins/SortMergeJoinExec.scala --- @@ -76,8 +76,36 @@ case class SortMergeJoinExec(

[GitHub] spark issue #21599: [SPARK-24598][SQL] Overflow on arithmetic operations ret...

2018-07-09 Thread mgaido91
Github user mgaido91 commented on the issue: https://github.com/apache/spark/pull/21599 kindly ping @gatorsmile @hvanhovell --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands,

[GitHub] spark issue #21568: [SPARK-24562][TESTS] Support different configs for same ...

2018-07-09 Thread mgaido91
Github user mgaido91 commented on the issue: https://github.com/apache/spark/pull/21568 kindly ping @cloud-fan --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: revi

[GitHub] spark issue #21403: [SPARK-24341][SQL] Support only IN subqueries with the s...

2018-07-09 Thread mgaido91
Github user mgaido91 commented on the issue: https://github.com/apache/spark/pull/21403 anymore comments @cloud-fan @hvanhovell @juliuszsompolski ? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org F

[GitHub] spark issue #21733: [SPARK-24763][SS] Remove redundant key data from value i...

2018-07-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21733 **[Test build #92738 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92738/testReport)** for PR 21733 at commit [`bb5f672`](https://github.com/apache/spark/commit/b

[GitHub] spark issue #21733: [SPARK-24763][SS] Remove redundant key data from value i...

2018-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21733 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21733: [SPARK-24763][SS] Remove redundant key data from value i...

2018-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21733 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92738/ Test FAILed. ---

[GitHub] spark issue #21156: [SPARK-24087][SQL] Avoid shuffle when join keys are a su...

2018-07-09 Thread yucai
Github user yucai commented on the issue: https://github.com/apache/spark/pull/21156 @mgaido91 with this way, seems like we don't need `reorderJoinPredicates` anymore, any thoughts? --- - To unsubscribe, e-mail: rev

[GitHub] spark pull request #21706: [SPARK-24702] Fix Unable to cast to calendar inte...

2018-07-09 Thread dmateusp
Github user dmateusp commented on a diff in the pull request: https://github.com/apache/spark/pull/21706#discussion_r200959306 --- Diff: sql/core/src/test/resources/sql-tests/inputs/cast.sql --- @@ -42,4 +42,23 @@ SELECT CAST('9223372036854775808' AS long); DESC FUNCTION

[GitHub] spark issue #21728: [SPARK-24759] [SQL] No reordering keys for broadcast has...

2018-07-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21728 **[Test build #92741 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92741/testReport)** for PR 21728 at commit [`194991b`](https://github.com/apache/spark/commit/1

[GitHub] spark issue #21728: [SPARK-24759] [SQL] No reordering keys for broadcast has...

2018-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21728 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

  1   2   3   4   5   6   >