[GitHub] spark issue #21157: [SPARK-22674][PYTHON] Removed the namedtuple pickling pa...

2018-10-13 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/21157 > Ok it looks like it was @HyukjinKwon who suggested that we remove this hack in general rather than the partial work around can I get your thoughts on why? It seems like the partial work

[GitHub] spark issue #22514: [SPARK-25271][SQL] Hive ctas commands should use data so...

2018-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22514 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #22514: [SPARK-25271][SQL] Hive ctas commands should use data so...

2018-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22514 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/97352/ Test PASSed. ---

[GitHub] spark issue #22514: [SPARK-25271][SQL] Hive ctas commands should use data so...

2018-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22514 **[Test build #97352 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97352/testReport)** for PR 22514 at commit

[GitHub] spark pull request #22715: [SPARK-25727][SQL] Add outputOrdering to otherCop...

2018-10-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/22715 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #22719: [SPARK-25714] [BACKPORT-2.2] Fix Null Handling in the Op...

2018-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22719 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark issue #22719: [SPARK-25714] [BACKPORT-2.2] Fix Null Handling in the Op...

2018-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22719 **[Test build #97357 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97357/testReport)** for PR 22719 at commit

[GitHub] spark issue #22719: [SPARK-25714] [BACKPORT-2.2] Fix Null Handling in the Op...

2018-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22719 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #22715: [SPARK-25727][SQL] Add outputOrdering to otherCopyArgs i...

2018-10-13 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/22715 Thank you, @gatorsmile and @mgaido91 . --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #22719: [SPARK-25714] [BACKPORT-2.2] Fix Null Handling in...

2018-10-13 Thread gatorsmile
GitHub user gatorsmile opened a pull request: https://github.com/apache/spark/pull/22719 [SPARK-25714] [BACKPORT-2.2] Fix Null Handling in the Optimizer rule BooleanSimplification This PR is to backport https://github.com/apache/spark/pull/22702 to branch 2.2. ---

[GitHub] spark issue #22715: [SPARK-25727][SQL] Add outputOrdering to otherCopyArgs i...

2018-10-13 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/22715 Merged to master/branch-2.4. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands,

[GitHub] spark issue #22263: [SPARK-25269][SQL] SQL interface support specify Storage...

2018-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22263 **[Test build #97356 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97356/testReport)** for PR 22263 at commit

[GitHub] spark issue #22263: [SPARK-25269][SQL] SQL interface support specify Storage...

2018-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22263 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #22263: [SPARK-25269][SQL] SQL interface support specify Storage...

2018-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22263 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark issue #22718: [SPARK-25714] [BACKPORT-2.3] Fix Null Handling in the Op...

2018-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22718 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #22718: [SPARK-25714] [BACKPORT-2.3] Fix Null Handling in the Op...

2018-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22718 **[Test build #97355 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97355/testReport)** for PR 22718 at commit

[GitHub] spark issue #22718: [SPARK-25714] [BACKPORT-2.3] Fix Null Handling in the Op...

2018-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22718 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request #22718: [SPARK-25714] [BACKPORT-2.3] Fix Null Handling in...

2018-10-13 Thread gatorsmile
GitHub user gatorsmile opened a pull request: https://github.com/apache/spark/pull/22718 [SPARK-25714] [BACKPORT-2.3] Fix Null Handling in the Optimizer rule BooleanSimplification This PR is to backport https://github.com/apache/spark/pull/22702 to branch 2.3. ---

[GitHub] spark issue #22662: [SPARK-25627][TEST] Reduce test time for ContinuousStres...

2018-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22662 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #22662: [SPARK-25627][TEST] Reduce test time for ContinuousStres...

2018-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22662 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/97351/ Test PASSed. ---

[GitHub] spark issue #22662: [SPARK-25627][TEST] Reduce test time for ContinuousStres...

2018-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22662 **[Test build #97351 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97351/testReport)** for PR 22662 at commit

[GitHub] spark pull request #22662: [SPARK-25627][TEST] Reduce test time for Continuo...

2018-10-13 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/22662#discussion_r224977443 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/streaming/continuous/ContinuousSuite.scala --- @@ -259,10 +259,10 @@ class ContinuousStressSuite

[GitHub] spark issue #22715: [SPARK-25727][SQL] Add outputOrdering to otherCopyArgs i...

2018-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22715 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #22715: [SPARK-25727][SQL] Add outputOrdering to otherCopyArgs i...

2018-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22715 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/97350/ Test PASSed. ---

[GitHub] spark issue #22715: [SPARK-25727][SQL] Add outputOrdering to otherCopyArgs i...

2018-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22715 **[Test build #97350 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97350/testReport)** for PR 22715 at commit

[GitHub] spark issue #22263: [SPARK-25269][SQL] SQL interface support specify Storage...

2018-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22263 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark issue #22263: [SPARK-25269][SQL] SQL interface support specify Storage...

2018-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22263 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #22717: [SPARK-25372][YARN][K8S][FOLLOW-UP] Deprecate and genera...

2018-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22717 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #22717: [SPARK-25372][YARN][K8S][FOLLOW-UP] Deprecate and genera...

2018-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22717 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/3954/ ---

[GitHub] spark issue #22717: [SPARK-25372][YARN][K8S][FOLLOW-UP] Deprecate and genera...

2018-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22717 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request #22263: [SPARK-25269][SQL] SQL interface support specify ...

2018-10-13 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/22263#discussion_r224977190 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/CachedTableSuite.scala --- @@ -288,6 +297,68 @@ class CachedTableSuite extends QueryTest with

[GitHub] spark issue #22717: [SPARK-25372][YARN][K8S][FOLLOW-UP] Deprecate and genera...

2018-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22717 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/3954/ ---

[GitHub] spark pull request #22705: [SPARK-25704][CORE][WIP] Allocate a bit less than...

2018-10-13 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/22705#discussion_r224977082 --- Diff: core/src/main/scala/org/apache/spark/util/io/ChunkedByteBuffer.scala --- @@ -195,7 +196,11 @@ object ChunkedByteBuffer { val is = new

[GitHub] spark issue #22717: [SPARK-25372][YARN][K8S][FOLLOW-UP] Deprecate and genera...

2018-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22717 **[Test build #97353 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97353/testReport)** for PR 22717 at commit

[GitHub] spark issue #22263: [SPARK-25269][SQL] SQL interface support specify Storage...

2018-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22263 **[Test build #97354 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97354/testReport)** for PR 22263 at commit

[GitHub] spark issue #22263: [SPARK-25269][SQL] SQL interface support specify Storage...

2018-10-13 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/22263 Retest this please. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark pull request #22717: [SPARK-25372][YARN][K8S][FOLLOW-UP] Deprecate and...

2018-10-13 Thread gatorsmile
GitHub user gatorsmile opened a pull request: https://github.com/apache/spark/pull/22717 [SPARK-25372][YARN][K8S][FOLLOW-UP] Deprecate and generalize keytab / principal config ## What changes were proposed in this pull request? Update the next version of Spark from 2.5 to 3.0

[GitHub] spark issue #22514: [SPARK-25271][SQL] Hive ctas commands should use data so...

2018-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22514 **[Test build #97352 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97352/testReport)** for PR 22514 at commit

[GitHub] spark issue #22514: [SPARK-25271][SQL] Hive ctas commands should use data so...

2018-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22514 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark issue #22514: [SPARK-25271][SQL] Hive ctas commands should use data so...

2018-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22514 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #22514: [SPARK-25271][SQL] Hive ctas commands should use data so...

2018-10-13 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/22514 Retest this please. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #22703: [SPARK-25705][BUILD][STREAMING][test-maven] Remove Kafka...

2018-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22703 **[Test build #4378 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4378/testReport)** for PR 22703 at commit

[GitHub] spark issue #22663: [SPARK-25490][SQL][TEST] Refactor KryoBenchmark to use m...

2018-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22663 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #22663: [SPARK-25490][SQL][TEST] Refactor KryoBenchmark to use m...

2018-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22663 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/97347/ Test PASSed. ---

[GitHub] spark issue #22663: [SPARK-25490][SQL][TEST] Refactor KryoBenchmark to use m...

2018-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22663 **[Test build #97347 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97347/testReport)** for PR 22663 at commit

[GitHub] spark pull request #22716: [SPARK-25726][SQL][TEST] Fix flaky test in SaveIn...

2018-10-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/22716 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #22716: [SPARK-25726][SQL][TEST] Fix flaky test in SaveIntoDataS...

2018-10-13 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/22716 Merged to master/branch-2.4. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands,

[GitHub] spark issue #22716: [SPARK-25726][SQL][TEST] Fix flaky test in SaveIntoDataS...

2018-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22716 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #22716: [SPARK-25726][SQL][TEST] Fix flaky test in SaveIntoDataS...

2018-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22716 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/97349/ Test PASSed. ---

[GitHub] spark issue #22716: [SPARK-25726][SQL][TEST] Fix flaky test in SaveIntoDataS...

2018-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22716 **[Test build #97349 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97349/testReport)** for PR 22716 at commit

[GitHub] spark issue #22716: [SPARK-25726][SQL][TEST] Fix flaky test in SaveIntoDataS...

2018-10-13 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/22716 Thank you for review, @felixcheung . It comes from `treeString`. If you are asking the origin, it comes from Java `toString` and the value is the object `hashCode`. So, this happens when the

[GitHub] spark issue #22662: [SPARK-25627][TEST] Reduce test time for ContinuousStres...

2018-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22662 **[Test build #97351 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97351/testReport)** for PR 22662 at commit

[GitHub] spark issue #22662: [SPARK-25627][TEST] Reduce test time for ContinuousStres...

2018-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22662 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #22662: [SPARK-25627][TEST] Reduce test time for ContinuousStres...

2018-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22662 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark issue #22662: [SPARK-25627][TEST] Reduce test time for ContinuousStres...

2018-10-13 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/22662 Retest this please. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #22663: [SPARK-25490][SQL][TEST] Refactor KryoBenchmark to use m...

2018-10-13 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/22663 @gengliangwang . This scope of this PR is broader than `Refactor to use main method`. Please update the tile and description in both JIRA and PR. We need to mention both OOM and Randomness

[GitHub] spark issue #22714: [SPARK-25720][WEBUI] Support auto refresh page for the W...

2018-10-13 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/22714 can this be passed in as a param in the url? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For

[GitHub] spark issue #22716: [SPARK-25726][SQL][TEST] Fix flaky test in SaveIntoDataS...

2018-10-13 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/22716 Thank you for review, @gatorsmile ! --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21993: [SPARK-24983][Catalyst] Add configuration for maximum nu...

2018-10-13 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/21993 Backlisting case-when statements looks good to me. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For

[GitHub] spark pull request #22711: [SPARK-25714][SQL][followup] improve the comment ...

2018-10-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/22711 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #22711: [SPARK-25714][SQL][followup] improve the comment inside ...

2018-10-13 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/22711 LGTM Thanks! Merged to master/2.4 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #22713: [SPARK-25691][SQL] Use semantic equality in order to com...

2018-10-13 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/22713 I do not want to take any risk unless you can have a test case to show the benefit of each change. --- - To unsubscribe,

[GitHub] spark issue #22715: [SPARK-25727][SQL] Add outputOrdering to otherCopyArgs

2018-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22715 **[Test build #97350 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97350/testReport)** for PR 22715 at commit

[GitHub] spark issue #22715: [SPARK-25727][SQL] Add outputOrdering to otherCopyArgs

2018-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22715 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #22715: [SPARK-25727][SQL] Add outputOrdering to otherCopyArgs

2018-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22715 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark issue #22715: [SPARK-23375][FOLLOW-UP] Add outputOrdering to otherCopy...

2018-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22715 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #22715: [SPARK-23375][FOLLOW-UP] Add outputOrdering to otherCopy...

2018-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22715 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/97346/ Test PASSed. ---

[GitHub] spark issue #22715: [SPARK-23375][FOLLOW-UP] Add outputOrdering to otherCopy...

2018-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22715 **[Test build #97346 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97346/testReport)** for PR 22715 at commit

[GitHub] spark issue #22715: [SPARK-23375][FOLLOW-UP] Add outputOrdering to otherCopy...

2018-10-13 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/22715 @mgaido91 Anything is missing in LogicalRDD? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For

[GitHub] spark issue #22714: [SPARK-25720][WEBUI] Support auto refresh page for the W...

2018-10-13 Thread shahidki31
Github user shahidki31 commented on the issue: https://github.com/apache/spark/pull/22714 Thank you @srowen for the comment. Yes, we should not hard-code the refresh interval and we let the user to enable the parameter. I will update the code accordingly. ---

[GitHub] spark issue #22706: [SPARK-25716][SQL][MINOR] remove unnecessary collection ...

2018-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22706 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/97345/ Test PASSed. ---

[GitHub] spark issue #22706: [SPARK-25716][SQL][MINOR] remove unnecessary collection ...

2018-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22706 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #22706: [SPARK-25716][SQL][MINOR] remove unnecessary collection ...

2018-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22706 **[Test build #97345 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97345/testReport)** for PR 22706 at commit

[GitHub] spark issue #22703: [SPARK-25705][BUILD][STREAMING][test-maven] Remove Kafka...

2018-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22703 **[Test build #4377 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4377/testReport)** for PR 22703 at commit

[GitHub] spark issue #22716: [SPARK-25726][SQL][TEST] Fix flaky test in SaveIntoDataS...

2018-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22716 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #22713: [SPARK-25691][SQL] Use semantic equality in order to com...

2018-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22713 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #22713: [SPARK-25691][SQL] Use semantic equality in order to com...

2018-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22713 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/97344/ Test PASSed. ---

[GitHub] spark issue #22716: [SPARK-25726][SQL][TEST] Fix flaky test in SaveIntoDataS...

2018-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22716 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark issue #22713: [SPARK-25691][SQL] Use semantic equality in order to com...

2018-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22713 **[Test build #97344 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97344/testReport)** for PR 22713 at commit

[GitHub] spark issue #22716: [SPARK-25726][SQL][TEST] Fix flaky test in SaveIntoDataS...

2018-10-13 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/22716 cc @onursatici and @gatorsmile --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #22716: [SPARK-25726][SQL][TEST] Fix flaky test in SaveIntoDataS...

2018-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22716 **[Test build #97349 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97349/testReport)** for PR 22716 at commit

[GitHub] spark pull request #22716: [SPARK-25726][SQL][TEST] Fix flaky test in SaveIn...

2018-10-13 Thread dongjoon-hyun
GitHub user dongjoon-hyun opened a pull request: https://github.com/apache/spark/pull/22716 [SPARK-25726][SQL][TEST] Fix flaky test in SaveIntoDataSourceCommandSuite ## What changes were proposed in this pull request? SPARK-22479 adds a test case which sometimes fails

[GitHub] spark issue #22703: [SPARK-25705][BUILD][STREAMING][test-maven] Remove Kafka...

2018-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22703 **[Test build #4378 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4378/testReport)** for PR 22703 at commit

[GitHub] spark issue #22714: [SPARK-25720][WEBUI] Support auto refresh page for the W...

2018-10-13 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/22714 Shouldn't it go in `commonHeaderNodes`? Looks like this was added waaay back in https://github.com/JoshRosen/spark/commit/6aa08c39cf30fa5c4ed97f4fff16371b9030a2e6 by @tdas but never used.

[GitHub] spark issue #22617: [SPARK-25484][SQL][TEST] Refactor ExternalAppendOnlyUnsa...

2018-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22617 **[Test build #97348 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97348/testReport)** for PR 22617 at commit

[GitHub] spark issue #22617: [SPARK-25484][SQL][TEST] Refactor ExternalAppendOnlyUnsa...

2018-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22617 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/97348/ Test FAILed. ---

[GitHub] spark issue #22617: [SPARK-25484][SQL][TEST] Refactor ExternalAppendOnlyUnsa...

2018-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22617 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #22617: [SPARK-25484][SQL][TEST] Refactor ExternalAppendOnlyUnsa...

2018-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22617 **[Test build #97348 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97348/testReport)** for PR 22617 at commit

[GitHub] spark issue #22663: [SPARK-25490][SQL][TEST] Refactor KryoBenchmark to use m...

2018-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22663 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark issue #22663: [SPARK-25490][SQL][TEST] Refactor KryoBenchmark to use m...

2018-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22663 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #22663: [SPARK-25490][SQL][TEST] Refactor KryoBenchmark to use m...

2018-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22663 **[Test build #97347 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97347/testReport)** for PR 22663 at commit

[GitHub] spark issue #22379: [SPARK-25393][SQL] Adding new function from_csv()

2018-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22379 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/97341/ Test PASSed. ---

[GitHub] spark issue #22379: [SPARK-25393][SQL] Adding new function from_csv()

2018-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22379 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #22379: [SPARK-25393][SQL] Adding new function from_csv()

2018-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22379 **[Test build #97341 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97341/testReport)** for PR 22379 at commit

[GitHub] spark issue #22663: [SPARK-25490][SQL][TEST] Refactor KryoBenchmark to use m...

2018-10-13 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/22663 Retest this please. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #22617: [SPARK-25484][SQL][TEST] Refactor ExternalAppendOnlyUnsa...

2018-10-13 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/22617 Retest this please. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark pull request #22699: [SPARK-25711][Core] Improve start-history-server....

2018-10-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/22699 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #22699: [SPARK-25711][Core] Improve start-history-server.sh: sho...

2018-10-13 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/22699 Merged to master. Thank you, @gengliangwang , @srowen , @jiangxb1987 . --- - To unsubscribe, e-mail:

[GitHub] spark issue #22713: [SPARK-25691][SQL] Use semantic equality in order to com...

2018-10-13 Thread mgaido91
Github user mgaido91 commented on the issue: https://github.com/apache/spark/pull/22713 @gatorsmile thanks for your comment. Honestly I don't see much value in holding, as we are (nearly always) using semantic equality throughout the Analyzer/Optimizer. So different expressions with

[GitHub] spark issue #22711: [SPARK-25714][SQL][followup] improve the comment inside ...

2018-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22711 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/97342/ Test PASSed. ---

  1   2   3   >