[GitHub] [spark] maropu commented on issue #26008: [MINOR][TESTS] Rename JsonBenchmark.scala to JSONBenchmark.scala to match class name

2019-10-02 Thread GitBox
maropu commented on issue #26008: [MINOR][TESTS] Rename JsonBenchmark.scala to JSONBenchmark.scala to match class name URL: https://github.com/apache/spark/pull/26008#issuecomment-537800095 nit: we have no consistent name rule for that? Since `Json` is more popular, `JSONBenchmark` ->

[GitHub] [spark] AmplabJenkins commented on issue #25993: [SPARK-29339][R] Support Arrow 0.14 in vectoried dapply and gapply (test it in AppVeyor build)

2019-10-02 Thread GitBox
AmplabJenkins commented on issue #25993: [SPARK-29339][R] Support Arrow 0.14 in vectoried dapply and gapply (test it in AppVeyor build) URL: https://github.com/apache/spark/pull/25993#issuecomment-537798069 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #25993: [SPARK-29339][R] Support Arrow 0.14 in vectoried dapply and gapply (test it in AppVeyor build)

2019-10-02 Thread GitBox
AmplabJenkins commented on issue #25993: [SPARK-29339][R] Support Arrow 0.14 in vectoried dapply and gapply (test it in AppVeyor build) URL: https://github.com/apache/spark/pull/25993#issuecomment-537798062 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25993: [SPARK-29339][R] Support Arrow 0.14 in vectoried dapply and gapply (test it in AppVeyor build)

2019-10-02 Thread GitBox
AmplabJenkins removed a comment on issue #25993: [SPARK-29339][R] Support Arrow 0.14 in vectoried dapply and gapply (test it in AppVeyor build) URL: https://github.com/apache/spark/pull/25993#issuecomment-537798062 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25993: [SPARK-29339][R] Support Arrow 0.14 in vectoried dapply and gapply (test it in AppVeyor build)

2019-10-02 Thread GitBox
AmplabJenkins removed a comment on issue #25993: [SPARK-29339][R] Support Arrow 0.14 in vectoried dapply and gapply (test it in AppVeyor build) URL: https://github.com/apache/spark/pull/25993#issuecomment-537798069 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] SparkQA commented on issue #25993: [SPARK-29339][R] Support Arrow 0.14 in vectoried dapply and gapply (test it in AppVeyor build)

2019-10-02 Thread GitBox
SparkQA commented on issue #25993: [SPARK-29339][R] Support Arrow 0.14 in vectoried dapply and gapply (test it in AppVeyor build) URL: https://github.com/apache/spark/pull/25993#issuecomment-537797631 **[Test build #111709 has

[GitHub] [spark] SparkQA removed a comment on issue #25993: [SPARK-29339][R] Support Arrow 0.14 in vectoried dapply and gapply (test it in AppVeyor build)

2019-10-02 Thread GitBox
SparkQA removed a comment on issue #25993: [SPARK-29339][R] Support Arrow 0.14 in vectoried dapply and gapply (test it in AppVeyor build) URL: https://github.com/apache/spark/pull/25993#issuecomment-537764496 **[Test build #111709 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #26001: [SPARK-29331][SQL] create DS v2 Write at physical plan

2019-10-02 Thread GitBox
AmplabJenkins removed a comment on issue #26001: [SPARK-29331][SQL] create DS v2 Write at physical plan URL: https://github.com/apache/spark/pull/26001#issuecomment-537795945 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #26001: [SPARK-29331][SQL] create DS v2 Write at physical plan

2019-10-02 Thread GitBox
AmplabJenkins removed a comment on issue #26001: [SPARK-29331][SQL] create DS v2 Write at physical plan URL: https://github.com/apache/spark/pull/26001#issuecomment-537795949 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26001: [SPARK-29331][SQL] create DS v2 Write at physical plan

2019-10-02 Thread GitBox
AmplabJenkins commented on issue #26001: [SPARK-29331][SQL] create DS v2 Write at physical plan URL: https://github.com/apache/spark/pull/26001#issuecomment-537795945 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #26001: [SPARK-29331][SQL] create DS v2 Write at physical plan

2019-10-02 Thread GitBox
AmplabJenkins commented on issue #26001: [SPARK-29331][SQL] create DS v2 Write at physical plan URL: https://github.com/apache/spark/pull/26001#issuecomment-537795949 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #26001: [SPARK-29331][SQL] create DS v2 Write at physical plan

2019-10-02 Thread GitBox
SparkQA removed a comment on issue #26001: [SPARK-29331][SQL] create DS v2 Write at physical plan URL: https://github.com/apache/spark/pull/26001#issuecomment-537755364 **[Test build #111708 has

[GitHub] [spark] SparkQA commented on issue #26001: [SPARK-29331][SQL] create DS v2 Write at physical plan

2019-10-02 Thread GitBox
SparkQA commented on issue #26001: [SPARK-29331][SQL] create DS v2 Write at physical plan URL: https://github.com/apache/spark/pull/26001#issuecomment-537795578 **[Test build #111708 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/111708/testReport)** for

[GitHub] [spark] karuppayya commented on issue #25995: SPARK-29324: Fix overwrite behaviour for saveAsTable

2019-10-02 Thread GitBox
karuppayya commented on issue #25995: SPARK-29324: Fix overwrite behaviour for saveAsTable URL: https://github.com/apache/spark/pull/25995#issuecomment-537790057 Can someone help review this change This is an automated

[GitHub] [spark] huaxingao commented on issue #26004: [SPARK-29142][PYTHON][ML][FOLLOWUP][DOC] Replace incorrect :py:attr: applications

2019-10-02 Thread GitBox
huaxingao commented on issue #26004: [SPARK-29142][PYTHON][ML][FOLLOWUP][DOC] Replace incorrect :py:attr: applications URL: https://github.com/apache/spark/pull/26004#issuecomment-537787996 LGTM. Thanks for catching the problem. @zero323

[GitHub] [spark] viirya commented on issue #25979: [SPARK-29295][SQL] Insert overwrite to Hive external table partition should delete old data

2019-10-02 Thread GitBox
viirya commented on issue #25979: [SPARK-29295][SQL] Insert overwrite to Hive external table partition should delete old data URL: https://github.com/apache/spark/pull/25979#issuecomment-537784884 I am not sure if this is designed behavior of Hive. You can see a similar issue at

[GitHub] [spark] AmplabJenkins commented on issue #25993: [SPARK-29339][R] Support Arrow 0.14 in vectoried dapply and gapply (test it in AppVeyor build)

2019-10-02 Thread GitBox
AmplabJenkins commented on issue #25993: [SPARK-29339][R] Support Arrow 0.14 in vectoried dapply and gapply (test it in AppVeyor build) URL: https://github.com/apache/spark/pull/25993#issuecomment-537784438 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #25993: [SPARK-29339][R] Support Arrow 0.14 in vectoried dapply and gapply (test it in AppVeyor build)

2019-10-02 Thread GitBox
AmplabJenkins commented on issue #25993: [SPARK-29339][R] Support Arrow 0.14 in vectoried dapply and gapply (test it in AppVeyor build) URL: https://github.com/apache/spark/pull/25993#issuecomment-537784433 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25993: [SPARK-29339][R] Support Arrow 0.14 in vectoried dapply and gapply (test it in AppVeyor build)

2019-10-02 Thread GitBox
AmplabJenkins removed a comment on issue #25993: [SPARK-29339][R] Support Arrow 0.14 in vectoried dapply and gapply (test it in AppVeyor build) URL: https://github.com/apache/spark/pull/25993#issuecomment-537784438 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins removed a comment on issue #25993: [SPARK-29339][R] Support Arrow 0.14 in vectoried dapply and gapply (test it in AppVeyor build)

2019-10-02 Thread GitBox
AmplabJenkins removed a comment on issue #25993: [SPARK-29339][R] Support Arrow 0.14 in vectoried dapply and gapply (test it in AppVeyor build) URL: https://github.com/apache/spark/pull/25993#issuecomment-537784433 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #25993: [SPARK-29339][R] Support Arrow 0.14 in vectoried dapply and gapply (test it in AppVeyor build)

2019-10-02 Thread GitBox
SparkQA commented on issue #25993: [SPARK-29339][R] Support Arrow 0.14 in vectoried dapply and gapply (test it in AppVeyor build) URL: https://github.com/apache/spark/pull/25993#issuecomment-537784158 **[Test build #111714 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #26007: [SPARK-28962][SPARK-27297][SQL] Add overload for filter with index to functions object

2019-10-02 Thread GitBox
AmplabJenkins removed a comment on issue #26007: [SPARK-28962][SPARK-27297][SQL] Add overload for filter with index to functions object URL: https://github.com/apache/spark/pull/26007#issuecomment-537779887 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26007: [SPARK-28962][SPARK-27297][SQL] Add overload for filter with index to functions object

2019-10-02 Thread GitBox
AmplabJenkins removed a comment on issue #26007: [SPARK-28962][SPARK-27297][SQL] Add overload for filter with index to functions object URL: https://github.com/apache/spark/pull/26007#issuecomment-537779896 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #26007: [SPARK-28962][SPARK-27297][SQL] Add overload for filter with index to functions object

2019-10-02 Thread GitBox
AmplabJenkins commented on issue #26007: [SPARK-28962][SPARK-27297][SQL] Add overload for filter with index to functions object URL: https://github.com/apache/spark/pull/26007#issuecomment-537779887 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26007: [SPARK-28962][SPARK-27297][SQL] Add overload for filter with index to functions object

2019-10-02 Thread GitBox
AmplabJenkins commented on issue #26007: [SPARK-28962][SPARK-27297][SQL] Add overload for filter with index to functions object URL: https://github.com/apache/spark/pull/26007#issuecomment-537779896 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #26007: [SPARK-28962][SPARK-27297][SQL] Add overload for filter with index to functions object

2019-10-02 Thread GitBox
SparkQA removed a comment on issue #26007: [SPARK-28962][SPARK-27297][SQL] Add overload for filter with index to functions object URL: https://github.com/apache/spark/pull/26007#issuecomment-537741121 **[Test build #111707 has

[GitHub] [spark] SparkQA commented on issue #26007: [SPARK-28962][SPARK-27297][SQL] Add overload for filter with index to functions object

2019-10-02 Thread GitBox
SparkQA commented on issue #26007: [SPARK-28962][SPARK-27297][SQL] Add overload for filter with index to functions object URL: https://github.com/apache/spark/pull/26007#issuecomment-537779368 **[Test build #111707 has

[GitHub] [spark] dongjoon-hyun commented on issue #20640: [SPARK-19755][Mesos] Blacklist is always active for MesosCoarseGrainedSchedulerBackend

2019-10-02 Thread GitBox
dongjoon-hyun commented on issue #20640: [SPARK-19755][Mesos] Blacklist is always active for MesosCoarseGrainedSchedulerBackend URL: https://github.com/apache/spark/pull/20640#issuecomment-537778659 Got it, @squito . I'll follow your advice.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25951: [SPARK-28917][CORE] Synchronize access to RDD mutable state.

2019-10-02 Thread GitBox
AmplabJenkins removed a comment on issue #25951: [SPARK-28917][CORE] Synchronize access to RDD mutable state. URL: https://github.com/apache/spark/pull/25951#issuecomment-537776749 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25951: [SPARK-28917][CORE] Synchronize access to RDD mutable state.

2019-10-02 Thread GitBox
AmplabJenkins removed a comment on issue #25951: [SPARK-28917][CORE] Synchronize access to RDD mutable state. URL: https://github.com/apache/spark/pull/25951#issuecomment-537776743 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins commented on issue #25951: [SPARK-28917][CORE] Synchronize access to RDD mutable state.

2019-10-02 Thread GitBox
AmplabJenkins commented on issue #25951: [SPARK-28917][CORE] Synchronize access to RDD mutable state. URL: https://github.com/apache/spark/pull/25951#issuecomment-537776749 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25951: [SPARK-28917][CORE] Synchronize access to RDD mutable state.

2019-10-02 Thread GitBox
AmplabJenkins commented on issue #25951: [SPARK-28917][CORE] Synchronize access to RDD mutable state. URL: https://github.com/apache/spark/pull/25951#issuecomment-537776743 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #26003: [WIP][SPARK-29320][TESTS] Compare `sql/core` module in JDK8/11

2019-10-02 Thread GitBox
AmplabJenkins removed a comment on issue #26003: [WIP][SPARK-29320][TESTS] Compare `sql/core` module in JDK8/11 URL: https://github.com/apache/spark/pull/26003#issuecomment-537776381 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #26003: [WIP][SPARK-29320][TESTS] Compare `sql/core` module in JDK8/11

2019-10-02 Thread GitBox
AmplabJenkins removed a comment on issue #26003: [WIP][SPARK-29320][TESTS] Compare `sql/core` module in JDK8/11 URL: https://github.com/apache/spark/pull/26003#issuecomment-537776386 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #25951: [SPARK-28917][CORE] Synchronize access to RDD mutable state.

2019-10-02 Thread GitBox
SparkQA commented on issue #25951: [SPARK-28917][CORE] Synchronize access to RDD mutable state. URL: https://github.com/apache/spark/pull/25951#issuecomment-537776459 **[Test build #111713 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/111713/testReport)**

[GitHub] [spark] AmplabJenkins commented on issue #26003: [WIP][SPARK-29320][TESTS] Compare `sql/core` module in JDK8/11

2019-10-02 Thread GitBox
AmplabJenkins commented on issue #26003: [WIP][SPARK-29320][TESTS] Compare `sql/core` module in JDK8/11 URL: https://github.com/apache/spark/pull/26003#issuecomment-537776381 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #26003: [WIP][SPARK-29320][TESTS] Compare `sql/core` module in JDK8/11

2019-10-02 Thread GitBox
AmplabJenkins commented on issue #26003: [WIP][SPARK-29320][TESTS] Compare `sql/core` module in JDK8/11 URL: https://github.com/apache/spark/pull/26003#issuecomment-537776386 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #26003: [WIP][SPARK-29320][TESTS] Compare `sql/core` module in JDK8/11

2019-10-02 Thread GitBox
SparkQA commented on issue #26003: [WIP][SPARK-29320][TESTS] Compare `sql/core` module in JDK8/11 URL: https://github.com/apache/spark/pull/26003#issuecomment-537776033 **[Test build #111706 has

[GitHub] [spark] SparkQA removed a comment on issue #26003: [WIP][SPARK-29320][TESTS] Compare `sql/core` module in JDK8/11

2019-10-02 Thread GitBox
SparkQA removed a comment on issue #26003: [WIP][SPARK-29320][TESTS] Compare `sql/core` module in JDK8/11 URL: https://github.com/apache/spark/pull/26003#issuecomment-537738004 **[Test build #111706 has

[GitHub] [spark] dongjoon-hyun commented on issue #25816: [SPARK-29107][SQL][TESTS] Port window.sql (Part 1)

2019-10-02 Thread GitBox
dongjoon-hyun commented on issue #25816: [SPARK-29107][SQL][TESTS] Port window.sql (Part 1) URL: https://github.com/apache/spark/pull/25816#issuecomment-537774869 Hmm. Still `Result did not match for query ` for the following. ``` SELECT four, ten/4 as two, sum(ten/4) over

[GitHub] [spark] felixcheung commented on a change in pull request #25993: [SPARK-29339][R] Support Arrow 0.14 in vectoried dapply and gapply (test it in AppVeyor build)

2019-10-02 Thread GitBox
felixcheung commented on a change in pull request #25993: [SPARK-29339][R] Support Arrow 0.14 in vectoried dapply and gapply (test it in AppVeyor build) URL: https://github.com/apache/spark/pull/25993#discussion_r330855381 ## File path: appveyor.yml ## @@ -46,9 +46,9 @@

[GitHub] [spark] felixcheung commented on issue #25979: [SPARK-29295][SQL] Insert overwrite to Hive external table partition should delete old data

2019-10-02 Thread GitBox
felixcheung commented on issue #25979: [SPARK-29295][SQL] Insert overwrite to Hive external table partition should delete old data URL: https://github.com/apache/spark/pull/25979#issuecomment-537773757 or we do > exception thrown (Hive 2.3.2)

[GitHub] [spark] felixcheung commented on issue #25979: [SPARK-29295][SQL] Insert overwrite to Hive external table partition should delete old data

2019-10-02 Thread GitBox
felixcheung commented on issue #25979: [SPARK-29295][SQL] Insert overwrite to Hive external table partition should delete old data URL: https://github.com/apache/spark/pull/25979#issuecomment-537773541 yeah, this is a hard one, obviously the behavior is buggy, hard to detect etc. but

[GitHub] [spark] HyukjinKwon commented on a change in pull request #25993: [SPARK-29339][R] Support Arrow 0.14 in vectoried dapply and gapply (test it in AppVeyor build)

2019-10-02 Thread GitBox
HyukjinKwon commented on a change in pull request #25993: [SPARK-29339][R] Support Arrow 0.14 in vectoried dapply and gapply (test it in AppVeyor build) URL: https://github.com/apache/spark/pull/25993#discussion_r330854715 ## File path: appveyor.yml ## @@ -46,9 +46,9 @@

[GitHub] [spark] felixcheung commented on a change in pull request #25993: [SPARK-29339][R] Support Arrow 0.14 in vectoried dapply and gapply (test it in AppVeyor build)

2019-10-02 Thread GitBox
felixcheung commented on a change in pull request #25993: [SPARK-29339][R] Support Arrow 0.14 in vectoried dapply and gapply (test it in AppVeyor build) URL: https://github.com/apache/spark/pull/25993#discussion_r330854350 ## File path: appveyor.yml ## @@ -46,9 +46,9 @@

[GitHub] [spark] dongjoon-hyun closed pull request #25996: [SPARK-29322][CORE] Enable closeFrameOnFlush on ZstdOutputStream for event log file

2019-10-02 Thread GitBox
dongjoon-hyun closed pull request #25996: [SPARK-29322][CORE] Enable closeFrameOnFlush on ZstdOutputStream for event log file URL: https://github.com/apache/spark/pull/25996 This is an automated message from the Apache Git

[GitHub] [spark] viirya edited a comment on issue #25979: [SPARK-29295][SQL] Insert overwrite to Hive external table partition should delete old data

2019-10-02 Thread GitBox
viirya edited a comment on issue #25979: [SPARK-29295][SQL] Insert overwrite to Hive external table partition should delete old data URL: https://github.com/apache/spark/pull/25979#issuecomment-537771098 Currently behavior of INSERT OVERWRITE into a Hive external table partition is

[GitHub] [spark] viirya commented on issue #25979: [SPARK-29295][SQL] Insert overwrite to Hive external table partition should delete old data

2019-10-02 Thread GitBox
viirya commented on issue #25979: [SPARK-29295][SQL] Insert overwrite to Hive external table partition should delete old data URL: https://github.com/apache/spark/pull/25979#issuecomment-537771098 Currently behavior of INSERT OVERWRITE into a Hive external table partition is consistent

[GitHub] [spark] AmplabJenkins removed a comment on issue #26006: [SPARK-29279][SQL] Merge SHOW NAMESPACES and SHOW DATABASES code path

2019-10-02 Thread GitBox
AmplabJenkins removed a comment on issue #26006: [SPARK-29279][SQL] Merge SHOW NAMESPACES and SHOW DATABASES code path URL: https://github.com/apache/spark/pull/26006#issuecomment-537770683 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26006: [SPARK-29279][SQL] Merge SHOW NAMESPACES and SHOW DATABASES code path

2019-10-02 Thread GitBox
AmplabJenkins removed a comment on issue #26006: [SPARK-29279][SQL] Merge SHOW NAMESPACES and SHOW DATABASES code path URL: https://github.com/apache/spark/pull/26006#issuecomment-537770677 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26006: [SPARK-29279][SQL] Merge SHOW NAMESPACES and SHOW DATABASES code path

2019-10-02 Thread GitBox
AmplabJenkins commented on issue #26006: [SPARK-29279][SQL] Merge SHOW NAMESPACES and SHOW DATABASES code path URL: https://github.com/apache/spark/pull/26006#issuecomment-537770677 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #26006: [SPARK-29279][SQL] Merge SHOW NAMESPACES and SHOW DATABASES code path

2019-10-02 Thread GitBox
AmplabJenkins commented on issue #26006: [SPARK-29279][SQL] Merge SHOW NAMESPACES and SHOW DATABASES code path URL: https://github.com/apache/spark/pull/26006#issuecomment-537770683 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #26006: [SPARK-29279][SQL] Merge SHOW NAMESPACES and SHOW DATABASES code path

2019-10-02 Thread GitBox
SparkQA commented on issue #26006: [SPARK-29279][SQL] Merge SHOW NAMESPACES and SHOW DATABASES code path URL: https://github.com/apache/spark/pull/26006#issuecomment-537770434 **[Test build #111712 has

[GitHub] [spark] cloud-fan commented on issue #25979: [SPARK-29295][SQL] Insert overwrite to Hive external table partition should delete old data

2019-10-02 Thread GitBox
cloud-fan commented on issue #25979: [SPARK-29295][SQL] Insert overwrite to Hive external table partition should delete old data URL: https://github.com/apache/spark/pull/25979#issuecomment-537769089 Do you mean the current behavior is consistent with some Hive versions?

[GitHub] [spark] maryannxue commented on a change in pull request #25600: [SPARK-11150][SQL] Dynamic Partition Pruning

2019-10-02 Thread GitBox
maryannxue commented on a change in pull request #25600: [SPARK-11150][SQL] Dynamic Partition Pruning URL: https://github.com/apache/spark/pull/25600#discussion_r330851430 ## File path: sql/core/src/main/scala/org/apache/spark/sql/dynamicpruning/PlanDynamicPruningFilters.scala

[GitHub] [spark] cloud-fan commented on issue #25024: [SPARK-27296][SQL] User Defined Aggregators that do not ser/de on each input row

2019-10-02 Thread GitBox
cloud-fan commented on issue #25024: [SPARK-27296][SQL] User Defined Aggregators that do not ser/de on each input row URL: https://github.com/apache/spark/pull/25024#issuecomment-537768473 What I want to see is a single UDAF API that works for all the use cases, if it's possible. It's

[GitHub] [spark] AmplabJenkins removed a comment on issue #25993: [SPARK-29339][R] Support Arrow 0.14 in vectoried dapply and gapply (test it in AppVeyor build)

2019-10-02 Thread GitBox
AmplabJenkins removed a comment on issue #25993: [SPARK-29339][R] Support Arrow 0.14 in vectoried dapply and gapply (test it in AppVeyor build) URL: https://github.com/apache/spark/pull/25993#issuecomment-537768175 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25993: [SPARK-29339][R] Support Arrow 0.14 in vectoried dapply and gapply (test it in AppVeyor build)

2019-10-02 Thread GitBox
AmplabJenkins removed a comment on issue #25993: [SPARK-29339][R] Support Arrow 0.14 in vectoried dapply and gapply (test it in AppVeyor build) URL: https://github.com/apache/spark/pull/25993#issuecomment-537768178 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #25993: [SPARK-29339][R] Support Arrow 0.14 in vectoried dapply and gapply (test it in AppVeyor build)

2019-10-02 Thread GitBox
AmplabJenkins commented on issue #25993: [SPARK-29339][R] Support Arrow 0.14 in vectoried dapply and gapply (test it in AppVeyor build) URL: https://github.com/apache/spark/pull/25993#issuecomment-537768175 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25993: [SPARK-29339][R] Support Arrow 0.14 in vectoried dapply and gapply (test it in AppVeyor build)

2019-10-02 Thread GitBox
AmplabJenkins commented on issue #25993: [SPARK-29339][R] Support Arrow 0.14 in vectoried dapply and gapply (test it in AppVeyor build) URL: https://github.com/apache/spark/pull/25993#issuecomment-537768178 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] SparkQA commented on issue #25993: [SPARK-29339][R] Support Arrow 0.14 in vectoried dapply and gapply (test it in AppVeyor build)

2019-10-02 Thread GitBox
SparkQA commented on issue #25993: [SPARK-29339][R] Support Arrow 0.14 in vectoried dapply and gapply (test it in AppVeyor build) URL: https://github.com/apache/spark/pull/25993#issuecomment-537767982 **[Test build #111711 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #26008: [MINOR][TESTS] Rename JsonBenchmark.scala to JSONBenchmark.scala to match class name

2019-10-02 Thread GitBox
AmplabJenkins removed a comment on issue #26008: [MINOR][TESTS] Rename JsonBenchmark.scala to JSONBenchmark.scala to match class name URL: https://github.com/apache/spark/pull/26008#issuecomment-537767050 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #26008: [MINOR][TESTS] Rename JsonBenchmark.scala to JSONBenchmark.scala to match class name

2019-10-02 Thread GitBox
AmplabJenkins removed a comment on issue #26008: [MINOR][TESTS] Rename JsonBenchmark.scala to JSONBenchmark.scala to match class name URL: https://github.com/apache/spark/pull/26008#issuecomment-537767044 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26008: [MINOR][TESTS] Rename JsonBenchmark.scala to JSONBenchmark.scala to match class name

2019-10-02 Thread GitBox
AmplabJenkins commented on issue #26008: [MINOR][TESTS] Rename JsonBenchmark.scala to JSONBenchmark.scala to match class name URL: https://github.com/apache/spark/pull/26008#issuecomment-537767044 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26008: [MINOR][TESTS] Rename JsonBenchmark.scala to JSONBenchmark.scala to match class name

2019-10-02 Thread GitBox
AmplabJenkins commented on issue #26008: [MINOR][TESTS] Rename JsonBenchmark.scala to JSONBenchmark.scala to match class name URL: https://github.com/apache/spark/pull/26008#issuecomment-537767050 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #26008: [MINOR][TESTS] Rename JsonBenchmark.scala to JSONBenchmark.scala to match class name

2019-10-02 Thread GitBox
SparkQA commented on issue #26008: [MINOR][TESTS] Rename JsonBenchmark.scala to JSONBenchmark.scala to match class name URL: https://github.com/apache/spark/pull/26008#issuecomment-537766801 **[Test build #111710 has

[GitHub] [spark] dongjoon-hyun opened a new pull request #26008: [MINOR][TESTS] Rename JsonBenchmark.scala to JSONBenchmark.scala to match class name

2019-10-02 Thread GitBox
dongjoon-hyun opened a new pull request #26008: [MINOR][TESTS] Rename JsonBenchmark.scala to JSONBenchmark.scala to match class name URL: https://github.com/apache/spark/pull/26008 ### What changes were proposed in this pull request? This PR renames `JsonBenchmark.scala` to

[GitHub] [spark] HyukjinKwon commented on issue #25993: [SPARK-29339][R] Support Arrow 0.14 in vectoried dapply and gapply (test it in AppVeyor build)

2019-10-02 Thread GitBox
HyukjinKwon commented on issue #25993: [SPARK-29339][R] Support Arrow 0.14 in vectoried dapply and gapply (test it in AppVeyor build) URL: https://github.com/apache/spark/pull/25993#issuecomment-537764993 cc @felixcheung and @viirya

[GitHub] [spark] AmplabJenkins removed a comment on issue #25993: [SPARK-29339][R] Support Arrow 0.14 in vectoried dapply and gapply (test it in AppVeyor build)

2019-10-02 Thread GitBox
AmplabJenkins removed a comment on issue #25993: [SPARK-29339][R] Support Arrow 0.14 in vectoried dapply and gapply (test it in AppVeyor build) URL: https://github.com/apache/spark/pull/25993#issuecomment-537764735 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25993: [SPARK-29339][R] Support Arrow 0.14 in vectoried dapply and gapply (test it in AppVeyor build)

2019-10-02 Thread GitBox
AmplabJenkins removed a comment on issue #25993: [SPARK-29339][R] Support Arrow 0.14 in vectoried dapply and gapply (test it in AppVeyor build) URL: https://github.com/apache/spark/pull/25993#issuecomment-537764739 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #25993: [SPARK-29339][R] Support Arrow 0.14 in vectoried dapply and gapply (test it in AppVeyor build)

2019-10-02 Thread GitBox
AmplabJenkins commented on issue #25993: [SPARK-29339][R] Support Arrow 0.14 in vectoried dapply and gapply (test it in AppVeyor build) URL: https://github.com/apache/spark/pull/25993#issuecomment-537764739 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #25993: [SPARK-29339][R] Support Arrow 0.14 in vectoried dapply and gapply (test it in AppVeyor build)

2019-10-02 Thread GitBox
AmplabJenkins commented on issue #25993: [SPARK-29339][R] Support Arrow 0.14 in vectoried dapply and gapply (test it in AppVeyor build) URL: https://github.com/apache/spark/pull/25993#issuecomment-537764735 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #25993: [SPARK-29339][R] Support Arrow 0.14 in vectoried dapply and gapply (test it in AppVeyor build)

2019-10-02 Thread GitBox
SparkQA commented on issue #25993: [SPARK-29339][R] Support Arrow 0.14 in vectoried dapply and gapply (test it in AppVeyor build) URL: https://github.com/apache/spark/pull/25993#issuecomment-537764496 **[Test build #111709 has

[GitHub] [spark] HeartSaVioR commented on a change in pull request #25670: [SPARK-28869][CORE] Roll over event log files

2019-10-02 Thread GitBox
HeartSaVioR commented on a change in pull request #25670: [SPARK-28869][CORE] Roll over event log files URL: https://github.com/apache/spark/pull/25670#discussion_r330847692 ## File path: core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala ## @@

[GitHub] [spark] HyukjinKwon commented on a change in pull request #25993: [DO-NOT-MERGE][R] Install Arrow and test Arrow optimization in AppVeyor build

2019-10-02 Thread GitBox
HyukjinKwon commented on a change in pull request #25993: [DO-NOT-MERGE][R] Install Arrow and test Arrow optimization in AppVeyor build URL: https://github.com/apache/spark/pull/25993#discussion_r330847032 ## File path: R/pkg/inst/worker/worker.R ## @@ -50,7 +50,7 @@

[GitHub] [spark] nvander1 commented on issue #26007: [SPARK-28962][SPARK-27297][SQL] Add overload for filter with index to functions object

2019-10-02 Thread GitBox
nvander1 commented on issue #26007: [SPARK-28962][SPARK-27297][SQL] Add overload for filter with index to functions object URL: https://github.com/apache/spark/pull/26007#issuecomment-537762211 Sure thing! This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #26006: [SPARK-29279][SQL] Merge SHOW NAMESPACES and SHOW DATABASES code path

2019-10-02 Thread GitBox
AmplabJenkins removed a comment on issue #26006: [SPARK-29279][SQL] Merge SHOW NAMESPACES and SHOW DATABASES code path URL: https://github.com/apache/spark/pull/26006#issuecomment-537759168 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26006: [SPARK-29279][SQL] Merge SHOW NAMESPACES and SHOW DATABASES code path

2019-10-02 Thread GitBox
AmplabJenkins commented on issue #26006: [SPARK-29279][SQL] Merge SHOW NAMESPACES and SHOW DATABASES code path URL: https://github.com/apache/spark/pull/26006#issuecomment-537759168 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26006: [SPARK-29279][SQL] Merge SHOW NAMESPACES and SHOW DATABASES code path

2019-10-02 Thread GitBox
AmplabJenkins commented on issue #26006: [SPARK-29279][SQL] Merge SHOW NAMESPACES and SHOW DATABASES code path URL: https://github.com/apache/spark/pull/26006#issuecomment-537759165 Merged build finished. Test FAILed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #26006: [SPARK-29279][SQL] Merge SHOW NAMESPACES and SHOW DATABASES code path

2019-10-02 Thread GitBox
AmplabJenkins removed a comment on issue #26006: [SPARK-29279][SQL] Merge SHOW NAMESPACES and SHOW DATABASES code path URL: https://github.com/apache/spark/pull/26006#issuecomment-537759165 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA removed a comment on issue #26006: [SPARK-29279][SQL] Merge SHOW NAMESPACES and SHOW DATABASES code path

2019-10-02 Thread GitBox
SparkQA removed a comment on issue #26006: [SPARK-29279][SQL] Merge SHOW NAMESPACES and SHOW DATABASES code path URL: https://github.com/apache/spark/pull/26006#issuecomment-537727823 **[Test build #111705 has

[GitHub] [spark] SparkQA commented on issue #26006: [SPARK-29279][SQL] Merge SHOW NAMESPACES and SHOW DATABASES code path

2019-10-02 Thread GitBox
SparkQA commented on issue #26006: [SPARK-29279][SQL] Merge SHOW NAMESPACES and SHOW DATABASES code path URL: https://github.com/apache/spark/pull/26006#issuecomment-537759048 **[Test build #111705 has

[GitHub] [spark] AmplabJenkins commented on issue #26001: [SPARK-29331][SQL] create DS v2 Write at physical plan

2019-10-02 Thread GitBox
AmplabJenkins commented on issue #26001: [SPARK-29331][SQL] create DS v2 Write at physical plan URL: https://github.com/apache/spark/pull/26001#issuecomment-537755617 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26001: [SPARK-29331][SQL] create DS v2 Write at physical plan

2019-10-02 Thread GitBox
AmplabJenkins removed a comment on issue #26001: [SPARK-29331][SQL] create DS v2 Write at physical plan URL: https://github.com/apache/spark/pull/26001#issuecomment-537755617 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26001: [SPARK-29331][SQL] create DS v2 Write at physical plan

2019-10-02 Thread GitBox
AmplabJenkins removed a comment on issue #26001: [SPARK-29331][SQL] create DS v2 Write at physical plan URL: https://github.com/apache/spark/pull/26001#issuecomment-537755615 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #26001: [SPARK-29331][SQL] create DS v2 Write at physical plan

2019-10-02 Thread GitBox
AmplabJenkins commented on issue #26001: [SPARK-29331][SQL] create DS v2 Write at physical plan URL: https://github.com/apache/spark/pull/26001#issuecomment-537755615 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] SparkQA commented on issue #26001: [SPARK-29331][SQL] create DS v2 Write at physical plan

2019-10-02 Thread GitBox
SparkQA commented on issue #26001: [SPARK-29331][SQL] create DS v2 Write at physical plan URL: https://github.com/apache/spark/pull/26001#issuecomment-537755364 **[Test build #111708 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/111708/testReport)** for

[GitHub] [spark] HyukjinKwon commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-10-02 Thread GitBox
HyukjinKwon commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-537754335 +1 ! This is an automated message from the Apache Git

[GitHub] [spark] maropu commented on issue #26004: [SPARK-29142][PYTHON][ML][FOLLOWUP][DOC] Replace incorrect :py:attr: applications

2019-10-02 Thread GitBox
maropu commented on issue #26004: [SPARK-29142][PYTHON][ML][FOLLOWUP][DOC] Replace incorrect :py:attr: applications URL: https://github.com/apache/spark/pull/26004#issuecomment-537748479 cc: @HyukjinKwon @ueshin This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #26005: [SPARK-29163] Simplify Hadoop Configuration access in DataSourcev2

2019-10-02 Thread GitBox
AmplabJenkins removed a comment on issue #26005: [SPARK-29163] Simplify Hadoop Configuration access in DataSourcev2 URL: https://github.com/apache/spark/pull/26005#issuecomment-537747396 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26005: [SPARK-29163] Simplify Hadoop Configuration access in DataSourcev2

2019-10-02 Thread GitBox
AmplabJenkins removed a comment on issue #26005: [SPARK-29163] Simplify Hadoop Configuration access in DataSourcev2 URL: https://github.com/apache/spark/pull/26005#issuecomment-537747405 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26005: [SPARK-29163] Simplify Hadoop Configuration access in DataSourcev2

2019-10-02 Thread GitBox
AmplabJenkins commented on issue #26005: [SPARK-29163] Simplify Hadoop Configuration access in DataSourcev2 URL: https://github.com/apache/spark/pull/26005#issuecomment-537747405 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26005: [SPARK-29163] Simplify Hadoop Configuration access in DataSourcev2

2019-10-02 Thread GitBox
AmplabJenkins commented on issue #26005: [SPARK-29163] Simplify Hadoop Configuration access in DataSourcev2 URL: https://github.com/apache/spark/pull/26005#issuecomment-537747396 Merged build finished. Test PASSed. This is

[GitHub] [spark] SparkQA removed a comment on issue #26005: [SPARK-29163] Simplify Hadoop Configuration access in DataSourcev2

2019-10-02 Thread GitBox
SparkQA removed a comment on issue #26005: [SPARK-29163] Simplify Hadoop Configuration access in DataSourcev2 URL: https://github.com/apache/spark/pull/26005#issuecomment-537697694 **[Test build #111704 has

[GitHub] [spark] SparkQA commented on issue #26005: [SPARK-29163] Simplify Hadoop Configuration access in DataSourcev2

2019-10-02 Thread GitBox
SparkQA commented on issue #26005: [SPARK-29163] Simplify Hadoop Configuration access in DataSourcev2 URL: https://github.com/apache/spark/pull/26005#issuecomment-537746974 **[Test build #111704 has

[GitHub] [spark] maropu commented on a change in pull request #25960: [SPARK-29283][SQL] Error message is hidden when query from JDBC, especially enabled adaptive execution

2019-10-02 Thread GitBox
maropu commented on a change in pull request #25960: [SPARK-29283][SQL] Error message is hidden when query from JDBC, especially enabled adaptive execution URL: https://github.com/apache/spark/pull/25960#discussion_r330831160 ## File path:

[GitHub] [spark] cloud-fan commented on issue #25988: [SPARK-29313][SQL] Fix failure on writing to `noop` in benchmarks

2019-10-02 Thread GitBox
cloud-fan commented on issue #25988: [SPARK-29313][SQL] Fix failure on writing to `noop` in benchmarks URL: https://github.com/apache/spark/pull/25988#issuecomment-537742759 we only disable file source v2, but noop souce is not file source.

[GitHub] [spark] YongjinZhou commented on issue #25976: [SPARK-25468][WEBUI] Current page index keep style with dataTable in the spark UI

2019-10-02 Thread GitBox
YongjinZhou commented on issue #25976: [SPARK-25468][WEBUI] Current page index keep style with dataTable in the spark UI URL: https://github.com/apache/spark/pull/25976#issuecomment-537742435 @srowen For match whth jquery.dataTables.1.10.18.min.css 。Selected page should be '.current',but

[GitHub] [spark] imback82 commented on a change in pull request #26006: [SPARK-29279][SQL] Merge SHOW NAMESPACES and SHOW DATABASES code path

2019-10-02 Thread GitBox
imback82 commented on a change in pull request #26006: [SPARK-29279][SQL] Merge SHOW NAMESPACES and SHOW DATABASES code path URL: https://github.com/apache/spark/pull/26006#discussion_r330829071 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #26007: Add overload for filter with index to functions object

2019-10-02 Thread GitBox
AmplabJenkins removed a comment on issue #26007: Add overload for filter with index to functions object URL: https://github.com/apache/spark/pull/26007#issuecomment-537741381 Merged build finished. Test PASSed. This is an

  1   2   3   4   5   6   7   >