cloud-fan commented on a change in pull request #28076:
[SPARK-31311][SQL][TESTS] Benchmark date-time rebasing in ORC datasource
URL: https://github.com/apache/spark/pull/28076#discussion_r401393426
##
File path: sql/core/benchmarks/DateTimeRebaseBenchmark-jdk11-results.txt
###
AmplabJenkins removed a comment on issue #28088: [SPARK-31320] Fix release
script for 3.0.0
URL: https://github.com/apache/spark/pull/28088#issuecomment-607070057
Merged build finished. Test PASSed.
This is an automated messa
AmplabJenkins removed a comment on issue #28088: [SPARK-31320] Fix release
script for 3.0.0
URL: https://github.com/apache/spark/pull/28088#issuecomment-607070069
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jen
AmplabJenkins commented on issue #28088: [SPARK-31320] Fix release script for
3.0.0
URL: https://github.com/apache/spark/pull/28088#issuecomment-607070069
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//jo
cloud-fan commented on a change in pull request #28076:
[SPARK-31311][SQL][TESTS] Benchmark date-time rebasing in ORC datasource
URL: https://github.com/apache/spark/pull/28076#discussion_r401393426
##
File path: sql/core/benchmarks/DateTimeRebaseBenchmark-jdk11-results.txt
###
AmplabJenkins commented on issue #28088: [SPARK-31320] Fix release script for
3.0.0
URL: https://github.com/apache/spark/pull/28088#issuecomment-607070057
Merged build finished. Test PASSed.
This is an automated message from
SparkQA commented on issue #28088: [SPARK-31320] Fix release script for 3.0.0
URL: https://github.com/apache/spark/pull/28088#issuecomment-607068987
**[Test build #120663 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120663/testReport)**
for PR 28088 at c
SparkQA removed a comment on issue #28088: [SPARK-31320] Fix release script for
3.0.0
URL: https://github.com/apache/spark/pull/28088#issuecomment-607017081
**[Test build #120663 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120663/testReport)**
for PR 28
Ngone51 commented on issue #28053: [SPARK-29153][CORE]Add ability to merge
resource profiles within a stage with Stage Level Scheduling
URL: https://github.com/apache/spark/pull/28053#issuecomment-607061160
LGTM, except one minor comment.
---
Ngone51 commented on a change in pull request #28053: [SPARK-29153][CORE]Add
ability to merge resource profiles within a stage with Stage Level Scheduling
URL: https://github.com/apache/spark/pull/28053#discussion_r401379471
##
File path: core/src/main/scala/org/apache/spark/schedul
Ngone51 commented on a change in pull request #28053: [SPARK-29153][CORE]Add
ability to merge resource profiles within a stage with Stage Level Scheduling
URL: https://github.com/apache/spark/pull/28053#discussion_r401376968
##
File path: core/src/main/scala/org/apache/spark/interna
AmplabJenkins removed a comment on issue #28078: [SPARK-31309][ML] Migrate the
ChiSquareTest from MLlib to ML
URL: https://github.com/apache/spark/pull/28078#issuecomment-607053876
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.
AmplabJenkins removed a comment on issue #28078: [SPARK-31309][ML] Migrate the
ChiSquareTest from MLlib to ML
URL: https://github.com/apache/spark/pull/28078#issuecomment-607053871
Merged build finished. Test PASSed.
This is
AmplabJenkins commented on issue #28078: [SPARK-31309][ML] Migrate the
ChiSquareTest from MLlib to ML
URL: https://github.com/apache/spark/pull/28078#issuecomment-607053871
Merged build finished. Test PASSed.
This is an autom
AmplabJenkins commented on issue #28078: [SPARK-31309][ML] Migrate the
ChiSquareTest from MLlib to ML
URL: https://github.com/apache/spark/pull/28078#issuecomment-607053876
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berke
SparkQA commented on issue #28078: [SPARK-31309][ML] Migrate the ChiSquareTest
from MLlib to ML
URL: https://github.com/apache/spark/pull/28078#issuecomment-607053466
**[Test build #120666 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120666/testReport)**
zhengruifeng opened a new pull request #28078: [SPARK-31309][ML] Migrate the
ChiSquareTest from MLlib to ML
URL: https://github.com/apache/spark/pull/28078
### What changes were proposed in this pull request?
1, Move the impl of ChiSq from .mllib to the .ml side;
2, in `.mllib.ChiSqTe
zhengruifeng commented on issue #28078: [SPARK-31309][ML] Migrate the
ChiSquareTest from MLlib to ML
URL: https://github.com/apache/spark/pull/28078#issuecomment-607051386
OK, I did not get the point.
I think it worthwhile to move some impls to the .ml side, since in .ml we
can use
huaxingao commented on a change in pull request #28087:
[SPARK-31319][SQL][DOCS] Document UDFs/UDAFs in SQL Reference
URL: https://github.com/apache/spark/pull/28087#discussion_r401372386
##
File path: docs/sql-ref-functions-udf-scalar.md
##
@@ -1,22 +1,125 @@
---
layout
AmplabJenkins removed a comment on issue #28076: [SPARK-31311][SQL][TESTS]
Benchmark date-time rebasing in ORC datasource
URL: https://github.com/apache/spark/pull/28076#issuecomment-607049060
Merged build finished. Test PASSed.
-
Ngone51 commented on a change in pull request #28053: [SPARK-29153][CORE]Add
ability to merge resource profiles within a stage with Stage Level Scheduling
URL: https://github.com/apache/spark/pull/28053#discussion_r401370604
##
File path: core/src/main/scala/org/apache/spark/schedul
AmplabJenkins removed a comment on issue #28076: [SPARK-31311][SQL][TESTS]
Benchmark date-time rebasing in ORC datasource
URL: https://github.com/apache/spark/pull/28076#issuecomment-607049069
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
htt
AmplabJenkins commented on issue #28076: [SPARK-31311][SQL][TESTS] Benchmark
date-time rebasing in ORC datasource
URL: https://github.com/apache/spark/pull/28076#issuecomment-607049069
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amp
AmplabJenkins commented on issue #28076: [SPARK-31311][SQL][TESTS] Benchmark
date-time rebasing in ORC datasource
URL: https://github.com/apache/spark/pull/28076#issuecomment-607049060
Merged build finished. Test PASSed.
This
AmplabJenkins removed a comment on issue #28087: [SPARK-31319][SQL][DOCS]
Document UDFs/UDAFs in SQL Reference
URL: https://github.com/apache/spark/pull/28087#issuecomment-607048551
Merged build finished. Test PASSed.
This is
AmplabJenkins removed a comment on issue #28087: [SPARK-31319][SQL][DOCS]
Document UDFs/UDAFs in SQL Reference
URL: https://github.com/apache/spark/pull/28087#issuecomment-607048556
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.
SparkQA commented on issue #28076: [SPARK-31311][SQL][TESTS] Benchmark
date-time rebasing in ORC datasource
URL: https://github.com/apache/spark/pull/28076#issuecomment-607048593
**[Test build #120665 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120665/te
AmplabJenkins commented on issue #28087: [SPARK-31319][SQL][DOCS] Document
UDFs/UDAFs in SQL Reference
URL: https://github.com/apache/spark/pull/28087#issuecomment-607048556
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berke
SparkQA removed a comment on issue #28087: [SPARK-31319][SQL][DOCS] Document
UDFs/UDAFs in SQL Reference
URL: https://github.com/apache/spark/pull/28087#issuecomment-607043432
**[Test build #120664 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120664/testR
SparkQA commented on issue #28087: [SPARK-31319][SQL][DOCS] Document UDFs/UDAFs
in SQL Reference
URL: https://github.com/apache/spark/pull/28087#issuecomment-607048390
**[Test build #120664 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120664/testReport)*
AmplabJenkins commented on issue #28087: [SPARK-31319][SQL][DOCS] Document
UDFs/UDAFs in SQL Reference
URL: https://github.com/apache/spark/pull/28087#issuecomment-607048551
Merged build finished. Test PASSed.
This is an auto
AmplabJenkins removed a comment on issue #27943: [SPARK-31179] Fast fail the
connection while last connection failed in fast fail time window
URL: https://github.com/apache/spark/pull/27943#issuecomment-607047767
Merged build finished. Test PASSed.
-
Ngone51 commented on issue #28049: [SPARK-31285][CORE] uppercase schedule mode
string at config
URL: https://github.com/apache/spark/pull/28049#issuecomment-607048295
LGTM, cc @dongjoon-hyun
This is an automated message from
AmplabJenkins removed a comment on issue #27943: [SPARK-31179] Fast fail the
connection while last connection failed in fast fail time window
URL: https://github.com/apache/spark/pull/27943#issuecomment-607047773
Test PASSed.
Refer to this link for build results (access rights to CI serv
AmplabJenkins commented on issue #27943: [SPARK-31179] Fast fail the connection
while last connection failed in fast fail time window
URL: https://github.com/apache/spark/pull/27943#issuecomment-607047767
Merged build finished. Test PASSed.
-
AmplabJenkins commented on issue #27943: [SPARK-31179] Fast fail the connection
while last connection failed in fast fail time window
URL: https://github.com/apache/spark/pull/27943#issuecomment-607047773
Test PASSed.
Refer to this link for build results (access rights to CI server neede
maropu commented on a change in pull request #28087: [SPARK-31319][SQL][DOCS]
Document UDFs/UDAFs in SQL Reference
URL: https://github.com/apache/spark/pull/28087#discussion_r401369262
##
File path: docs/sql-ref-functions-udf-scalar.md
##
@@ -1,22 +1,125 @@
---
layout: g
SparkQA commented on issue #27943: [SPARK-31179] Fast fail the connection while
last connection failed in fast fail time window
URL: https://github.com/apache/spark/pull/27943#issuecomment-607046965
**[Test build #120661 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullReq
SparkQA removed a comment on issue #27943: [SPARK-31179] Fast fail the
connection while last connection failed in fast fail time window
URL: https://github.com/apache/spark/pull/27943#issuecomment-606998340
**[Test build #120661 has
started](https://amplab.cs.berkeley.edu/jenkins/job/Spark
wang-zhun commented on issue #28069: [SPARK-31265][YARN] Add
-XX:MaxDirectMemorySize jvm options in yarn mode
URL: https://github.com/apache/spark/pull/28069#issuecomment-607045826
@dongjoon-hyun thanks for the reply.
I think the `amMemoryOverhead` represents the usable off-heap memory.
AmplabJenkins commented on issue #28087: [SPARK-31319][SQL][DOCS] Document
UDFs/UDAFs in SQL Reference
URL: https://github.com/apache/spark/pull/28087#issuecomment-607043968
Merged build finished. Test PASSed.
This is an auto
AmplabJenkins commented on issue #28087: [SPARK-31319][SQL][DOCS] Document
UDFs/UDAFs in SQL Reference
URL: https://github.com/apache/spark/pull/28087#issuecomment-607043976
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berk
cloud-fan commented on a change in pull request #28088: [SPARK-31320] Fix
release script for 3.0.0
URL: https://github.com/apache/spark/pull/28088#discussion_r401366461
##
File path: dev/create-release/spark-rm/Dockerfile
##
@@ -76,10 +75,8 @@ RUN apt-get clean && apt-get
AmplabJenkins removed a comment on issue #28087: [SPARK-31319][SQL][DOCS]
Document UDFs/UDAFs in SQL Reference
URL: https://github.com/apache/spark/pull/28087#issuecomment-607043968
Merged build finished. Test PASSed.
This is
AmplabJenkins removed a comment on issue #28087: [SPARK-31319][SQL][DOCS]
Document UDFs/UDAFs in SQL Reference
URL: https://github.com/apache/spark/pull/28087#issuecomment-607043976
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab
cloud-fan commented on issue #28076: [SPARK-31311][SQL][TESTS] Benchmark
date-time rebasing in ORC datasource
URL: https://github.com/apache/spark/pull/28076#issuecomment-607043797
can you fix the conflicts?
This is an automa
SparkQA commented on issue #28087: [SPARK-31319][SQL][DOCS] Document UDFs/UDAFs
in SQL Reference
URL: https://github.com/apache/spark/pull/28087#issuecomment-607043432
**[Test build #120664 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120664/testReport)**
huaxingao commented on issue #28087: [SPARK-31319][SQL][DOCS] Document
UDFs/UDAFs in SQL Reference
URL: https://github.com/apache/spark/pull/28087#issuecomment-607041687
> Do we have a page for introducing the APIs for Scala, Java, Python
UDFs/UDAFs/UDTF? If not, could we introduce it?
dongjoon-hyun commented on issue #28088: [SPARK-31320] Fix release script for
3.0.0
URL: https://github.com/apache/spark/pull/28088#issuecomment-607041154
cc @rxin and @gatorsmile
This is an automated message from the Apache
huaxingao commented on a change in pull request #28087:
[SPARK-31319][SQL][DOCS] Document UDFs/UDAFs in SQL Reference
URL: https://github.com/apache/spark/pull/28087#discussion_r401363958
##
File path: docs/sql-ref-functions-udf.md
##
@@ -1,25 +1,25 @@
---
layout: global
huaxingao commented on a change in pull request #28087:
[SPARK-31319][SQL][DOCS] Document UDFs/UDAFs in SQL Reference
URL: https://github.com/apache/spark/pull/28087#discussion_r401363852
##
File path: docs/sql-ref-functions-udf-scalar.md
##
@@ -1,22 +1,125 @@
---
layout
dongjoon-hyun commented on a change in pull request #28088: [SPARK-31320] Fix
release script for 3.0.0
URL: https://github.com/apache/spark/pull/28088#discussion_r401363806
##
File path: dev/create-release/spark-rm/Dockerfile
##
@@ -76,10 +75,8 @@ RUN apt-get clean && apt-
huaxingao commented on a change in pull request #28087:
[SPARK-31319][SQL][DOCS] Document UDFs/UDAFs in SQL Reference
URL: https://github.com/apache/spark/pull/28087#discussion_r401363788
##
File path: docs/sql-ref-functions-udf-aggregate.md
##
@@ -1,22 +1,65 @@
---
layo
srowen commented on issue #28078: [SPARK-31309][ML] Migrate the ChiSquareTest
from MLlib to ML
URL: https://github.com/apache/spark/pull/28078#issuecomment-607039548
I don't think that means we can't refactor and improve the relationship
between .ml and .mllib; I'm just saying I don't thin
AmplabJenkins commented on issue #27897: [SPARK-31113][SQL] Add SHOW VIEWS
command
URL: https://github.com/apache/spark/pull/27897#issuecomment-607037366
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job
AmplabJenkins commented on issue #27897: [SPARK-31113][SQL] Add SHOW VIEWS
command
URL: https://github.com/apache/spark/pull/27897#issuecomment-607037361
Merged build finished. Test PASSed.
This is an automated message from t
AmplabJenkins removed a comment on issue #27897: [SPARK-31113][SQL] Add SHOW
VIEWS command
URL: https://github.com/apache/spark/pull/27897#issuecomment-607037366
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenk
AmplabJenkins removed a comment on issue #27897: [SPARK-31113][SQL] Add SHOW
VIEWS command
URL: https://github.com/apache/spark/pull/27897#issuecomment-607037361
Merged build finished. Test PASSed.
This is an automated messag
SparkQA removed a comment on issue #27897: [SPARK-31113][SQL] Add SHOW VIEWS
command
URL: https://github.com/apache/spark/pull/27897#issuecomment-606960582
**[Test build #120657 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120657/testReport)**
for PR 278
SparkQA commented on issue #27897: [SPARK-31113][SQL] Add SHOW VIEWS command
URL: https://github.com/apache/spark/pull/27897#issuecomment-607036772
**[Test build #120657 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120657/testReport)**
for PR 27897 at co
dongjoon-hyun commented on issue #28069: [SPARK-31265][YARN] Add
-XX:MaxDirectMemorySize jvm options in yarn mode
URL: https://github.com/apache/spark/pull/28069#issuecomment-607036183
Netty library itself also use some off-heap memory.
-
dongjoon-hyun commented on issue #28080: [SPARK-31313][K8S][TEST] Add `m01`
node name to support Minikube 1.8.x
URL: https://github.com/apache/spark/pull/28080#issuecomment-607034445
Thank you, @dbtsai !
This is an automated
HeartSaVioR commented on issue #28026: [SPARK-31257][SQL] Unify create table
syntax (WIP)
URL: https://github.com/apache/spark/pull/28026#issuecomment-607032955
Maybe we also need to change two "create table" pages and migration guide
page as well regardless of the approach, since we are
cloud-fan closed pull request #28082: [SPARK-31318][SQL] Split Parquet/Avro
configs for rebasing dates/timestamps in read and in write
URL: https://github.com/apache/spark/pull/28082
This is an automated message from the Apa
cloud-fan commented on issue #28082: [SPARK-31318][SQL] Split Parquet/Avro
configs for rebasing dates/timestamps in read and in write
URL: https://github.com/apache/spark/pull/28082#issuecomment-607032296
thanks, merging to master/3.0!
--
yaooqinn commented on issue #28003: [SPARK-31234][SQL] ResetCommand should
reset config to sc.conf only
URL: https://github.com/apache/spark/pull/28003#issuecomment-607031617
> @yaooqinn Could you backport this to 2.4? and add it to the migration
guide since it could impact the query resul
AmplabJenkins removed a comment on issue #28085: [SPARK-29641][PYTHON][CORE]
Stage Level Sched: Add python api's and tests
URL: https://github.com/apache/spark/pull/28085#issuecomment-607029132
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
htt
AmplabJenkins removed a comment on issue #28085: [SPARK-29641][PYTHON][CORE]
Stage Level Sched: Add python api's and tests
URL: https://github.com/apache/spark/pull/28085#issuecomment-607029129
Merged build finished. Test FAILed.
AmplabJenkins commented on issue #28085: [SPARK-29641][PYTHON][CORE] Stage
Level Sched: Add python api's and tests
URL: https://github.com/apache/spark/pull/28085#issuecomment-607029132
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amp
AmplabJenkins commented on issue #28085: [SPARK-29641][PYTHON][CORE] Stage
Level Sched: Add python api's and tests
URL: https://github.com/apache/spark/pull/28085#issuecomment-607029129
Merged build finished. Test FAILed.
Thi
cloud-fan commented on issue #28041: [SPARK-30564][SQL] Improved extra new line
and comment remove
URL: https://github.com/apache/spark/pull/28041#issuecomment-607029102
Agree with @maropu . We can slowly update all comments with
`CodegenContext.registerComment`
--
SparkQA removed a comment on issue #28085: [SPARK-29641][PYTHON][CORE] Stage
Level Sched: Add python api's and tests
URL: https://github.com/apache/spark/pull/28085#issuecomment-606901165
**[Test build #120653 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/
SparkQA commented on issue #28085: [SPARK-29641][PYTHON][CORE] Stage Level
Sched: Add python api's and tests
URL: https://github.com/apache/spark/pull/28085#issuecomment-607028697
**[Test build #120653 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120653/
dbtsai commented on issue #27728:
[SPARK-25556][SPARK-17636][SPARK-31026][SPARK-31060][SQL][test-hive1.2] Nested
Column Predicate Pushdown for Parquet
URL: https://github.com/apache/spark/pull/27728#issuecomment-607021780
For the worst case, we don't see extra overhead from parquet side. I
HyukjinKwon commented on a change in pull request #27928: [SPARK-31167][BUILD]
Refactor how we track Python test/build dependencies
URL: https://github.com/apache/spark/pull/27928#discussion_r401347559
##
File path: docs/README.md
##
@@ -88,7 +88,7 @@ Note: Other versions
HyukjinKwon edited a comment on issue #27534: [SPARK-30879][DOCS] Refine
workflow for building docs
URL: https://github.com/apache/spark/pull/27534#issuecomment-607021040
We can pin the version for release related ones; however, I doubt if we
should do that for others e.g., CI, documentati
HyukjinKwon commented on issue #27534: [SPARK-30879][DOCS] Refine workflow for
building docs
URL: https://github.com/apache/spark/pull/27534#issuecomment-607021040
We can pin the version for release related ones; however, I doubt if we
should do that for others e.g., CI, documentation. It'
HyukjinKwon edited a comment on issue #27728:
[SPARK-25556][SPARK-17636][SPARK-31026][SPARK-31060][SQL][test-hive1.2] Nested
Column Predicate Pushdown for Parquet
URL: https://github.com/apache/spark/pull/27728#issuecomment-607020100
It's true that it can depends on the nature of data or w
HyukjinKwon commented on issue #27728:
[SPARK-25556][SPARK-17636][SPARK-31026][SPARK-31060][SQL][test-hive1.2] Nested
Column Predicate Pushdown for Parquet
URL: https://github.com/apache/spark/pull/27728#issuecomment-607020100
It's true that it can depends on the nature of data or workload
gatorsmile commented on issue #27728:
[SPARK-25556][SPARK-17636][SPARK-31026][SPARK-31060][SQL][test-hive1.2] Nested
Column Predicate Pushdown for Parquet
URL: https://github.com/apache/spark/pull/27728#issuecomment-607018589
Do you know the perf number for the worst case (e.g., no row can
AmplabJenkins removed a comment on issue #28088: [SPARK-31320] fix release
script for 3.0.0
URL: https://github.com/apache/spark/pull/28088#issuecomment-607017528
Merged build finished. Test PASSed.
This is an automated messa
AmplabJenkins removed a comment on issue #28088: [SPARK-31320] fix release
script for 3.0.0
URL: https://github.com/apache/spark/pull/28088#issuecomment-607017538
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/je
AmplabJenkins commented on issue #28088: [SPARK-31320] fix release script for
3.0.0
URL: https://github.com/apache/spark/pull/28088#issuecomment-607017528
Merged build finished. Test PASSed.
This is an automated message from
AmplabJenkins commented on issue #28088: [SPARK-31320] fix release script for
3.0.0
URL: https://github.com/apache/spark/pull/28088#issuecomment-607017538
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//j
SparkQA commented on issue #28088: [SPARK-31320] fix release script for 3.0.0
URL: https://github.com/apache/spark/pull/28088#issuecomment-607017081
**[Test build #120663 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120663/testReport)**
for PR 28088 at co
cloud-fan commented on issue #28088: [SPARK-31320] fix release script for 3.0.0
URL: https://github.com/apache/spark/pull/28088#issuecomment-607016636
Note that we should forward port this to the master branch. It was done at
`branch-3.0` as the policy is to use the script of the correspond
cloud-fan commented on issue #28088: [SPARK-31320] fix release script for 3.0.0
URL: https://github.com/apache/spark/pull/28088#issuecomment-607016103
cc @dongjoon-hyun @HyukjinKwon @nchammas
This is an automated message from
cloud-fan commented on a change in pull request #28088: [SPARK-31320] fix
release script for 3.0.0
URL: https://github.com/apache/spark/pull/28088#discussion_r401342910
##
File path: dev/create-release/spark-rm/Dockerfile
##
@@ -33,8 +33,8 @@ ENV DEBCONF_NONINTERACTIVE_SEE
cloud-fan commented on a change in pull request #28088: [SPARK-31320] fix
release script for 3.0.0
URL: https://github.com/apache/spark/pull/28088#discussion_r401342694
##
File path: dev/create-release/release-util.sh
##
@@ -159,10 +159,14 @@ function get_release_info {
cloud-fan commented on a change in pull request #28088: [SPARK-31320] fix
release script for 3.0.0
URL: https://github.com/apache/spark/pull/28088#discussion_r401342577
##
File path: dev/create-release/do-release-docker.sh
##
@@ -93,7 +93,7 @@ done
GPG_KEY_FILE="$WORKDI
cloud-fan opened a new pull request #28088: [SPARK-31320] fix release script
for 3.0.0
URL: https://github.com/apache/spark/pull/28088
### What changes were proposed in this pull request?
The release script stops working after
https://github.com/apache/spark/commit/d5865493a
HeartSaVioR commented on issue #28086: [SPARK-31312][SQL][2.4] Cache Class
instance for the UDF instance in HiveFunctionWrapper
URL: https://github.com/apache/spark/pull/28086#issuecomment-607013918
Thanks for the quick review and merge!
dbtsai commented on issue #27728:
[SPARK-25556][SPARK-17636][SPARK-31026][SPARK-31060][SQL][test-hive1.2] Nested
Column Predicate Pushdown for Parquet
URL: https://github.com/apache/spark/pull/27728#issuecomment-60700
It really depends on the data and if we can skip most of the row gro
dbtsai edited a comment on issue #27728:
[SPARK-25556][SPARK-17636][SPARK-31026][SPARK-31060][SQL][test-hive1.2] Nested
Column Predicate Pushdown for Parquet
URL: https://github.com/apache/spark/pull/27728#issuecomment-60700
It really depends on the data and if we can skip most of the
cloud-fan commented on issue #27534: [SPARK-30879][DOCS] Refine workflow for
building docs
URL: https://github.com/apache/spark/pull/27534#issuecomment-607011028
This PR does have a good point to fix the dependency versions so that the
script is more robust. I'm happy to see a working vers
dbtsai commented on issue #28080: [SPARK-31313][K8S][TEST] Add `m01` node name
to support Minikube 1.8.x
URL: https://github.com/apache/spark/pull/28080#issuecomment-607009930
LGTM. Merged into master.
This is an automated me
dbtsai closed pull request #28080: [SPARK-31313][K8S][TEST] Add `m01` node name
to support Minikube 1.8.x
URL: https://github.com/apache/spark/pull/28080
This is an automated message from the Apache Git Service.
To respond t
cloud-fan closed pull request #28086: [SPARK-31312][SQL][2.4] Cache Class
instance for the UDF instance in HiveFunctionWrapper
URL: https://github.com/apache/spark/pull/28086
This is an automated message from the Apache Git
cloud-fan commented on issue #28086: [SPARK-31312][SQL][2.4] Cache Class
instance for the UDF instance in HiveFunctionWrapper
URL: https://github.com/apache/spark/pull/28086#issuecomment-607009137
thanks, merging to 2.4!
This
cloud-fan commented on a change in pull request #27897: [SPARK-31113][SQL] Add
SHOW VIEWS command
URL: https://github.com/apache/spark/pull/27897#discussion_r401337418
##
File path:
sql/core/src/test/scala/org/apache/spark/sql/connector/DataSourceV2SQLSuite.scala
##
@@ -9
1 - 100 of 633 matches
Mail list logo