HyukjinKwon commented on a change in pull request #32725:
URL: https://github.com/apache/spark/pull/32725#discussion_r642801775
##
File path:
sql/core/src/test/scala/org/apache/spark/sql/execution/adaptive/AdaptiveQueryExecSuite.scala
##
@@ -1605,7 +1605,7 @@ class
dongjoon-hyun opened a new pull request #32727:
URL: https://github.com/apache/spark/pull/32727
…
### What changes were proposed in this pull request?
### Why are the changes needed?
### Does this PR introduce _any_ user-facing change?
SparkQA commented on pull request #32723:
URL: https://github.com/apache/spark/pull/32723#issuecomment-851839313
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43654/
--
This is an automated message from the Apache
SparkQA commented on pull request #32725:
URL: https://github.com/apache/spark/pull/32725#issuecomment-851839028
**[Test build #139137 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139137/testReport)**
for PR 32725 at commit
SparkQA commented on pull request #32726:
URL: https://github.com/apache/spark/pull/32726#issuecomment-851838979
**[Test build #139136 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139136/testReport)**
for PR 32726 at commit
SparkQA commented on pull request #32724:
URL: https://github.com/apache/spark/pull/32724#issuecomment-851839022
**[Test build #139138 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139138/testReport)**
for PR 32724 at commit
HyukjinKwon commented on pull request #32726:
URL: https://github.com/apache/spark/pull/32726#issuecomment-851837787
cc @ueshin @xinrong-databricks @itholic FYI
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL
HyukjinKwon opened a new pull request #32726:
URL: https://github.com/apache/spark/pull/32726
### What changes were proposed in this pull request?
This PR proposes to port Koalas documentation to PySpark documentation as
its initial step.
It ports almost as is except that the
AmplabJenkins removed a comment on pull request #32721:
URL: https://github.com/apache/spark/pull/32721#issuecomment-851836879
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43653/
AmplabJenkins removed a comment on pull request #32719:
URL: https://github.com/apache/spark/pull/32719#issuecomment-851836878
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139129/
AmplabJenkins commented on pull request #32719:
URL: https://github.com/apache/spark/pull/32719#issuecomment-851836878
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139129/
--
This
AmplabJenkins commented on pull request #32721:
URL: https://github.com/apache/spark/pull/32721#issuecomment-851836879
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43653/
--
gengliangwang opened a new pull request #32725:
URL: https://github.com/apache/spark/pull/32725
### What changes were proposed in this pull request?
Fix a flaky test case in AdaptiveQueryExecSuite
### Why are the changes needed?
The test case becomes flaky since
MaxGekk commented on pull request #32506:
URL: https://github.com/apache/spark/pull/32506#issuecomment-851835967
cc @HyukjinKwon
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific
ulysses-you commented on pull request #32724:
URL: https://github.com/apache/spark/pull/32724#issuecomment-851834150
cc @maropu @cloud-fan @yaooqinn
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to
ulysses-you commented on a change in pull request #32724:
URL: https://github.com/apache/spark/pull/32724#discussion_r642797088
##
File path:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala
##
@@ -1711,7 +1711,7 @@ object DecimalAggregates
SparkQA commented on pull request #32722:
URL: https://github.com/apache/spark/pull/32722#issuecomment-851832519
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43652/
--
This is an automated message from the Apache
yaooqinn commented on a change in pull request #32718:
URL: https://github.com/apache/spark/pull/32718#discussion_r642796052
##
File path: sql/core/src/test/scala/org/apache/spark/sql/MiscFunctionsSuite.scala
##
@@ -40,6 +40,12 @@ class MiscFunctionsSuite extends QueryTest
SparkQA commented on pull request #32721:
URL: https://github.com/apache/spark/pull/32721#issuecomment-851830047
Kubernetes integration test unable to build dist.
exiting with code: 1
URL:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43653/
--
MaxGekk commented on a change in pull request #32714:
URL: https://github.com/apache/spark/pull/32714#discussion_r642795083
##
File path: docs/sql-migration-guide.md
##
@@ -91,6 +91,8 @@ license: |
- In Spark 3.2, `CREATE TABLE AS SELECT` with non-empty `LOCATION` will
ulysses-you opened a new pull request #32724:
URL: https://github.com/apache/spark/pull/32724
### What changes were proposed in this pull request?
Add rule `ConvertToLocalRelation` into AQE Optimizer.
### Why are the changes needed?
Support propagate empty local
HeartSaVioR commented on a change in pull request #32653:
URL: https://github.com/apache/spark/pull/32653#discussion_r642792749
##
File path:
sql/catalyst/src/main/java/org/apache/spark/sql/connector/read/streaming/CompositeReadLimit.java
##
@@ -0,0 +1,61 @@
+/*
+ * Licensed
SparkQA removed a comment on pull request #32719:
URL: https://github.com/apache/spark/pull/32719#issuecomment-851769807
**[Test build #139129 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139129/testReport)**
for PR 32719 at commit
SparkQA commented on pull request #32719:
URL: https://github.com/apache/spark/pull/32719#issuecomment-851821942
**[Test build #139129 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139129/testReport)**
for PR 32719 at commit
HyukjinKwon commented on a change in pull request #32723:
URL: https://github.com/apache/spark/pull/32723#discussion_r642788618
##
File path: python/pyspark/sql/readwriter.py
##
@@ -627,8 +627,6 @@ def jdbc(self, url, table, column=None, lowerBound=None,
upperBound=None,
SparkQA commented on pull request #32721:
URL: https://github.com/apache/spark/pull/32721#issuecomment-851806715
**[Test build #139135 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139135/testReport)**
for PR 32721 at commit
SparkQA removed a comment on pull request #32721:
URL: https://github.com/apache/spark/pull/32721#issuecomment-851803742
**[Test build #139133 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139133/testReport)**
for PR 32721 at commit
AmplabJenkins removed a comment on pull request #32721:
URL: https://github.com/apache/spark/pull/32721#issuecomment-851806052
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139133/
AmplabJenkins commented on pull request #32721:
URL: https://github.com/apache/spark/pull/32721#issuecomment-851806052
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139133/
--
This
SparkQA commented on pull request #32721:
URL: https://github.com/apache/spark/pull/32721#issuecomment-851806030
**[Test build #139133 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139133/testReport)**
for PR 32721 at commit
SparkQA commented on pull request #32723:
URL: https://github.com/apache/spark/pull/32723#issuecomment-851805108
**[Test build #139134 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139134/testReport)**
for PR 32723 at commit
itholic opened a new pull request #32723:
URL: https://github.com/apache/spark/pull/32723
### What changes were proposed in this pull request?
This PR proposes move missing JDBC data source options from Python, Scala
and Java into a single page.
### Why are the changes
SparkQA commented on pull request #32721:
URL: https://github.com/apache/spark/pull/32721#issuecomment-851803742
**[Test build #139133 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139133/testReport)**
for PR 32721 at commit
SparkQA commented on pull request #32722:
URL: https://github.com/apache/spark/pull/32722#issuecomment-851803720
**[Test build #139132 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139132/testReport)**
for PR 32722 at commit
AmplabJenkins removed a comment on pull request #32718:
URL: https://github.com/apache/spark/pull/32718#issuecomment-851802395
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43647/
AmplabJenkins removed a comment on pull request #32686:
URL: https://github.com/apache/spark/pull/32686#issuecomment-851802400
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139125/
AmplabJenkins removed a comment on pull request #32720:
URL: https://github.com/apache/spark/pull/32720#issuecomment-851802399
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43651/
AmplabJenkins removed a comment on pull request #32693:
URL: https://github.com/apache/spark/pull/32693#issuecomment-851802397
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43650/
AmplabJenkins removed a comment on pull request #32506:
URL: https://github.com/apache/spark/pull/32506#issuecomment-851802398
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43648/
AmplabJenkins commented on pull request #32686:
URL: https://github.com/apache/spark/pull/32686#issuecomment-851802400
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139125/
--
This
AmplabJenkins commented on pull request #32720:
URL: https://github.com/apache/spark/pull/32720#issuecomment-851802399
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43651/
--
AmplabJenkins commented on pull request #32718:
URL: https://github.com/apache/spark/pull/32718#issuecomment-851802395
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43647/
--
AmplabJenkins commented on pull request #32693:
URL: https://github.com/apache/spark/pull/32693#issuecomment-851802397
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43650/
--
AmplabJenkins commented on pull request #32506:
URL: https://github.com/apache/spark/pull/32506#issuecomment-851802398
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43648/
--
viirya commented on pull request #32702:
URL: https://github.com/apache/spark/pull/32702#issuecomment-851802006
Okay, sounds good. Let me change to using a source option.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and
SparkQA commented on pull request #32720:
URL: https://github.com/apache/spark/pull/32720#issuecomment-851801961
Kubernetes integration test unable to build dist.
exiting with code: 1
URL:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43651/
--
sarutak opened a new pull request #32722:
URL: https://github.com/apache/spark/pull/32722
### What changes were proposed in this pull request?
This PR set a default value for `spark.kubernetes.test.sparkTgz` in
`kubernetes/integration-tests/pom.xml` for Kubernetes integration tests.
SparkQA commented on pull request #32693:
URL: https://github.com/apache/spark/pull/32693#issuecomment-851797476
Kubernetes integration test unable to build dist.
exiting with code: 1
URL:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43650/
--
sigmod opened a new pull request #32721:
URL: https://github.com/apache/spark/pull/32721
### What changes were proposed in this pull request?
### Why are the changes needed?
### Does this PR introduce _any_ user-facing change?
### How was
SparkQA commented on pull request #32506:
URL: https://github.com/apache/spark/pull/32506#issuecomment-851795183
Kubernetes integration test status success
URL:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43648/
--
This is an automated message from the
SparkQA removed a comment on pull request #32686:
URL: https://github.com/apache/spark/pull/32686#issuecomment-851734216
**[Test build #139125 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139125/testReport)**
for PR 32686 at commit
SparkQA commented on pull request #32686:
URL: https://github.com/apache/spark/pull/32686#issuecomment-851794843
**[Test build #139125 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139125/testReport)**
for PR 32686 at commit
SparkQA commented on pull request #32718:
URL: https://github.com/apache/spark/pull/32718#issuecomment-851792608
Kubernetes integration test status success
URL:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43647/
--
This is an automated message from the
SparkQA commented on pull request #32720:
URL: https://github.com/apache/spark/pull/32720#issuecomment-851790068
**[Test build #139131 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139131/testReport)**
for PR 32720 at commit
gengliangwang commented on pull request #32712:
URL: https://github.com/apache/spark/pull/32712#issuecomment-851789021
@dongjoon-hyun Thanks for merging. I have opened a cherry-pick PR in
https://github.com/apache/spark/pull/32720
--
This is an automated message from the Apache Git
gengliangwang opened a new pull request #32720:
URL: https://github.com/apache/spark/pull/32720
### What changes were proposed in this pull request?
Currently, the results of following SQL queries are not redacted:
```
SET [KEY];
SET;
```
For example:
viirya commented on pull request #32709:
URL: https://github.com/apache/spark/pull/32709#issuecomment-851788514
Cool! Thanks @HyukjinKwon!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the
HeartSaVioR commented on a change in pull request #32653:
URL: https://github.com/apache/spark/pull/32653#discussion_r642765673
##
File path:
external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSource.scala
##
@@ -139,26 +156,78 @@ private[kafka010]
HeartSaVioR commented on a change in pull request #32653:
URL: https://github.com/apache/spark/pull/32653#discussion_r642765440
##
File path:
external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaMicroBatchStream.scala
##
@@ -95,15 +114,62 @@
SparkQA commented on pull request #32693:
URL: https://github.com/apache/spark/pull/32693#issuecomment-851785773
**[Test build #139130 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139130/testReport)**
for PR 32693 at commit
AmplabJenkins removed a comment on pull request #32658:
URL: https://github.com/apache/spark/pull/32658#issuecomment-851784991
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43646/
AmplabJenkins commented on pull request #32719:
URL: https://github.com/apache/spark/pull/32719#issuecomment-851784992
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43649/
--
AmplabJenkins commented on pull request #32658:
URL: https://github.com/apache/spark/pull/32658#issuecomment-851784991
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43646/
--
AmplabJenkins removed a comment on pull request #32719:
URL: https://github.com/apache/spark/pull/32719#issuecomment-851784992
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43649/
SparkQA commented on pull request #32506:
URL: https://github.com/apache/spark/pull/32506#issuecomment-851784737
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43648/
--
This is an automated message from the Apache
SparkQA commented on pull request #32719:
URL: https://github.com/apache/spark/pull/32719#issuecomment-851784608
Kubernetes integration test unable to build dist.
exiting with code: 1
URL:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43649/
--
SparkQA commented on pull request #32718:
URL: https://github.com/apache/spark/pull/32718#issuecomment-851782661
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43647/
--
This is an automated message from the Apache
gengliangwang closed pull request #32686:
URL: https://github.com/apache/spark/pull/32686
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service,
gengliangwang commented on pull request #32686:
URL: https://github.com/apache/spark/pull/32686#issuecomment-851781327
Thanks, merging to master
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to
HyukjinKwon commented on a change in pull request #32718:
URL: https://github.com/apache/spark/pull/32718#discussion_r642758972
##
File path: sql/core/src/test/scala/org/apache/spark/sql/MiscFunctionsSuite.scala
##
@@ -40,6 +40,12 @@ class MiscFunctionsSuite extends QueryTest
HyukjinKwon commented on pull request #32709:
URL: https://github.com/apache/spark/pull/32709#issuecomment-851778790
CRAN was my env issue. Now the tests and CRAN check should work with R 4.1+
too.
--
This is an automated message from the Apache Git Service.
To respond to the message,
yaooqinn commented on a change in pull request #32714:
URL: https://github.com/apache/spark/pull/32714#discussion_r642757369
##
File path: docs/sql-migration-guide.md
##
@@ -91,6 +91,8 @@ license: |
- In Spark 3.2, `CREATE TABLE AS SELECT` with non-empty `LOCATION` will
ulysses-you commented on a change in pull request #32602:
URL: https://github.com/apache/spark/pull/32602#discussion_r642757227
##
File path:
sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/AQEOptimizer.scala
##
@@ -27,7 +28,9 @@ import
SparkQA commented on pull request #32658:
URL: https://github.com/apache/spark/pull/32658#issuecomment-851775047
Kubernetes integration test status success
URL:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43646/
--
This is an automated message from the
HyukjinKwon commented on pull request #32719:
URL: https://github.com/apache/spark/pull/32719#issuecomment-851771579
seems like the JIRA number is wrong in the title
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use
SparkQA commented on pull request #32719:
URL: https://github.com/apache/spark/pull/32719#issuecomment-851769807
**[Test build #139129 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139129/testReport)**
for PR 32719 at commit
Yikun opened a new pull request #32719:
URL: https://github.com/apache/spark/pull/32719
### What changes were proposed in this pull request?
```
- Upload multi stages *** FAILED ***
{{ The code passed to eventually never returned normally. Attempted 20 times
over 10.011176743
cloud-fan commented on a change in pull request #32602:
URL: https://github.com/apache/spark/pull/32602#discussion_r642749109
##
File path:
sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/AQEOptimizer.scala
##
@@ -27,7 +28,9 @@ import
SparkQA commented on pull request #32506:
URL: https://github.com/apache/spark/pull/32506#issuecomment-851767556
**[Test build #139128 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139128/testReport)**
for PR 32506 at commit
SparkQA commented on pull request #32718:
URL: https://github.com/apache/spark/pull/32718#issuecomment-851767500
**[Test build #139127 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139127/testReport)**
for PR 32718 at commit
cloud-fan commented on a change in pull request #32602:
URL: https://github.com/apache/spark/pull/32602#discussion_r642749109
##
File path:
sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/AQEOptimizer.scala
##
@@ -27,7 +28,9 @@ import
yaooqinn commented on pull request #32718:
URL: https://github.com/apache/spark/pull/32718#issuecomment-851766836
cc @cloud-fan @wangyum @maropu thanks very much
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
yaooqinn opened a new pull request #32718:
URL: https://github.com/apache/spark/pull/32718
### What changes were proposed in this pull request?
Currently, we do not have a suitable definition of the `user` concept in
Spark. We only have a `sparkUser` app widely but do not support
ulysses-you commented on a change in pull request #32602:
URL: https://github.com/apache/spark/pull/32602#discussion_r642747242
##
File path:
sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/AQEOptimizer.scala
##
@@ -27,7 +28,9 @@ import
SparkQA commented on pull request #32658:
URL: https://github.com/apache/spark/pull/32658#issuecomment-851763525
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43646/
--
This is an automated message from the Apache
HyukjinKwon commented on pull request #32715:
URL: https://github.com/apache/spark/pull/32715#issuecomment-851751136
Looks fine. cc @maropu
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the
HyukjinKwon closed pull request #32658:
URL: https://github.com/apache/spark/pull/32658
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service,
HyukjinKwon commented on pull request #32658:
URL: https://github.com/apache/spark/pull/32658#issuecomment-851750789
Merged to master.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the
HyukjinKwon commented on pull request #32558:
URL: https://github.com/apache/spark/pull/32558#issuecomment-851750660
Oh I meant this:
https://github.com/apache/spark/blob/master/python/pyspark/sql/readwriter.py#L342-L350
These options are listed up as a parameter in Python side
SparkQA commented on pull request #32658:
URL: https://github.com/apache/spark/pull/32658#issuecomment-851749314
**[Test build #139126 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139126/testReport)**
for PR 32658 at commit
AmplabJenkins removed a comment on pull request #32686:
URL: https://github.com/apache/spark/pull/32686#issuecomment-851748863
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43645/
AmplabJenkins commented on pull request #32686:
URL: https://github.com/apache/spark/pull/32686#issuecomment-851748863
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43645/
--
HyukjinKwon closed pull request #32716:
URL: https://github.com/apache/spark/pull/32716
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service,
HyukjinKwon commented on pull request #32716:
URL: https://github.com/apache/spark/pull/32716#issuecomment-851748664
Merged to master.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the
HyukjinKwon commented on pull request #32709:
URL: https://github.com/apache/spark/pull/32709#issuecomment-851745373
I have backported it to branch-3.1 and branch-3.0 too because this is a
test-only, and in case other people run the tests with higher R versions.
--
This is an automated
HyukjinKwon closed pull request #32709:
URL: https://github.com/apache/spark/pull/32709
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service,
HyukjinKwon commented on pull request #32709:
URL: https://github.com/apache/spark/pull/32709#issuecomment-851744847
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For
HyukjinKwon closed pull request #32674:
URL: https://github.com/apache/spark/pull/32674
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service,
HyukjinKwon commented on pull request #32674:
URL: https://github.com/apache/spark/pull/32674#issuecomment-851744212
Merged to master.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the
SparkQA commented on pull request #32686:
URL: https://github.com/apache/spark/pull/32686#issuecomment-851743806
Kubernetes integration test unable to build dist.
exiting with code: 1
URL:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43645/
--
1 - 100 of 496 matches
Mail list logo
