Github user IgorBerman commented on the issue:
https://github.com/apache/spark/pull/11207
@bbossy so my work around: ive disabled cleanup of external shuffle
service and removing shuffle files by cron that finds files that were not
accessed in last X hours.
---
Github user jerryshao commented on a diff in the pull request:
https://github.com/apache/spark/pull/20382#discussion_r170178735
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/streaming/sources/TextSocketStreamSuite.scala
---
@@ -0,0 +1,246 @@
+/*
+ *
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/20382
Sorry @tdas for the delay. I'm working on this, will push new changes soon.
---
-
To unsubscribe, e-mail:
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/20624#discussion_r170171868
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/interface.scala
---
@@ -387,6 +390,101 @@ case class CatalogStatistics(
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/20618
Also cc @srinathshankar
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/20660
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/20660
Thanks! Merged to master.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20553
Kubernetes integration test status success
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-spark-integration/1009/
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20553
**[Test build #87626 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87626/testReport)**
for PR 20553 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20553
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20553
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87626/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20553
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-spark-integration/1009/
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20553
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20553
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1015/
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/10942
FYI this feature will be re-designed when migrating file-based data sources
to data source v2. From a quick look seems this feature is not in the current
code base anymore.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20553
Kubernetes integration test status success
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-spark-integration/1008/
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20553
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20553
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87625/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20553
**[Test build #87625 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87625/testReport)**
for PR 20553 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20553
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-spark-integration/1008/
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20553
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1014/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20553
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20553
**[Test build #87626 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87626/testReport)**
for PR 20553 at commit
Github user liyinan926 commented on a diff in the pull request:
https://github.com/apache/spark/pull/20553#discussion_r170169357
--- Diff: docs/running-on-kubernetes.md ---
@@ -576,14 +576,21 @@ specific to Spark on Kubernetes.
spark.kubernetes.driver.limit.cores
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20553
**[Test build #87625 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87625/testReport)**
for PR 20553 at commit
Github user liyinan926 commented on a diff in the pull request:
https://github.com/apache/spark/pull/20553#discussion_r170168795
--- Diff: docs/running-on-kubernetes.md ---
@@ -576,14 +576,21 @@ specific to Spark on Kubernetes.
spark.kubernetes.driver.limit.cores
Github user liyinan926 commented on a diff in the pull request:
https://github.com/apache/spark/pull/20553#discussion_r170168480
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPodFactory.scala
---
@@ -144,7 +149,7 @@
Github user jiangxb1987 commented on the issue:
https://github.com/apache/spark/pull/20628
also cc @vanzin to verify this change.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20647
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20647
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1013/
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20647
**[Test build #87624 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87624/testReport)**
for PR 20647 at commit
Github user viirya commented on the issue:
https://github.com/apache/spark/pull/20648
Yes, thanks @HyukjinKwon for checking the behavior. If we look at the codes
of JSON parser, we will find many places indicating the expectation of
availability of partial results.
For
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/20647#discussion_r170162261
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/DataSourceV2Relation.scala
---
@@ -35,15 +35,14 @@ case class
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/20647#discussion_r170160050
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/MicroBatchExecution.scala
---
@@ -77,31 +79,32 @@ class MicroBatchExecution(
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/20647#discussion_r170159543
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/DataSourceV2Relation.scala
---
@@ -107,17 +106,24 @@ case class
Github user drboyer commented on a diff in the pull request:
https://github.com/apache/spark/pull/20658#discussion_r170158422
--- Diff: python/pyspark/sql/catalog.py ---
@@ -28,7 +28,7 @@
Database = namedtuple("Database", "name description locationUri")
Table =
Github user bersprockets closed the pull request at:
https://github.com/apache/spark/pull/20519
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user asolimando commented on a diff in the pull request:
https://github.com/apache/spark/pull/20632#discussion_r170140738
--- Diff:
mllib/src/test/scala/org/apache/spark/ml/tree/impl/RandomForestSuite.scala ---
@@ -362,10 +365,10 @@ class RandomForestSuite extends
Github user asolimando commented on a diff in the pull request:
https://github.com/apache/spark/pull/20632#discussion_r170140280
--- Diff:
mllib/src/test/scala/org/apache/spark/mllib/tree/DecisionTreeSuite.scala ---
@@ -359,29 +339,6 @@ class DecisionTreeSuite extends
Github user asolimando commented on a diff in the pull request:
https://github.com/apache/spark/pull/20632#discussion_r170139957
--- Diff:
mllib/src/test/scala/org/apache/spark/ml/tree/impl/RandomForestSuite.scala ---
@@ -402,20 +405,40 @@ class RandomForestSuite extends
Github user foxish commented on a diff in the pull request:
https://github.com/apache/spark/pull/20553#discussion_r170138424
--- Diff: docs/running-on-kubernetes.md ---
@@ -576,14 +576,21 @@ specific to Spark on Kubernetes.
spark.kubernetes.driver.limit.cores
(none)
Github user foxish commented on a diff in the pull request:
https://github.com/apache/spark/pull/20553#discussion_r170137631
--- Diff: docs/running-on-kubernetes.md ---
@@ -576,14 +576,21 @@ specific to Spark on Kubernetes.
spark.kubernetes.driver.limit.cores
(none)
Github user foxish commented on a diff in the pull request:
https://github.com/apache/spark/pull/20553#discussion_r170138218
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPodFactory.scala
---
@@ -144,7 +149,7 @@
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20622
**[Test build #4129 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4129/testReport)**
for PR 20622 at commit
Github user liyinan926 commented on the issue:
https://github.com/apache/spark/pull/20553
Any comment or concern on this? Is this good to merge?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20622
**[Test build #4134 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4134/testReport)**
for PR 20622 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20622
**[Test build #4132 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4132/testReport)**
for PR 20622 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20622
**[Test build #4131 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4131/testReport)**
for PR 20622 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20622
**[Test build #4133 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4133/testReport)**
for PR 20622 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20622
**[Test build #4130 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4130/testReport)**
for PR 20622 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20622
**[Test build #4127 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4127/testReport)**
for PR 20622 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20622
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20622
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87623/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20622
**[Test build #87623 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87623/testReport)**
for PR 20622 at commit
Github user gengliangwang commented on the issue:
https://github.com/apache/spark/pull/20660
@gatorsmile
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20622
**[Test build #4135 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4135/testReport)**
for PR 20622 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20622
**[Test build #4128 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4128/testReport)**
for PR 20622 at commit
Github user jose-torres commented on the issue:
https://github.com/apache/spark/pull/20650
LGTM
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user rdblue commented on the issue:
https://github.com/apache/spark/pull/20645
> A quick question: after this change, extraJavaOptions is still able to
cleanly override whatever's set in defaultJavaOptions, is that right?
No, the intent is for both sets of options to
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20657
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20657
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87621/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20653
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20653
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87622/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20657
**[Test build #87621 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87621/testReport)**
for PR 20657 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20653
**[Test build #87622 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87622/testReport)**
for PR 20653 at commit
Github user marmbrus commented on a diff in the pull request:
https://github.com/apache/spark/pull/20647#discussion_r170115965
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/MicroBatchExecution.scala
---
@@ -415,12 +418,14 @@ class MicroBatchExecution(
Github user rednaxelafx commented on the issue:
https://github.com/apache/spark/pull/20645
A quick question: after this change, `extraJavaOptions` is still able to
cleanly override whatever's set in `defaultJavaOptions`, is that right?
^^ Just making sure I understood the
Github user jose-torres commented on a diff in the pull request:
https://github.com/apache/spark/pull/20647#discussion_r170106104
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/MicroBatchExecution.scala
---
@@ -415,12 +418,14 @@ class
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/20604#discussion_r170103841
--- Diff:
core/src/main/scala/org/apache/spark/ExecutorAllocationClient.scala ---
@@ -55,18 +55,18 @@ private[spark] trait ExecutorAllocationClient {
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/20604#discussion_r170102063
--- Diff:
core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala ---
@@ -334,6 +336,11 @@ private[spark] class ExecutorAllocationManager(
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/20604#discussion_r170102582
--- Diff:
core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala ---
@@ -334,6 +336,11 @@ private[spark] class ExecutorAllocationManager(
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/20604#discussion_r170102363
--- Diff:
core/src/main/scala/org/apache/spark/ExecutorAllocationClient.scala ---
@@ -55,18 +55,18 @@ private[spark] trait ExecutorAllocationClient {
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/20624#discussion_r170102064
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/interface.scala
---
@@ -387,6 +390,101 @@ case class CatalogStatistics(
Github user skonto commented on the issue:
https://github.com/apache/spark/pull/20640
@susanxhuynh I agree in case it is not enabled we can log failures as
usual, but not for blacklisting as it is disabled it wouldnt make sense. User
should have this option not to care.
>
Github user rdblue commented on a diff in the pull request:
https://github.com/apache/spark/pull/20647#discussion_r170097795
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/MicroBatchExecution.scala
---
@@ -415,12 +418,14 @@ class MicroBatchExecution(
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20622
**[Test build #4135 has
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4135/testReport)**
for PR 20622 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20622
**[Test build #4134 has
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4134/testReport)**
for PR 20622 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20622
**[Test build #4133 has
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4133/testReport)**
for PR 20622 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20622
**[Test build #4132 has
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4132/testReport)**
for PR 20622 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20622
**[Test build #4131 has
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4131/testReport)**
for PR 20622 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20622
**[Test build #4130 has
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4130/testReport)**
for PR 20622 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20622
**[Test build #4129 has
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4129/testReport)**
for PR 20622 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20622
**[Test build #4128 has
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4128/testReport)**
for PR 20622 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20622
**[Test build #4127 has
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4127/testReport)**
for PR 20622 at commit
Github user jose-torres commented on a diff in the pull request:
https://github.com/apache/spark/pull/20647#discussion_r170095169
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/MicroBatchExecution.scala
---
@@ -415,12 +418,14 @@ class
Github user susanxhuynh commented on the issue:
https://github.com/apache/spark/pull/20640
@skonto We should not remove the logging. The logging
Github user rdblue commented on a diff in the pull request:
https://github.com/apache/spark/pull/20647#discussion_r170092263
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/streaming/continuous/ContinuousSuite.scala
---
@@ -17,15 +17,12 @@
package
Github user rdblue commented on a diff in the pull request:
https://github.com/apache/spark/pull/20647#discussion_r170092091
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/streaming/StreamSuite.scala ---
@@ -492,16 +492,16 @@ class StreamSuite extends StreamTest {
Github user rdblue commented on a diff in the pull request:
https://github.com/apache/spark/pull/20647#discussion_r170091954
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/MicroBatchExecution.scala
---
@@ -415,12 +418,14 @@ class MicroBatchExecution(
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20622
**[Test build #87623 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87623/testReport)**
for PR 20622 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20622
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20622
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87620/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20622
**[Test build #87620 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87620/testReport)**
for PR 20622 at commit
Github user rdblue commented on a diff in the pull request:
https://github.com/apache/spark/pull/20647#discussion_r170090758
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/MicroBatchExecution.scala
---
@@ -415,12 +418,14 @@ class MicroBatchExecution(
Github user rdblue commented on a diff in the pull request:
https://github.com/apache/spark/pull/20647#discussion_r170090323
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/MicroBatchExecution.scala
---
@@ -77,31 +79,32 @@ class MicroBatchExecution(
Github user rdblue commented on a diff in the pull request:
https://github.com/apache/spark/pull/20647#discussion_r170089913
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/PushDownOperatorsToDataSource.scala
---
@@ -26,7 +26,7 @@ object
Github user rdblue commented on a diff in the pull request:
https://github.com/apache/spark/pull/20647#discussion_r170089465
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/DataSourceV2Strategy.scala
---
@@ -23,11 +23,11 @@ import
Github user rdblue commented on a diff in the pull request:
https://github.com/apache/spark/pull/20647#discussion_r170089368
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/DataSourceV2Relation.scala
---
@@ -107,17 +106,24 @@ case class
Github user tdas commented on the issue:
https://github.com/apache/spark/pull/20650
All the failures above can be attributed to other flakiness unrelated to
the flakiness this PR trying to address.
---
-
To
Github user rdblue commented on a diff in the pull request:
https://github.com/apache/spark/pull/20647#discussion_r170088798
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/DataSourceV2Relation.scala
---
@@ -35,15 +35,14 @@ case class
1 - 100 of 215 matches
Mail list logo
