Github user CodingCat commented on the issue:
https://github.com/apache/spark/pull/19810
When I contributed it back, the community is as looking at something else,
so I didnât spend too much time to convince the people to reviewbut if
the interests are raised again now, I am
Github user CodingCat commented on a diff in the pull request:
https://github.com/apache/spark/pull/21757#discussion_r202417166
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSourceStrategy.scala
---
@@ -254,13 +254,15 @@ class
Github user CodingCat closed the pull request at:
https://github.com/apache/spark/pull/21757
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user CodingCat commented on a diff in the pull request:
https://github.com/apache/spark/pull/21757#discussion_r202414440
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSourceStrategy.scala
---
@@ -254,13 +254,15 @@ class
GitHub user CodingCat opened a pull request:
https://github.com/apache/spark/pull/21757
[SQL][SPARK-24797] respect spark.sql.hive.convertMetastoreOrc/Parquet when
buildâ¦
## What changes were proposed in this pull request?
the current code path ignore the value
Github user CodingCat commented on the issue:
https://github.com/apache/spark/pull/21757
@felixcheung
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h
Github user CodingCat commented on the issue:
https://github.com/apache/spark/pull/20394
LGTM
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h
Github user CodingCat commented on a diff in the pull request:
https://github.com/apache/spark/pull/20368#discussion_r163402210
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/columnar/InMemoryRelation.scala
---
@@ -63,7 +63,7 @@ case class InMemoryRelation
Github user CodingCat commented on a diff in the pull request:
https://github.com/apache/spark/pull/19864#discussion_r163401858
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/columnar/InMemoryRelation.scala
---
@@ -60,7 +62,8 @@ case class InMemoryRelation
Github user CodingCat commented on a diff in the pull request:
https://github.com/apache/spark/pull/20259#discussion_r162423666
--- Diff: core/src/main/scala/org/apache/spark/deploy/master/Master.scala
---
@@ -179,6 +181,7 @@ private[deploy] class Master
Github user CodingCat commented on a diff in the pull request:
https://github.com/apache/spark/pull/20259#discussion_r161956457
--- Diff: core/src/main/scala/org/apache/spark/deploy/master/Master.scala
---
@@ -179,6 +181,7 @@ private[deploy] class Master
Github user CodingCat commented on a diff in the pull request:
https://github.com/apache/spark/pull/20259#discussion_r161866373
--- Diff: core/src/main/scala/org/apache/spark/deploy/master/Master.scala
---
@@ -179,6 +181,7 @@ private[deploy] class Master
Github user CodingCat commented on a diff in the pull request:
https://github.com/apache/spark/pull/20259#discussion_r161865952
--- Diff: core/src/main/scala/org/apache/spark/deploy/master/Master.scala
---
@@ -179,6 +181,7 @@ private[deploy] class Master
Github user CodingCat commented on the issue:
https://github.com/apache/spark/pull/20072
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews
Github user CodingCat commented on the issue:
https://github.com/apache/spark/pull/11994
I see, I didn't recognize that the same registry is used to for source as
well.
in this case, even we have some way to eliminate MetricsRegistry from the
API signature, haven't we still
Github user CodingCat commented on a diff in the pull request:
https://github.com/apache/spark/pull/20072#discussion_r160076999
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ---
@@ -263,6 +263,17 @@ object SQLConf {
.booleanConf
Github user CodingCat commented on the issue:
https://github.com/apache/spark/pull/20072
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews
Github user CodingCat commented on the issue:
https://github.com/apache/spark/pull/20072
@cloud-fan @rxin @wzhfy @felixcheung @gatorsmile thanks the review, the new
name of the parameter and test are added
Github user CodingCat commented on the issue:
https://github.com/apache/spark/pull/11994
@jerryshao I mean we also need to provide BaseReporter trait
```scala
trait Sink {
protected val reporter: BaseReporter = createReporter()
def createReporter
Github user CodingCat commented on a diff in the pull request:
https://github.com/apache/spark/pull/20072#discussion_r159474580
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/HadoopFsRelation.scala
---
@@ -82,7 +82,11 @@ case class HadoopFsRelation
Github user CodingCat commented on a diff in the pull request:
https://github.com/apache/spark/pull/20072#discussion_r159474598
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ---
@@ -261,6 +261,17 @@ object SQLConf {
.booleanConf
Github user CodingCat commented on the issue:
https://github.com/apache/spark/pull/20072
@wzhfy thanks for the review, please take a look
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
Github user CodingCat commented on a diff in the pull request:
https://github.com/apache/spark/pull/20072#discussion_r159171970
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ---
@@ -261,6 +261,17 @@ object SQLConf {
.booleanConf
Github user CodingCat commented on a diff in the pull request:
https://github.com/apache/spark/pull/20072#discussion_r159133859
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ---
@@ -261,6 +261,17 @@ object SQLConf {
.booleanConf
Github user CodingCat commented on the issue:
https://github.com/apache/spark/pull/20072
@gatorsmile more comments?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail
Github user CodingCat commented on the issue:
https://github.com/apache/spark/pull/11994
if I understand correctly, the only issue here is that we exposed
codehale's MetricsRegistry in Sink base
class..https://github.com/apache/spark/pull/11994/files#diff
Github user CodingCat commented on the issue:
https://github.com/apache/spark/pull/20072
@gatorsmile thanks for the review, Happy Christmas!
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
Github user CodingCat commented on a diff in the pull request:
https://github.com/apache/spark/pull/20072#discussion_r158651308
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/HadoopFsRelation.scala
---
@@ -82,7 +84,15 @@ case class HadoopFsRelation
GitHub user CodingCat opened a pull request:
https://github.com/apache/spark/pull/20072
[SPARK-22790][SQL] add a configurable factor to describe HadoopFsRelation's
size
## What changes were proposed in this pull request?
as per discussion in
https://github.com/apache
Github user CodingCat commented on the issue:
https://github.com/apache/spark/pull/19864
thanks
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h
Github user CodingCat commented on a diff in the pull request:
https://github.com/apache/spark/pull/19864#discussion_r157653784
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/columnar/InMemoryColumnarQuerySuite.scala
---
@@ -479,4 +485,43 @@ class
Github user CodingCat commented on the issue:
https://github.com/apache/spark/pull/19864
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews
Github user CodingCat commented on a diff in the pull request:
https://github.com/apache/spark/pull/19864#discussion_r157381615
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/columnar/InMemoryColumnarQuerySuite.scala
---
@@ -479,4 +485,35 @@ class
Github user CodingCat commented on a diff in the pull request:
https://github.com/apache/spark/pull/19864#discussion_r157381595
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/columnar/InMemoryColumnarQuerySuite.scala
---
@@ -479,4 +485,35 @@ class
Github user CodingCat commented on a diff in the pull request:
https://github.com/apache/spark/pull/19864#discussion_r157381594
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/columnar/InMemoryColumnarQuerySuite.scala
---
@@ -479,4 +485,35 @@ class
Github user CodingCat commented on a diff in the pull request:
https://github.com/apache/spark/pull/19864#discussion_r157381589
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/columnar/InMemoryRelation.scala
---
@@ -71,9 +74,8 @@ case class InMemoryRelation
Github user CodingCat commented on a diff in the pull request:
https://github.com/apache/spark/pull/19864#discussion_r157118091
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/CacheManager.scala ---
@@ -80,6 +80,14 @@ class CacheManager extends Logging
Github user CodingCat commented on a diff in the pull request:
https://github.com/apache/spark/pull/19864#discussion_r156718763
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/CacheManager.scala ---
@@ -80,6 +80,14 @@ class CacheManager extends Logging
Github user CodingCat commented on a diff in the pull request:
https://github.com/apache/spark/pull/19864#discussion_r156716896
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/columnar/InMemoryRelation.scala
---
@@ -71,9 +74,10 @@ case class InMemoryRelation
Github user CodingCat commented on a diff in the pull request:
https://github.com/apache/spark/pull/19926#discussion_r156527867
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StreamExecution.scala
---
@@ -71,27 +68,29 @@ class StreamExecution
Github user CodingCat commented on a diff in the pull request:
https://github.com/apache/spark/pull/19926#discussion_r156527709
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StreamExecution.scala
---
@@ -447,296 +384,6 @@ class StreamExecution
Github user CodingCat commented on a diff in the pull request:
https://github.com/apache/spark/pull/19926#discussion_r156527409
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/streaming/StreamingQueryManager.scala
---
@@ -237,7 +237,7 @@ class StreamingQueryManager private
Github user CodingCat commented on a diff in the pull request:
https://github.com/apache/spark/pull/19926#discussion_r156458057
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/streaming/StreamingQueryManager.scala
---
@@ -237,7 +237,7 @@ class StreamingQueryManager private
Github user CodingCat commented on a diff in the pull request:
https://github.com/apache/spark/pull/19926#discussion_r156451593
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StreamExecution.scala
---
@@ -71,27 +68,29 @@ class StreamExecution
Github user CodingCat commented on a diff in the pull request:
https://github.com/apache/spark/pull/19926#discussion_r156461586
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StreamExecution.scala
---
@@ -447,296 +384,6 @@ class StreamExecution
Github user CodingCat commented on a diff in the pull request:
https://github.com/apache/spark/pull/19926#discussion_r156451756
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StreamExecution.scala
---
@@ -71,27 +68,29 @@ class StreamExecution
Github user CodingCat commented on a diff in the pull request:
https://github.com/apache/spark/pull/19926#discussion_r156457754
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StreamExecution.scala
---
@@ -783,29 +430,29 @@ class StreamExecution
Github user CodingCat commented on a diff in the pull request:
https://github.com/apache/spark/pull/19926#discussion_r156458765
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/streaming/StreamTest.scala ---
@@ -285,12 +285,13 @@ trait StreamTest extends QueryTest
Github user CodingCat commented on a diff in the pull request:
https://github.com/apache/spark/pull/19926#discussion_r156459771
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StreamExecution.scala
---
@@ -71,27 +68,29 @@ class StreamExecution
Github user CodingCat commented on a diff in the pull request:
https://github.com/apache/spark/pull/19864#discussion_r156445522
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/columnar/InMemoryRelation.scala
---
@@ -60,7 +62,8 @@ case class InMemoryRelation
Github user CodingCat commented on the issue:
https://github.com/apache/spark/pull/19864
@cloud-fan @viirya any more comments about this?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
Github user CodingCat commented on a diff in the pull request:
https://github.com/apache/spark/pull/19864#discussion_r155587468
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/columnar/InMemoryColumnarQuerySuite.scala
---
@@ -479,4 +481,32 @@ class
Github user CodingCat commented on a diff in the pull request:
https://github.com/apache/spark/pull/19864#discussion_r155587431
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/columnar/InMemoryColumnarQuerySuite.scala
---
@@ -479,4 +481,32 @@ class
Github user CodingCat commented on the issue:
https://github.com/apache/spark/pull/19810
@cloud-fan for this case, if the data has been dumped to disk or some
non-local tasks are started, I/O is involved in addition to the overhead to
start extra tasks. If all data is in-memory, only
Github user CodingCat commented on a diff in the pull request:
https://github.com/apache/spark/pull/19810#discussion_r155392065
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/columnar/InMemoryTableScanExec.scala
---
@@ -193,38 +195,68 @@ case class
Github user CodingCat commented on a diff in the pull request:
https://github.com/apache/spark/pull/19864#discussion_r155296970
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/columnar/InMemoryRelation.scala
---
@@ -37,8 +37,10 @@ object InMemoryRelation
Github user CodingCat commented on a diff in the pull request:
https://github.com/apache/spark/pull/19864#discussion_r155287758
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/CacheManager.scala ---
@@ -94,14 +94,16 @@ class CacheManager extends Logging
Github user CodingCat commented on a diff in the pull request:
https://github.com/apache/spark/pull/19864#discussion_r155147478
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/CacheManager.scala ---
@@ -94,14 +94,16 @@ class CacheManager extends Logging
Github user CodingCat commented on the issue:
https://github.com/apache/spark/pull/19864
@viirya sure will add
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail
Github user CodingCat commented on a diff in the pull request:
https://github.com/apache/spark/pull/19864#discussion_r155140125
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/CacheManager.scala ---
@@ -94,14 +94,16 @@ class CacheManager extends Logging
Github user CodingCat commented on the issue:
https://github.com/apache/spark/pull/19864
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews
Github user CodingCat commented on the issue:
https://github.com/apache/spark/pull/19864
thanks @viirya @cloud-fan and @hvanhovell, just addressed the comments and
answered the question
---
-
To unsubscribe, e-mail
Github user CodingCat commented on a diff in the pull request:
https://github.com/apache/spark/pull/19864#discussion_r15502
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/CacheManager.scala ---
@@ -94,14 +94,16 @@ class CacheManager extends Logging
Github user CodingCat commented on a diff in the pull request:
https://github.com/apache/spark/pull/19864#discussion_r154968066
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/CacheManager.scala ---
@@ -94,14 +94,16 @@ class CacheManager extends Logging
Github user CodingCat commented on the issue:
https://github.com/apache/spark/pull/19810
@sadikovi thanks for the review, I replied in comments
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
Github user CodingCat commented on a diff in the pull request:
https://github.com/apache/spark/pull/19810#discussion_r154845669
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/columnar/InMemoryTableScanExec.scala
---
@@ -193,38 +195,68 @@ case class
Github user CodingCat commented on a diff in the pull request:
https://github.com/apache/spark/pull/19810#discussion_r154844579
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/columnar/InMemoryRelation.scala
---
@@ -52,6 +52,68 @@ object InMemoryRelation
Github user CodingCat commented on the issue:
https://github.com/apache/spark/pull/19810
@cloud-fan would you mind continuing the review?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
Github user CodingCat commented on the issue:
https://github.com/apache/spark/pull/19864
@viirya any thoughts?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail
Github user CodingCat commented on the issue:
https://github.com/apache/spark/pull/19864
@viirya yes, we can get more accurate stats later, however, the first stats
is also important as it enables the user to pay less for `the first run` which
writes cache.
The current
Github user CodingCat commented on a diff in the pull request:
https://github.com/apache/spark/pull/19864#discussion_r154501939
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/CacheManager.scala ---
@@ -94,14 +94,16 @@ class CacheManager extends Logging
Github user CodingCat commented on the issue:
https://github.com/apache/spark/pull/19824
if you just worry about
> As I was using the StreamingListenerBatchCompleted to do some metadata
checkpointing stuff, which should be done only when the batch succee
Github user CodingCat commented on a diff in the pull request:
https://github.com/apache/spark/pull/19864#discussion_r154500900
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/columnar/InMemoryRelation.scala
---
@@ -71,9 +73,17 @@ case class InMemoryRelation
Github user CodingCat commented on the issue:
https://github.com/apache/spark/pull/19864
@cloud-fan @viirya @gatorsmile @felixcheung @hvanhovell @HyukjinKwon
@dongjoon-hyun @liancheng
---
-
To unsubscribe, e-mail
GitHub user CodingCat opened a pull request:
https://github.com/apache/spark/pull/19864
[SPARK-22673][SQL] InMemoryRelation should utilize on-disk table stats
whenever possible
## What changes were proposed in this pull request?
The current implementation
Github user CodingCat commented on the issue:
https://github.com/apache/spark/pull/19824
One thing to note is that mute an event is a behavior change, if a user has
introduced some customized listener to capture all completed batches and also
extract failed job info, he/she will see
Github user CodingCat commented on the issue:
https://github.com/apache/spark/pull/19824
#16542 has guaranteed that the failed batch can be re-executed, and I
didnât check if reverting the change in #16542 plus your new change can
guarantee the same thing...
Suppose
Github user CodingCat commented on the issue:
https://github.com/apache/spark/pull/19824
`What I want to say is that if a Job is failed, we should consider the
Batch as not completed.` isn't #16542 doing the same thing
Github user CodingCat commented on the issue:
https://github.com/apache/spark/pull/19824
did I miss anything? @victor-wong , you are describing what
https://github.com/apache/spark/pull/16542 does in your description, but you
are reverting it in your changes
Github user CodingCat commented on the issue:
https://github.com/apache/spark/pull/19810
reading less data is a observation from the input metrics in Spark UI which
includes both of local/remote read in BlockManagers, and also the overhead in
BlockManager layer itself (especially
Github user CodingCat commented on the issue:
https://github.com/apache/spark/pull/19810
Hi, @cloud-fan, this PR is not only for the case where the data size is
larger than the memory size, even when all data is in-memory, I observed up to
10-40% speedup because the implementation
Github user CodingCat commented on the issue:
https://github.com/apache/spark/pull/19810
ping @cloud-fan @viirya @gatorsmile @felixcheung @hvanhovell @HyukjinKwon
---
-
To unsubscribe, e-mail: reviews-unsubscr
Github user CodingCat commented on the issue:
https://github.com/apache/spark/pull/19810
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews
Github user CodingCat commented on the issue:
https://github.com/apache/spark/pull/19810
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews
Github user CodingCat commented on the issue:
https://github.com/apache/spark/pull/19810
jenkins, retest it please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail
GitHub user CodingCat opened a pull request:
https://github.com/apache/spark/pull/19810
Partition level pruning 2
## What changes were proposed in this pull request?
In the current implementation of Spark, InMemoryTableExec read all data in
a cached table, filter
Github user CodingCat commented on the issue:
https://github.com/apache/spark/pull/19763
my question is "how many times we have seen this operation of collecting
statistics is the bottleneck?"
---
-
To u
Github user CodingCat commented on a diff in the pull request:
https://github.com/apache/spark/pull/19763#discussion_r151322438
--- Diff: core/src/main/scala/org/apache/spark/MapOutputTracker.scala ---
@@ -473,16 +477,41 @@ private[spark] class MapOutputTrackerMaster
Github user CodingCat commented on the issue:
https://github.com/apache/spark/pull/16578
made a simple test in a single-node spark environment
I used a synthetic dataset which is generated as: (thatâs 20M)
```scala
import spark.implicits._
import
Github user CodingCat commented on a diff in the pull request:
https://github.com/apache/spark/pull/19569#discussion_r146748032
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/columnar/InMemoryTableScanExec.scala
---
@@ -201,35 +193,50 @@ case class
Github user CodingCat commented on the issue:
https://github.com/apache/spark/pull/15590
The fallback strategy is actually the "pure external sorter" approach,
right?
(https://github.com/apache/spark/blob/41439fd52dd263b9f7d92e608f027f193f461777/sql/core/src/main/scala/
Github user CodingCat commented on the issue:
https://github.com/apache/spark/pull/18410
retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so
Github user CodingCat commented on the issue:
https://github.com/apache/spark/pull/18410
retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so
Github user CodingCat commented on the issue:
https://github.com/apache/spark/pull/18410
@HyukjinKwon thanks for the pointer, is it fixed now?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user CodingCat commented on the issue:
https://github.com/apache/spark/pull/18410
@zsxwing would you mind taking a look at this PR...what does this pip
packaging tests mean? it's flaky test?
---
If your project is set up for it, you can reply to this email and have your
reply
Github user CodingCat commented on the issue:
https://github.com/apache/spark/pull/18410
retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so
Github user CodingCat commented on the issue:
https://github.com/apache/spark/pull/18410
retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so
Github user CodingCat commented on the issue:
https://github.com/apache/spark/pull/18410
Jenkins, retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled
Github user CodingCat commented on the issue:
https://github.com/apache/spark/pull/18410
Jenkins, test it please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled
GitHub user CodingCat opened a pull request:
https://github.com/apache/spark/pull/18410
[SS][SPARK-20971] purge metadata log in FileStreamSource
## What changes were proposed in this pull request?
Currently, there is no cleanup mechanism for FileStreamSource's metadata
log
1 - 100 of 847 matches
Mail list logo
