Github user dreamworks007 commented on the issue:
https://github.com/apache/spark/pull/9276
@yhuai , could you please let us know is there any known issues /
limitation with this feature ? Has this feature been tested under some large
jobs ?
We are also considering
Github user dreamworks007 commented on the issue:
https://github.com/apache/spark/pull/15616
ping ..
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so
Github user dreamworks007 commented on the issue:
https://github.com/apache/spark/pull/15616
ping ... @JoshRosen
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled
Github user dreamworks007 commented on the issue:
https://github.com/apache/spark/pull/15616
@joshrosen - could you take a look ?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user dreamworks007 commented on the issue:
https://github.com/apache/spark/pull/15616
ping
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so
GitHub user dreamworks007 opened a pull request:
https://github.com/apache/spark/pull/15616
[SPARK-16827][Shuffle] add disk spill bytes to UnsafeExternalSorter
## What changes were proposed in this pull request?
disk spill bytes metrics was disabled due to apache/spark
Github user dreamworks007 commented on the issue:
https://github.com/apache/spark/pull/15347
@rxin , "Can you also work on reporting spill metrics?" --> here , you mean
reporting spill time metrics , right ? Since I think write spill bytes is
already included -
https
