Github user MaxGekk commented on the issue:
https://github.com/apache/spark/pull/21589
> I am not seeing the utility of these two methods.
@mridulm I describe the utility of the methods in the ticket:
https://issues.apache.org/jira/browse/SPARK-24591
> defaultParallelism already captures the current number of cores.
The `defaultParallelism` can be changed by users. And pretty often it is
not reflected to number of cores.
> For monitoring usecases, existing events fired via listener can be used
to keep track of current executor population (if that is the intended usecase).
The basic cluster properties should be easily discoverable via APIs, I
believe. And monitoring is just one of use cases.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
