[GitHub] [spark] mridulm commented on pull request #32136: [SPARK-35022][CORE] Task Scheduling Plugin in Spark

2021-06-14 Thread GitBox
mridulm commented on pull request #32136: URL: https://github.com/apache/spark/pull/32136#issuecomment-859263950 I am trying to catch up on this discussion, and it is a very long thread already :-) Thanks for all the discussion ! Can we update the doc @viirya given that there seems to

[GitHub] [spark] mridulm commented on pull request #32136: [SPARK-35022][CORE] Task Scheduling Plugin in Spark

2021-04-26 Thread GitBox
mridulm commented on pull request #32136: URL: https://github.com/apache/spark/pull/32136#issuecomment-826506510 As I mentioned in the doc, are we are trying to retrofit scenarios that Spark is not trying to handle ? Namely: some task for some stage must only run on a particular executor

[GitHub] [spark] mridulm commented on pull request #32136: [SPARK-35022][CORE] Task Scheduling Plugin in Spark

2021-04-25 Thread GitBox
mridulm commented on pull request #32136: URL: https://github.com/apache/spark/pull/32136#issuecomment-826506510 As I mentioned in the doc, are we are trying to retrofit scenarios that Spark is not trying to handle ? Namely: some task for some stage must only run on a particular executor