Re: [DISCUSS] Time to evaluate "continuous mode" in SS?

2020-09-16 Thread Cheng Su
I am +1 to take a look and participate in continuous shuffle work, while push-based shuffle is being added. To be honest, I feel it might be hard to get people’s hard commitment on this, as it depends on progress of another SPIP, and timeline for discussion/work can be several months later.

Spark-Locality: Hinting Spark location of the executor does not take effect

2020-09-16 Thread Priyanka Gomatam
Sending on behalf of a colleague whose mail isn’t reaching the dev list for some reason  === HI Spark developers, If I want to hint spark to use

Spark-Locality: Hinting Spark location of the executor does not take effect.

2020-09-16 Thread Nasrulla Khan Haris
HI Spark developers, If I want to hint spark to use particular list of hosts to execute tasks on. I see that getBlockLocations is used to get the list of hosts from HDFS.

Spark-Locality: Hinting Spark location of the executor does not take effect.

2020-09-16 Thread Nasrulla Khan Haris
HI Spark developers, If I want to hint spark to use particular list of hosts to execute tasks on. I see that getBlockLocations is used to get the list of hosts from HDFS.