any
additional comments please feel free to share.
Thank you
Alessandro
On Sun, Nov 5, 2023 at 8:11 AM Alessandro Bellina
wrote:
> Thanks for the comments Reynold. This is an ease of use change, and it is
> not absolutely required (as other ease of use changes are not required
&g
n data source APIs need it is because it
> will be used by very unsophisticated end users and used all the time (for
> each connection / query). Shuffle is something you set up once, presumably
> by fairly sophisticated admins / engineers.
>
>
>
> On Sat, Nov 04, 2023 at 2:
Hello devs,
I would like to start discussion on the SPIP "ShuffleManager short name
registration via SparkPlugin"
The idea behind this change is to allow a driver plugin (spark.plugins) to
export ShuffleManagers via short names, along with sensible default
configurations. Users can then use this
