Re: Ammonite as REPL for Spark Connect

+1 on better notebook and other REPL experience On Thu, Mar 23, 2023 at 9:17 AM Dongjoon Hyun wrote: > I also support Herman's `SPARK-42884 Add Ammonite REPL integration` PR. > > Thanks, > Dongjoon. > > > On Thu, Mar 23, 2023 at 7:51 AM Mridul Muralidharan > wrote: > >> >> Sounds good, thanks

Re: Ammonite as REPL for Spark Connect

I also support Herman's `SPARK-42884 Add Ammonite REPL integration` PR. Thanks, Dongjoon. On Thu, Mar 23, 2023 at 7:51 AM Mridul Muralidharan wrote: > > Sounds good, thanks for clarifying ! > > Regards, > Mridul > > On Thu, Mar 23, 2023 at 9:09 AM Herman van Hovell > wrote: > >> The goal of

Re: Ammonite as REPL for Spark Connect

Sounds good, thanks for clarifying ! Regards, Mridul On Thu, Mar 23, 2023 at 9:09 AM Herman van Hovell wrote: > The goal of adding this, is to make it easy for a user to connect a scala > REPL to a Spark Connect server. Just like Spark shell makes it easy to work > with a regular Spark

Re: Ammonite as REPL for Spark Connect

The goal of adding this, is to make it easy for a user to connect a scala REPL to a Spark Connect server. Just like Spark shell makes it easy to work with a regular Spark environment. It is not meant as a Spark shell replacement. They represent two different modes of working with Spark, and they

Re: Ammonite as REPL for Spark Connect

What is unclear to me is why we are introducing this integration, how users will leverage it. * Are we replacing spark-shell with it ? Given the existing gaps, this is not the case. * Is it an example to showcase how to build an integration ? That could be interesting, and we can add it to

Re: Ammonite as REPL for Spark Connect

I am +1 to the general concept of including Ammonite magic 彩. On Wed, Mar 22, 2023 at 4:58 PM Herman van Hovell wrote: > Ammonite is maintained externally by Li Haoyi et al. We are including it > as a 'provided' dependency. The integration bits and pieces (1 file) are > included in Apache

Re: Ammonite as REPL for Spark Connect

Ammonite is maintained externally by Li Haoyi et al. We are including it as a 'provided' dependency. The integration bits and pieces (1 file) are included in Apache Spark. On Wed, Mar 22, 2023 at 7:53 PM Mridul Muralidharan wrote: > > Will this be maintained externally or included into Apache

Re: Ammonite as REPL for Spark Connect

Will this be maintained externally or included into Apache Spark ? Regards , Mridul On Wed, Mar 22, 2023 at 6:50 PM Herman van Hovell wrote: > Hi All, > > For Spark Connect Scala Client we are working on making the REPL > experience a bit nicer .

Ammonite as REPL for Spark Connect

Hi All, For Spark Connect Scala Client we are working on making the REPL experience a bit nicer . In a nutshell we want to give users a turn key scala REPL, that works even if you don't have a Spark distribution on your machine (through coursier