afaik It has been there since Spark 2.0 in 2015. Not certain about Spark 1.5/1.6
On Thu, 18 Jun 2020 at 23:56, Anwar AliKhan <anwaralikhan...@gmail.com> wrote: > I first ran the command > df.show() > > For sanity check of my dataFrame. > > I wasn't impressed with the display. > > I then ran > df.toPandas() in Jupiter Notebook. > > Now the display is really good looking . > > Is toPandas() a new function which became available in Spark 3.0 ? > > > > > >
