Re: How to see the full contents of dataset or dataframe is structured streaming?

You can write it to the memory sink. df.writeStream.format("memory").queryName("myStream").start() spark.table("myStream").show() On Wed, May 17, 2017 at 7:55 PM, kant kodali wrote: > Hi All, > > How to see the full contents of dataset or dataframe is structured >

Re: How to see the full contents of dataset or dataframe is structured streaming?

Looks like there is .option("truncate", "false") On Wed, May 17, 2017 at 11:30 PM, Jörn Franke wrote: > You can also write it into a file and view it using your favorite > viewer/editor > > On 18. May 2017, at 04:55, kant kodali wrote: > > Hi All, > >

Re: How to see the full contents of dataset or dataframe is structured streaming?

so for console sink it is not possible? On Wed, May 17, 2017 at 11:30 PM, Jörn Franke wrote: > You can also write it into a file and view it using your favorite > viewer/editor > > On 18. May 2017, at 04:55, kant kodali wrote: > > Hi All, > > How to

Re: How to see the full contents of dataset or dataframe is structured streaming?

You can also write it into a file and view it using your favorite viewer/editor > On 18. May 2017, at 04:55, kant kodali wrote: > > Hi All, > > How to see the full contents of dataset or dataframe is structured streaming > just like we normally with df.show(false)? Is