You may resort to the generic save API introduced in 1.3, which supports
appending as long as the target data source supports it. And in 1.3,
Parquet does support appending.
Cheng
On 3/26/15 4:13 PM, Richard Grossman wrote:
Hi
I've succeed to write kafka stream to parquet file in Spark 1.2 but I
can't make it with spark 1.3
As in streaming I can't use saveAsParquetFile() because I can't add
data to an existing parquet File
I know that it's possible to stream data directly into parquet
could you help me by providing a little sample what API I need to use ??
Thanks
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org
