Re: is RosckDB backend available in 3.0 preview?

2020-04-22 Thread Jungtaek Lim
, 2020 at 11:32 AM kant kodali wrote: >> >>> Hi All, >>> >>> 1. is RosckDB backend available in 3.0 preview? >>> 2. if RocksDB can store intermediate results of a stream-stream join can >>> I run streaming join queries forever? forever I mean until I r

Re: is RosckDB backend available in 3.0 preview?

2020-04-22 Thread kant kodali
this project is > most widely known implementation for RocksDB backend state store - > https://github.com/chermenin/spark-states > > On Wed, Apr 22, 2020 at 11:32 AM kant kodali wrote: > >> Hi All, >> >> 1. is RosckDB backend available in 3.0 preview? >> 2. if

Re: is RosckDB backend available in 3.0 preview?

2020-04-21 Thread Jungtaek Lim
/chermenin/spark-states On Wed, Apr 22, 2020 at 11:32 AM kant kodali wrote: > Hi All, > > 1. is RosckDB backend available in 3.0 preview? > 2. if RocksDB can store intermediate results of a stream-stream join can I > run streaming join queries forever? forever I mean until I run out of

is RosckDB backend available in 3.0 preview?

2020-04-21 Thread kant kodali
Hi All, 1. is RosckDB backend available in 3.0 preview? 2. if RocksDB can store intermediate results of a stream-stream join can I run streaming join queries forever? forever I mean until I run out of disk. or put it another can I run the stream-stream join queries for years if necessary