Re: Queryable State race condition or serialization errors?

2019-05-27 Thread Tzu-Li (Gordon) Tai
Hi Burgess, Would you be able to provide a minimal project that can reproduce your error? That would help a lot with figuring out the issue. If you prefer to share that only privately, please feel free to send me a private email with the details. Another thing you can do is set logging level to

Re: Queryable State race condition or serialization errors?

2019-05-21 Thread burgesschen
Hi Gary. Thanks for the reply. I am using RocksDBStateBackend though. Best, Chen -- Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

Re: Queryable State race condition or serialization errors?

2019-05-21 Thread Gary Yao
Hi Burgess Chen, If you are using MemoryStateBackend or FsStateBackend, you can observe race conditions on the state objects. However, the RocksDBStateBackend should be safe from these issues [1]. Best, Gary [1]

Queryable State race condition or serialization errors?

2019-05-20 Thread burgesschen
Hi Guys, I observed some strange behaviors while using Queryable state with Flink 1.6.2. Here is the story: My state is of type MapState[String, Map[String, String]]. the inner map is frequently updated. Upon querying, sometimes the returned inner map can miss some fields. What's more, sometimes