Re: Ever increasing key space

2018-07-16 Thread Yun Tang
ctions or DBOptions.setIncreaseParallelism . Best, Yun From: burgesschen Sent: Monday, July 16, 2018 23:57 To: user@flink.apache.org Subject: Ever increasing key space Hi every one, We are building a flink job that keys on a dynamic value. Only a few events share the same key and

Ever increasing key space

2018-07-16 Thread burgesschen
Hi every one, We are building a flink job that keys on a dynamic value. Only a few events share the same key and events with new keys are consumed constantly. For each key, there are some keyedState created the first time it is seen. And we clean up the keyedState if the key has not been seen