Re: MapState bad performance

2020-06-20 Thread Congxian Qiu
d3386b955a92b731a8e758223045f/flink-state-backends/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/RocksDBMapState.java#L254 > > Best > Yun Tang > > -- > *From:* nick toker > *Sent:* Tuesday, June 16, 2020 15:35 >

Re: MapState bad performance

2020-06-16 Thread Yun Tang
.toker@gmail.com>> Sent: Tuesday, June 16, 2020 15:35 To: user@flink.apache.org<mailto:user@flink.apache.org> mailto:user@flink.apache.org>> Subject: MapState bad performance Hello, We wrote a very simple streaming pipeline containing: 1. Kafka consumer 2. Process function 3. Kaf

Re: MapState bad performance

2020-06-16 Thread nick toker
ng > > -- > *From:* nick toker > *Sent:* Tuesday, June 16, 2020 15:35 > *To:* user@flink.apache.org > *Subject:* MapState bad performance > > Hello, > > We wrote a very simple streaming pipeline containing: > 1. Kafka consumer &

Re: MapState bad performance

2020-06-16 Thread Yun Tang
flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/RocksDBMapState.java#L254 Best Yun Tang From: nick toker Sent: Tuesday, June 16, 2020 15:35 To: user@flink.apache.org Subject: MapState bad performance Hello, We wrote a very simple stre

MapState bad performance

2020-06-16 Thread nick toker
Hello, We wrote a very simple streaming pipeline containing: 1. Kafka consumer 2. Process function 3. Kafka producer The code of the process function is listed below: private transient MapState testMapState; @Override public void processElement(Map value, Context ctx, Collector> out) throws