Re: MapState bad performance

2020-06-20 Thread Congxian Qiu
1a8e758223045f/flink-state-backends/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/RocksDBMapState.java#L254 > > Best > Yun Tang > > -- > *From:* nick toker > *Sent:* Tuesday, June 16, 2020 15:35 > *To:* user@fl

Re: MapState bad performance

2020-06-16 Thread Yun Tang
l.com>> Sent: Tuesday, June 16, 2020 15:35 To: user@flink.apache.org<mailto:user@flink.apache.org> mailto:user@flink.apache.org>> Subject: MapState bad performance Hello, We wrote a very simple streaming pipeline containing: 1. Kafka consumer 2. Process function 3. Kafka producer Th

Re: MapState bad performance

2020-06-16 Thread nick toker
t; > -- > *From:* nick toker > *Sent:* Tuesday, June 16, 2020 15:35 > *To:* user@flink.apache.org > *Subject:* MapState bad performance > > Hello, > > We wrote a very simple streaming pipeline containing: > 1. Kafka consumer > 2

Re: MapState bad performance

2020-06-16 Thread Yun Tang
-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/RocksDBMapState.java#L254 Best Yun Tang From: nick toker Sent: Tuesday, June 16, 2020 15:35 To: user@flink.apache.org Subject: MapState bad performance Hello, We wrote a very simple streaming

MapState bad performance

2020-06-16 Thread nick toker
Hello, We wrote a very simple streaming pipeline containing: 1. Kafka consumer 2. Process function 3. Kafka producer The code of the process function is listed below: private transient MapState testMapState; @Override public void processElement(Map value, Context ctx, Collector> out)