Re: [DISCUSS] FLIP-310:use VARINT and ZIGZAG to encode ROWDATA in state

2023-05-11 Thread Xiaogang Zhou
Hi Zakelly, Thanks for replay, I have add some more information in the FLIP document. Please help review and let me know if further evidence is needed.

Re: [DISCUSS] FLIP-310:use VARINT and ZIGZAG to encode ROWDATA in state

2023-05-09 Thread Zakelly Lan
Hi Xiaogang Zhou, Thanks for driving this! I'm pretty interested in your verification test, could you please provide more details? AFAIK, the performance is related to the format of user data and the state size of the RocksDB, as well as the memory setup (determines the proportion of IO required

Re: [DISCUSS] FLIP-310:use VARINT and ZIGZAG to encode ROWDATA in state

2023-05-09 Thread Xiaogang Zhou
Hi Masters, This FLIP is mainly related to the flink-table module, Can you please let me know who can help me review this feature? regards! Xiaogang Zhou 于2023年5月5日周五 15:41写道: > Hi Guys, > > I have created a FLIP WIKI FLIP-310 >

Re: [DISCUSS] FLIP-310:use VARINT and ZIGZAG to encode ROWDATA in state

2023-05-09 Thread Zakelly Lan
Hi Xiaogang Zhou, Thanks for driving this! I'm pretty interested in your verification test, could you please provide more details? AFAIK, the performance is related to the format of user data and the state size of the RocksDB, as well as the memory setup (determines the proportion of IO required

[DISCUSS] FLIP-310:use VARINT and ZIGZAG to encode ROWDATA in state

2023-05-05 Thread Xiaogang Zhou
Hi Guys, I have created a FLIP WIKI FLIP-310 , and documented my thinking about using the varint format in FLINK state to improve the FLINK state performance. Would you please