[jira] [Commented] (FLINK-29402) Add USE_DIRECT_READ configuration parameter for RocksDB

2022-10-20 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17620916#comment-17620916 ] Yuan Mei commented on FLINK-29402: -- # benchmarking for a pure k-v store ruling out other factors (like

[jira] [Commented] (FLINK-29402) Add USE_DIRECT_READ configuration parameter for RocksDB

2022-10-20 Thread Donatien (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17620901#comment-17620901 ] Donatien commented on FLINK-29402: -- Hey Yuan! This concern of enabling DirectIO for benchmarking came

[jira] [Commented] (FLINK-29402) Add USE_DIRECT_READ configuration parameter for RocksDB

2022-10-20 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17620861#comment-17620861 ] Yuan Mei commented on FLINK-29402: -- [~donaschmi]  * I understand enabling/disabling DirectIO leads to

[jira] [Commented] (FLINK-29402) Add USE_DIRECT_READ configuration parameter for RocksDB

2022-10-03 Thread Donatien (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17612208#comment-17612208 ] Donatien commented on FLINK-29402: -- Thanks for your comment! Considering that Facebook uses DirectIO

[jira] [Commented] (FLINK-29402) Add USE_DIRECT_READ configuration parameter for RocksDB

2022-09-27 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17610081#comment-17610081 ] Yun Tang commented on FLINK-29402: -- Thanks for creating this ticket. From my understanding, this option

[jira] [Commented] (FLINK-29402) Add USE_DIRECT_READ configuration parameter for RocksDB

2022-09-26 Thread Yanfei Lei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17609421#comment-17609421 ] Yanfei Lei commented on FLINK-29402: Thanks for your benchmark results. Comparing the second colunm

[jira] [Commented] (FLINK-29402) Add USE_DIRECT_READ configuration parameter for RocksDB

2022-09-26 Thread Donatien (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17609377#comment-17609377 ] Donatien commented on FLINK-29402: -- I added an image showing the behaviour of an identical job under

[jira] [Commented] (FLINK-29402) Add USE_DIRECT_READ configuration parameter for RocksDB

2022-09-25 Thread Donatien (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17609298#comment-17609298 ] Donatien commented on FLINK-29402: -- Indeed, with RocksDB API it is easy to add this new option (two new

[jira] [Commented] (FLINK-29402) Add USE_DIRECT_READ configuration parameter for RocksDB

2022-09-25 Thread Yanfei Lei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17609277#comment-17609277 ] Yanfei Lei commented on FLINK-29402: This is a very interesting proposal, I think this is not hard