[
https://issues.apache.org/jira/browse/CASSANDRA-21632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18110472#comment-18110472
]
Alexandre Viau commented on CASSANDRA-21632:
--------------------------------------------
Hey [~brandon.williams],
> These are in good shape now
Thanks for the reviews! Excited to get attention on this so fast!
> but we'll need patches for 6.0 and trunk
Done!
- For 6.0: https://github.com/apache/cassandra/pull/5091
- For Trunk: https://github.com/apache/cassandra/pull/5092
Not sure if opening the trunk version was really helpful since its the same
thing as 6.0 except the `CHANGES`, but I wanted to make sure you had everything
you needed to move forward. Let me know what I should to next time.
Cheers,
> BTI partition index preload is unbounded
> ----------------------------------------
>
> Key: CASSANDRA-21632
> URL: https://issues.apache.org/jira/browse/CASSANDRA-21632
> Project: Apache Cassandra
> Issue Type: Bug
> Components: Local/SSTable, Local/Startup and Shutdown
> Reporter: Alexandre Viau
> Priority: Normal
> Labels: patch-available
> Fix For: 5.0.x, 6.x, 7.x
>
> Time Spent: 1h 50m
> Remaining Estimate: 0h
>
> When a table has bloom_filter_fp_chance = 1, PartitionIndex.load warms the
> entire Partitions.db by seeking to every 4096-byte offset and reading a
> single byte. The warm is unbounded. Nothing relates the amount read to the
> amount of page cache the node can actually retain
>
> On our cluster (5.4 TiB and 32.5B partitions per node, bloom_filter_fp_chance
> = 1, Partitions.db totalling 309.47 GiB across 798 files, or 81,125,849 pages
> to touch), roughly 70 GiB of page cache is available to the process. The warm
> reads 309 GiB to retain at most a fraction of it, and startup takes roughly
> 90 minutes, essentially all of it in SSTableReader.openAll.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
