[ 
https://issues.apache.org/jira/browse/CASSANDRA-18111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17904456#comment-17904456
 ] 

Stefan Miklosovic commented on CASSANDRA-18111:
-----------------------------------------------

[CASSANDRA-18111|https://github.com/instaclustr/cassandra/tree/CASSANDRA-18111]
{noformat}
java11_pre-commit_tests                         
  ✓ j11_build                                        8m 13s
  ✓ j11_cqlsh_dtests_py311                          10m 22s
  ✓ j11_cqlsh_dtests_py311_vnode                      8m 6s
  ✓ j11_cqlsh_dtests_py38                            8m 30s
  ✓ j11_cqlsh_dtests_py38_vnode                      11m 7s
  ✓ j11_cqlshlib_cython_tests                        7m 58s
  ✓ j11_cqlshlib_tests                               9m 56s
  ✓ j11_dtests                                      34m 46s
  ✓ j11_dtests_latest                               36m 48s
  ✓ j11_jvm_dtests                                   31m 6s
  ✓ j11_simulator_dtests                              9m 8s
  ✓ j11_unit_tests                                  21m 20s
  ✓ j11_utests_latest                               17m 10s
  ✓ j11_utests_oa                                   17m 32s
  ✓ j11_utests_system_keyspace_directory            17m 44s
  ✓ j17_cqlsh_dtests_py311                            7m 6s
  ✓ j17_cqlsh_dtests_py311_vnode                     7m 36s
  ✓ j17_cqlsh_dtests_py38                             7m 4s
  ✓ j17_cqlsh_dtests_py38_vnode                      7m 25s
  ✓ j17_cqlshlib_cython_tests                       10m 31s
  ✓ j17_cqlshlib_tests                               6m 42s
  ✓ j17_dtests                                      32m 41s
  ✓ j17_dtests_latest                               34m 58s
  ✓ j17_dtests_vnode                                35m 44s
  ✓ j17_unit_tests                                  16m 49s
  ✓ j17_utests_oa                                   16m 56s
  ✕ j11_dtests_vnode                                39m 24s
      counter_test.TestCounters test_counter_node_down
  ✕ j11_jvm_dtests_latest_vnode                     28m 43s
      org.apache.cassandra.distributed.test.tcm.CMSPlacementAfterMoveTest 
testMoveToCMS
  ✕ j17_jvm_dtests                                  27m 51s
      org.apache.cassandra.fuzz.snapshots.SnapshotsTest fuzzySnapshotsTest
  ✕ j17_jvm_dtests_latest_vnode                     25m 30s
      org.apache.cassandra.distributed.test.tcm.CMSPlacementAfterMoveTest 
testMoveToCMS
  ✕ j17_utests_latest                               15m 54s
      org.apache.cassandra.db.guardrails.GuardrailMaximumTimestampTest 
testEnabledWarn
{noformat}

[java11_pre-commit_tests|https://app.circleci.com/pipelines/github/instaclustr/cassandra/5095/workflows/3d04b46e-ed2e-4eec-9847-ebbe2455b298]

I will be dealing with the stability of fuzzySnapshotsTest in a moment.


> Centralize all snapshot operations to SnapshotManager and cache snapshots
> -------------------------------------------------------------------------
>
>                 Key: CASSANDRA-18111
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-18111
>             Project: Apache Cassandra
>          Issue Type: Improvement
>          Components: Local/Snapshots
>            Reporter: Paulo Motta
>            Assignee: Stefan Miklosovic
>            Priority: Normal
>             Fix For: 5.x
>
>          Time Spent: 12h 40m
>  Remaining Estimate: 0h
>
> Everytime {{nodetool listsnapshots}} is called, all data directories are 
> scanned to find snapshots, what is inefficient.
> For example, fetching the 
> {{org.apache.cassandra.metrics:type=ColumnFamily,name=SnapshotsSize}} metric 
> can take half a second (CASSANDRA-13338).
> This improvement will also allow snapshots to be efficiently queried via 
> virtual tables (CASSANDRA-18102).
> In order to do this, we should:
> a) load all snapshots from disk during initialization
> b) keep a collection of snapshots on {{SnapshotManager}}
> c) update the snapshots collection anytime a new snapshot is taken or cleared
> d) detect when a snapshot is manually removed from disk.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to