[jira] [Commented] (CASSANDRA-18344) Store PreAccept, Accept, Commit, and Apply in a durable log before processing by CommandStores

2023-05-04 Thread David Capwell (Jira)


[ 
https://issues.apache.org/jira/browse/CASSANDRA-18344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17719532#comment-17719532
 ] 

David Capwell commented on CASSANDRA-18344:
---

+1

> Store PreAccept, Accept, Commit, and Apply in a durable log before processing 
> by CommandStores
> --
>
> Key: CASSANDRA-18344
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18344
> Project: Cassandra
>  Issue Type: New Feature
>  Components: Accord
>Reporter: Aleksey Yeschenko
>Assignee: Aleksey Yeschenko
>Priority: Normal
> Fix For: 5.x
>
>  Time Spent: 17h
>  Remaining Estimate: 0h
>
> Write PreAccept, Accept, Commit, and Apply messages durably to a journal.
> CommandStore will then processes the messages in write order.
>  
> This is a prerequisite JIRA for several incoming improvements, such as 
> reducing the data we store in system tables, making command stores and 
> progress log persistent, simplifying caching.
> The journal supports invalidating individual entries by id and sets of 
> owners, and looking up records by id, both needed for near-future Accord work.
>  
> Several complete/near-complete parts of the generic journal implementation 
> have been temporarily taken out until we need them (soon, once 
> bootstrap/state reclamation are implemented).
> These include invalidation support (in memory and on-disk implementations), 
> and segment compaction (not needed without invalidations).
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Commented] (CASSANDRA-18344) Store PreAccept, Accept, Commit, and Apply in a durable log before processing by CommandStores

2023-03-31 Thread Aleksey Yeschenko (Jira)


[ 
https://issues.apache.org/jira/browse/CASSANDRA-18344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17707343#comment-17707343
 ] 

Aleksey Yeschenko commented on CASSANDRA-18344:
---

[https://github.com/apache/cassandra/pull/2256]

Pre-requisite patch-set for several upcoming Accord changes.

Introduces an append-only journal for Accord messages. The journal supports 
invalidating individual entries by id and sets of owners, and looking up 
records by id, among other things.

Several complete/near-complete parts of the generic journal implementation have 
been temporarily taken out until we need them (soon, once bootstrap/state 
reclamation are implemented).

These include:
 * invalidation support (in memory and on-disk implementations), and
 * segment compaction (not needed without invalidations)

PreAccept, Accept, Commit, and Apply are now written to a journal but aren't 
yet being read/used.

Test coverage needs and comments around certain areas need work before commit. 
Coming soon.

> Store PreAccept, Accept, Commit, and Apply in a durable log before processing 
> by CommandStores
> --
>
> Key: CASSANDRA-18344
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18344
> Project: Cassandra
>  Issue Type: New Feature
>  Components: Accord
>Reporter: Aleksey Yeschenko
>Assignee: Aleksey Yeschenko
>Priority: Normal
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> Write PreAccept, Accept, Commit, and Apply messages durably to a journal.
> CommandStore will then processes the messages in write order.
>  
> This is a prerequisite JIRA for several incoming improvements, such as 
> reducing the data we store in system tables, making command stores and 
> progress log persistent, simplifying caching.
> The journal supports invalidating individual entries by id and sets of 
> owners, and looking up records by id, both needed for near-future Accord work.
>  
> Several complete/near-complete parts of the generic journal implementation 
> have been temporarily taken out until we need them (soon, once 
> bootstrap/state reclamation are implemented).
> These include invalidation support (in memory and on-disk implementations), 
> and segment compaction (not needed without invalidations).
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org