[jira] [Created] (CASSANDRA-19974) Accord: Fix Test

2024-10-01 Thread Alex Petrov (Jira)
Alex Petrov created CASSANDRA-19974:
---

 Summary: Accord: Fix Test
 Key: CASSANDRA-19974
 URL: https://issues.apache.org/jira/browse/CASSANDRA-19974
 Project: Cassandra
  Issue Type: Bug
Reporter: Alex Petrov






--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19877) Accord Journal Compaction / Purging

2024-09-30 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19877:

Attachment: ci_summary-1.html

> Accord Journal Compaction / Purging
> ---
>
> Key: CASSANDRA-19877
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19877
> Project: Cassandra
>  Issue Type: New Feature
>  Components: Accord
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: High
> Fix For: 5.1
>
> Attachments: ci_summary-1.html, ci_summary.html, 
> result_details.tar-1.gz, result_details.tar.gz
>
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19877) Accord Journal Compaction / Purging

2024-09-30 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19877:

Attachment: result_details.tar-1.gz

> Accord Journal Compaction / Purging
> ---
>
> Key: CASSANDRA-19877
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19877
> Project: Cassandra
>  Issue Type: New Feature
>  Components: Accord
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: High
> Fix For: 5.1
>
> Attachments: ci_summary-1.html, ci_summary.html, 
> result_details.tar-1.gz, result_details.tar.gz
>
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19869) Implement command and CFK reloading for Accord BurnTest

2024-09-29 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19869:

Attachment: ci_summary-2.html
result_details.tar-2.gz

> Implement command and CFK reloading for Accord BurnTest 
> 
>
> Key: CASSANDRA-19869
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19869
> Project: Cassandra
>  Issue Type: New Feature
>  Components: Accord
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: High
> Fix For: 5.1
>
> Attachments: ci_summary-1.html, ci_summary-2.html, ci_summary.html, 
> result_details.tar-1.gz, result_details.tar-2.gz, result_details.tar.gz
>
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19869) Implement command and CFK reloading for Accord BurnTest

2024-09-27 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19869:

Attachment: ci_summary-1.html
result_details.tar-1.gz

> Implement command and CFK reloading for Accord BurnTest 
> 
>
> Key: CASSANDRA-19869
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19869
> Project: Cassandra
>  Issue Type: New Feature
>  Components: Accord
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: High
> Fix For: 5.1
>
> Attachments: ci_summary-1.html, ci_summary.html, 
> result_details.tar-1.gz, result_details.tar.gz
>
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19877) Accord Journal Compaction / Purging

2024-09-18 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19877:

Attachment: ci_summary.html
result_details.tar.gz

> Accord Journal Compaction / Purging
> ---
>
> Key: CASSANDRA-19877
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19877
> Project: Cassandra
>  Issue Type: New Feature
>  Components: Accord
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: High
> Fix For: 5.1
>
> Attachments: ci_summary.html, result_details.tar.gz
>
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19877) Accord Journal Compaction / Purging

2024-09-16 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19877:

Reviewers: Aleksey Yeschenko
   Status: Review In Progress  (was: Patch Available)

> Accord Journal Compaction / Purging
> ---
>
> Key: CASSANDRA-19877
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19877
> Project: Cassandra
>  Issue Type: New Feature
>  Components: Accord
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: High
> Fix For: 5.1
>
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19877) Accord Journal Compaction / Purging

2024-09-16 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19877:

Test and Documentation Plan: covered by existing tests (ish)
 Status: Patch Available  (was: Open)

> Accord Journal Compaction / Purging
> ---
>
> Key: CASSANDRA-19877
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19877
> Project: Cassandra
>  Issue Type: New Feature
>  Components: Accord
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: High
> Fix For: 5.1
>
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19877) Accord Journal Compaction / Purging

2024-09-16 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19877:

Summary: Accord Journal Compaction / Purging  (was: TBD)

> Accord Journal Compaction / Purging
> ---
>
> Key: CASSANDRA-19877
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19877
> Project: Cassandra
>  Issue Type: New Feature
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: Normal
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19877) Accord Journal Compaction / Purging

2024-09-16 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19877:

Change Category: Semantic
 Complexity: Normal
Component/s: Accord
  Fix Version/s: 5.1
   Priority: High  (was: Normal)
 Status: Open  (was: Triage Needed)

> Accord Journal Compaction / Purging
> ---
>
> Key: CASSANDRA-19877
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19877
> Project: Cassandra
>  Issue Type: New Feature
>  Components: Accord
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: High
> Fix For: 5.1
>
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Commented] (CASSANDRA-19876) SSTable-Backed Accord Journal Segment

2024-09-16 Thread Alex Petrov (Jira)


[ 
https://issues.apache.org/jira/browse/CASSANDRA-19876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17882168#comment-17882168
 ] 

Alex Petrov commented on CASSANDRA-19876:
-

+1 from Aleksey in PR


> SSTable-Backed Accord Journal Segment
> -
>
> Key: CASSANDRA-19876
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19876
> Project: Cassandra
>  Issue Type: New Feature
>  Components: Accord
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: High
> Fix For: 5.1
>
> Attachments: ci_summary-1.html, ci_summary-2.html, ci_summary.html, 
> result_details.tar-1.gz, result_details.tar-2.gz, result_details.tar.gz
>
>  Time Spent: 2h
>  Remaining Estimate: 0h
>
> Add an ability to flush Journal segments to SSTables, and to read data from 
> these SSTable-backed segments.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19876) SSTable-Backed Accord Journal Segment

2024-09-16 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19876:

  Fix Version/s: 5.1
Source Control Link: 
https://github.com/apache/cassandra/commit/c831042910fce4b2ce1a92a0d86c2003d44b853f
 Resolution: Fixed
 Status: Resolved  (was: Ready to Commit)

> SSTable-Backed Accord Journal Segment
> -
>
> Key: CASSANDRA-19876
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19876
> Project: Cassandra
>  Issue Type: New Feature
>  Components: Accord
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: High
> Fix For: 5.1
>
> Attachments: ci_summary-1.html, ci_summary-2.html, ci_summary.html, 
> result_details.tar-1.gz, result_details.tar-2.gz, result_details.tar.gz
>
>  Time Spent: 2h
>  Remaining Estimate: 0h
>
> Add an ability to flush Journal segments to SSTables, and to read data from 
> these SSTable-backed segments.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19876) SSTable-Backed Accord Journal Segment

2024-09-16 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19876:

Status: Ready to Commit  (was: Review In Progress)

> SSTable-Backed Accord Journal Segment
> -
>
> Key: CASSANDRA-19876
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19876
> Project: Cassandra
>  Issue Type: New Feature
>  Components: Accord
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: High
> Attachments: ci_summary-1.html, ci_summary-2.html, ci_summary.html, 
> result_details.tar-1.gz, result_details.tar-2.gz, result_details.tar.gz
>
>  Time Spent: 2h
>  Remaining Estimate: 0h
>
> Add an ability to flush Journal segments to SSTables, and to read data from 
> these SSTable-backed segments.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19876) SSTable-Backed Accord Journal Segment

2024-09-16 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19876:

Test and Documentation Plan: includes tests
 Status: Patch Available  (was: Open)

> SSTable-Backed Accord Journal Segment
> -
>
> Key: CASSANDRA-19876
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19876
> Project: Cassandra
>  Issue Type: New Feature
>  Components: Accord
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: High
> Attachments: ci_summary-1.html, ci_summary-2.html, ci_summary.html, 
> result_details.tar-1.gz, result_details.tar-2.gz, result_details.tar.gz
>
>  Time Spent: 2h
>  Remaining Estimate: 0h
>
> Add an ability to flush Journal segments to SSTables, and to read data from 
> these SSTable-backed segments.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19876) SSTable-Backed Accord Journal Segment

2024-09-16 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19876:

Status: Review In Progress  (was: Patch Available)

> SSTable-Backed Accord Journal Segment
> -
>
> Key: CASSANDRA-19876
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19876
> Project: Cassandra
>  Issue Type: New Feature
>  Components: Accord
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: High
> Attachments: ci_summary-1.html, ci_summary-2.html, ci_summary.html, 
> result_details.tar-1.gz, result_details.tar-2.gz, result_details.tar.gz
>
>  Time Spent: 2h
>  Remaining Estimate: 0h
>
> Add an ability to flush Journal segments to SSTables, and to read data from 
> these SSTable-backed segments.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19876) SSTable-Backed Accord Journal Segment

2024-09-16 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19876:

Change Category: Semantic
 Complexity: Normal
Component/s: Accord
   Priority: High  (was: Normal)
 Status: Open  (was: Triage Needed)

> SSTable-Backed Accord Journal Segment
> -
>
> Key: CASSANDRA-19876
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19876
> Project: Cassandra
>  Issue Type: New Feature
>  Components: Accord
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: High
> Attachments: ci_summary-1.html, ci_summary-2.html, ci_summary.html, 
> result_details.tar-1.gz, result_details.tar-2.gz, result_details.tar.gz
>
>  Time Spent: 2h
>  Remaining Estimate: 0h
>
> Add an ability to flush Journal segments to SSTables, and to read data from 
> these SSTable-backed segments.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19876) SSTable-Backed Accord Journal Segment

2024-09-16 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19876:

Attachment: result_details.tar-2.gz

> SSTable-Backed Accord Journal Segment
> -
>
> Key: CASSANDRA-19876
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19876
> Project: Cassandra
>  Issue Type: New Feature
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: Normal
> Attachments: ci_summary-1.html, ci_summary-2.html, ci_summary.html, 
> result_details.tar-1.gz, result_details.tar-2.gz, result_details.tar.gz
>
>  Time Spent: 2h
>  Remaining Estimate: 0h
>
> Add an ability to flush Journal segments to SSTables, and to read data from 
> these SSTable-backed segments.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19876) SSTable-Backed Accord Journal Segment

2024-09-16 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19876:

Attachment: ci_summary-2.html

> SSTable-Backed Accord Journal Segment
> -
>
> Key: CASSANDRA-19876
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19876
> Project: Cassandra
>  Issue Type: New Feature
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: Normal
> Attachments: ci_summary-1.html, ci_summary-2.html, ci_summary.html, 
> result_details.tar-1.gz, result_details.tar-2.gz, result_details.tar.gz
>
>  Time Spent: 2h
>  Remaining Estimate: 0h
>
> Add an ability to flush Journal segments to SSTables, and to read data from 
> these SSTable-backed segments.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19870) Accord: DefaultProgressLog

2024-09-16 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19870:

Attachment: ci_summary-1.html

> Accord: DefaultProgressLog
> --
>
> Key: CASSANDRA-19870
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19870
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Accord
>Reporter: Benedict Elliott Smith
>Priority: Normal
> Attachments: ci_summary-1.html, ci_summary.html, result_details.tar.gz
>
>
> Redesign progress mechanisms to be memory efficient, use fewer messages and 
> to resolve dependency chains promptly.
> The SimpleProgressLog had a number of problems:
> # It polled for progress with no attempt to determine whether progress could 
> realistically be made, so:
> ## as the number of pending transactions grew, the proportion of useful work 
> dropped (as many would be unable to make progress without earlier 
> transactions completing)
> ## each transaction in the chain could recover only on average 1/2 poll 
> interval behind the last transaction to complete
> # It requested full transaction state from every replica on each attempt
> # It maintained a lot of in-memory state
> # Polling happened en-masse, allowing for little per-transaction control
> We also separately maintained fairly expensive per-command listener state 
> that negatively affected our command loading and caching.
> The new DefaultProgressLog makes use of several new features: LocalListeners, 
> RemoteListeners, Timers and Await messages.
> - LocalListeners provide a memory-efficient collection for managing each 
> CommandStore’s transaction listeners, with dedicated record keeping for 
> inter-transaction relationships.
> - RemoteListeners provide a mechanism for request/response pairs that may be 
> separated by longer than the normal Cassandra message timeout, and require 
> minimal state on sender and recipient. This permits replicas to cheaply 
> update their local state machine as soon as distributed information becomes 
> available.
> The DefaultProgressLog tracks each transaction with separate timers to handle 
> per-transaction scheduling, backoff etc, and a succinct state machine. To 
> reduce overhead correspondence is preferentially limited to a handful of 
> replicas, and limited to the home shard where appropriate.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19870) Accord: DefaultProgressLog

2024-09-16 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19870:

Attachment: result_details.tar.gz

> Accord: DefaultProgressLog
> --
>
> Key: CASSANDRA-19870
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19870
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Accord
>Reporter: Benedict Elliott Smith
>Priority: Normal
> Attachments: ci_summary-1.html, ci_summary.html, result_details.tar.gz
>
>
> Redesign progress mechanisms to be memory efficient, use fewer messages and 
> to resolve dependency chains promptly.
> The SimpleProgressLog had a number of problems:
> # It polled for progress with no attempt to determine whether progress could 
> realistically be made, so:
> ## as the number of pending transactions grew, the proportion of useful work 
> dropped (as many would be unable to make progress without earlier 
> transactions completing)
> ## each transaction in the chain could recover only on average 1/2 poll 
> interval behind the last transaction to complete
> # It requested full transaction state from every replica on each attempt
> # It maintained a lot of in-memory state
> # Polling happened en-masse, allowing for little per-transaction control
> We also separately maintained fairly expensive per-command listener state 
> that negatively affected our command loading and caching.
> The new DefaultProgressLog makes use of several new features: LocalListeners, 
> RemoteListeners, Timers and Await messages.
> - LocalListeners provide a memory-efficient collection for managing each 
> CommandStore’s transaction listeners, with dedicated record keeping for 
> inter-transaction relationships.
> - RemoteListeners provide a mechanism for request/response pairs that may be 
> separated by longer than the normal Cassandra message timeout, and require 
> minimal state on sender and recipient. This permits replicas to cheaply 
> update their local state machine as soon as distributed information becomes 
> available.
> The DefaultProgressLog tracks each transaction with separate timers to handle 
> per-transaction scheduling, backoff etc, and a succinct state machine. To 
> reduce overhead correspondence is preferentially limited to a handful of 
> replicas, and limited to the home shard where appropriate.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19876) SSTable-Backed Accord Journal Segment

2024-09-13 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19876:

Attachment: ci_summary-1.html

> SSTable-Backed Accord Journal Segment
> -
>
> Key: CASSANDRA-19876
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19876
> Project: Cassandra
>  Issue Type: New Feature
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: Normal
> Attachments: ci_summary-1.html, ci_summary.html, 
> result_details.tar-1.gz, result_details.tar.gz
>
>  Time Spent: 1h 50m
>  Remaining Estimate: 0h
>
> Add an ability to flush Journal segments to SSTables, and to read data from 
> these SSTable-backed segments.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19876) SSTable-Backed Accord Journal Segment

2024-09-13 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19876:

Attachment: result_details.tar-1.gz

> SSTable-Backed Accord Journal Segment
> -
>
> Key: CASSANDRA-19876
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19876
> Project: Cassandra
>  Issue Type: New Feature
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: Normal
> Attachments: ci_summary-1.html, ci_summary.html, 
> result_details.tar-1.gz, result_details.tar.gz
>
>  Time Spent: 1h 50m
>  Remaining Estimate: 0h
>
> Add an ability to flush Journal segments to SSTables, and to read data from 
> these SSTable-backed segments.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19866) Fix Journal segment allocation/switch race condition

2024-09-09 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19866:

Reviewers: Aleksey Yeschenko, Alex Petrov
   Status: Review In Progress  (was: Patch Available)

> Fix Journal segment allocation/switch race condition
> 
>
> Key: CASSANDRA-19866
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19866
> Project: Cassandra
>  Issue Type: Bug
>  Components: Accord
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: Normal
> Attachments: ci_summary.html, result_details.tar.gz
>
>
> Concurrent r/w workload is currently throwing:
> {code}
> java.lang.IllegalArgumentException: Can not reference segment 1724695101990
> at org.apache.cassandra.journal.Segments.isFlushed(Segments.java:189)
> at org.apache.cassandra.journal.Journal.isFlushed(Journal.java:199)
> at 
> org.apache.cassandra.journal.Journal$FlusherCallbacks.submit(Journal.java:151)
> at org.apache.cassandra.journal.Journal.onFlush(Journal.java:204)
> at 
> org.apache.cassandra.service.accord.AccordJournal.appendCommand(AccordJournal.java:264)
> at 
> org.apache.cassandra.service.accord.AccordCommandStore.appendCommands(AccordCommandStore.java:579)
> at 
> org.apache.cassandra.service.accord.async.AsyncOperation.runInternal(AsyncOperation.java:277)
> at 
> org.apache.cassandra.service.accord.async.AsyncOperation.run(AsyncOperation.java:303)
> at 
> org.apache.cassandra.service.accord.async.AsyncOperation.onLoaded(AsyncOperation.java:169)
> at 
> accord.utils.async.AsyncCallbacks.lambda$inExecutorService$0(AsyncCallbacks.java:36)
> at 
> org.apache.cassandra.concurrent.ExecutionFailure$1.run(ExecutionFailure.java:133)
> at 
> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
> at 
> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
> at 
> io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
> at java.base/java.lang.Thread.run(Thread.java:829)
> {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19867) Fix a problem with static segments being opened with an empty offset after switch unless active segments offset file was closed

2024-09-09 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19867:

Attachment: ci_summary.html

> Fix a problem with static segments being opened with an empty offset after 
> switch unless active segments offset file was closed
> ---
>
> Key: CASSANDRA-19867
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19867
> Project: Cassandra
>  Issue Type: Bug
>  Components: Accord
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: Normal
> Attachments: ci_summary.html, result_details.tar.gz
>
>
> Buffer backing the writer for segment offsets is not flushed to disk before 
> being fsynced



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19865) Fix CompacctionAccordIteratorTest, switch Journal to streaming serialization

2024-08-30 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19865:

  Fix Version/s: 5.1
 (was: 5.x)
Source Control Link: 
https://github.com/apache/cassandra/commit/059ce88143b55e3345bc49c69b20a9fb62d27567
 Resolution: Fixed
 Status: Resolved  (was: Ready to Commit)

> Fix CompacctionAccordIteratorTest, switch Journal to streaming serialization
> 
>
> Key: CASSANDRA-19865
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19865
> Project: Cassandra
>  Issue Type: Improvement
>  Components: CI
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: Normal
> Fix For: 5.1
>
> Attachments: ci_summary-1.html, ci_summary.html, 
> result_details.tar-1.gz, result_details.tar.gz
>
>  Time Spent: 1.5h
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19866) Fix Journal segment allocation/switch race condition

2024-08-30 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19866:

Test and Documentation Plan: Covered by existing tests
 Status: Patch Available  (was: Open)

> Fix Journal segment allocation/switch race condition
> 
>
> Key: CASSANDRA-19866
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19866
> Project: Cassandra
>  Issue Type: Bug
>  Components: Accord
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: Normal
>
> Concurrent r/w workload is currently throwing:
> {code}
> java.lang.IllegalArgumentException: Can not reference segment 1724695101990
> at org.apache.cassandra.journal.Segments.isFlushed(Segments.java:189)
> at org.apache.cassandra.journal.Journal.isFlushed(Journal.java:199)
> at 
> org.apache.cassandra.journal.Journal$FlusherCallbacks.submit(Journal.java:151)
> at org.apache.cassandra.journal.Journal.onFlush(Journal.java:204)
> at 
> org.apache.cassandra.service.accord.AccordJournal.appendCommand(AccordJournal.java:264)
> at 
> org.apache.cassandra.service.accord.AccordCommandStore.appendCommands(AccordCommandStore.java:579)
> at 
> org.apache.cassandra.service.accord.async.AsyncOperation.runInternal(AsyncOperation.java:277)
> at 
> org.apache.cassandra.service.accord.async.AsyncOperation.run(AsyncOperation.java:303)
> at 
> org.apache.cassandra.service.accord.async.AsyncOperation.onLoaded(AsyncOperation.java:169)
> at 
> accord.utils.async.AsyncCallbacks.lambda$inExecutorService$0(AsyncCallbacks.java:36)
> at 
> org.apache.cassandra.concurrent.ExecutionFailure$1.run(ExecutionFailure.java:133)
> at 
> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
> at 
> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
> at 
> io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
> at java.base/java.lang.Thread.run(Thread.java:829)
> {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Commented] (CASSANDRA-19871) Add size to the segment index for safer journal reads

2024-08-30 Thread Alex Petrov (Jira)


[ 
https://issues.apache.org/jira/browse/CASSANDRA-19871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17878038#comment-17878038
 ] 

Alex Petrov commented on CASSANDRA-19871:
-

Committed as 
[e9baf3e01799f4e026b1fad6543c2825310ecdca|https://github.com/apache/cassandra/commit/e9baf3e01799f4e026b1fad6543c2825310ecdca]
 to {{cep-15-accord}}

> Add size to the segment index for safer journal reads
> -
>
> Key: CASSANDRA-19871
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19871
> Project: Cassandra
>  Issue Type: New Feature
>  Components: Accord
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: Normal
> Attachments: ci_summary.html, result_details.tar.gz
>
>  Time Spent: 40m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19866) Fix Journal segment allocation/switch race condition

2024-08-30 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19866:

 Bug Category: Parent values: Availability(12983)Level 1 values: Response 
Crash(12991)
   Complexity: Normal
Discovered By: Adhoc Test
 Severity: Normal
   Status: Open  (was: Triage Needed)

> Fix Journal segment allocation/switch race condition
> 
>
> Key: CASSANDRA-19866
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19866
> Project: Cassandra
>  Issue Type: Bug
>  Components: Accord
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: Normal
>
> Concurrent r/w workload is currently throwing:
> {code}
> java.lang.IllegalArgumentException: Can not reference segment 1724695101990
> at org.apache.cassandra.journal.Segments.isFlushed(Segments.java:189)
> at org.apache.cassandra.journal.Journal.isFlushed(Journal.java:199)
> at 
> org.apache.cassandra.journal.Journal$FlusherCallbacks.submit(Journal.java:151)
> at org.apache.cassandra.journal.Journal.onFlush(Journal.java:204)
> at 
> org.apache.cassandra.service.accord.AccordJournal.appendCommand(AccordJournal.java:264)
> at 
> org.apache.cassandra.service.accord.AccordCommandStore.appendCommands(AccordCommandStore.java:579)
> at 
> org.apache.cassandra.service.accord.async.AsyncOperation.runInternal(AsyncOperation.java:277)
> at 
> org.apache.cassandra.service.accord.async.AsyncOperation.run(AsyncOperation.java:303)
> at 
> org.apache.cassandra.service.accord.async.AsyncOperation.onLoaded(AsyncOperation.java:169)
> at 
> accord.utils.async.AsyncCallbacks.lambda$inExecutorService$0(AsyncCallbacks.java:36)
> at 
> org.apache.cassandra.concurrent.ExecutionFailure$1.run(ExecutionFailure.java:133)
> at 
> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
> at 
> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
> at 
> io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
> at java.base/java.lang.Thread.run(Thread.java:829)
> {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19871) Add size to the segment index for safer journal reads

2024-08-30 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19871:

Resolution: Fixed
Status: Resolved  (was: Triage Needed)

> Add size to the segment index for safer journal reads
> -
>
> Key: CASSANDRA-19871
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19871
> Project: Cassandra
>  Issue Type: New Feature
>  Components: Accord
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: Normal
> Attachments: ci_summary.html, result_details.tar.gz
>
>  Time Spent: 40m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Created] (CASSANDRA-19877) TBD

2024-08-29 Thread Alex Petrov (Jira)
Alex Petrov created CASSANDRA-19877:
---

 Summary: TBD
 Key: CASSANDRA-19877
 URL: https://issues.apache.org/jira/browse/CASSANDRA-19877
 Project: Cassandra
  Issue Type: New Feature
Reporter: Alex Petrov






--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19876) SSTable-Backed Accord Journal Segment

2024-08-29 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19876:

Attachment: result_details.tar.gz

> SSTable-Backed Accord Journal Segment
> -
>
> Key: CASSANDRA-19876
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19876
> Project: Cassandra
>  Issue Type: New Feature
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: Normal
> Attachments: ci_summary.html, result_details.tar.gz
>
>
> Add an ability to flush Journal segments to SSTables, and to read data from 
> these SSTable-backed segments.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19876) SSTable-Backed Accord Journal Segment

2024-08-29 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19876:

Attachment: ci_summary.html

> SSTable-Backed Accord Journal Segment
> -
>
> Key: CASSANDRA-19876
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19876
> Project: Cassandra
>  Issue Type: New Feature
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: Normal
> Attachments: ci_summary.html
>
>
> Add an ability to flush Journal segments to SSTables, and to read data from 
> these SSTable-backed segments.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19865) Fix CompacctionAccordIteratorTest, switch Journal to streaming serialization

2024-08-28 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19865:

Attachment: result_details.tar-1.gz

> Fix CompacctionAccordIteratorTest, switch Journal to streaming serialization
> 
>
> Key: CASSANDRA-19865
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19865
> Project: Cassandra
>  Issue Type: Improvement
>  Components: CI
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: Normal
> Fix For: 5.x
>
> Attachments: ci_summary-1.html, ci_summary.html, 
> result_details.tar-1.gz, result_details.tar.gz
>
>  Time Spent: 1h 20m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19865) Fix CompacctionAccordIteratorTest, switch Journal to streaming serialization

2024-08-28 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19865:

Attachment: ci_summary-1.html

> Fix CompacctionAccordIteratorTest, switch Journal to streaming serialization
> 
>
> Key: CASSANDRA-19865
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19865
> Project: Cassandra
>  Issue Type: Improvement
>  Components: CI
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: Normal
> Fix For: 5.x
>
> Attachments: ci_summary-1.html, ci_summary.html, 
> result_details.tar-1.gz, result_details.tar.gz
>
>  Time Spent: 1h 20m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Assigned] (CASSANDRA-19876) SSTable-Backed Accord Journal Segment

2024-08-28 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov reassigned CASSANDRA-19876:
---

Assignee: Alex Petrov

> SSTable-Backed Accord Journal Segment
> -
>
> Key: CASSANDRA-19876
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19876
> Project: Cassandra
>  Issue Type: New Feature
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: Normal
>
> Add an ability to flush Journal segments to SSTables, and to read data from 
> these SSTable-backed segments.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19876) SSTable-Backed Accord Journal Segment

2024-08-28 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19876:

Summary: SSTable-Backed Accord Journal Segment  (was: TBD)

> SSTable-Backed Accord Journal Segment
> -
>
> Key: CASSANDRA-19876
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19876
> Project: Cassandra
>  Issue Type: New Feature
>Reporter: Alex Petrov
>Priority: Normal
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19876) SSTable-Backed Accord Journal Segment

2024-08-28 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19876:

Description: 
Add an ability to flush Journal segments to SSTables, and to read data from 
these SSTable-backed segments.


> SSTable-Backed Accord Journal Segment
> -
>
> Key: CASSANDRA-19876
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19876
> Project: Cassandra
>  Issue Type: New Feature
>Reporter: Alex Petrov
>Priority: Normal
>
> Add an ability to flush Journal segments to SSTables, and to read data from 
> these SSTable-backed segments.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19875) CFK Serializer buffer underflow

2024-08-28 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19875:

Description: 
{code}
java.lang.AssertionError: 6884646163227752822 seed failed

at 
org.apache.cassandra.service.accord.serializers.CommandsForKeySerializerTest.testOne(CommandsForKeySerializerTest.java:487)
at 
org.apache.cassandra.service.accord.serializers.CommandsForKeySerializerTest.serde(CommandsForKeySerializerTest.java:359)
at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
{code}


> CFK Serializer buffer underflow
> ---
>
> Key: CASSANDRA-19875
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19875
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Alex Petrov
>Priority: Normal
>
> {code}
> java.lang.AssertionError: 6884646163227752822 seed failed
>   at 
> org.apache.cassandra.service.accord.serializers.CommandsForKeySerializerTest.testOne(CommandsForKeySerializerTest.java:487)
>   at 
> org.apache.cassandra.service.accord.serializers.CommandsForKeySerializerTest.serde(CommandsForKeySerializerTest.java:359)
>   at 
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Assigned] (CASSANDRA-19875) CFK Serializer buffer underflow

2024-08-28 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov reassigned CASSANDRA-19875:
---

Assignee: Alex Petrov

> CFK Serializer buffer underflow
> ---
>
> Key: CASSANDRA-19875
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19875
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: Normal
>
> {code}
> java.lang.AssertionError: 6884646163227752822 seed failed
>   at 
> org.apache.cassandra.service.accord.serializers.CommandsForKeySerializerTest.testOne(CommandsForKeySerializerTest.java:487)
>   at 
> org.apache.cassandra.service.accord.serializers.CommandsForKeySerializerTest.serde(CommandsForKeySerializerTest.java:359)
>   at 
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19875) CFK Serializer buffer underflow

2024-08-28 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19875:

Summary: CFK Serializer buffer underflow  (was: Bugfix)

> CFK Serializer buffer underflow
> ---
>
> Key: CASSANDRA-19875
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19875
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Alex Petrov
>Priority: Normal
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Created] (CASSANDRA-19876) TBD

2024-08-28 Thread Alex Petrov (Jira)
Alex Petrov created CASSANDRA-19876:
---

 Summary: TBD
 Key: CASSANDRA-19876
 URL: https://issues.apache.org/jira/browse/CASSANDRA-19876
 Project: Cassandra
  Issue Type: New Feature
Reporter: Alex Petrov






--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Created] (CASSANDRA-19875) Bugfix

2024-08-28 Thread Alex Petrov (Jira)
Alex Petrov created CASSANDRA-19875:
---

 Summary: Bugfix
 Key: CASSANDRA-19875
 URL: https://issues.apache.org/jira/browse/CASSANDRA-19875
 Project: Cassandra
  Issue Type: Bug
Reporter: Alex Petrov






--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19869) Implement command and CFK reloading for Accord BurnTest

2024-08-28 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19869:

Attachment: result_details.tar.gz

> Implement command and CFK reloading for Accord BurnTest 
> 
>
> Key: CASSANDRA-19869
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19869
> Project: Cassandra
>  Issue Type: New Feature
>  Components: Accord
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: High
> Fix For: 5.1
>
> Attachments: ci_summary.html, result_details.tar.gz
>
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19869) Implement command and CFK reloading for Accord BurnTest

2024-08-28 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19869:

Attachment: ci_summary.html

> Implement command and CFK reloading for Accord BurnTest 
> 
>
> Key: CASSANDRA-19869
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19869
> Project: Cassandra
>  Issue Type: New Feature
>  Components: Accord
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: High
> Fix For: 5.1
>
> Attachments: ci_summary.html, result_details.tar.gz
>
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Commented] (CASSANDRA-19871) Add size to the segment index for safer journal reads

2024-08-28 Thread Alex Petrov (Jira)


[ 
https://issues.apache.org/jira/browse/CASSANDRA-19871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17877414#comment-17877414
 ] 

Alex Petrov commented on CASSANDRA-19871:
-

Uploaded CI results. CompactionIterator accord tests are fixed in 
[CASSANDRA-19865], and {{AccordIncrementalRepairTest}} seems to just be flaky. 
Passed several times locally. 

> Add size to the segment index for safer journal reads
> -
>
> Key: CASSANDRA-19871
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19871
> Project: Cassandra
>  Issue Type: New Feature
>  Components: Accord
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: Normal
> Attachments: ci_summary.html, result_details.tar.gz
>
>  Time Spent: 40m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19871) Add size to the segment index for safer journal reads

2024-08-28 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19871:

Attachment: result_details.tar.gz

> Add size to the segment index for safer journal reads
> -
>
> Key: CASSANDRA-19871
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19871
> Project: Cassandra
>  Issue Type: New Feature
>  Components: Accord
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: Normal
> Attachments: ci_summary.html, result_details.tar.gz
>
>  Time Spent: 40m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19871) Add size to the segment index for safer journal reads

2024-08-28 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19871:

Attachment: ci_summary.html

> Add size to the segment index for safer journal reads
> -
>
> Key: CASSANDRA-19871
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19871
> Project: Cassandra
>  Issue Type: New Feature
>  Components: Accord
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: Normal
> Attachments: ci_summary.html, result_details.tar.gz
>
>  Time Spent: 40m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19865) Fix CompacctionAccordIteratorTest, switch Journal to streaming serialization

2024-08-27 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19865:

Attachment: ci_summary.html

> Fix CompacctionAccordIteratorTest, switch Journal to streaming serialization
> 
>
> Key: CASSANDRA-19865
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19865
> Project: Cassandra
>  Issue Type: Improvement
>  Components: CI
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: Normal
> Fix For: 5.x
>
> Attachments: ci_summary.html, result_details.tar.gz
>
>  Time Spent: 0.5h
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19865) Fix CompacctionAccordIteratorTest, switch Journal to streaming serialization

2024-08-27 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19865:

Attachment: result_details.tar.gz

> Fix CompacctionAccordIteratorTest, switch Journal to streaming serialization
> 
>
> Key: CASSANDRA-19865
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19865
> Project: Cassandra
>  Issue Type: Improvement
>  Components: CI
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: Normal
> Fix For: 5.x
>
> Attachments: result_details.tar.gz
>
>  Time Spent: 0.5h
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19869) Implement command and CFK reloading for Accord BurnTest

2024-08-27 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19869:

Change Category: Operability
 Complexity: Challenging
  Fix Version/s: 5.1
  Reviewers: Benedict Elliott Smith
   Priority: High  (was: Normal)
 Status: Open  (was: Triage Needed)

> Implement command and CFK reloading for Accord BurnTest 
> 
>
> Key: CASSANDRA-19869
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19869
> Project: Cassandra
>  Issue Type: New Feature
>  Components: Accord
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: High
> Fix For: 5.1
>
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Created] (CASSANDRA-19871) Add size to the segment index for safer journal reads

2024-08-27 Thread Alex Petrov (Jira)
Alex Petrov created CASSANDRA-19871:
---

 Summary: Add size to the segment index for safer journal reads
 Key: CASSANDRA-19871
 URL: https://issues.apache.org/jira/browse/CASSANDRA-19871
 Project: Cassandra
  Issue Type: New Feature
  Components: Accord
Reporter: Alex Petrov






--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19864) Switch to infinite loop executor instead of a while-loop thread

2024-08-27 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19864:

  Since Version: 5.1
Source Control Link: 
https://github.com/apache/cassandra/commit/6b2bd52447f9dd97e890069cb3aa5eb2e53a400f
 Resolution: Fixed
 Status: Resolved  (was: Ready to Commit)

> Switch to infinite loop executor instead of a while-loop thread
> ---
>
> Key: CASSANDRA-19864
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19864
> Project: Cassandra
>  Issue Type: Bug
>  Components: Accord
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: Normal
> Fix For: 5.x
>
> Attachments: ci_summary.html, result_details.tar.gz
>
>
> DelayedRequestProcessor was causing simulation failures because it was 
> running using raw threads rather than an executor.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19790) Add an ability to reconstruct arbitrary epoch state from the log to TCM

2024-08-27 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19790:

Status: Ready to Commit  (was: Review In Progress)

> Add an ability to reconstruct arbitrary epoch state from the log to TCM
> ---
>
> Key: CASSANDRA-19790
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19790
> Project: Cassandra
>  Issue Type: New Feature
>  Components: Transactional Cluster Metadata
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: High
> Fix For: 5.1
>
> Attachments: ci_summary.html, result_details.tar.gz
>
>
> Current Accord functionality requires TCM to be able to provide cluster 
> metadata for an arbitrary epoch. Unfortunately, epochs are not always 
> available locally especially on bootstrapping non-CMS nodes. For this, we 
> need to reconstruct from the log.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19790) Add an ability to reconstruct arbitrary epoch state from the log to TCM

2024-08-27 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19790:

Source Control Link: 
https://github.com/apache/cassandra/commit/b98954f0acb281101d42f76bad18a2051d114692
 Resolution: Fixed
 Status: Resolved  (was: Ready to Commit)

> Add an ability to reconstruct arbitrary epoch state from the log to TCM
> ---
>
> Key: CASSANDRA-19790
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19790
> Project: Cassandra
>  Issue Type: New Feature
>  Components: Transactional Cluster Metadata
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: High
> Fix For: 5.1
>
> Attachments: ci_summary.html, result_details.tar.gz
>
>
> Current Accord functionality requires TCM to be able to provide cluster 
> metadata for an arbitrary epoch. Unfortunately, epochs are not always 
> available locally especially on bootstrapping non-CMS nodes. For this, we 
> need to reconstruct from the log.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19866) Fix Journal segment allocation/switch race condition

2024-08-27 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19866:

Description: 
Concurrent r/w workload is currently throwing:
{code}
java.lang.IllegalArgumentException: Can not reference segment 1724695101990
at org.apache.cassandra.journal.Segments.isFlushed(Segments.java:189)
at org.apache.cassandra.journal.Journal.isFlushed(Journal.java:199)
at 
org.apache.cassandra.journal.Journal$FlusherCallbacks.submit(Journal.java:151)
at org.apache.cassandra.journal.Journal.onFlush(Journal.java:204)
at 
org.apache.cassandra.service.accord.AccordJournal.appendCommand(AccordJournal.java:264)
at 
org.apache.cassandra.service.accord.AccordCommandStore.appendCommands(AccordCommandStore.java:579)
at 
org.apache.cassandra.service.accord.async.AsyncOperation.runInternal(AsyncOperation.java:277)
at 
org.apache.cassandra.service.accord.async.AsyncOperation.run(AsyncOperation.java:303)
at 
org.apache.cassandra.service.accord.async.AsyncOperation.onLoaded(AsyncOperation.java:169)
at 
accord.utils.async.AsyncCallbacks.lambda$inExecutorService$0(AsyncCallbacks.java:36)
at 
org.apache.cassandra.concurrent.ExecutionFailure$1.run(ExecutionFailure.java:133)
at 
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at 
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at 
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Thread.java:829)
{code}

  was:
Concurrent r/w workload is currently throwing:

java.lang.IllegalArgumentException: Can not reference segment 1724695101990
at org.apache.cassandra.journal.Segments.isFlushed(Segments.java:189)
at org.apache.cassandra.journal.Journal.isFlushed(Journal.java:199)
at 
org.apache.cassandra.journal.Journal$FlusherCallbacks.submit(Journal.java:151)
at org.apache.cassandra.journal.Journal.onFlush(Journal.java:204)
at 
org.apache.cassandra.service.accord.AccordJournal.appendCommand(AccordJournal.java:264)
at 
org.apache.cassandra.service.accord.AccordCommandStore.appendCommands(AccordCommandStore.java:579)
at 
org.apache.cassandra.service.accord.async.AsyncOperation.runInternal(AsyncOperation.java:277)
at 
org.apache.cassandra.service.accord.async.AsyncOperation.run(AsyncOperation.java:303)
at 
org.apache.cassandra.service.accord.async.AsyncOperation.onLoaded(AsyncOperation.java:169)
at 
accord.utils.async.AsyncCallbacks.lambda$inExecutorService$0(AsyncCallbacks.java:36)
at 
org.apache.cassandra.concurrent.ExecutionFailure$1.run(ExecutionFailure.java:133)
at 
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at 
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at 
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Thread.java:829)



> Fix Journal segment allocation/switch race condition
> 
>
> Key: CASSANDRA-19866
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19866
> Project: Cassandra
>  Issue Type: Bug
>  Components: Accord
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: Normal
>
> Concurrent r/w workload is currently throwing:
> {code}
> java.lang.IllegalArgumentException: Can not reference segment 1724695101990
> at org.apache.cassandra.journal.Segments.isFlushed(Segments.java:189)
> at org.apache.cassandra.journal.Journal.isFlushed(Journal.java:199)
> at 
> org.apache.cassandra.journal.Journal$FlusherCallbacks.submit(Journal.java:151)
> at org.apache.cassandra.journal.Journal.onFlush(Journal.java:204)
> at 
> org.apache.cassandra.service.accord.AccordJournal.appendCommand(AccordJournal.java:264)
> at 
> org.apache.cassandra.service.accord.AccordCommandStore.appendCommands(AccordCommandStore.java:579)
> at 
> org.apache.cassandra.service.accord.async.AsyncOperation.runInternal(AsyncOperation.java:277)
> at 
> org.apache.cassandra.service.accord.async.AsyncOperation.run(AsyncOperation.java:303)
> at 
> org.apache.cassandra.service.accord.async.AsyncOperation.onLoaded(AsyncOperation.java:169)
> at 
> accord.utils.async.AsyncCallbacks.lambda$inExecutorService$0(AsyncCallbacks.java:36)
> at 
> org.apache.cassandra.concurrent.ExecutionFailure$1.run(ExecutionFailure.java:133)
> at 
> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1

[jira] [Assigned] (CASSANDRA-19869) Implement command and CFK reloading for Accord BurnTest

2024-08-27 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov reassigned CASSANDRA-19869:
---

Assignee: Alex Petrov

> Implement command and CFK reloading for Accord BurnTest 
> 
>
> Key: CASSANDRA-19869
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19869
> Project: Cassandra
>  Issue Type: New Feature
>  Components: Accord
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: Normal
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19869) Implement command and CFK reloading for Accord BurnTest

2024-08-27 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19869:

Summary: Implement command and CFK reloading for Accord BurnTest   (was: 
Implement command and CFK reloading for BurnTest )

> Implement command and CFK reloading for Accord BurnTest 
> 
>
> Key: CASSANDRA-19869
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19869
> Project: Cassandra
>  Issue Type: New Feature
>  Components: Accord
>Reporter: Alex Petrov
>Priority: Normal
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Created] (CASSANDRA-19869) Implement command and CFK reloading for BurnTest

2024-08-27 Thread Alex Petrov (Jira)
Alex Petrov created CASSANDRA-19869:
---

 Summary: Implement command and CFK reloading for BurnTest 
 Key: CASSANDRA-19869
 URL: https://issues.apache.org/jira/browse/CASSANDRA-19869
 Project: Cassandra
  Issue Type: New Feature
  Components: Accord
Reporter: Alex Petrov






--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19864) Switch to infinite loop executor instead of a while-loop thread

2024-08-27 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19864:

Attachment: ci_summary.html

> Switch to infinite loop executor instead of a while-loop thread
> ---
>
> Key: CASSANDRA-19864
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19864
> Project: Cassandra
>  Issue Type: Bug
>  Components: Accord
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: Normal
> Fix For: 5.x
>
> Attachments: ci_summary.html, result_details.tar.gz
>
>
> DelayedRequestProcessor was causing simulation failures because it was 
> running using raw threads rather than an executor.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19864) Switch to infinite loop executor instead of a while-loop thread

2024-08-27 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19864:

Attachment: result_details.tar.gz

> Switch to infinite loop executor instead of a while-loop thread
> ---
>
> Key: CASSANDRA-19864
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19864
> Project: Cassandra
>  Issue Type: Bug
>  Components: Accord
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: Normal
> Fix For: 5.x
>
> Attachments: ci_summary.html, result_details.tar.gz
>
>
> DelayedRequestProcessor was causing simulation failures because it was 
> running using raw threads rather than an executor.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Created] (CASSANDRA-19868) Fix NPE in InformDurableSerializers

2024-08-26 Thread Alex Petrov (Jira)
Alex Petrov created CASSANDRA-19868:
---

 Summary: Fix NPE in InformDurableSerializers
 Key: CASSANDRA-19868
 URL: https://issues.apache.org/jira/browse/CASSANDRA-19868
 Project: Cassandra
  Issue Type: Bug
Reporter: Alex Petrov
Assignee: Alex Petrov


Currently, R/W concurrent workload may throw:
java.lang.NullPointerException: null
at 
org.apache.cassandra.service.accord.serializers.CommandSerializers$TimestampSerializer.serialize(CommandSerializers.java:97)
at 
org.apache.cassandra.service.accord.serializers.InformDurableSerializers$1.serializeBody(InformDurableSerializers.java:39)
at 
org.apache.cassandra.service.accord.serializers.InformDurableSerializers$1.serializeBody(InformDurableSerializers.java:35)
at 
org.apache.cassandra.service.accord.serializers.TxnRequestSerializer.serialize(TxnRequestSerializer.java:46)
at 
org.apache.cassandra.service.accord.serializers.TxnRequestSerializer.serialize(TxnRequestSerializer.java:31)
at 
org.apache.cassandra.net.Message$Serializer.serialize(Message.java:833)
at 
org.apache.cassandra.distributed.impl.Instance.serializeMessage(Instance.java:445)
at 
org.apache.cassandra.distributed.impl.Instance.lambda$registerOutboundFilter$5(Instance.java:388)
at 
org.apache.cassandra.net.OutboundSink$Filtered.accept(OutboundSink.java:54)
at org.apache.cassandra.net.OutboundSink.accept(OutboundSink.java:70)
at 
org.apache.cassandra.net.MessagingService.send(MessagingService.java:534)
at 
org.apache.cassandra.net.MessagingService.send(MessagingService.java:472)
at 
org.apache.cassandra.service.accord.AccordMessageSink.send(AccordMessageSink.java:228)
at accord.local.Node.send(Node.java:526)
at accord.local.Node.lambda$send$8(Node.java:464)
at java.base/java.lang.Iterable.forEach(Iterable.java:75)
at accord.local.Node.send(Node.java:464)
at accord.coordinate.MaybeRecover.onDone(MaybeRecover.java:109)
at accord.coordinate.ReadCoordinator.handle(ReadCoordinator.java:241)
at accord.coordinate.ReadCoordinator.onSuccess(ReadCoordinator.java:145)
at accord.coordinate.ReadCoordinator.onSuccess(ReadCoordinator.java:43)




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19868) Fix NPE in InformDurableSerializers

2024-08-26 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19868:

Description: 
Currently, R/W concurrent workload may throw:
{code}
java.lang.NullPointerException: null
at 
org.apache.cassandra.service.accord.serializers.CommandSerializers$TimestampSerializer.serialize(CommandSerializers.java:97)
at 
org.apache.cassandra.service.accord.serializers.InformDurableSerializers$1.serializeBody(InformDurableSerializers.java:39)
at 
org.apache.cassandra.service.accord.serializers.InformDurableSerializers$1.serializeBody(InformDurableSerializers.java:35)
at 
org.apache.cassandra.service.accord.serializers.TxnRequestSerializer.serialize(TxnRequestSerializer.java:46)
at 
org.apache.cassandra.service.accord.serializers.TxnRequestSerializer.serialize(TxnRequestSerializer.java:31)
at 
org.apache.cassandra.net.Message$Serializer.serialize(Message.java:833)
at 
org.apache.cassandra.distributed.impl.Instance.serializeMessage(Instance.java:445)
at 
org.apache.cassandra.distributed.impl.Instance.lambda$registerOutboundFilter$5(Instance.java:388)
at 
org.apache.cassandra.net.OutboundSink$Filtered.accept(OutboundSink.java:54)
at org.apache.cassandra.net.OutboundSink.accept(OutboundSink.java:70)
at 
org.apache.cassandra.net.MessagingService.send(MessagingService.java:534)
at 
org.apache.cassandra.net.MessagingService.send(MessagingService.java:472)
at 
org.apache.cassandra.service.accord.AccordMessageSink.send(AccordMessageSink.java:228)
at accord.local.Node.send(Node.java:526)
at accord.local.Node.lambda$send$8(Node.java:464)
at java.base/java.lang.Iterable.forEach(Iterable.java:75)
at accord.local.Node.send(Node.java:464)
at accord.coordinate.MaybeRecover.onDone(MaybeRecover.java:109)
at accord.coordinate.ReadCoordinator.handle(ReadCoordinator.java:241)
at accord.coordinate.ReadCoordinator.onSuccess(ReadCoordinator.java:145)
at accord.coordinate.ReadCoordinator.onSuccess(ReadCoordinator.java:43)
{code}


  was:
Currently, R/W concurrent workload may throw:
java.lang.NullPointerException: null
at 
org.apache.cassandra.service.accord.serializers.CommandSerializers$TimestampSerializer.serialize(CommandSerializers.java:97)
at 
org.apache.cassandra.service.accord.serializers.InformDurableSerializers$1.serializeBody(InformDurableSerializers.java:39)
at 
org.apache.cassandra.service.accord.serializers.InformDurableSerializers$1.serializeBody(InformDurableSerializers.java:35)
at 
org.apache.cassandra.service.accord.serializers.TxnRequestSerializer.serialize(TxnRequestSerializer.java:46)
at 
org.apache.cassandra.service.accord.serializers.TxnRequestSerializer.serialize(TxnRequestSerializer.java:31)
at 
org.apache.cassandra.net.Message$Serializer.serialize(Message.java:833)
at 
org.apache.cassandra.distributed.impl.Instance.serializeMessage(Instance.java:445)
at 
org.apache.cassandra.distributed.impl.Instance.lambda$registerOutboundFilter$5(Instance.java:388)
at 
org.apache.cassandra.net.OutboundSink$Filtered.accept(OutboundSink.java:54)
at org.apache.cassandra.net.OutboundSink.accept(OutboundSink.java:70)
at 
org.apache.cassandra.net.MessagingService.send(MessagingService.java:534)
at 
org.apache.cassandra.net.MessagingService.send(MessagingService.java:472)
at 
org.apache.cassandra.service.accord.AccordMessageSink.send(AccordMessageSink.java:228)
at accord.local.Node.send(Node.java:526)
at accord.local.Node.lambda$send$8(Node.java:464)
at java.base/java.lang.Iterable.forEach(Iterable.java:75)
at accord.local.Node.send(Node.java:464)
at accord.coordinate.MaybeRecover.onDone(MaybeRecover.java:109)
at accord.coordinate.ReadCoordinator.handle(ReadCoordinator.java:241)
at accord.coordinate.ReadCoordinator.onSuccess(ReadCoordinator.java:145)
at accord.coordinate.ReadCoordinator.onSuccess(ReadCoordinator.java:43)



> Fix NPE in InformDurableSerializers
> ---
>
> Key: CASSANDRA-19868
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19868
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: Normal
>
> Currently, R/W concurrent workload may throw:
> {code}
> java.lang.NullPointerException: null
>   at 
> org.apache.cassandra.service.accord.serializers.CommandSerializers$TimestampSerializer.serialize(CommandSerializers.java:97)
>   at 
> org.apache.cassandra.service.accord.serializers.InformDurableSerializers$1.serializeBody(InformDurableSerializers.java:39)
>   at 
> org.apache.cassandra.se

[jira] [Assigned] (CASSANDRA-19867) Fix a problem with static segments being opened with an empty offset after switch unless active segments offset file was closed

2024-08-26 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov reassigned CASSANDRA-19867:
---

Assignee: Alex Petrov

> Fix a problem with static segments being opened with an empty offset after 
> switch unless active segments offset file was closed
> ---
>
> Key: CASSANDRA-19867
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19867
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: Normal
>
> Buffer backing the writer for segment offsets is not flushed to disk before 
> being fsynced



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Created] (CASSANDRA-19867) Fix a problem with static segments being opened with an empty offset after switch unless active segments offset file was closed

2024-08-26 Thread Alex Petrov (Jira)
Alex Petrov created CASSANDRA-19867:
---

 Summary: Fix a problem with static segments being opened with an 
empty offset after switch unless active segments offset file was closed
 Key: CASSANDRA-19867
 URL: https://issues.apache.org/jira/browse/CASSANDRA-19867
 Project: Cassandra
  Issue Type: Bug
Reporter: Alex Petrov


Buffer backing the writer for segment offsets is not flushed to disk before 
being fsynced



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Created] (CASSANDRA-19866) Fix Journal segment allocation/switch race condition

2024-08-26 Thread Alex Petrov (Jira)
Alex Petrov created CASSANDRA-19866:
---

 Summary: Fix Journal segment allocation/switch race condition
 Key: CASSANDRA-19866
 URL: https://issues.apache.org/jira/browse/CASSANDRA-19866
 Project: Cassandra
  Issue Type: Bug
  Components: Accord
Reporter: Alex Petrov
Assignee: Alex Petrov


Concurrent r/w workload is currently throwing:

java.lang.IllegalArgumentException: Can not reference segment 1724695101990
at org.apache.cassandra.journal.Segments.isFlushed(Segments.java:189)
at org.apache.cassandra.journal.Journal.isFlushed(Journal.java:199)
at 
org.apache.cassandra.journal.Journal$FlusherCallbacks.submit(Journal.java:151)
at org.apache.cassandra.journal.Journal.onFlush(Journal.java:204)
at 
org.apache.cassandra.service.accord.AccordJournal.appendCommand(AccordJournal.java:264)
at 
org.apache.cassandra.service.accord.AccordCommandStore.appendCommands(AccordCommandStore.java:579)
at 
org.apache.cassandra.service.accord.async.AsyncOperation.runInternal(AsyncOperation.java:277)
at 
org.apache.cassandra.service.accord.async.AsyncOperation.run(AsyncOperation.java:303)
at 
org.apache.cassandra.service.accord.async.AsyncOperation.onLoaded(AsyncOperation.java:169)
at 
accord.utils.async.AsyncCallbacks.lambda$inExecutorService$0(AsyncCallbacks.java:36)
at 
org.apache.cassandra.concurrent.ExecutionFailure$1.run(ExecutionFailure.java:133)
at 
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at 
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at 
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Thread.java:829)




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Assigned] (CASSANDRA-19865) Fix CompacctionAccordIteratorTest, switch Journal to streaming serialization

2024-08-26 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov reassigned CASSANDRA-19865:
---

Assignee: Alex Petrov

> Fix CompacctionAccordIteratorTest, switch Journal to streaming serialization
> 
>
> Key: CASSANDRA-19865
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19865
> Project: Cassandra
>  Issue Type: Improvement
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: Normal
>  Time Spent: 10m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Created] (CASSANDRA-19865) Fix CompacctionAccordIteratorTest, switch Journal to streaming serialization

2024-08-26 Thread Alex Petrov (Jira)
Alex Petrov created CASSANDRA-19865:
---

 Summary: Fix CompacctionAccordIteratorTest, switch Journal to 
streaming serialization
 Key: CASSANDRA-19865
 URL: https://issues.apache.org/jira/browse/CASSANDRA-19865
 Project: Cassandra
  Issue Type: Improvement
Reporter: Alex Petrov






--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Created] (CASSANDRA-19864) Switch to infinite loop executor instead of a while-loop thread

2024-08-26 Thread Alex Petrov (Jira)
Alex Petrov created CASSANDRA-19864:
---

 Summary: Switch to infinite loop executor instead of a while-loop 
thread
 Key: CASSANDRA-19864
 URL: https://issues.apache.org/jira/browse/CASSANDRA-19864
 Project: Cassandra
  Issue Type: Bug
  Components: Accord
Reporter: Alex Petrov
Assignee: Alex Petrov


DelayedRequestProcessor was causing simulation failures because it was running 
using raw threads rather than an executor.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19849) Test Failure: org.apache.cassandra.tcm.sequences.ProgressBarrierTest.testProgressBarrier

2024-08-22 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19849:

Status: Ready to Commit  (was: Review In Progress)

> Test Failure: 
> org.apache.cassandra.tcm.sequences.ProgressBarrierTest.testProgressBarrier
> 
>
> Key: CASSANDRA-19849
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19849
> Project: Cassandra
>  Issue Type: Bug
>  Components: CI
>Reporter: Ekaterina Dimitrova
>Assignee: Alex Petrov
>Priority: Normal
> Fix For: 5.x
>
> Attachments: ci_summary-1.html, result_details.tar-1.gz
>
>
> Seen on current trunk here:
> https://app.circleci.com/pipelines/github/ekaterinadimitrova2/cassandra/2726/workflows/2d5c888b-d5b8-4f72-9fcb-9e7ae0887940/jobs/61321/tests
> {code:java}
> junit.framework.AssertionFailedError: Should have collected at least 15 nodes 
> but got 14.
> RF: NtsReplicationFactor{map={datacenter1=5, datacenter2=5, datacenter3=5}}
> Replicas: [/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012, 
> /127.0.0.4:7012, /127.0.0.5:7012, /127.0.0.6:7012, /127.0.0.7:7012, 
> /127.0.0.8:7012, /127.0.0.9:7012, /127.0.0.10:7012, /127.0.0.11:7012, 
> /127.0.0.12:7012, /127.0.0.13:7012, /127.0.0.14:7012]
> Nodes: [/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012, /127.0.0.4:7012, 
> /127.0.0.5:7012, /127.0.0.6:7012, /127.0.0.7:7012, /127.0.0.8:7012, 
> /127.0.0.9:7012, /127.0.0.10:7012, /127.0.0.11:7012, /127.0.0.12:7012, 
> /127.0.0.13:7012, /127.0.0.14:7012]
>   at 
> org.apache.cassandra.tcm.sequences.ProgressBarrierTest.testProgressBarrier(ProgressBarrierTest.java:176)
>   at 
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>   at 
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19849) Test Failure: org.apache.cassandra.tcm.sequences.ProgressBarrierTest.testProgressBarrier

2024-08-22 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19849:

  Since Version: 5.1
Source Control Link: 
https://github.com/apache/cassandra/commit/c263cdf6106adbf706bb85991e103e2c6519946c
 Resolution: Fixed
 Status: Resolved  (was: Ready to Commit)

> Test Failure: 
> org.apache.cassandra.tcm.sequences.ProgressBarrierTest.testProgressBarrier
> 
>
> Key: CASSANDRA-19849
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19849
> Project: Cassandra
>  Issue Type: Bug
>  Components: CI
>Reporter: Ekaterina Dimitrova
>Assignee: Alex Petrov
>Priority: Normal
> Fix For: 5.x
>
> Attachments: ci_summary-1.html, result_details.tar-1.gz
>
>
> Seen on current trunk here:
> https://app.circleci.com/pipelines/github/ekaterinadimitrova2/cassandra/2726/workflows/2d5c888b-d5b8-4f72-9fcb-9e7ae0887940/jobs/61321/tests
> {code:java}
> junit.framework.AssertionFailedError: Should have collected at least 15 nodes 
> but got 14.
> RF: NtsReplicationFactor{map={datacenter1=5, datacenter2=5, datacenter3=5}}
> Replicas: [/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012, 
> /127.0.0.4:7012, /127.0.0.5:7012, /127.0.0.6:7012, /127.0.0.7:7012, 
> /127.0.0.8:7012, /127.0.0.9:7012, /127.0.0.10:7012, /127.0.0.11:7012, 
> /127.0.0.12:7012, /127.0.0.13:7012, /127.0.0.14:7012]
> Nodes: [/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012, /127.0.0.4:7012, 
> /127.0.0.5:7012, /127.0.0.6:7012, /127.0.0.7:7012, /127.0.0.8:7012, 
> /127.0.0.9:7012, /127.0.0.10:7012, /127.0.0.11:7012, /127.0.0.12:7012, 
> /127.0.0.13:7012, /127.0.0.14:7012]
>   at 
> org.apache.cassandra.tcm.sequences.ProgressBarrierTest.testProgressBarrier(ProgressBarrierTest.java:176)
>   at 
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>   at 
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19849) Test Failure: org.apache.cassandra.tcm.sequences.ProgressBarrierTest.testProgressBarrier

2024-08-22 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19849:

Reviewers: Marcus Eriksson, Alex Petrov
   Marcus Eriksson, Alex Petrov  (was: Alex Petrov, Marcus Eriksson)
   Status: Review In Progress  (was: Patch Available)

> Test Failure: 
> org.apache.cassandra.tcm.sequences.ProgressBarrierTest.testProgressBarrier
> 
>
> Key: CASSANDRA-19849
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19849
> Project: Cassandra
>  Issue Type: Bug
>  Components: CI
>Reporter: Ekaterina Dimitrova
>Assignee: Alex Petrov
>Priority: Normal
> Fix For: 5.x
>
> Attachments: ci_summary-1.html, result_details.tar-1.gz
>
>
> Seen on current trunk here:
> https://app.circleci.com/pipelines/github/ekaterinadimitrova2/cassandra/2726/workflows/2d5c888b-d5b8-4f72-9fcb-9e7ae0887940/jobs/61321/tests
> {code:java}
> junit.framework.AssertionFailedError: Should have collected at least 15 nodes 
> but got 14.
> RF: NtsReplicationFactor{map={datacenter1=5, datacenter2=5, datacenter3=5}}
> Replicas: [/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012, 
> /127.0.0.4:7012, /127.0.0.5:7012, /127.0.0.6:7012, /127.0.0.7:7012, 
> /127.0.0.8:7012, /127.0.0.9:7012, /127.0.0.10:7012, /127.0.0.11:7012, 
> /127.0.0.12:7012, /127.0.0.13:7012, /127.0.0.14:7012]
> Nodes: [/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012, /127.0.0.4:7012, 
> /127.0.0.5:7012, /127.0.0.6:7012, /127.0.0.7:7012, /127.0.0.8:7012, 
> /127.0.0.9:7012, /127.0.0.10:7012, /127.0.0.11:7012, /127.0.0.12:7012, 
> /127.0.0.13:7012, /127.0.0.14:7012]
>   at 
> org.apache.cassandra.tcm.sequences.ProgressBarrierTest.testProgressBarrier(ProgressBarrierTest.java:176)
>   at 
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>   at 
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19849) Test Failure: org.apache.cassandra.tcm.sequences.ProgressBarrierTest.testProgressBarrier

2024-08-22 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19849:

Test and Documentation Plan: fixes an existing test
 Status: Patch Available  (was: Open)

> Test Failure: 
> org.apache.cassandra.tcm.sequences.ProgressBarrierTest.testProgressBarrier
> 
>
> Key: CASSANDRA-19849
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19849
> Project: Cassandra
>  Issue Type: Bug
>  Components: CI
>Reporter: Ekaterina Dimitrova
>Assignee: Alex Petrov
>Priority: Normal
> Fix For: 5.x
>
> Attachments: ci_summary-1.html, result_details.tar-1.gz
>
>
> Seen on current trunk here:
> https://app.circleci.com/pipelines/github/ekaterinadimitrova2/cassandra/2726/workflows/2d5c888b-d5b8-4f72-9fcb-9e7ae0887940/jobs/61321/tests
> {code:java}
> junit.framework.AssertionFailedError: Should have collected at least 15 nodes 
> but got 14.
> RF: NtsReplicationFactor{map={datacenter1=5, datacenter2=5, datacenter3=5}}
> Replicas: [/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012, 
> /127.0.0.4:7012, /127.0.0.5:7012, /127.0.0.6:7012, /127.0.0.7:7012, 
> /127.0.0.8:7012, /127.0.0.9:7012, /127.0.0.10:7012, /127.0.0.11:7012, 
> /127.0.0.12:7012, /127.0.0.13:7012, /127.0.0.14:7012]
> Nodes: [/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012, /127.0.0.4:7012, 
> /127.0.0.5:7012, /127.0.0.6:7012, /127.0.0.7:7012, /127.0.0.8:7012, 
> /127.0.0.9:7012, /127.0.0.10:7012, /127.0.0.11:7012, /127.0.0.12:7012, 
> /127.0.0.13:7012, /127.0.0.14:7012]
>   at 
> org.apache.cassandra.tcm.sequences.ProgressBarrierTest.testProgressBarrier(ProgressBarrierTest.java:176)
>   at 
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>   at 
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19849) Test Failure: org.apache.cassandra.tcm.sequences.ProgressBarrierTest.testProgressBarrier

2024-08-22 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19849:

Attachment: (was: ci_summary.html)

> Test Failure: 
> org.apache.cassandra.tcm.sequences.ProgressBarrierTest.testProgressBarrier
> 
>
> Key: CASSANDRA-19849
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19849
> Project: Cassandra
>  Issue Type: Bug
>  Components: CI
>Reporter: Ekaterina Dimitrova
>Assignee: Alex Petrov
>Priority: Normal
> Fix For: 5.x
>
> Attachments: ci_summary-1.html, result_details.tar-1.gz
>
>
> Seen on current trunk here:
> https://app.circleci.com/pipelines/github/ekaterinadimitrova2/cassandra/2726/workflows/2d5c888b-d5b8-4f72-9fcb-9e7ae0887940/jobs/61321/tests
> {code:java}
> junit.framework.AssertionFailedError: Should have collected at least 15 nodes 
> but got 14.
> RF: NtsReplicationFactor{map={datacenter1=5, datacenter2=5, datacenter3=5}}
> Replicas: [/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012, 
> /127.0.0.4:7012, /127.0.0.5:7012, /127.0.0.6:7012, /127.0.0.7:7012, 
> /127.0.0.8:7012, /127.0.0.9:7012, /127.0.0.10:7012, /127.0.0.11:7012, 
> /127.0.0.12:7012, /127.0.0.13:7012, /127.0.0.14:7012]
> Nodes: [/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012, /127.0.0.4:7012, 
> /127.0.0.5:7012, /127.0.0.6:7012, /127.0.0.7:7012, /127.0.0.8:7012, 
> /127.0.0.9:7012, /127.0.0.10:7012, /127.0.0.11:7012, /127.0.0.12:7012, 
> /127.0.0.13:7012, /127.0.0.14:7012]
>   at 
> org.apache.cassandra.tcm.sequences.ProgressBarrierTest.testProgressBarrier(ProgressBarrierTest.java:176)
>   at 
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>   at 
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19849) Test Failure: org.apache.cassandra.tcm.sequences.ProgressBarrierTest.testProgressBarrier

2024-08-22 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19849:

Attachment: (was: result_details.tar.gz)

> Test Failure: 
> org.apache.cassandra.tcm.sequences.ProgressBarrierTest.testProgressBarrier
> 
>
> Key: CASSANDRA-19849
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19849
> Project: Cassandra
>  Issue Type: Bug
>  Components: CI
>Reporter: Ekaterina Dimitrova
>Assignee: Alex Petrov
>Priority: Normal
> Fix For: 5.x
>
> Attachments: ci_summary-1.html, result_details.tar-1.gz
>
>
> Seen on current trunk here:
> https://app.circleci.com/pipelines/github/ekaterinadimitrova2/cassandra/2726/workflows/2d5c888b-d5b8-4f72-9fcb-9e7ae0887940/jobs/61321/tests
> {code:java}
> junit.framework.AssertionFailedError: Should have collected at least 15 nodes 
> but got 14.
> RF: NtsReplicationFactor{map={datacenter1=5, datacenter2=5, datacenter3=5}}
> Replicas: [/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012, 
> /127.0.0.4:7012, /127.0.0.5:7012, /127.0.0.6:7012, /127.0.0.7:7012, 
> /127.0.0.8:7012, /127.0.0.9:7012, /127.0.0.10:7012, /127.0.0.11:7012, 
> /127.0.0.12:7012, /127.0.0.13:7012, /127.0.0.14:7012]
> Nodes: [/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012, /127.0.0.4:7012, 
> /127.0.0.5:7012, /127.0.0.6:7012, /127.0.0.7:7012, /127.0.0.8:7012, 
> /127.0.0.9:7012, /127.0.0.10:7012, /127.0.0.11:7012, /127.0.0.12:7012, 
> /127.0.0.13:7012, /127.0.0.14:7012]
>   at 
> org.apache.cassandra.tcm.sequences.ProgressBarrierTest.testProgressBarrier(ProgressBarrierTest.java:176)
>   at 
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>   at 
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19849) Test Failure: org.apache.cassandra.tcm.sequences.ProgressBarrierTest.testProgressBarrier

2024-08-22 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19849:

Attachment: ci_summary-1.html

> Test Failure: 
> org.apache.cassandra.tcm.sequences.ProgressBarrierTest.testProgressBarrier
> 
>
> Key: CASSANDRA-19849
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19849
> Project: Cassandra
>  Issue Type: Bug
>  Components: CI
>Reporter: Ekaterina Dimitrova
>Assignee: Alex Petrov
>Priority: Normal
> Fix For: 5.x
>
> Attachments: ci_summary-1.html, ci_summary.html, 
> result_details.tar-1.gz, result_details.tar.gz
>
>
> Seen on current trunk here:
> https://app.circleci.com/pipelines/github/ekaterinadimitrova2/cassandra/2726/workflows/2d5c888b-d5b8-4f72-9fcb-9e7ae0887940/jobs/61321/tests
> {code:java}
> junit.framework.AssertionFailedError: Should have collected at least 15 nodes 
> but got 14.
> RF: NtsReplicationFactor{map={datacenter1=5, datacenter2=5, datacenter3=5}}
> Replicas: [/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012, 
> /127.0.0.4:7012, /127.0.0.5:7012, /127.0.0.6:7012, /127.0.0.7:7012, 
> /127.0.0.8:7012, /127.0.0.9:7012, /127.0.0.10:7012, /127.0.0.11:7012, 
> /127.0.0.12:7012, /127.0.0.13:7012, /127.0.0.14:7012]
> Nodes: [/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012, /127.0.0.4:7012, 
> /127.0.0.5:7012, /127.0.0.6:7012, /127.0.0.7:7012, /127.0.0.8:7012, 
> /127.0.0.9:7012, /127.0.0.10:7012, /127.0.0.11:7012, /127.0.0.12:7012, 
> /127.0.0.13:7012, /127.0.0.14:7012]
>   at 
> org.apache.cassandra.tcm.sequences.ProgressBarrierTest.testProgressBarrier(ProgressBarrierTest.java:176)
>   at 
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>   at 
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19849) Test Failure: org.apache.cassandra.tcm.sequences.ProgressBarrierTest.testProgressBarrier

2024-08-22 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19849:

Attachment: result_details.tar-1.gz

> Test Failure: 
> org.apache.cassandra.tcm.sequences.ProgressBarrierTest.testProgressBarrier
> 
>
> Key: CASSANDRA-19849
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19849
> Project: Cassandra
>  Issue Type: Bug
>  Components: CI
>Reporter: Ekaterina Dimitrova
>Assignee: Alex Petrov
>Priority: Normal
> Fix For: 5.x
>
> Attachments: ci_summary-1.html, ci_summary.html, 
> result_details.tar-1.gz, result_details.tar.gz
>
>
> Seen on current trunk here:
> https://app.circleci.com/pipelines/github/ekaterinadimitrova2/cassandra/2726/workflows/2d5c888b-d5b8-4f72-9fcb-9e7ae0887940/jobs/61321/tests
> {code:java}
> junit.framework.AssertionFailedError: Should have collected at least 15 nodes 
> but got 14.
> RF: NtsReplicationFactor{map={datacenter1=5, datacenter2=5, datacenter3=5}}
> Replicas: [/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012, 
> /127.0.0.4:7012, /127.0.0.5:7012, /127.0.0.6:7012, /127.0.0.7:7012, 
> /127.0.0.8:7012, /127.0.0.9:7012, /127.0.0.10:7012, /127.0.0.11:7012, 
> /127.0.0.12:7012, /127.0.0.13:7012, /127.0.0.14:7012]
> Nodes: [/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012, /127.0.0.4:7012, 
> /127.0.0.5:7012, /127.0.0.6:7012, /127.0.0.7:7012, /127.0.0.8:7012, 
> /127.0.0.9:7012, /127.0.0.10:7012, /127.0.0.11:7012, /127.0.0.12:7012, 
> /127.0.0.13:7012, /127.0.0.14:7012]
>   at 
> org.apache.cassandra.tcm.sequences.ProgressBarrierTest.testProgressBarrier(ProgressBarrierTest.java:176)
>   at 
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>   at 
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Comment Edited] (CASSANDRA-19849) Test Failure: org.apache.cassandra.tcm.sequences.ProgressBarrierTest.testProgressBarrier

2024-08-22 Thread Alex Petrov (Jira)


[ 
https://issues.apache.org/jira/browse/CASSANDRA-19849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17875874#comment-17875874
 ] 

Alex Petrov edited comment on CASSANDRA-19849 at 8/22/24 2:44 PM:
--

All test failures are in files this patch does not touch, and the patch only 
touches/fixes a single test file.


was (Author: ifesdjeen):
All test failures are in files this patch does not touch.

> Test Failure: 
> org.apache.cassandra.tcm.sequences.ProgressBarrierTest.testProgressBarrier
> 
>
> Key: CASSANDRA-19849
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19849
> Project: Cassandra
>  Issue Type: Bug
>  Components: CI
>Reporter: Ekaterina Dimitrova
>Assignee: Alex Petrov
>Priority: Normal
> Fix For: 5.x
>
> Attachments: ci_summary.html, result_details.tar.gz
>
>
> Seen on current trunk here:
> https://app.circleci.com/pipelines/github/ekaterinadimitrova2/cassandra/2726/workflows/2d5c888b-d5b8-4f72-9fcb-9e7ae0887940/jobs/61321/tests
> {code:java}
> junit.framework.AssertionFailedError: Should have collected at least 15 nodes 
> but got 14.
> RF: NtsReplicationFactor{map={datacenter1=5, datacenter2=5, datacenter3=5}}
> Replicas: [/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012, 
> /127.0.0.4:7012, /127.0.0.5:7012, /127.0.0.6:7012, /127.0.0.7:7012, 
> /127.0.0.8:7012, /127.0.0.9:7012, /127.0.0.10:7012, /127.0.0.11:7012, 
> /127.0.0.12:7012, /127.0.0.13:7012, /127.0.0.14:7012]
> Nodes: [/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012, /127.0.0.4:7012, 
> /127.0.0.5:7012, /127.0.0.6:7012, /127.0.0.7:7012, /127.0.0.8:7012, 
> /127.0.0.9:7012, /127.0.0.10:7012, /127.0.0.11:7012, /127.0.0.12:7012, 
> /127.0.0.13:7012, /127.0.0.14:7012]
>   at 
> org.apache.cassandra.tcm.sequences.ProgressBarrierTest.testProgressBarrier(ProgressBarrierTest.java:176)
>   at 
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>   at 
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19849) Test Failure: org.apache.cassandra.tcm.sequences.ProgressBarrierTest.testProgressBarrier

2024-08-22 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19849:

Attachment: result_details.tar.gz

> Test Failure: 
> org.apache.cassandra.tcm.sequences.ProgressBarrierTest.testProgressBarrier
> 
>
> Key: CASSANDRA-19849
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19849
> Project: Cassandra
>  Issue Type: Bug
>  Components: CI
>Reporter: Ekaterina Dimitrova
>Assignee: Alex Petrov
>Priority: Normal
> Fix For: 5.x
>
> Attachments: ci_summary.html, result_details.tar.gz
>
>
> Seen on current trunk here:
> https://app.circleci.com/pipelines/github/ekaterinadimitrova2/cassandra/2726/workflows/2d5c888b-d5b8-4f72-9fcb-9e7ae0887940/jobs/61321/tests
> {code:java}
> junit.framework.AssertionFailedError: Should have collected at least 15 nodes 
> but got 14.
> RF: NtsReplicationFactor{map={datacenter1=5, datacenter2=5, datacenter3=5}}
> Replicas: [/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012, 
> /127.0.0.4:7012, /127.0.0.5:7012, /127.0.0.6:7012, /127.0.0.7:7012, 
> /127.0.0.8:7012, /127.0.0.9:7012, /127.0.0.10:7012, /127.0.0.11:7012, 
> /127.0.0.12:7012, /127.0.0.13:7012, /127.0.0.14:7012]
> Nodes: [/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012, /127.0.0.4:7012, 
> /127.0.0.5:7012, /127.0.0.6:7012, /127.0.0.7:7012, /127.0.0.8:7012, 
> /127.0.0.9:7012, /127.0.0.10:7012, /127.0.0.11:7012, /127.0.0.12:7012, 
> /127.0.0.13:7012, /127.0.0.14:7012]
>   at 
> org.apache.cassandra.tcm.sequences.ProgressBarrierTest.testProgressBarrier(ProgressBarrierTest.java:176)
>   at 
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>   at 
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Commented] (CASSANDRA-19849) Test Failure: org.apache.cassandra.tcm.sequences.ProgressBarrierTest.testProgressBarrier

2024-08-22 Thread Alex Petrov (Jira)


[ 
https://issues.apache.org/jira/browse/CASSANDRA-19849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17875874#comment-17875874
 ] 

Alex Petrov commented on CASSANDRA-19849:
-

All test failures are in files this patch does not touch.

> Test Failure: 
> org.apache.cassandra.tcm.sequences.ProgressBarrierTest.testProgressBarrier
> 
>
> Key: CASSANDRA-19849
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19849
> Project: Cassandra
>  Issue Type: Bug
>  Components: CI
>Reporter: Ekaterina Dimitrova
>Assignee: Alex Petrov
>Priority: Normal
> Fix For: 5.x
>
> Attachments: ci_summary.html
>
>
> Seen on current trunk here:
> https://app.circleci.com/pipelines/github/ekaterinadimitrova2/cassandra/2726/workflows/2d5c888b-d5b8-4f72-9fcb-9e7ae0887940/jobs/61321/tests
> {code:java}
> junit.framework.AssertionFailedError: Should have collected at least 15 nodes 
> but got 14.
> RF: NtsReplicationFactor{map={datacenter1=5, datacenter2=5, datacenter3=5}}
> Replicas: [/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012, 
> /127.0.0.4:7012, /127.0.0.5:7012, /127.0.0.6:7012, /127.0.0.7:7012, 
> /127.0.0.8:7012, /127.0.0.9:7012, /127.0.0.10:7012, /127.0.0.11:7012, 
> /127.0.0.12:7012, /127.0.0.13:7012, /127.0.0.14:7012]
> Nodes: [/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012, /127.0.0.4:7012, 
> /127.0.0.5:7012, /127.0.0.6:7012, /127.0.0.7:7012, /127.0.0.8:7012, 
> /127.0.0.9:7012, /127.0.0.10:7012, /127.0.0.11:7012, /127.0.0.12:7012, 
> /127.0.0.13:7012, /127.0.0.14:7012]
>   at 
> org.apache.cassandra.tcm.sequences.ProgressBarrierTest.testProgressBarrier(ProgressBarrierTest.java:176)
>   at 
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>   at 
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19849) Test Failure: org.apache.cassandra.tcm.sequences.ProgressBarrierTest.testProgressBarrier

2024-08-22 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19849:

Attachment: ci_summary.html

> Test Failure: 
> org.apache.cassandra.tcm.sequences.ProgressBarrierTest.testProgressBarrier
> 
>
> Key: CASSANDRA-19849
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19849
> Project: Cassandra
>  Issue Type: Bug
>  Components: CI
>Reporter: Ekaterina Dimitrova
>Assignee: Alex Petrov
>Priority: Normal
> Fix For: 5.x
>
> Attachments: ci_summary.html
>
>
> Seen on current trunk here:
> https://app.circleci.com/pipelines/github/ekaterinadimitrova2/cassandra/2726/workflows/2d5c888b-d5b8-4f72-9fcb-9e7ae0887940/jobs/61321/tests
> {code:java}
> junit.framework.AssertionFailedError: Should have collected at least 15 nodes 
> but got 14.
> RF: NtsReplicationFactor{map={datacenter1=5, datacenter2=5, datacenter3=5}}
> Replicas: [/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012, 
> /127.0.0.4:7012, /127.0.0.5:7012, /127.0.0.6:7012, /127.0.0.7:7012, 
> /127.0.0.8:7012, /127.0.0.9:7012, /127.0.0.10:7012, /127.0.0.11:7012, 
> /127.0.0.12:7012, /127.0.0.13:7012, /127.0.0.14:7012]
> Nodes: [/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012, /127.0.0.4:7012, 
> /127.0.0.5:7012, /127.0.0.6:7012, /127.0.0.7:7012, /127.0.0.8:7012, 
> /127.0.0.9:7012, /127.0.0.10:7012, /127.0.0.11:7012, /127.0.0.12:7012, 
> /127.0.0.13:7012, /127.0.0.14:7012]
>   at 
> org.apache.cassandra.tcm.sequences.ProgressBarrierTest.testProgressBarrier(ProgressBarrierTest.java:176)
>   at 
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>   at 
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Assigned] (CASSANDRA-19849) Test Failure: org.apache.cassandra.tcm.sequences.ProgressBarrierTest.testProgressBarrier

2024-08-22 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov reassigned CASSANDRA-19849:
---

Assignee: Alex Petrov

> Test Failure: 
> org.apache.cassandra.tcm.sequences.ProgressBarrierTest.testProgressBarrier
> 
>
> Key: CASSANDRA-19849
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19849
> Project: Cassandra
>  Issue Type: Bug
>  Components: CI
>Reporter: Ekaterina Dimitrova
>Assignee: Alex Petrov
>Priority: Normal
> Fix For: 5.x
>
>
> Seen on current trunk here:
> https://app.circleci.com/pipelines/github/ekaterinadimitrova2/cassandra/2726/workflows/2d5c888b-d5b8-4f72-9fcb-9e7ae0887940/jobs/61321/tests
> {code:java}
> junit.framework.AssertionFailedError: Should have collected at least 15 nodes 
> but got 14.
> RF: NtsReplicationFactor{map={datacenter1=5, datacenter2=5, datacenter3=5}}
> Replicas: [/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012, 
> /127.0.0.4:7012, /127.0.0.5:7012, /127.0.0.6:7012, /127.0.0.7:7012, 
> /127.0.0.8:7012, /127.0.0.9:7012, /127.0.0.10:7012, /127.0.0.11:7012, 
> /127.0.0.12:7012, /127.0.0.13:7012, /127.0.0.14:7012]
> Nodes: [/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012, /127.0.0.4:7012, 
> /127.0.0.5:7012, /127.0.0.6:7012, /127.0.0.7:7012, /127.0.0.8:7012, 
> /127.0.0.9:7012, /127.0.0.10:7012, /127.0.0.11:7012, /127.0.0.12:7012, 
> /127.0.0.13:7012, /127.0.0.14:7012]
>   at 
> org.apache.cassandra.tcm.sequences.ProgressBarrierTest.testProgressBarrier(ProgressBarrierTest.java:176)
>   at 
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>   at 
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Commented] (CASSANDRA-18322) Warn about unqualified prepared statement only if it is a select, update, delete, insert

2024-08-22 Thread Alex Petrov (Jira)


[ 
https://issues.apache.org/jira/browse/CASSANDRA-18322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17875818#comment-17875818
 ] 

Alex Petrov commented on CASSANDRA-18322:
-

+1; we have discussed the approach privately with Stefan, and apart from 
batches where we would already have similar behaviour I do not see any 
problems. 

> Warn about unqualified prepared statement only if it is a select, update, 
> delete, insert
> 
>
> Key: CASSANDRA-18322
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18322
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Messaging/Client
>Reporter: Mohammad Aburadeh
>Assignee: Stefan Miklosovic
>Priority: Normal
> Fix For: 5.1
>
>  Time Spent: 1h
>  Remaining Estimate: 0h
>
> Hi, 
> We get the following warnings when we use prepared statements with "create 
> keyspace ... " or "drop keyspace" statements.
> "
> {{USE }} with prepared statements is considered to be an 
> anti-pattern due to ambiguity in non-qualified table names. Please consider 
> removing instances of {{{}Session#setKeyspace(){}}}, 
> {{Session#execute("USE ")}} and {{cluster.newSession()}} 
> from your code, and always use fully qualified table names (e.g. 
> .). Keyspace used: null, statement keyspace: null, statement 
> id: 8153d922390fdf9a9963bfeda85b2f3b at 
> "
> Such statements are already full-qualified. So, why are we getting this 
> warning? 
> Regards
> Mohammad



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19788) Simplify and deduplicate Harry ModelChecker

2024-08-20 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19788:

Source Control Link: 
https://github.com/apache/cassandra/commit/52396ec1fc4d08a988714704ff0cbb796ee06f7f
 Resolution: Fixed
 Status: Resolved  (was: Ready to Commit)

> Simplify and deduplicate Harry ModelChecker
> ---
>
> Key: CASSANDRA-19788
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19788
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Test/fuzz
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: High
> Fix For: 5.1
>
> Attachments: ci_summary.html, result_details.tar.gz
>
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19788) Simplify and deduplicate Harry ModelChecker

2024-08-20 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19788:

Status: Ready to Commit  (was: Review In Progress)

> Simplify and deduplicate Harry ModelChecker
> ---
>
> Key: CASSANDRA-19788
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19788
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Test/fuzz
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: High
> Fix For: 5.1
>
> Attachments: ci_summary.html, result_details.tar.gz
>
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19788) Simplify and deduplicate Harry ModelChecker

2024-08-20 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19788:

Attachment: result_details.tar.gz

> Simplify and deduplicate Harry ModelChecker
> ---
>
> Key: CASSANDRA-19788
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19788
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Test/fuzz
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: High
> Fix For: 5.1
>
> Attachments: ci_summary.html, result_details.tar.gz
>
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19788) Simplify and deduplicate Harry ModelChecker

2024-08-20 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19788:

Attachment: ci_summary.html

> Simplify and deduplicate Harry ModelChecker
> ---
>
> Key: CASSANDRA-19788
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19788
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Test/fuzz
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: High
> Fix For: 5.1
>
> Attachments: ci_summary.html, result_details.tar.gz
>
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19756) Accord Journal / Determinism: Store intermediate Command states in the log

2024-08-19 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19756:

Resolution: Fixed
Status: Resolved  (was: Open)

> Accord Journal / Determinism: Store intermediate Command states in the log
> --
>
> Key: CASSANDRA-19756
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19756
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Accord
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: High
>
> Write side of the replay determinism: persist intermediate Command in the 
> journal
>   * Simplifies AccordJournal by removing Framing
>   * Saves command outcomes to the log
>   * Reconstructs latest command state from the log entries



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19757) Accord Journal / Determinism: Load Command states from the log

2024-08-14 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19757:

Source Control Link: 
https://github.com/apache/cassandra/commit/bea968acddfbb454838fedef4f22de2eb285bd91
 Resolution: Fixed
 Status: Resolved  (was: Ready to Commit)

>  Accord Journal / Determinism: Load Command states from the log
> ---
>
> Key: CASSANDRA-19757
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19757
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Accord
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: High
>  Labels: pull-request-available
> Fix For: 5.1
>
> Attachments: ci_summary-1.html, ci_summary.html
>
>
>   * Persist intermediate Command inthe journal
>   * Simplify AccordJournal by removing Framing
>   * Save command outcomes to the log
>   * Reconstruct latest command state from the log entries
>   * Replace `SerializerSupport#reconstruct` with log reconstruction



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Commented] (CASSANDRA-19757) Accord Journal / Determinism: Load Command states from the log

2024-08-14 Thread Alex Petrov (Jira)


[ 
https://issues.apache.org/jira/browse/CASSANDRA-19757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17873434#comment-17873434
 ] 

Alex Petrov commented on CASSANDRA-19757:
-

Committed as 
[4c870dc9b561a841ea9b923ff739953adcc00325|https://github.com/apache/cassandra-accord/commit/4c870dc9b561a841ea9b923ff739953adcc00325]
 and 
[bea968acddfbb454838fedef4f22de2eb285bd91|https://github.com/apache/cassandra/commit/bea968acddfbb454838fedef4f22de2eb285bd91]

>  Accord Journal / Determinism: Load Command states from the log
> ---
>
> Key: CASSANDRA-19757
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19757
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Accord
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: High
>  Labels: pull-request-available
> Fix For: 5.1
>
> Attachments: ci_summary-1.html, ci_summary.html
>
>
>   * Persist intermediate Command inthe journal
>   * Simplify AccordJournal by removing Framing
>   * Save command outcomes to the log
>   * Reconstruct latest command state from the log entries
>   * Replace `SerializerSupport#reconstruct` with log reconstruction



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19757) Accord Journal / Determinism: Load Command states from the log

2024-08-14 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19757:

Status: Review In Progress  (was: Patch Available)

>  Accord Journal / Determinism: Load Command states from the log
> ---
>
> Key: CASSANDRA-19757
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19757
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Accord
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: High
>  Labels: pull-request-available
> Fix For: 5.1
>
> Attachments: ci_summary-1.html, ci_summary.html
>
>
>   * Persist intermediate Command inthe journal
>   * Simplify AccordJournal by removing Framing
>   * Save command outcomes to the log
>   * Reconstruct latest command state from the log entries
>   * Replace `SerializerSupport#reconstruct` with log reconstruction



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19757) Accord Journal / Determinism: Load Command states from the log

2024-08-14 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19757:

Status: Ready to Commit  (was: Review In Progress)

>  Accord Journal / Determinism: Load Command states from the log
> ---
>
> Key: CASSANDRA-19757
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19757
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Accord
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: High
>  Labels: pull-request-available
> Fix For: 5.1
>
> Attachments: ci_summary-1.html, ci_summary.html
>
>
>   * Persist intermediate Command inthe journal
>   * Simplify AccordJournal by removing Framing
>   * Save command outcomes to the log
>   * Reconstruct latest command state from the log entries
>   * Replace `SerializerSupport#reconstruct` with log reconstruction



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Commented] (CASSANDRA-19534) Unbounded queues in native transport requests lead to node instability

2024-08-14 Thread Alex Petrov (Jira)


[ 
https://issues.apache.org/jira/browse/CASSANDRA-19534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17873433#comment-17873433
 ] 

Alex Petrov commented on CASSANDRA-19534:
-

[~gauravapiscean] I do not think largecolumn test failure is caused by this 
commit, or at least not at the first glance. 

I 
[ninja'd|https://github.com/apache/cassandra/commit/ff3e5ab76d7ad1386e216eadaf8a1a7e8ea9e0b8]
 4.1 test fix because it already was reviewed for other branches, and tested by 
Gaurav to confirm. 


> Unbounded queues in native transport requests lead to node instability
> --
>
> Key: CASSANDRA-19534
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19534
> Project: Cassandra
>  Issue Type: Bug
>  Components: Legacy/Local Write-Read Paths
>Reporter: Jon Haddad
>Assignee: Alex Petrov
>Priority: Urgent
> Fix For: 4.1.6, 5.0-rc1, 5.0, 5.1
>
> Attachments: Scenario 1 - QUEUE + Backpressure.jpg, Scenario 1 - 
> QUEUE.jpg, Scenario 1 - Stock.jpg, Scenario 2 - QUEUE + Backpressure.jpg, 
> Scenario 2 - QUEUE.jpg, Scenario 2 - Stock.jpg, ci_summary-4.1.html, 
> ci_summary-5.0.html, ci_summary-trunk.html, ci_summary.html, 
> image-2024-05-03-16-08-10-101.png, image-2024-08-07-11-37-58-417.png, 
> image-2024-08-08-14-25-12-915.png, screenshot-1.png, screenshot-2.png, 
> screenshot-3.png, screenshot-4.png, screenshot-5.png, screenshot-6.png, 
> screenshot-7.png, screenshot-8.png, screenshot-9.png
>
>  Time Spent: 10h 10m
>  Remaining Estimate: 0h
>
> When a node is under pressure, hundreds of thousands of requests can show up 
> in the native transport queue, and it looks like it can take way longer to 
> timeout than is configured.  We should be shedding load much more 
> aggressively and use a bounded queue for incoming work.  This is extremely 
> evident when we combine a resource consuming workload with a smaller one:
> Running 5.0 HEAD on a single node as of today:
> {noformat}
> # populate only
> easy-cass-stress run RandomPartitionAccess -p 100  -r 1 
> --workload.rows=10 --workload.select=partition --maxrlat 100 --populate 
> 10m --rate 50k -n 1
> # workload 1 - larger reads
> easy-cass-stress run RandomPartitionAccess -p 100  -r 1 
> --workload.rows=10 --workload.select=partition --rate 200 -d 1d
> # second workload - small reads
> easy-cass-stress run KeyValue -p 1m --rate 20k -r .5 -d 24h{noformat}
> It appears our results don't time out at the requested server time either:
>  
> {noformat}
>                  Writes                                  Reads                
>                   Deletes                       Errors
>   Count  Latency (p99)  1min (req/s) |   Count  Latency (p99)  1min (req/s) | 
>   Count  Latency (p99)  1min (req/s) |   Count  1min (errors/s)
>  950286       70403.93        634.77 |  789524       70442.07        426.02 | 
>       0              0             0 | 9580484         18980.45
>  952304       70567.62         640.1 |  791072       70634.34        428.36 | 
>       0              0             0 | 9636658         18969.54
>  953146       70767.34         640.1 |  791400       70767.76        428.36 | 
>       0              0             0 | 9695272         18969.54
>  956833       71171.28        623.14 |  794009        71175.6        412.79 | 
>       0              0             0 | 9749377         19002.44
>  959627       71312.58        656.93 |  795703       71349.87        435.56 | 
>       0              0             0 | 9804907         18943.11{noformat}
>  
> After stopping the load test altogether, it took nearly a minute before the 
> requests were no longer queued.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Commented] (CASSANDRA-19534) Unbounded queues in native transport requests lead to node instability

2024-08-09 Thread Alex Petrov (Jira)


[ 
https://issues.apache.org/jira/browse/CASSANDRA-19534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17872420#comment-17872420
 ] 

Alex Petrov commented on CASSANDRA-19534:
-

[~gauravapiscean] RR test turned out to be a consequence of a bad merge, you 
can check out the fix here: 
https://github.com/ifesdjeen/cassandra/pull/new/cassandra-4.1 


> Unbounded queues in native transport requests lead to node instability
> --
>
> Key: CASSANDRA-19534
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19534
> Project: Cassandra
>  Issue Type: Bug
>  Components: Legacy/Local Write-Read Paths
>Reporter: Jon Haddad
>Assignee: Alex Petrov
>Priority: Urgent
> Fix For: 4.1.6, 5.0-rc1, 5.0, 5.1
>
> Attachments: Scenario 1 - QUEUE + Backpressure.jpg, Scenario 1 - 
> QUEUE.jpg, Scenario 1 - Stock.jpg, Scenario 2 - QUEUE + Backpressure.jpg, 
> Scenario 2 - QUEUE.jpg, Scenario 2 - Stock.jpg, ci_summary-4.1.html, 
> ci_summary-5.0.html, ci_summary-trunk.html, ci_summary.html, 
> image-2024-05-03-16-08-10-101.png, image-2024-08-07-11-37-58-417.png, 
> image-2024-08-08-14-25-12-915.png, screenshot-1.png, screenshot-2.png, 
> screenshot-3.png, screenshot-4.png, screenshot-5.png, screenshot-6.png, 
> screenshot-7.png, screenshot-8.png, screenshot-9.png
>
>  Time Spent: 10h 10m
>  Remaining Estimate: 0h
>
> When a node is under pressure, hundreds of thousands of requests can show up 
> in the native transport queue, and it looks like it can take way longer to 
> timeout than is configured.  We should be shedding load much more 
> aggressively and use a bounded queue for incoming work.  This is extremely 
> evident when we combine a resource consuming workload with a smaller one:
> Running 5.0 HEAD on a single node as of today:
> {noformat}
> # populate only
> easy-cass-stress run RandomPartitionAccess -p 100  -r 1 
> --workload.rows=10 --workload.select=partition --maxrlat 100 --populate 
> 10m --rate 50k -n 1
> # workload 1 - larger reads
> easy-cass-stress run RandomPartitionAccess -p 100  -r 1 
> --workload.rows=10 --workload.select=partition --rate 200 -d 1d
> # second workload - small reads
> easy-cass-stress run KeyValue -p 1m --rate 20k -r .5 -d 24h{noformat}
> It appears our results don't time out at the requested server time either:
>  
> {noformat}
>                  Writes                                  Reads                
>                   Deletes                       Errors
>   Count  Latency (p99)  1min (req/s) |   Count  Latency (p99)  1min (req/s) | 
>   Count  Latency (p99)  1min (req/s) |   Count  1min (errors/s)
>  950286       70403.93        634.77 |  789524       70442.07        426.02 | 
>       0              0             0 | 9580484         18980.45
>  952304       70567.62         640.1 |  791072       70634.34        428.36 | 
>       0              0             0 | 9636658         18969.54
>  953146       70767.34         640.1 |  791400       70767.76        428.36 | 
>       0              0             0 | 9695272         18969.54
>  956833       71171.28        623.14 |  794009        71175.6        412.79 | 
>       0              0             0 | 9749377         19002.44
>  959627       71312.58        656.93 |  795703       71349.87        435.56 | 
>       0              0             0 | 9804907         18943.11{noformat}
>  
> After stopping the load test altogether, it took nearly a minute before the 
> requests were no longer queued.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Commented] (CASSANDRA-19757) Accord Journal / Determinism: Load Command states from the log

2024-08-09 Thread Alex Petrov (Jira)


[ 
https://issues.apache.org/jira/browse/CASSANDRA-19757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17872350#comment-17872350
 ] 

Alex Petrov commented on CASSANDRA-19757:
-

Probably the biggest argument here is that {{BurnTest}} never relied on 
execution order. It was a construct added in {{AsyncOperation}} to make sure 
replay is deterministic, but since now we are achieving log dereminism via 
preserving outcomes rather than replaying commands, this feature became 
redundant. And from what I can tell, the tests I have added ignore flag for 
mainly tested this aspect of determinism. One way to preserve them is to port 
execution order to the tests, but I think they will be testing themselves then. 
We can try to create something more like {{BurnTest}}, maybe? But probably 
simulator already covers this.

>  Accord Journal / Determinism: Load Command states from the log
> ---
>
> Key: CASSANDRA-19757
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19757
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Accord
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: High
>  Labels: pull-request-available
> Fix For: 5.1
>
> Attachments: ci_summary-1.html, ci_summary.html
>
>
>   * Persist intermediate Command inthe journal
>   * Simplify AccordJournal by removing Framing
>   * Save command outcomes to the log
>   * Reconstruct latest command state from the log entries
>   * Replace `SerializerSupport#reconstruct` with log reconstruction



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19790) Add an ability to reconstruct arbitrary epoch state from the log to TCM

2024-08-08 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19790:

Reviewers: Marcus Eriksson, Sam Tunnicliffe
   Status: Review In Progress  (was: Patch Available)

> Add an ability to reconstruct arbitrary epoch state from the log to TCM
> ---
>
> Key: CASSANDRA-19790
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19790
> Project: Cassandra
>  Issue Type: New Feature
>  Components: Transactional Cluster Metadata
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: High
> Fix For: 5.1
>
> Attachments: ci_summary.html, result_details.tar.gz
>
>
> Current Accord functionality requires TCM to be able to provide cluster 
> metadata for an arbitrary epoch. Unfortunately, epochs are not always 
> available locally especially on bootstrapping non-CMS nodes. For this, we 
> need to reconstruct from the log.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19790) Add an ability to reconstruct arbitrary epoch state from the log to TCM

2024-08-08 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19790:

Attachment: result_details.tar.gz

> Add an ability to reconstruct arbitrary epoch state from the log to TCM
> ---
>
> Key: CASSANDRA-19790
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19790
> Project: Cassandra
>  Issue Type: New Feature
>  Components: Transactional Cluster Metadata
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: High
> Fix For: 5.1
>
> Attachments: ci_summary.html, result_details.tar.gz
>
>
> Current Accord functionality requires TCM to be able to provide cluster 
> metadata for an arbitrary epoch. Unfortunately, epochs are not always 
> available locally especially on bootstrapping non-CMS nodes. For this, we 
> need to reconstruct from the log.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19790) Add an ability to reconstruct arbitrary epoch state from the log to TCM

2024-08-08 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19790:

Test and Documentation Plan: includes a test
 Status: Patch Available  (was: Open)

> Add an ability to reconstruct arbitrary epoch state from the log to TCM
> ---
>
> Key: CASSANDRA-19790
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19790
> Project: Cassandra
>  Issue Type: New Feature
>  Components: Transactional Cluster Metadata
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: High
> Fix For: 5.1
>
> Attachments: ci_summary.html, result_details.tar.gz
>
>
> Current Accord functionality requires TCM to be able to provide cluster 
> metadata for an arbitrary epoch. Unfortunately, epochs are not always 
> available locally especially on bootstrapping non-CMS nodes. For this, we 
> need to reconstruct from the log.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19790) Add an ability to reconstruct arbitrary epoch state from the log to TCM

2024-08-08 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19790:

Attachment: ci_summary.html

> Add an ability to reconstruct arbitrary epoch state from the log to TCM
> ---
>
> Key: CASSANDRA-19790
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19790
> Project: Cassandra
>  Issue Type: New Feature
>  Components: Transactional Cluster Metadata
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: High
> Fix For: 5.1
>
> Attachments: ci_summary.html, result_details.tar.gz
>
>
> Current Accord functionality requires TCM to be able to provide cluster 
> metadata for an arbitrary epoch. Unfortunately, epochs are not always 
> available locally especially on bootstrapping non-CMS nodes. For this, we 
> need to reconstruct from the log.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-19794) NPE on Directory access during Memtable flush fails ShortPaxosSimulationTest

2024-08-08 Thread Alex Petrov (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-19794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Petrov updated CASSANDRA-19794:

  Since Version: 5.1
Source Control Link: 
https://github.com/apache/cassandra/commit/018feb36f42d28bc11073741ef224b42f9a60ad0
 Resolution: Fixed
 Status: Resolved  (was: Ready to Commit)

> NPE on Directory access during Memtable flush fails ShortPaxosSimulationTest
> 
>
> Key: CASSANDRA-19794
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19794
> Project: Cassandra
>  Issue Type: Bug
>  Components: Test/burn, Transactional Cluster Metadata
>Reporter: Caleb Rackliffe
>Assignee: Alex Petrov
>Priority: Normal
> Fix For: 5.x
>
> Attachments: ci_summary.html, result_details.tar.gz
>
>
> Run {{ShortPaxosSimulationTest}} w/ the following arguments on trunk:
> {noformat}
> PaxosSimulationRunner.main(new String[] { "run", "-n", "3..6", "-t", "1000", 
> "-c", "2", "--cluster-action-limit", "2", "-s", "30", "--seed", 
> "0xe0247e19a75e3bba" });
> {noformat}
> You should see a failure, starting with...
> {noformat}
> [junit-timeout] WARN  [OptionalTasks:1] node5 2024-07-22 15:46:00,210 
> LegacyStateListener.java:158 - Token -6148914691236517205 changing ownership 
> from /127.0.0.1:7012 to /127.0.0.6:7012
> [junit-timeout] WARN  [OptionalTasks:1] node6 2024-07-22 15:46:00,259 
> SystemKeyspace.java:1287 - Using stored Gossip Generation 1577894856 as it is 
> greater than current system time 1577894855.  See CASSANDRA-3654 if you 
> experience problems
> [junit-timeout] WARN  [OptionalTasks:1] node6 2024-07-22 15:46:00,277 
> LegacyStateListener.java:158 - Token -6148914691236517205 changing ownership 
> from /127.0.0.1:7012 to /127.0.0.6:7012
> [junit-timeout] ERROR [isolatedExecutor:3] node6 2024-07-22 15:46:00,469 
> ReconfigureCMS.java:184 - Could not finish adding the node to the Cluster 
> Metadata Service
> [junit-timeout] java.lang.IllegalStateException: Can not commit 
> transformation: "SERVER_ERROR"(class java.lang.NullPointerException).
> [junit-timeout]   at 
> org.apache.cassandra.tcm.ClusterMetadataService.lambda$commit$6(ClusterMetadataService.java:491)
> [junit-timeout]   at 
> org.apache.cassandra.tcm.ClusterMetadataService.commit(ClusterMetadataService.java:535)
> [junit-timeout]   at 
> org.apache.cassandra.tcm.ClusterMetadataService.commit(ClusterMetadataService.java:488)
> [junit-timeout]   at 
> org.apache.cassandra.tcm.sequences.ReconfigureCMS.executeNext(ReconfigureCMS.java:179)
> [junit-timeout]   at 
> org.apache.cassandra.tcm.sequences.InProgressSequences.resume(InProgressSequences.java:200)
> [junit-timeout]   at 
> org.apache.cassandra.tcm.sequences.InProgressSequences.finishInProgressSequences(InProgressSequences.java:72)
> [junit-timeout]   at 
> org.apache.cassandra.tcm.ClusterMetadataService.reconfigureCMS(ClusterMetadataService.java:372)
> [junit-timeout]   at 
> org.apache.cassandra.tcm.ClusterMetadataService.ensureCMSPlacement(ClusterMetadataService.java:379)
> [junit-timeout]   at 
> org.apache.cassandra.tcm.sequences.BootstrapAndReplace.executeNext(BootstrapAndReplace.java:274)
> [junit-timeout]   at 
> org.apache.cassandra.simulator.cluster.OnClusterReplace$ExecuteNextStep.lambda$new$f5e64c00$1(OnClusterReplace.java:162)
> [junit-timeout]   at 
> org.apache.cassandra.distributed.api.IInvokableInstance.unsafeRunOnThisThread(IInvokableInstance.java:85)
> [junit-timeout]   at 
> org.apache.cassandra.simulator.systems.SimulatedActionTask.lambda$asSafeRunnable$0(SimulatedActionTask.java:83)
> [junit-timeout]   at 
> org.apache.cassandra.simulator.systems.SimulatedActionTask$1.run(SimulatedActionTask.java:93)
> [junit-timeout]   at 
> org.apache.cassandra.simulator.systems.InterceptingExecutor$InterceptingPooledExecutor$WaitingThread.lambda$new$1(InterceptingExecutor.java:318)
> [junit-timeout]   at 
> io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
> [junit-timeout]   at java.base/java.lang.Thread.run(Thread.java:829)
> {noformat}
> ...and underneath that...
> {noformat}
> [junit-timeout] Thread[ScheduledTasks:1,5,node3]
> [junit-timeout] java.lang.NullPointerException
> [junit-timeout]   at 
> org.apache.cassandra.utils.btree.AbstractBTreeMap.get(AbstractBTreeMap.java:92)
> [junit-timeout]   at 
> org.apache.cassandra.tcm.membership.Directory.endpoint(Directory.java:312)
> [junit-timeout]   at 
> org.apache.cassandra.tcm.transformations.cms.AdvanceCMSReconfiguration.executeRemove(AdvanceCMSReconfiguration.java:242)
> [junit-timeout]   at 
> org.apache.cassandra.tcm.transformations.cms.AdvanceCMSReconfiguration.execute(Advance

[jira] [Commented] (CASSANDRA-19534) Unbounded queues in native transport requests lead to node instability

2024-08-07 Thread Alex Petrov (Jira)


[ 
https://issues.apache.org/jira/browse/CASSANDRA-19534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17871880#comment-17871880
 ] 

Alex Petrov commented on CASSANDRA-19534:
-

[~gauravapiscean] is there any reason you believe this SHA has caused it? CI on 
my side came clean (report attached). You can try reproducing on SHA~1 and/or 
check if it is flaky.

> Unbounded queues in native transport requests lead to node instability
> --
>
> Key: CASSANDRA-19534
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19534
> Project: Cassandra
>  Issue Type: Bug
>  Components: Legacy/Local Write-Read Paths
>Reporter: Jon Haddad
>Assignee: Alex Petrov
>Priority: Urgent
> Fix For: 4.1.6, 5.0-rc1, 5.0, 5.1
>
> Attachments: Scenario 1 - QUEUE + Backpressure.jpg, Scenario 1 - 
> QUEUE.jpg, Scenario 1 - Stock.jpg, Scenario 2 - QUEUE + Backpressure.jpg, 
> Scenario 2 - QUEUE.jpg, Scenario 2 - Stock.jpg, ci_summary-4.1.html, 
> ci_summary-5.0.html, ci_summary-trunk.html, ci_summary.html, 
> image-2024-05-03-16-08-10-101.png, image-2024-08-07-11-37-58-417.png, 
> screenshot-1.png, screenshot-2.png, screenshot-3.png, screenshot-4.png, 
> screenshot-5.png, screenshot-6.png, screenshot-7.png, screenshot-8.png, 
> screenshot-9.png
>
>  Time Spent: 10h 10m
>  Remaining Estimate: 0h
>
> When a node is under pressure, hundreds of thousands of requests can show up 
> in the native transport queue, and it looks like it can take way longer to 
> timeout than is configured.  We should be shedding load much more 
> aggressively and use a bounded queue for incoming work.  This is extremely 
> evident when we combine a resource consuming workload with a smaller one:
> Running 5.0 HEAD on a single node as of today:
> {noformat}
> # populate only
> easy-cass-stress run RandomPartitionAccess -p 100  -r 1 
> --workload.rows=10 --workload.select=partition --maxrlat 100 --populate 
> 10m --rate 50k -n 1
> # workload 1 - larger reads
> easy-cass-stress run RandomPartitionAccess -p 100  -r 1 
> --workload.rows=10 --workload.select=partition --rate 200 -d 1d
> # second workload - small reads
> easy-cass-stress run KeyValue -p 1m --rate 20k -r .5 -d 24h{noformat}
> It appears our results don't time out at the requested server time either:
>  
> {noformat}
>                  Writes                                  Reads                
>                   Deletes                       Errors
>   Count  Latency (p99)  1min (req/s) |   Count  Latency (p99)  1min (req/s) | 
>   Count  Latency (p99)  1min (req/s) |   Count  1min (errors/s)
>  950286       70403.93        634.77 |  789524       70442.07        426.02 | 
>       0              0             0 | 9580484         18980.45
>  952304       70567.62         640.1 |  791072       70634.34        428.36 | 
>       0              0             0 | 9636658         18969.54
>  953146       70767.34         640.1 |  791400       70767.76        428.36 | 
>       0              0             0 | 9695272         18969.54
>  956833       71171.28        623.14 |  794009        71175.6        412.79 | 
>       0              0             0 | 9749377         19002.44
>  959627       71312.58        656.93 |  795703       71349.87        435.56 | 
>       0              0             0 | 9804907         18943.11{noformat}
>  
> After stopping the load test altogether, it took nearly a minute before the 
> requests were no longer queued.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



  1   2   3   4   5   6   7   8   9   10   >