[jira] [Commented] (CASSANDRA-18304) hinted_handoff_enabled=false is not honored
[ https://issues.apache.org/jira/browse/CASSANDRA-18304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17704688#comment-17704688 ] Paulo Motta commented on CASSANDRA-18304: - Thanks for the review. Finally got a 4.1 CI to not fail: * 4.1 CI: [!https://ci-cassandra.apache.org/job/Cassandra-devbranch/2391/badge/icon!|https://ci-cassandra.apache.org/blue/organizations/jenkins/Cassandra-devbranch/detail/Cassandra-devbranch/2391/pipeline] * trunk CI: [!https://ci-cassandra.apache.org/job/Cassandra-devbranch/2369/badge/icon!|https://ci-cassandra.apache.org/blue/organizations/jenkins/Cassandra-devbranch/detail/Cassandra-devbranch/2369/pipeline] will commit shortly > hinted_handoff_enabled=false is not honored > --- > > Key: CASSANDRA-18304 > URL: https://issues.apache.org/jira/browse/CASSANDRA-18304 > Project: Cassandra > Issue Type: Bug > Components: Consistency/Hints >Reporter: Paulo Motta >Assignee: Paulo Motta >Priority: Normal > Fix For: 4.1.x, 5.x > > Time Spent: 50m > Remaining Estimate: 0h > > I've had some dtests with disabled hints failing. > After investigation it seems that CASSANDRA-17164 moved hint submission on > timeout from > [RequestCallbacks.onExpired|https://github.com/apache/cassandra/commit/d2923275e360a1ee9db498e748c269f701bb3a8b#diff-b73c13ea8cae91a215495917fe5e90d55c9f4a283f9e053110992bc9a60004b8L176] > to > [AbstractWriteResponseHandler.onFailure|https://github.com/apache/cassandra/commit/d2923275e360a1ee9db498e748c269f701bb3a8b#diff-3b202de0d077638bede7bf4076a15eb4d483b717f955f11e743efb8d27c6eb1dR285], > but it no longer checks if {{CallbackInfo.shouldHint}} which checks for > {{StorageProxy.shouldHint}} which ultimately checks if > {{{}hinted_handoff_enabled=true{}}}. > This could cause some tests which expect hints to be disabled to fail > intermittently. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org For additional commands, e-mail: commits-h...@cassandra.apache.org
[jira] [Commented] (CASSANDRA-18304) hinted_handoff_enabled=false is not honored
[ https://issues.apache.org/jira/browse/CASSANDRA-18304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703703#comment-17703703 ] Aleksey Yeschenko commented on CASSANDRA-18304: --- +1. I can't say that the code around hint submission is currently correct, but the changes are strictly an improvement, and don't make anything worse. > hinted_handoff_enabled=false is not honored > --- > > Key: CASSANDRA-18304 > URL: https://issues.apache.org/jira/browse/CASSANDRA-18304 > Project: Cassandra > Issue Type: Bug > Components: Consistency/Hints >Reporter: Paulo Motta >Assignee: Paulo Motta >Priority: Normal > Fix For: 4.1.x, 5.x > > Time Spent: 50m > Remaining Estimate: 0h > > I've had some dtests with disabled hints failing. > After investigation it seems that CASSANDRA-17164 moved hint submission on > timeout from > [RequestCallbacks.onExpired|https://github.com/apache/cassandra/commit/d2923275e360a1ee9db498e748c269f701bb3a8b#diff-b73c13ea8cae91a215495917fe5e90d55c9f4a283f9e053110992bc9a60004b8L176] > to > [AbstractWriteResponseHandler.onFailure|https://github.com/apache/cassandra/commit/d2923275e360a1ee9db498e748c269f701bb3a8b#diff-3b202de0d077638bede7bf4076a15eb4d483b717f955f11e743efb8d27c6eb1dR285], > but it no longer checks if {{CallbackInfo.shouldHint}} which checks for > {{StorageProxy.shouldHint}} which ultimately checks if > {{{}hinted_handoff_enabled=true{}}}. > This could cause some tests which expect hints to be disabled to fail > intermittently. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org For additional commands, e-mail: commits-h...@cassandra.apache.org
[jira] [Commented] (CASSANDRA-18304) hinted_handoff_enabled=false is not honored
[ https://issues.apache.org/jira/browse/CASSANDRA-18304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17702752#comment-17702752 ] Paulo Motta commented on CASSANDRA-18304: - CI failed due to unused imports Resubmitted after fixing * 4.1 CI: [!https://ci-cassandra.apache.org/job/Cassandra-devbranch/2365/badge/icon!|https://ci-cassandra.apache.org/blue/organizations/jenkins/Cassandra-devbranch/detail/Cassandra-devbranch/2365/pipeline] * trunk CI: [!https://ci-cassandra.apache.org/job/Cassandra-devbranch/2366/badge/icon!|https://ci-cassandra.apache.org/blue/organizations/jenkins/Cassandra-devbranch/detail/Cassandra-devbranch/2366/pipeline] > hinted_handoff_enabled=false is not honored > --- > > Key: CASSANDRA-18304 > URL: https://issues.apache.org/jira/browse/CASSANDRA-18304 > Project: Cassandra > Issue Type: Bug > Components: Consistency/Hints >Reporter: Paulo Motta >Assignee: Paulo Motta >Priority: Normal > Fix For: 4.1.x, 5.x > > Time Spent: 50m > Remaining Estimate: 0h > > I've had some dtests with disabled hints failing. > After investigation it seems that CASSANDRA-17164 moved hint submission on > timeout from > [RequestCallbacks.onExpired|https://github.com/apache/cassandra/commit/d2923275e360a1ee9db498e748c269f701bb3a8b#diff-b73c13ea8cae91a215495917fe5e90d55c9f4a283f9e053110992bc9a60004b8L176] > to > [AbstractWriteResponseHandler.onFailure|https://github.com/apache/cassandra/commit/d2923275e360a1ee9db498e748c269f701bb3a8b#diff-3b202de0d077638bede7bf4076a15eb4d483b717f955f11e743efb8d27c6eb1dR285], > but it no longer checks if {{CallbackInfo.shouldHint}} which checks for > {{StorageProxy.shouldHint}} which ultimately checks if > {{{}hinted_handoff_enabled=true{}}}. > This could cause some tests which expect hints to be disabled to fail > intermittently. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org For additional commands, e-mail: commits-h...@cassandra.apache.org
[jira] [Commented] (CASSANDRA-18304) hinted_handoff_enabled=false is not honored
[ https://issues.apache.org/jira/browse/CASSANDRA-18304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17702317#comment-17702317 ] Paulo Motta commented on CASSANDRA-18304: - Thanks for the review. Incorporated [~aleksey] {{WriteCallbackInfo}} cleanup and moved shouldHint check to AbstractWriteResponseHandler#onFailure(). Also improved dtest a bit by removing 25s sleep for hint to be dispatched, instead I check that {{StorageMetrics.totalHints.getCount()}} after write timeout (15ms) to ensure hints are not submitted. * [4.1 PR|https://github.com/apache/cassandra/pull/2196] * [trunk PR|https://github.com/apache/cassandra/pull/2197] * 4.1 CI: [!https://ci-cassandra.apache.org/job/Cassandra-devbranch/2357/badge/icon!|https://ci-cassandra.apache.org/blue/organizations/jenkins/Cassandra-devbranch/detail/Cassandra-devbranch/2357/pipeline] * trunk CI: [!https://ci-cassandra.apache.org/job/Cassandra-devbranch/2358/badge/icon!|https://ci-cassandra.apache.org/blue/organizations/jenkins/Cassandra-devbranch/detail/Cassandra-devbranch/2358/pipeline] > hinted_handoff_enabled=false is not honored > --- > > Key: CASSANDRA-18304 > URL: https://issues.apache.org/jira/browse/CASSANDRA-18304 > Project: Cassandra > Issue Type: Bug > Components: Consistency/Hints >Reporter: Paulo Motta >Assignee: Paulo Motta >Priority: Normal > Fix For: 4.1.x, 5.x > > Time Spent: 50m > Remaining Estimate: 0h > > I've had some dtests with disabled hints failing. > After investigation it seems that CASSANDRA-17164 moved hint submission on > timeout from > [RequestCallbacks.onExpired|https://github.com/apache/cassandra/commit/d2923275e360a1ee9db498e748c269f701bb3a8b#diff-b73c13ea8cae91a215495917fe5e90d55c9f4a283f9e053110992bc9a60004b8L176] > to > [AbstractWriteResponseHandler.onFailure|https://github.com/apache/cassandra/commit/d2923275e360a1ee9db498e748c269f701bb3a8b#diff-3b202de0d077638bede7bf4076a15eb4d483b717f955f11e743efb8d27c6eb1dR285], > but it no longer checks if {{CallbackInfo.shouldHint}} which checks for > {{StorageProxy.shouldHint}} which ultimately checks if > {{{}hinted_handoff_enabled=true{}}}. > This could cause some tests which expect hints to be disabled to fail > intermittently. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org For additional commands, e-mail: commits-h...@cassandra.apache.org
[jira] [Commented] (CASSANDRA-18304) hinted_handoff_enabled=false is not honored
[ https://issues.apache.org/jira/browse/CASSANDRA-18304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698453#comment-17698453 ] Aleksey Yeschenko commented on CASSANDRA-18304: --- As for the {{shouldHint()}} check, that could easily live in {{{}AbstractWriteResponseHandler#onFailure(){}}}, which would be a more direct translation of previous logic, without risk of unintended consequences of introducing filtering to the {{StorageProxy}} method. {code} if (hintOnFailure != null && StorageProxy.shouldHint(replicaPlan.lookup(from))) { StorageProxy.submitHint(hintOnFailure.get(), replicaPlan.lookup(from), null); } {code} > hinted_handoff_enabled=false is not honored > --- > > Key: CASSANDRA-18304 > URL: https://issues.apache.org/jira/browse/CASSANDRA-18304 > Project: Cassandra > Issue Type: Bug > Components: Consistency/Hints >Reporter: Paulo Motta >Assignee: Paulo Motta >Priority: Normal > Fix For: 4.1.x, 5.x > > Time Spent: 40m > Remaining Estimate: 0h > > I've had some dtests with disabled hints failing. > After investigation it seems that CASSANDRA-17164 moved hint submission on > timeout from > [RequestCallbacks.onExpired|https://github.com/apache/cassandra/commit/d2923275e360a1ee9db498e748c269f701bb3a8b#diff-b73c13ea8cae91a215495917fe5e90d55c9f4a283f9e053110992bc9a60004b8L176] > to > [AbstractWriteResponseHandler.onFailure|https://github.com/apache/cassandra/commit/d2923275e360a1ee9db498e748c269f701bb3a8b#diff-3b202de0d077638bede7bf4076a15eb4d483b717f955f11e743efb8d27c6eb1dR285], > but it no longer checks if {{CallbackInfo.shouldHint}} which checks for > {{StorageProxy.shouldHint}} which ultimately checks if > {{{}hinted_handoff_enabled=true{}}}. > This could cause some tests which expect hints to be disabled to fail > intermittently. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org For additional commands, e-mail: commits-h...@cassandra.apache.org
[jira] [Commented] (CASSANDRA-18304) hinted_handoff_enabled=false is not honored
[ https://issues.apache.org/jira/browse/CASSANDRA-18304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698376#comment-17698376 ] Aleksey Yeschenko commented on CASSANDRA-18304: --- So, {{WriteCallbackInfo}} code is all dead weight and should be removed. Pushed a commit that does it here: https://github.com/iamaleksey/cassandra/commits/18304-dead-code-removal {{allowHints}} argument to some of the upstream methods needs to make its way to {{AbstractWriteResponseHandler}}, or, alternatively, we need to make sure that mutation supplier is always null when when {{!allowHints}} and never null when {{allowHints}}. > hinted_handoff_enabled=false is not honored > --- > > Key: CASSANDRA-18304 > URL: https://issues.apache.org/jira/browse/CASSANDRA-18304 > Project: Cassandra > Issue Type: Bug > Components: Consistency/Hints >Reporter: Paulo Motta >Assignee: Paulo Motta >Priority: Normal > Fix For: 4.1.x, 5.x > > Time Spent: 40m > Remaining Estimate: 0h > > I've had some dtests with disabled hints failing. > After investigation it seems that CASSANDRA-17164 moved hint submission on > timeout from > [RequestCallbacks.onExpired|https://github.com/apache/cassandra/commit/d2923275e360a1ee9db498e748c269f701bb3a8b#diff-b73c13ea8cae91a215495917fe5e90d55c9f4a283f9e053110992bc9a60004b8L176] > to > [AbstractWriteResponseHandler.onFailure|https://github.com/apache/cassandra/commit/d2923275e360a1ee9db498e748c269f701bb3a8b#diff-3b202de0d077638bede7bf4076a15eb4d483b717f955f11e743efb8d27c6eb1dR285], > but it no longer checks if {{CallbackInfo.shouldHint}} which checks for > {{StorageProxy.shouldHint}} which ultimately checks if > {{{}hinted_handoff_enabled=true{}}}. > This could cause some tests which expect hints to be disabled to fail > intermittently. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org For additional commands, e-mail: commits-h...@cassandra.apache.org
[jira] [Commented] (CASSANDRA-18304) hinted_handoff_enabled=false is not honored
[ https://issues.apache.org/jira/browse/CASSANDRA-18304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698071#comment-17698071 ] Stefan Miklosovic commented on CASSANDRA-18304: --- I've added some nits to the PR. Thanks. > hinted_handoff_enabled=false is not honored > --- > > Key: CASSANDRA-18304 > URL: https://issues.apache.org/jira/browse/CASSANDRA-18304 > Project: Cassandra > Issue Type: Bug > Components: Consistency/Hints >Reporter: Paulo Motta >Assignee: Paulo Motta >Priority: Normal > Fix For: 4.1.x, 5.x > > Time Spent: 40m > Remaining Estimate: 0h > > I've had some dtests with disabled hints failing. > After investigation it seems that CASSANDRA-17164 moved hint submission on > timeout from > [RequestCallbacks.onExpired|https://github.com/apache/cassandra/commit/d2923275e360a1ee9db498e748c269f701bb3a8b#diff-b73c13ea8cae91a215495917fe5e90d55c9f4a283f9e053110992bc9a60004b8L176] > to > [AbstractWriteResponseHandler.onFailure|https://github.com/apache/cassandra/commit/d2923275e360a1ee9db498e748c269f701bb3a8b#diff-3b202de0d077638bede7bf4076a15eb4d483b717f955f11e743efb8d27c6eb1dR285], > but it no longer checks if {{CallbackInfo.shouldHint}} which checks for > {{StorageProxy.shouldHint}} which ultimately checks if > {{{}hinted_handoff_enabled=true{}}}. > This could cause some tests which expect hints to be disabled to fail > intermittently. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org For additional commands, e-mail: commits-h...@cassandra.apache.org
[jira] [Commented] (CASSANDRA-18304) hinted_handoff_enabled=false is not honored
[ https://issues.apache.org/jira/browse/CASSANDRA-18304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17697501#comment-17697501 ] Paulo Motta commented on CASSANDRA-18304: - Thanks! 4.1 build seems to be fine, trunk skipped some tests.. rebased and resubmitted but still queued > hinted_handoff_enabled=false is not honored > --- > > Key: CASSANDRA-18304 > URL: https://issues.apache.org/jira/browse/CASSANDRA-18304 > Project: Cassandra > Issue Type: Bug > Components: Consistency/Hints >Reporter: Paulo Motta >Assignee: Paulo Motta >Priority: Normal > Fix For: 4.1.x, 5.x > > > I've had some dtests with disabled hints failing. > After investigation it seems that CASSANDRA-17164 moved hint submission on > timeout from > [RequestCallbacks.onExpired|https://github.com/apache/cassandra/commit/d2923275e360a1ee9db498e748c269f701bb3a8b#diff-b73c13ea8cae91a215495917fe5e90d55c9f4a283f9e053110992bc9a60004b8L176] > to > [AbstractWriteResponseHandler.onFailure|https://github.com/apache/cassandra/commit/d2923275e360a1ee9db498e748c269f701bb3a8b#diff-3b202de0d077638bede7bf4076a15eb4d483b717f955f11e743efb8d27c6eb1dR285], > but it no longer checks if {{CallbackInfo.shouldHint}} which checks for > {{StorageProxy.shouldHint}} which ultimately checks if > {{{}hinted_handoff_enabled=true{}}}. > This could cause some tests which expect hints to be disabled to fail > intermittently. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org For additional commands, e-mail: commits-h...@cassandra.apache.org
[jira] [Commented] (CASSANDRA-18304) hinted_handoff_enabled=false is not honored
[ https://issues.apache.org/jira/browse/CASSANDRA-18304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17697497#comment-17697497 ] Aleksey Yeschenko commented on CASSANDRA-18304: --- Sure, let me see. > hinted_handoff_enabled=false is not honored > --- > > Key: CASSANDRA-18304 > URL: https://issues.apache.org/jira/browse/CASSANDRA-18304 > Project: Cassandra > Issue Type: Bug > Components: Consistency/Hints >Reporter: Paulo Motta >Assignee: Paulo Motta >Priority: Normal > Fix For: 4.1.x, 5.x > > > I've had some dtests with disabled hints failing. > After investigation it seems that CASSANDRA-17164 moved hint submission on > timeout from > [RequestCallbacks.onExpired|https://github.com/apache/cassandra/commit/d2923275e360a1ee9db498e748c269f701bb3a8b#diff-b73c13ea8cae91a215495917fe5e90d55c9f4a283f9e053110992bc9a60004b8L176] > to > [AbstractWriteResponseHandler.onFailure|https://github.com/apache/cassandra/commit/d2923275e360a1ee9db498e748c269f701bb3a8b#diff-3b202de0d077638bede7bf4076a15eb4d483b717f955f11e743efb8d27c6eb1dR285], > but it no longer checks if {{CallbackInfo.shouldHint}} which checks for > {{StorageProxy.shouldHint}} which ultimately checks if > {{{}hinted_handoff_enabled=true{}}}. > This could cause some tests which expect hints to be disabled to fail > intermittently. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org For additional commands, e-mail: commits-h...@cassandra.apache.org
[jira] [Commented] (CASSANDRA-18304) hinted_handoff_enabled=false is not honored
[ https://issues.apache.org/jira/browse/CASSANDRA-18304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17697176#comment-17697176 ] Paulo Motta commented on CASSANDRA-18304: - Added dtest to reproduce issue. Fix is to filter endpoints on with {{StorageProxy::shouldHint}} on {{{}StorageProxy.submitHint{}}}, not sure if this has any unintended consequences. Can you take a look [~benedict] [~aleksey] ? * [4.1 PR|https://github.com/apache/cassandra/pull/2196] * [trunk PR|https://github.com/apache/cassandra/pull/2197] * 4.1 CI: [!https://ci-cassandra.apache.org/job/Cassandra-devbranch/2327/badge/icon!|https://ci-cassandra.apache.org/blue/organizations/jenkins/Cassandra-devbranch/detail/Cassandra-devbranch/2327/pipeline] * trunk CI: [!https://ci-cassandra.apache.org/job/Cassandra-devbranch/2328/badge/icon!|https://ci-cassandra.apache.org/blue/organizations/jenkins/Cassandra-devbranch/detail/Cassandra-devbranch/2328/pipeline] > hinted_handoff_enabled=false is not honored > --- > > Key: CASSANDRA-18304 > URL: https://issues.apache.org/jira/browse/CASSANDRA-18304 > Project: Cassandra > Issue Type: Bug > Components: Consistency/Hints >Reporter: Paulo Motta >Assignee: Paulo Motta >Priority: Normal > Fix For: 4.1.x > > > I've had some dtests with disabled hints failing. > After investigation it seems that CASSANDRA-17164 moved hint submission on > timeout from > [RequestCallbacks.onExpired|https://github.com/apache/cassandra/commit/d2923275e360a1ee9db498e748c269f701bb3a8b#diff-b73c13ea8cae91a215495917fe5e90d55c9f4a283f9e053110992bc9a60004b8L176] > to > [AbstractWriteResponseHandler.onFailure|https://github.com/apache/cassandra/commit/d2923275e360a1ee9db498e748c269f701bb3a8b#diff-3b202de0d077638bede7bf4076a15eb4d483b717f955f11e743efb8d27c6eb1dR285], > but it no longer checks if {{CallbackInfo.shouldHint}} which checks for > {{StorageProxy.shouldHint}} which ultimately checks if > {{{}hinted_handoff_enabled=true{}}}. > This could cause some tests which expect hints to be disabled to fail > intermittently. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org For additional commands, e-mail: commits-h...@cassandra.apache.org