[cassandra-website] branch asf-staging updated (ee5aa52b -> bf2ac307)

2023-08-24 Thread git-site-role
This is an automated email from the ASF dual-hosted git repository.

git-site-role pushed a change to branch asf-staging
in repository https://gitbox.apache.org/repos/asf/cassandra-website.git


 discard ee5aa52b generate docs for ce048d19
 new bf2ac307 generate docs for ce048d19

This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version.  This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:

 * -- * -- B -- O -- O -- O   (ee5aa52b)
\
 N -- N -- N   refs/heads/asf-staging (bf2ac307)

You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.

Any revisions marked "omit" are not gone; other references still
refer to them.  Any revisions marked "discard" are gone forever.

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 content/search-index.js |   2 +-
 site-ui/build/ui-bundle.zip | Bin 4852435 -> 4852435 bytes
 2 files changed, 1 insertion(+), 1 deletion(-)


-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[cassandra-website] branch asf-staging updated (4363ada1 -> ee5aa52b)

2023-08-24 Thread git-site-role
This is an automated email from the ASF dual-hosted git repository.

git-site-role pushed a change to branch asf-staging
in repository https://gitbox.apache.org/repos/asf/cassandra-website.git


 discard 4363ada1 generate docs for ce048d19
 new ee5aa52b generate docs for ce048d19

This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version.  This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:

 * -- * -- B -- O -- O -- O   (4363ada1)
\
 N -- N -- N   refs/heads/asf-staging (ee5aa52b)

You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.

Any revisions marked "omit" are not gone; other references still
refer to them.  Any revisions marked "discard" are gone forever.

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 content/search-index.js |   2 +-
 site-ui/build/ui-bundle.zip | Bin 4852435 -> 4852435 bytes
 2 files changed, 1 insertion(+), 1 deletion(-)


-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRASC-68) Add Metrics publisher interface to Sidecar to expose metrics for capture

2023-08-24 Thread Yifan Cai (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRASC-68?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yifan Cai updated CASSANDRASC-68:
-
Reviewers: Francisco Guerrero, Yifan Cai  (was: Yifan Cai)
   Status: Review In Progress  (was: Patch Available)

> Add Metrics publisher interface to Sidecar to expose metrics for capture
> 
>
> Key: CASSANDRASC-68
> URL: https://issues.apache.org/jira/browse/CASSANDRASC-68
> Project: Sidecar for Apache Cassandra
>  Issue Type: New Feature
>  Components: Rest API
>Reporter: Saranya Krishnakumar
>Assignee: Saranya Krishnakumar
>Priority: High
>
> We need metrics publisher interface in Sidecar to capture some of the metrics 
> like bytes written/streamed. 
> PR: [https://github.com/apache/cassandra-sidecar/pull/64]



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Commented] (CASSANDRASC-68) Add Metrics publisher interface to Sidecar to expose metrics for capture

2023-08-24 Thread Yifan Cai (Jira)


[ 
https://issues.apache.org/jira/browse/CASSANDRASC-68?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758773#comment-17758773
 ] 

Yifan Cai commented on CASSANDRASC-68:
--

+1 on the patch. Please post the CI link. 

> Add Metrics publisher interface to Sidecar to expose metrics for capture
> 
>
> Key: CASSANDRASC-68
> URL: https://issues.apache.org/jira/browse/CASSANDRASC-68
> Project: Sidecar for Apache Cassandra
>  Issue Type: New Feature
>  Components: Rest API
>Reporter: Saranya Krishnakumar
>Assignee: Saranya Krishnakumar
>Priority: High
>
> We need metrics publisher interface in Sidecar to capture some of the metrics 
> like bytes written/streamed. 
> PR: [https://github.com/apache/cassandra-sidecar/pull/64]



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-18572) Instance.nodetoolResult should connect to JMX if there is such feature enabled in its config

2023-08-24 Thread Stefan Miklosovic (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-18572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Stefan Miklosovic updated CASSANDRA-18572:
--
Fix Version/s: (was: 3.11.x)
   (was: 4.0.x)
   (was: 4.1.x)

> Instance.nodetoolResult should connect to JMX if there is such feature 
> enabled in its config
> 
>
> Key: CASSANDRA-18572
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18572
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Test/dtest/java
>Reporter: Stefan Miklosovic
>Assignee: Stefan Miklosovic
>Priority: Normal
> Fix For: 5.x
>
> Attachments: fix-jmx-issue-on-shutdown.patch
>
>  Time Spent: 2h 10m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-18725) IsolatedJMX should not release all TCPEndpoints on instance shutdown

2023-08-24 Thread Jon Meredith (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-18725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jon Meredith updated CASSANDRA-18725:
-
  Fix Version/s: 3.11.17
 4.0.12
 4.1.4
 5.0-alpha
 (was: 3.11.x)
 (was: 4.0.x)
 (was: 4.1.x)
 (was: 5.0.x)
Source Control Link:  
https://github.com/apache/cassandra/commit/c6d7d070c59d81db8949683d3e5670b909efb48c
 Resolution: Fixed
 Status: Resolved  (was: Ready to Commit)

> IsolatedJMX should not release all TCPEndpoints on instance shutdown
> 
>
> Key: CASSANDRA-18725
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18725
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Test/dtest/java
>Reporter: Doug Rohrer
>Assignee: Doug Rohrer
>Priority: Normal
> Fix For: 3.11.17, 4.0.12, 4.1.4, 5.0-alpha, 5.x
>
>  Time Spent: 2.5h
>  Remaining Estimate: 0h
>
> In the original implementation of the JMX feature, we fixed some memory leaks 
> by clearing some internal state in Java’s TCPEndpoint. However, that 
> implementation was overly aggressive and cleared the whole map, vs. just 
> removing the endpoints created by the individual instances. This causes 
> issues when you remove a node from the cluster (as all of the endpoints are 
> cleared, not just the ones in use by that instance).
>  
> In stead, we should check if the endpoint was created by the instance in 
> question and only remove it if it was.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Commented] (CASSANDRA-18725) IsolatedJMX should not release all TCPEndpoints on instance shutdown

2023-08-24 Thread Jon Meredith (Jira)


[ 
https://issues.apache.org/jira/browse/CASSANDRA-18725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758767#comment-17758767
 ] 

Jon Meredith commented on CASSANDRA-18725:
--

Reviewing test failures, I don't think any are due to the changes as it should 
only affect in-jvm tests and those failures are pre-existing.
{{code}}

*3.11*

j8_jvm_dtests

 testReprepareMixedVersionWithoutReset - hashcollision

j8_jvm_upgrade_dtests

 testDropCompactWithClusteringAndValueColumn  - cannot achieve consistency
 testDropCompactWithClusteringAndValueColumnWithDeletesAndWrites - unavailable 
exception
 org.apache.cassandra.distributed.upgrade.MixedModeReadTest - unavailable 
exception

*4.0*

j11_dtest
  test_move_backwards_between_and_cleanup - startup timeout

j11_jvm_dtests
  org.apache.cassandra.distributed.test.FailingRepairTest:testFailingMessage - 
test timeout

j11_unit_tests
  testPagingWithClustering

j8_jvm_dtests
  timeout in org.apache.cassandra.distributed.test.FailingRepairTest

j8_jvm_upgrade_dtests

  org.apache.cassandra.distributed.upgrade.MixedModeReadTest -- cannot achieve 
consistency


*4.1*

j11_dtests
  ttl_test.py::TestTTL::test_insert_ttl_has_priority_on_defaut_ttl

j8_jvm_upgrade_dtests
  org.apache.cassandra.distributed.upgrade.MixedModeReadTest -- cannot achieve 
consistency

j8_upgrade_dtests
  
TestProtoV3Upgrade_AllVersions_RandomPartitioner_EndsAt_Trunk_HEAD.test_parallel_upgrade_with_internode_ssl

j8_upgrade_dtests
  TestUpgrade_indev_4_1_x_To_indev_trunk.test_bootstrap_multidc

*5.0*

j11_dtests_vnode
  TestSecondaryIndexes.test_failing_manual_rebuild_index

*trunk*
  org.apache.cassandra.distributed.upgrade.MixedModeAvailabilityV30AllOneTest 
-- failing before commit
{{code}}

> IsolatedJMX should not release all TCPEndpoints on instance shutdown
> 
>
> Key: CASSANDRA-18725
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18725
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Test/dtest/java
>Reporter: Doug Rohrer
>Assignee: Doug Rohrer
>Priority: Normal
> Fix For: 3.11.x, 4.0.x, 4.1.x, 5.0.x, 5.x
>
>  Time Spent: 2.5h
>  Remaining Estimate: 0h
>
> In the original implementation of the JMX feature, we fixed some memory leaks 
> by clearing some internal state in Java’s TCPEndpoint. However, that 
> implementation was overly aggressive and cleared the whole map, vs. just 
> removing the endpoints created by the individual instances. This causes 
> issues when you remove a node from the cluster (as all of the endpoints are 
> cleared, not just the ones in use by that instance).
>  
> In stead, we should check if the endpoint was created by the instance in 
> question and only remove it if it was.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[cassandra] 01/01: Merge branch 'cassandra-5.0' into trunk

2023-08-24 Thread jonmeredith
This is an automated email from the ASF dual-hosted git repository.

jonmeredith pushed a commit to branch trunk
in repository https://gitbox.apache.org/repos/asf/cassandra.git

commit 6fb82b75d5e5f04af1a0bb2f73320c86db56829d
Merge: cbaef9094e d2f8e8e105
Author: Jon Meredith 
AuthorDate: Thu Aug 24 16:44:58 2023 -0600

Merge branch 'cassandra-5.0' into trunk

 .build/parent-pom-template.xml |  2 +-
 build.xml  |  1 +
 .../utils/RMIClientSocketFactoryImpl.java  | 22 +-
 .../apache/cassandra/utils/ReflectionUtils.java| 44 ++-
 .../cassandra/distributed/impl/Instance.java   |  5 +-
 .../cassandra/distributed/impl/IsolatedJmx.java| 88 ++
 .../cassandra/distributed/shared/ClusterUtils.java | 34 +++--
 .../distributed/test/ResourceLeakTest.java | 54 +++--
 .../distributed/test/jmx/JMXFeatureTest.java   | 85 ++---
 .../distributed/test/jmx/JMXGetterCheckTest.java   | 46 ---
 .../commitlog/CommitLogSegmentManagerCDCTest.java  |  2 +-
 11 files changed, 261 insertions(+), 122 deletions(-)

diff --cc src/java/org/apache/cassandra/utils/RMIClientSocketFactoryImpl.java
index 62ab88fb92,5caa92cce4..81e728eeb9
--- a/src/java/org/apache/cassandra/utils/RMIClientSocketFactoryImpl.java
+++ b/src/java/org/apache/cassandra/utils/RMIClientSocketFactoryImpl.java
@@@ -42,7 -45,23 +45,24 @@@ public class RMIClientSocketFactoryImp
  @Override
  public Socket createSocket(String host, int port) throws IOException
  {
- return new Socket(localAddress, port);
+ Socket socket = new Socket(localAddress, port);
+ sockets.add(socket);
+ return socket;
+ }
+ 
+ public void close() throws IOException
+ {
 -for (Socket socket: sockets) {
++for (Socket socket: sockets)
++{
+ try
+ {
+ socket.close();
+ }
+ catch (IOException ignored)
+ {
+ // intentionally ignored
+ }
+ }
  }
  
  @Override
diff --cc 
test/distributed/org/apache/cassandra/distributed/impl/IsolatedJmx.java
index e19e29fdb3,dd53ba4829..7812ec89f8
--- a/test/distributed/org/apache/cassandra/distributed/impl/IsolatedJmx.java
+++ b/test/distributed/org/apache/cassandra/distributed/impl/IsolatedJmx.java
@@@ -32,10 -31,12 +31,12 @@@ import javax.management.remote.JMXServi
  import javax.management.remote.rmi.RMIConnectorServer;
  import javax.management.remote.rmi.RMIJRMPServerImpl;
  
++import com.google.common.util.concurrent.Uninterruptibles;
  import org.slf4j.Logger;
  
 -import com.google.common.util.concurrent.Uninterruptibles;
  import org.apache.cassandra.distributed.api.IInstance;
  import org.apache.cassandra.distributed.api.IInstanceConfig;
+ import org.apache.cassandra.distributed.shared.JMXUtil;
  import org.apache.cassandra.utils.JMXServerUtils;
  import org.apache.cassandra.utils.MBeanWrapper;
  import org.apache.cassandra.utils.RMIClientSocketFactoryImpl;
@@@ -135,36 -137,20 +137,21 @@@ public class IsolatedJm
  }
  }
  
- private void waitForJmxAvailability(String hostname, int rmiPort, 
Map env) throws InterruptedException, MalformedURLException
+ private void waitForJmxAvailability(Map env)
  {
- String url = 
String.format("service:jmx:rmi:///jndi/rmi://%s:%d/jmxrmi", hostname, rmiPort);
- JMXServiceURL serviceURL = new JMXServiceURL(url);
- int attempts = 0;
- Throwable lastThrown = null;
- while (attempts < 20)
 -try (JMXConnector ignored = JMXUtil.getJmxConnector(config, 20, env)) 
{
++try (JMXConnector ignored = JMXUtil.getJmxConnector(config, 20, env))
 +{
- attempts++;
- try (JMXConnector ignored = 
JMXConnectorFactory.connect(serviceURL, env))
- {
- inInstancelogger.info("Connected to JMX server at {} after {} 
attempt(s)",
-   url, attempts);
- return;
- }
- catch (MalformedURLException e)
- {
- throw new RuntimeException(e);
- }
- catch (Throwable thrown)
- {
- lastThrown = thrown;
- }
- inInstancelogger.info("Could not connect to JMX on {} after {} 
attempts. Will retry.", url, attempts);
- Thread.sleep(1000);
+ // Do nothing - JMXUtil now retries
+ }
+ catch (IOException iex)
+ {
+ // If we land here, there's something more than a timeout
+ inInstancelogger.error(UNKNOWN_JMX_CONNECTION_ERROR, iex);
+ throw new RuntimeException(UNKNOWN_JMX_CONNECTION_ERROR, iex);
  }
- throw new RuntimeException("Could not start JMX - unreachable after 
20 attempts", lastThrown);
  }
  
- 

[cassandra] 01/01: Merge branch 'cassandra-4.1' into cassandra-5.0

2023-08-24 Thread jonmeredith
This is an automated email from the ASF dual-hosted git repository.

jonmeredith pushed a commit to branch cassandra-5.0
in repository https://gitbox.apache.org/repos/asf/cassandra.git

commit d2f8e8e10546a229d7280e3bf70780ccdbcb7320
Merge: 410018ab16 ac3b356063
Author: Jon Meredith 
AuthorDate: Thu Aug 24 16:44:04 2023 -0600

Merge branch 'cassandra-4.1' into cassandra-5.0

 .build/parent-pom-template.xml |  2 +-
 build.xml  |  1 +
 .../utils/RMIClientSocketFactoryImpl.java  | 21 +-
 .../apache/cassandra/utils/ReflectionUtils.java| 44 ++-
 .../cassandra/distributed/impl/Instance.java   |  5 +-
 .../cassandra/distributed/impl/IsolatedJmx.java| 87 +-
 .../cassandra/distributed/shared/ClusterUtils.java | 34 +++--
 .../distributed/test/ResourceLeakTest.java | 54 --
 .../distributed/test/jmx/JMXFeatureTest.java   | 85 ++---
 .../distributed/test/jmx/JMXGetterCheckTest.java   | 46 +---
 .../commitlog/CommitLogSegmentManagerCDCTest.java  |  2 +-
 11 files changed, 259 insertions(+), 122 deletions(-)

diff --cc .build/parent-pom-template.xml
index 7d80e5160d,00..ba1e2bb5a9
mode 100644,00..100644
--- a/.build/parent-pom-template.xml
+++ b/.build/parent-pom-template.xml
@@@ -1,1209 -1,0 +1,1209 @@@
 +
 +
 +http://maven.apache.org/POM/4.0.0 
http://maven.apache.org/xsd/maven-4.0.0.xsd; 
xmlns="http://maven.apache.org/POM/4.0.0;
 +xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance;>
 +  4.0.0
 +  
 +apache
 +org.apache
 +22
 +  
 +  org.apache.cassandra
 +  cassandra-parent
 +  @version@
 +  pom
 +  Apache Cassandra
 +  The Apache Cassandra Project develops a highly scalable 
second-generation distributed database, bringing together Dynamo's fully 
distributed design and Bigtable's ColumnFamily-based data model.
 +  https://cassandra.apache.org
 +  2009
 +  
 +
 +  The Apache Software License, Version 2.0
 +  https://www.apache.org/licenses/LICENSE-2.0.txt
 +
 +  
 +  
 +1.12.13
 +4.0.20
 +0.5.1
 +
 +
 +@asm.version@
 +@jamm.version@
 +
@allocation-instrumenter.version@
 +@ecj.version@
 +@jacoco.version@
 +@jflex.version@
 +  
 +  
 +
 +  adelapena
 +  Andres de la Peña
 +
 +
 +  alakshman
 +  Avinash Lakshman
 +
 +
 +  aleksey
 +  Aleksey Yeschenko
 +
 +
 +  amorton
 +  Aaron Morton
 +
 +
 +  aweisberg
 +  Ariel Weisberg
 +
 +
 +  bdeggleston
 +  Blake Eggleston
 +
 +
 +  benedict
 +  Benedict Elliott Smith
 +
 +
 +  benjamin
 +  Benjamin Lerer
 +
 +
 +  blambov
 +  Branimir Lambov
 +
 +
 +  brandonwilliams
 +  Brandon Williams
 +
 +
 +  carl
 +  Carl Yeksigian
 +
 +
 +  dbrosius
 +  David Brosiusd
 +
 +
 +  dikang
 +  Dikang Gu
 +
 +
 +  eevans
 +  Eric Evans
 +
 +
 +  edimitrova
 +  Ekaterina Dimitrova
 +
 +
 +  gdusbabek
 +  Gary Dusbabek
 +
 +
 +  goffinet
 +  Chris Goffinet
 +
 +
 +  ifesdjeen
 +  Alex Petrov
 +
 +
 +  jaakko
 +  Laine Jaakko Olavi
 +
 +
 +  jake
 +  T Jake Luciani
 +
 +
 +  jasonbrown
 +  Jason Brown
 +
 +
 +  jbellis
 +  Jonathan Ellis
 +
 +
 +  jfarrell
 +  Jake Farrell
 +
 +
 +  jjirsa
 +  Jeff Jirsa
 +
 +
 +  jkni
 +  Joel Knighton
 +
 +
 +  jmckenzie
 +  Josh McKenzie
 +
 +
 +  johan
 +  Johan Oskarsson
 +
 +
 +  junrao
 +  Jun Rao
 +
 +
 +  jzhuang
 +  Jay Zhuang
 +
 +
 +  kohlisankalp
 +  Sankalp Kohli
 +
 +
 +  marcuse
 +  Marcus Eriksson
 +
 +
 +  mck
 +  Michael Semb Wever
 +
 +
 +  mishail
 +  Mikhail Stepura
 +
 +
 +  mshuler
 +  Michael Shuler
 +
 +
 +  paulo
 +  Paulo Motta
 +
 +
 +  pmalik
 +  Prashant Malik
 +
 +
 +  rstupp
 +  Robert Stupp
 +
 +
 +  scode
 +  Peter Schuller
 +
 +
 +  beobal
 +  Sam Tunnicliffe
 +
 +
 +  slebresne
 +  Sylvain Lebresne
 +
 +
 +  stefania
 +  Stefania Alborghetti
 +
 +
 +  tylerhobbs
 +  Tyler Hobbs
 +
 +
 +  vijay
 +  Vijay Parthasarathy
 +
 +
 +  xedin
 +  Pavel Yaskevich
 +
 +
 +  yukim
 +  Yuki Morishita
 +
 +
 +  zznate
 +  Nate McCall
 +
 +
 +  smiklosovic
 +  Stefan Miklosovic
 +
 +  
 +  
 +
scm:https://gitbox.apache.org/repos/asf/cassandra.git
 +
scm:https://gitbox.apache.org/repos/asf/cassandra.git
 +

[cassandra] branch cassandra-5.0 updated (410018ab16 -> d2f8e8e105)

2023-08-24 Thread jonmeredith
This is an automated email from the ASF dual-hosted git repository.

jonmeredith pushed a change to branch cassandra-5.0
in repository https://gitbox.apache.org/repos/asf/cassandra.git


from 410018ab16 Fix spelling errors in the documentation for DDM
 new c6d7d070c5 IsolatedJMX should not release all TCPEndpoints on instance 
shutdown
 new 4034fbb6dd Merge branch 'cassandra-3.11' into cassandra-4.0
 new ac3b356063 Merge branch 'cassandra-4.0' into cassandra-4.1
 new d2f8e8e105 Merge branch 'cassandra-4.1' into cassandra-5.0

The 4 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .build/parent-pom-template.xml |  2 +-
 build.xml  |  1 +
 .../utils/RMIClientSocketFactoryImpl.java  | 21 +-
 .../apache/cassandra/utils/ReflectionUtils.java| 44 ++-
 .../cassandra/distributed/impl/Instance.java   |  5 +-
 .../cassandra/distributed/impl/IsolatedJmx.java| 87 +-
 .../cassandra/distributed/shared/ClusterUtils.java | 34 +++--
 .../distributed/test/ResourceLeakTest.java | 54 --
 .../distributed/test/jmx/JMXFeatureTest.java   | 85 ++---
 .../distributed/test/jmx/JMXGetterCheckTest.java   | 46 +---
 .../commitlog/CommitLogSegmentManagerCDCTest.java  |  2 +-
 11 files changed, 259 insertions(+), 122 deletions(-)


-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[cassandra] branch cassandra-3.11 updated: IsolatedJMX should not release all TCPEndpoints on instance shutdown

2023-08-24 Thread jonmeredith
This is an automated email from the ASF dual-hosted git repository.

jonmeredith pushed a commit to branch cassandra-3.11
in repository https://gitbox.apache.org/repos/asf/cassandra.git


The following commit(s) were added to refs/heads/cassandra-3.11 by this push:
 new c6d7d070c5 IsolatedJMX should not release all TCPEndpoints on instance 
shutdown
c6d7d070c5 is described below

commit c6d7d070c59d81db8949683d3e5670b909efb48c
Author: Doug Rohrer 
AuthorDate: Wed Aug 23 18:03:30 2023 -0600

IsolatedJMX should not release all TCPEndpoints on instance shutdown

patch by Doug Rohrer; reviewed by Jon Meredith, Stefan Miklosovic for 
CASSANDRA-18725
---
 build.xml  |   2 +-
 .../utils/RMIClientSocketFactoryImpl.java  |  23 ++-
 .../apache/cassandra/utils/ReflectionUtils.java| 101 +
 .../cassandra/distributed/impl/Instance.java   |   5 +-
 .../cassandra/distributed/impl/IsolatedJmx.java|  95 -
 .../cassandra/distributed/shared/ClusterUtils.java | 226 +
 .../distributed/shared/WithProperties.java | 112 ++
 .../distributed/test/ResourceLeakTest.java |  54 ++---
 .../distributed/test/jmx/JMXFeatureTest.java   |  57 +-
 .../distributed/test/jmx/JMXGetterCheckTest.java   |  48 +++--
 10 files changed, 627 insertions(+), 96 deletions(-)

diff --git a/build.xml b/build.xml
index c634761566..70a195f98d 100644
--- a/build.xml
+++ b/build.xml
@@ -383,7 +383,7 @@
 
   
   
-  
+  
   
   
   
diff --git 
a/src/java/org/apache/cassandra/utils/RMIClientSocketFactoryImpl.java 
b/src/java/org/apache/cassandra/utils/RMIClientSocketFactoryImpl.java
index 62ab88fb92..c04e934fdc 100644
--- a/src/java/org/apache/cassandra/utils/RMIClientSocketFactoryImpl.java
+++ b/src/java/org/apache/cassandra/utils/RMIClientSocketFactoryImpl.java
@@ -21,8 +21,11 @@ package org.apache.cassandra.utils;
 import java.io.IOException;
 import java.io.Serializable;
 import java.net.InetAddress;
+import java.net.ServerSocket;
 import java.net.Socket;
 import java.rmi.server.RMIClientSocketFactory;
+import java.util.ArrayList;
+import java.util.List;
 import java.util.Objects;
 
 /**
@@ -32,6 +35,7 @@ import java.util.Objects;
  */
 public class RMIClientSocketFactoryImpl implements RMIClientSocketFactory, 
Serializable
 {
+List sockets = new ArrayList<>();
 private final InetAddress localAddress;
 
 public RMIClientSocketFactoryImpl(InetAddress localAddress)
@@ -42,7 +46,24 @@ public class RMIClientSocketFactoryImpl implements 
RMIClientSocketFactory, Seria
 @Override
 public Socket createSocket(String host, int port) throws IOException
 {
-return new Socket(localAddress, port);
+Socket socket = new Socket(localAddress, port);
+sockets.add(socket);
+return socket;
+}
+
+public void close() throws IOException
+{
+for (Socket socket: sockets)
+{
+try
+{
+socket.close();
+}
+catch (IOException ignored)
+{
+// intentionally ignored
+}
+}
 }
 
 @Override
diff --git a/src/java/org/apache/cassandra/utils/ReflectionUtils.java 
b/src/java/org/apache/cassandra/utils/ReflectionUtils.java
new file mode 100644
index 00..3d1cc29565
--- /dev/null
+++ b/src/java/org/apache/cassandra/utils/ReflectionUtils.java
@@ -0,0 +1,101 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.cassandra.utils;
+
+import java.lang.reflect.Field;
+import java.lang.reflect.Method;
+import java.util.Iterator;
+import java.util.Map;
+import java.util.function.Predicate;
+
+public class ReflectionUtils
+{
+public static Field getField(Class clazz, String fieldName) throws 
NoSuchFieldException
+{
+// below code works before Java 12
+try
+{
+return clazz.getDeclaredField(fieldName);
+}
+catch (NoSuchFieldException e)
+{
+// this is mitigation for JDK 17 
(https://bugs.openjdk.org/browse/JDK-8210522)
+try
+   

[cassandra] branch cassandra-4.1 updated (8666265521 -> ac3b356063)

2023-08-24 Thread jonmeredith
This is an automated email from the ASF dual-hosted git repository.

jonmeredith pushed a change to branch cassandra-4.1
in repository https://gitbox.apache.org/repos/asf/cassandra.git


from 8666265521 Merge branch 'cassandra-4.0' into cassandra-4.1
 new c6d7d070c5 IsolatedJMX should not release all TCPEndpoints on instance 
shutdown
 new 4034fbb6dd Merge branch 'cassandra-3.11' into cassandra-4.0
 new ac3b356063 Merge branch 'cassandra-4.0' into cassandra-4.1

The 3 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 build.xml  |  5 +-
 .../utils/RMIClientSocketFactoryImpl.java  | 21 +-
 .../apache/cassandra/utils/ReflectionUtils.java| 43 +++
 .../cassandra/distributed/impl/Instance.java   |  5 +-
 .../cassandra/distributed/impl/IsolatedJmx.java| 87 +-
 .../cassandra/distributed/shared/ClusterUtils.java | 34 +++--
 .../distributed/test/ResourceLeakTest.java | 52 +++--
 .../distributed/test/jmx/JMXFeatureTest.java   | 86 ++---
 .../distributed/test/jmx/JMXGetterCheckTest.java   | 46 +---
 9 files changed, 259 insertions(+), 120 deletions(-)


-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[cassandra] 01/01: Merge branch 'cassandra-4.0' into cassandra-4.1

2023-08-24 Thread jonmeredith
This is an automated email from the ASF dual-hosted git repository.

jonmeredith pushed a commit to branch cassandra-4.1
in repository https://gitbox.apache.org/repos/asf/cassandra.git

commit ac3b356063d38833214608c873f25ad0a27ea16e
Merge: 8666265521 4034fbb6dd
Author: Jon Meredith 
AuthorDate: Thu Aug 24 16:38:53 2023 -0600

Merge branch 'cassandra-4.0' into cassandra-4.1

 build.xml  |  5 +-
 .../utils/RMIClientSocketFactoryImpl.java  | 21 +-
 .../apache/cassandra/utils/ReflectionUtils.java| 43 +++
 .../cassandra/distributed/impl/Instance.java   |  5 +-
 .../cassandra/distributed/impl/IsolatedJmx.java| 87 +-
 .../cassandra/distributed/shared/ClusterUtils.java | 34 +++--
 .../distributed/test/ResourceLeakTest.java | 52 +++--
 .../distributed/test/jmx/JMXFeatureTest.java   | 86 ++---
 .../distributed/test/jmx/JMXGetterCheckTest.java   | 46 +---
 9 files changed, 259 insertions(+), 120 deletions(-)

diff --cc build.xml
index 3593d4bd70,5812360e27..8d9b8f5516
--- a/build.xml
+++ b/build.xml
@@@ -153,8 -146,6 +153,8 @@@
  
  
  
- 
++
 +
  

  
diff --cc src/java/org/apache/cassandra/utils/RMIClientSocketFactoryImpl.java
index 62ab88fb92,81e728eeb9..5caa92cce4
--- a/src/java/org/apache/cassandra/utils/RMIClientSocketFactoryImpl.java
+++ b/src/java/org/apache/cassandra/utils/RMIClientSocketFactoryImpl.java
@@@ -42,7 -45,24 +45,23 @@@ public class RMIClientSocketFactoryImp
  @Override
  public Socket createSocket(String host, int port) throws IOException
  {
- return new Socket(localAddress, port);
+ Socket socket = new Socket(localAddress, port);
+ sockets.add(socket);
+ return socket;
+ }
+ 
+ public void close() throws IOException
+ {
 -for (Socket socket: sockets)
 -{
++for (Socket socket: sockets) {
+ try
+ {
+ socket.close();
+ }
+ catch (IOException ignored)
+ {
+ // intentionally ignored
+ }
+ }
  }
  
  @Override
diff --cc src/java/org/apache/cassandra/utils/ReflectionUtils.java
index bd605db3bc,e2280e66b0..07802267f1
--- a/src/java/org/apache/cassandra/utils/ReflectionUtils.java
+++ b/src/java/org/apache/cassandra/utils/ReflectionUtils.java
@@@ -20,8 -20,12 +20,11 @@@ package org.apache.cassandra.utils
  
  import java.lang.reflect.Field;
  import java.lang.reflect.Method;
+ import java.util.Iterator;
+ import java.util.Map;
+ import java.util.function.Predicate;
  
 -public class ReflectionUtils
 -{
 +public class ReflectionUtils {
  public static Field getField(Class clazz, String fieldName) throws 
NoSuchFieldException
  {
  // below code works before Java 12
diff --cc test/distributed/org/apache/cassandra/distributed/impl/Instance.java
index 9975aeb9eb,39f5e980af..4b4276774b
--- a/test/distributed/org/apache/cassandra/distributed/impl/Instance.java
+++ b/test/distributed/org/apache/cassandra/distributed/impl/Instance.java
@@@ -755,9 -641,9 +755,9 @@@ public class Instance extends IsolatedE
  initialized = true;
  }
  
- private void startJmx()
+ private synchronized void startJmx()
  {
 -isolatedJmx = new IsolatedJmx(this, inInstancelogger);
 +this.isolatedJmx = new IsolatedJmx(this, inInstancelogger);
  isolatedJmx.startJmx();
  }
  
diff --cc 
test/distributed/org/apache/cassandra/distributed/test/ResourceLeakTest.java
index 794873feea,f318a1b0e0..7e4581c99c
--- 
a/test/distributed/org/apache/cassandra/distributed/test/ResourceLeakTest.java
+++ 
b/test/distributed/org/apache/cassandra/distributed/test/ResourceLeakTest.java
@@@ -47,7 -48,7 +47,8 @@@ import static org.apache.cassandra.dist
  import static org.apache.cassandra.distributed.api.Feature.JMX;
  import static org.apache.cassandra.distributed.api.Feature.NATIVE_PROTOCOL;
  import static org.apache.cassandra.distributed.api.Feature.NETWORK;
+ import static 
org.apache.cassandra.distributed.test.jmx.JMXGetterCheckTest.testAllValidGetters;
 +import static org.apache.cassandra.utils.FBUtilities.now;
  import static org.hamcrest.Matchers.startsWith;
  
  /* Resource Leak Test - useful when tracking down issues with in-JVM 
framework cleanup.
diff --cc 
test/distributed/org/apache/cassandra/distributed/test/jmx/JMXFeatureTest.java
index 83a35e594d,ea1efa8902..a1576d6e36
--- 
a/test/distributed/org/apache/cassandra/distributed/test/jmx/JMXFeatureTest.java
+++ 
b/test/distributed/org/apache/cassandra/distributed/test/jmx/JMXFeatureTest.java
@@@ -18,9 -18,8 +18,9 @@@
  
  package org.apache.cassandra.distributed.test.jmx;
  
- import java.io.IOException;
  import java.util.HashSet;
  import java.util.Set;
++
  import javax.management.MBeanServerConnection;
  import javax.management.remote.JMXConnector;
  



[cassandra] branch trunk updated (cbaef9094e -> 6fb82b75d5)

2023-08-24 Thread jonmeredith
This is an automated email from the ASF dual-hosted git repository.

jonmeredith pushed a change to branch trunk
in repository https://gitbox.apache.org/repos/asf/cassandra.git


from cbaef9094e Merge branch 'cassandra-5.0' into trunk
 new c6d7d070c5 IsolatedJMX should not release all TCPEndpoints on instance 
shutdown
 new 4034fbb6dd Merge branch 'cassandra-3.11' into cassandra-4.0
 new ac3b356063 Merge branch 'cassandra-4.0' into cassandra-4.1
 new d2f8e8e105 Merge branch 'cassandra-4.1' into cassandra-5.0
 new 6fb82b75d5 Merge branch 'cassandra-5.0' into trunk

The 5 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .build/parent-pom-template.xml |  2 +-
 build.xml  |  1 +
 .../utils/RMIClientSocketFactoryImpl.java  | 22 +-
 .../apache/cassandra/utils/ReflectionUtils.java| 44 ++-
 .../cassandra/distributed/impl/Instance.java   |  5 +-
 .../cassandra/distributed/impl/IsolatedJmx.java| 88 ++
 .../cassandra/distributed/shared/ClusterUtils.java | 34 +++--
 .../distributed/test/ResourceLeakTest.java | 54 +++--
 .../distributed/test/jmx/JMXFeatureTest.java   | 85 ++---
 .../distributed/test/jmx/JMXGetterCheckTest.java   | 46 ---
 .../commitlog/CommitLogSegmentManagerCDCTest.java  |  2 +-
 11 files changed, 261 insertions(+), 122 deletions(-)


-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[cassandra] 01/01: Merge branch 'cassandra-3.11' into cassandra-4.0

2023-08-24 Thread jonmeredith
This is an automated email from the ASF dual-hosted git repository.

jonmeredith pushed a commit to branch cassandra-4.0
in repository https://gitbox.apache.org/repos/asf/cassandra.git

commit 4034fbb6dd4b9026b5227458a63c82e7e8075459
Merge: d13b3ef61b c6d7d070c5
Author: Jon Meredith 
AuthorDate: Thu Aug 24 16:32:51 2023 -0600

Merge branch 'cassandra-3.11' into cassandra-4.0

 build.xml  |  5 +-
 .../utils/RMIClientSocketFactoryImpl.java  | 22 +-
 .../apache/cassandra/utils/ReflectionUtils.java| 46 +++-
 .../cassandra/distributed/impl/Instance.java   |  5 +-
 .../cassandra/distributed/impl/IsolatedJmx.java| 87 +-
 .../cassandra/distributed/shared/ClusterUtils.java | 34 +++--
 .../distributed/test/ResourceLeakTest.java | 54 --
 .../distributed/test/jmx/JMXFeatureTest.java   | 85 ++---
 .../distributed/test/jmx/JMXGetterCheckTest.java   | 46 +---
 9 files changed, 262 insertions(+), 122 deletions(-)

diff --cc build.xml
index 0b914175bb,70a195f98d..5812360e27
--- a/build.xml
+++ b/build.xml
@@@ -176,111 -160,6 +176,112 @@@
  }
  
  
 +
 +
 +
 +
 +
 +
 +
 +
 +
 +
 +
 +
 +-Djdk.attach.allowAttachSelf=true
 +
 +-XX:+UseConcMarkSweepGC
 +-XX:+CMSParallelRemarkEnabled
 +-XX:SurvivorRatio=8
 +-XX:MaxTenuringThreshold=1
 +-XX:CMSInitiatingOccupancyFraction=75
 +-XX:+UseCMSInitiatingOccupancyOnly
 +-XX:CMSWaitDuration=1
 +-XX:+CMSParallelInitialMarkEnabled
 +-XX:+CMSEdenChunksRecordAlways
 +
 +--add-exports java.base/jdk.internal.misc=ALL-UNNAMED
 +--add-exports java.base/jdk.internal.ref=ALL-UNNAMED
 +--add-exports java.base/sun.nio.ch=ALL-UNNAMED
 +--add-exports 
java.management.rmi/com.sun.jmx.remote.internal.rmi=ALL-UNNAMED
 +--add-exports java.rmi/sun.rmi.registry=ALL-UNNAMED
 +--add-exports java.rmi/sun.rmi.server=ALL-UNNAMED
++--add-exports java.rmi/sun.rmi.transport=ALL-UNNAMED
 +--add-exports 
java.rmi/sun.rmi.transport.tcp=ALL-UNNAMED
 +--add-exports java.sql/java.sql=ALL-UNNAMED
 +
 +--add-opens java.base/java.lang.module=ALL-UNNAMED
 +--add-opens java.base/java.net=ALL-UNNAMED
 +--add-opens java.base/jdk.internal.loader=ALL-UNNAMED
 +--add-opens java.base/jdk.internal.ref=ALL-UNNAMED
 +--add-opens 
java.base/jdk.internal.reflect=ALL-UNNAMED
 +--add-opens java.base/jdk.internal.math=ALL-UNNAMED
 +--add-opens java.base/jdk.internal.module=ALL-UNNAMED
 +--add-opens 
java.base/jdk.internal.util.jar=ALL-UNNAMED
 +--add-opens 
jdk.management/com.sun.management.internal=ALL-UNNAMED
 +
 +
 +
 +
 +
 +
 +
 +
 +
 +
 +
 +  
 +
 +
 +
 +-XX:-CMSClassUnloadingEnabled
 +-Dio.netty.tryReflectionSetAccessible=true
 +
 +
 +
 +
 +
 +
 +
 +
 +
 +
 +
 +
 +
 +
 +
 +
 +
 +
 +
 +
 +
 +
 +
 +
 +
 +
 +
 +
 +
 +
 +
  
@@@ -552,35 -383,30 +553,35 @@@
  


 +  
 +  
 +
 +  
-   
+   

 -  

 -  
 -  
 -  
 -  
 -  
 +
 +
 +
 +
 +
  
 +


 -   
 + 
 +
  

 -  
 +  
  
 -  
 -  
 +  
 +  
  
 -  
 -  
 -  
 -  
 +  
 +  
 +  
 +  
  


@@@ -2003,32 -1752,13 +2004,32 @@@


  
 +  
 +
 +
 +
 +
 +
 +  
 +  
 +

 -  
 +  
  
  
 -
 +
  
  
 +
 +
  
  Apache Cassandra ${eclipse.project.name}
  

[cassandra] branch cassandra-4.0 updated (d13b3ef61b -> 4034fbb6dd)

2023-08-24 Thread jonmeredith
This is an automated email from the ASF dual-hosted git repository.

jonmeredith pushed a change to branch cassandra-4.0
in repository https://gitbox.apache.org/repos/asf/cassandra.git


from d13b3ef61b Merge branch 'cassandra-3.11' into cassandra-4.0
 new c6d7d070c5 IsolatedJMX should not release all TCPEndpoints on instance 
shutdown
 new 4034fbb6dd Merge branch 'cassandra-3.11' into cassandra-4.0

The 2 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 build.xml  |  5 +-
 .../utils/RMIClientSocketFactoryImpl.java  | 22 +-
 .../apache/cassandra/utils/ReflectionUtils.java| 46 +++-
 .../cassandra/distributed/impl/Instance.java   |  5 +-
 .../cassandra/distributed/impl/IsolatedJmx.java| 87 +-
 .../cassandra/distributed/shared/ClusterUtils.java | 34 +++--
 .../distributed/test/ResourceLeakTest.java | 54 --
 .../distributed/test/jmx/JMXFeatureTest.java   | 85 ++---
 .../distributed/test/jmx/JMXGetterCheckTest.java   | 46 +---
 9 files changed, 262 insertions(+), 122 deletions(-)


-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[cassandra-website] branch asf-staging updated (c03b5d639 -> 4363ada12)

2023-08-24 Thread git-site-role
This is an automated email from the ASF dual-hosted git repository.

git-site-role pushed a change to branch asf-staging
in repository https://gitbox.apache.org/repos/asf/cassandra-website.git


 discard c03b5d639 generate docs for ce048d19
 new 4363ada12 generate docs for ce048d19

This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version.  This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:

 * -- * -- B -- O -- O -- O   (c03b5d639)
\
 N -- N -- N   refs/heads/asf-staging (4363ada12)

You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.

Any revisions marked "omit" are not gone; other references still
refer to them.  Any revisions marked "discard" are gone forever.

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 site-ui/build/ui-bundle.zip | Bin 4852435 -> 4852435 bytes
 1 file changed, 0 insertions(+), 0 deletions(-)


-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Commented] (CASSANDRA-18745) cqlsh should warn on server version mismatch

2023-08-24 Thread Brandon Williams (Jira)


[ 
https://issues.apache.org/jira/browse/CASSANDRA-18745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758740#comment-17758740
 ] 

Brandon Williams commented on CASSANDRA-18745:
--

Running from the src directory isn't a problem if C* has been built:

{noformat}
$ ../bin/cqlsh
Connection error: ('Unable to connect to any servers', {'127.0.0.1:9042': 
ConnectionRefusedError(111, "Tried connecting to [('127.0.0.1', 9042)]. Last 
error: Connection refused")})
{noformat}

I'm not against printing some warning if it can't be imported instead, but will 
note this only happens with source that isn't built - binaries and packages 
will have a serverversion.py since they include a compiled server.

> cqlsh should warn on server version mismatch
> 
>
> Key: CASSANDRA-18745
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18745
> Project: Cassandra
>  Issue Type: Improvement
>  Components: CQL/Interpreter
>Reporter: Brandon Williams
>Assignee: Brandon Williams
>Priority: Normal
> Fix For: 3.0.30, 3.11.16, 4.0.12, 4.1.4, 5.0, 5.1
>
>
> When cqlsh is used against a different version of the server than the one 
> that it shipped with, it should emit a warning so that users aren't confused 
> when some things don't work correctly.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Commented] (CASSANDRA-18745) cqlsh should warn on server version mismatch

2023-08-24 Thread Brad Schoening (Jira)


[ 
https://issues.apache.org/jira/browse/CASSANDRA-18745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758738#comment-17758738
 ] 

Brad Schoening commented on CASSANDRA-18745:


Yes, understand its being run from the src directory, but it doesn't seem like 
it needs to be a fatal error.

> cqlsh should warn on server version mismatch
> 
>
> Key: CASSANDRA-18745
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18745
> Project: Cassandra
>  Issue Type: Improvement
>  Components: CQL/Interpreter
>Reporter: Brandon Williams
>Assignee: Brandon Williams
>Priority: Normal
> Fix For: 3.0.30, 3.11.16, 4.0.12, 4.1.4, 5.0, 5.1
>
>
> When cqlsh is used against a different version of the server than the one 
> that it shipped with, it should emit a warning so that users aren't confused 
> when some things don't work correctly.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Comment Edited] (CASSANDRA-18745) cqlsh should warn on server version mismatch

2023-08-24 Thread Brandon Williams (Jira)


[ 
https://issues.apache.org/jira/browse/CASSANDRA-18745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758736#comment-17758736
 ] 

Brandon Williams edited comment on CASSANDRA-18745 at 8/24/23 9:43 PM:
---

That is an indication your C* hasn't been built.  We could make it throw a more 
informative error to that effect though.


was (Author: brandon.williams):
That is an indication your C* hasn't been built.

> cqlsh should warn on server version mismatch
> 
>
> Key: CASSANDRA-18745
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18745
> Project: Cassandra
>  Issue Type: Improvement
>  Components: CQL/Interpreter
>Reporter: Brandon Williams
>Assignee: Brandon Williams
>Priority: Normal
> Fix For: 3.0.30, 3.11.16, 4.0.12, 4.1.4, 5.0, 5.1
>
>
> When cqlsh is used against a different version of the server than the one 
> that it shipped with, it should emit a warning so that users aren't confused 
> when some things don't work correctly.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Commented] (CASSANDRA-18745) cqlsh should warn on server version mismatch

2023-08-24 Thread Brandon Williams (Jira)


[ 
https://issues.apache.org/jira/browse/CASSANDRA-18745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758736#comment-17758736
 ] 

Brandon Williams commented on CASSANDRA-18745:
--

That is an indication your C* hasn't been built.

> cqlsh should warn on server version mismatch
> 
>
> Key: CASSANDRA-18745
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18745
> Project: Cassandra
>  Issue Type: Improvement
>  Components: CQL/Interpreter
>Reporter: Brandon Williams
>Assignee: Brandon Williams
>Priority: Normal
> Fix For: 3.0.30, 3.11.16, 4.0.12, 4.1.4, 5.0, 5.1
>
>
> When cqlsh is used against a different version of the server than the one 
> that it shipped with, it should emit a warning so that users aren't confused 
> when some things don't work correctly.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Commented] (CASSANDRA-18564) Test Failure: MixedModeAvailabilityV30AllOneTest.testAvailabilityCoordinatorUpgraded

2023-08-24 Thread Caleb Rackliffe (Jira)


[ 
https://issues.apache.org/jira/browse/CASSANDRA-18564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758735#comment-17758735
 ] 

Caleb Rackliffe commented on CASSANDRA-18564:
-

bq. We could simply skip testing the cases where the query should timeout. 
After all, those expected timeouts due to down replicas seem indistinguishable 
from the timeouts produced by an overloaded CI environment. wdyt?

That seems reasonable to me.

> Test Failure: 
> MixedModeAvailabilityV30AllOneTest.testAvailabilityCoordinatorUpgraded
> 
>
> Key: CASSANDRA-18564
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18564
> Project: Cassandra
>  Issue Type: Bug
>  Components: Test/dtest/java
>Reporter: Andres de la Peña
>Assignee: Andres de la Peña
>Priority: Normal
> Fix For: 5.0.x, 5.x
>
>
> The JVM upgrade dtest 
> {{MixedModeAvailabilityV3XAllOneTest.testAvailabilityCoordinatorUpgraded}} 
> seems to be flaky at least in {{trunk}}:
> {code}
> junit.framework.AssertionFailedError: Error in test '4.0.11 -> [5.0]' while 
> upgrading to '5.0'; successful upgrades []
>   at 
> org.apache.cassandra.distributed.upgrade.UpgradeTestBase$TestCase.run(UpgradeTestBase.java:348)
>   at 
> org.apache.cassandra.distributed.upgrade.MixedModeAvailabilityTestBase.testAvailability(MixedModeAvailabilityTestBase.java:154)
>   at 
> org.apache.cassandra.distributed.upgrade.MixedModeAvailabilityTestBase.testAvailabilityCoordinatorUpgraded(MixedModeAvailabilityTestBase.java:74)
> Caused by: java.lang.AssertionError: Unexpected error while reading in case 
> write-read consistency ALL-ONE with upgraded coordinator and 2 nodes down: 
> org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - 
> received only 0 responses.
>   at 
> org.apache.cassandra.distributed.upgrade.MixedModeAvailabilityTestBase.lambda$testAvailability$6(MixedModeAvailabilityTestBase.java:145)
>   at 
> org.apache.cassandra.distributed.upgrade.UpgradeTestBase$TestCase.run(UpgradeTestBase.java:339)
> Caused by: org.apache.cassandra.exceptions.ReadTimeoutException: Operation 
> timed out - received only 0 responses.
>   at 
> org.apache.cassandra.service.reads.ReadCallback.awaitResults(ReadCallback.java:162)
>   at 
> org.apache.cassandra.service.reads.AbstractReadExecutor.awaitResponses(AbstractReadExecutor.java:387)
>   at 
> org.apache.cassandra.service.StorageProxy.fetchRows(StorageProxy.java:2124)
>   at 
> org.apache.cassandra.service.StorageProxy.readRegular(StorageProxy.java:1995)
>   at 
> org.apache.cassandra.service.StorageProxy.read(StorageProxy.java:1873)
>   at 
> org.apache.cassandra.db.SinglePartitionReadCommand$Group.execute(SinglePartitionReadCommand.java:1286)
>   at 
> org.apache.cassandra.cql3.statements.SelectStatement.execute(SelectStatement.java:364)
>   at 
> org.apache.cassandra.cql3.statements.SelectStatement.execute(SelectStatement.java:293)
>   at 
> org.apache.cassandra.cql3.statements.SelectStatement.execute(SelectStatement.java:105)
>   at 
> org.apache.cassandra.distributed.impl.Coordinator.unsafeExecuteInternal(Coordinator.java:122)
>   at 
> org.apache.cassandra.distributed.impl.Coordinator.unsafeExecuteInternal(Coordinator.java:103)
>   at 
> org.apache.cassandra.distributed.impl.Coordinator.lambda$executeWithResult$0(Coordinator.java:66)
>   at org.apache.cassandra.concurrent.FutureTask.call(FutureTask.java:61)
>   at org.apache.cassandra.concurrent.FutureTask.run(FutureTask.java:71)
>   at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
>   at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>   at 
> io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
>   at java.lang.Thread.run(Thread.java:750)
> {code}
> This has failed 143 times in 500 iterations of this CircleCI run:
> * 
> https://app.circleci.com/pipelines/github/adelapena/cassandra/2927/workflows/fcd1cd60-826b-484a-8e81-d3ba640f7de9/jobs/47659/tests
> The failure has also recently appeared on Jenkins too:
> * 
> https://ci-cassandra.apache.org/job/Cassandra-trunk/1585/testReport/org.apache.cassandra.distributed.upgrade/MixedModeAvailabilityV3XAllOneTest/testAvailabilityCoordinatorUpgraded__jdk11/
> Given that the failure has just appeared on Jenkins and it fails relatively 
> easily on CircleCI, it's likely that it has been broken by a very recent 
> change.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: 

[jira] [Commented] (CASSANDRA-18745) cqlsh should warn on server version mismatch

2023-08-24 Thread Brad Schoening (Jira)


[ 
https://issues.apache.org/jira/browse/CASSANDRA-18745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758734#comment-17758734
 ] 

Brad Schoening commented on CASSANDRA-18745:


[~brandon.williams] would be helpful if this had a try/catch around the import 
of serverversion and didn't fail outright if serververison is missing. This can 
happen if you run directly from the src directory, for example:

 
{quote}../bin/cqlsh 

Traceback (most recent call last):

  File "/Users/.../cassandra/bin/cqlsh.py", line 82, in 

    from cqlshlib.cqlshmain import main

  File "/Users/.../cassandra/bin/../pylib/cqlshlib/cqlshmain.py", line 85, in 


    from cqlshlib.serverversion import version as build_version

ModuleNotFoundError: No module named 'cqlshlib.serverversion'
{quote}

> cqlsh should warn on server version mismatch
> 
>
> Key: CASSANDRA-18745
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18745
> Project: Cassandra
>  Issue Type: Improvement
>  Components: CQL/Interpreter
>Reporter: Brandon Williams
>Assignee: Brandon Williams
>Priority: Normal
> Fix For: 3.0.30, 3.11.16, 4.0.12, 4.1.4, 5.0, 5.1
>
>
> When cqlsh is used against a different version of the server than the one 
> that it shipped with, it should emit a warning so that users aren't confused 
> when some things don't work correctly.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Created] (CASSANDRA-18796) Optionally fail when a non-partition-restricted query is issued against a storage-attached index with a backing table using LCS

2023-08-24 Thread Caleb Rackliffe (Jira)
Caleb Rackliffe created CASSANDRA-18796:
---

 Summary: Optionally fail when a non-partition-restricted query is 
issued against a storage-attached index with a backing table using LCS
 Key: CASSANDRA-18796
 URL: https://issues.apache.org/jira/browse/CASSANDRA-18796
 Project: Cassandra
  Issue Type: Improvement
  Components: Feature/2i Index, Feature/SAI, Local/Compaction/LCS
Reporter: Caleb Rackliffe
Assignee: Caleb Rackliffe


With LCS, we will have potentially thousands of SSTables for a given user 
table. Storage-attached also means SSTable-attached, and searching thousands of 
attached indexes is not going to scale well at all locally, due to the sheer 
number of searches and amount of postings list merging involved. We should have 
a guardrail to prohibit this by default.

Partition-restricted queries, the use-case SAI is broadly designed for, should 
be very efficient.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-18796) Optionally fail when a non-partition-restricted query is issued against a storage-attached index with a backing table using LCS

2023-08-24 Thread Caleb Rackliffe (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-18796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Caleb Rackliffe updated CASSANDRA-18796:

Change Category: Performance
 Complexity: Low Hanging Fruit
  Fix Version/s: 5.0.x
 5.x
 Status: Open  (was: Triage Needed)

> Optionally fail when a non-partition-restricted query is issued against a 
> storage-attached index with a backing table using LCS
> ---
>
> Key: CASSANDRA-18796
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18796
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Feature/2i Index, Feature/SAI, Local/Compaction/LCS
>Reporter: Caleb Rackliffe
>Assignee: Caleb Rackliffe
>Priority: Normal
> Fix For: 5.0.x, 5.x
>
>
> With LCS, we will have potentially thousands of SSTables for a given user 
> table. Storage-attached also means SSTable-attached, and searching thousands 
> of attached indexes is not going to scale well at all locally, due to the 
> sheer number of searches and amount of postings list merging involved. We 
> should have a guardrail to prohibit this by default.
> Partition-restricted queries, the use-case SAI is broadly designed for, 
> should be very efficient.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Commented] (CASSANDRA-18710) Test failure: org.apache.cassandra.io.DiskSpaceMetricsTest.testFlushSize-.jdk17 (from org.apache.cassandra.io.DiskSpaceMetricsTest-.jdk17)

2023-08-24 Thread Ekaterina Dimitrova (Jira)


[ 
https://issues.apache.org/jira/browse/CASSANDRA-18710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758711#comment-17758711
 ] 

Ekaterina Dimitrova commented on CASSANDRA-18710:
-

This test was added as part of CASSANDRA-18397 - 
https://github.com/apache/cassandra/commit/957eca2fb53477d56bdc9a97c612f1fbecfb5d41#diff-af921b889c103e8ba6c4c21566a6b1264b7ebcea8d8c374a9105252418618e6cR99

>From the PR in that ticket, it seems that there was a try to fix the flakiness 
>there (that explains why it is very hard to reproduce in CircleCI)- 
>[https://github.com/blambov/cassandra/commit/6b7e755db20bb1b63dd18f3a03830b8dee909672]

Maybe [~blambov] will have some hints here? 

> Test failure: 
> org.apache.cassandra.io.DiskSpaceMetricsTest.testFlushSize-.jdk17 (from 
> org.apache.cassandra.io.DiskSpaceMetricsTest-.jdk17)
> --
>
> Key: CASSANDRA-18710
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18710
> Project: Cassandra
>  Issue Type: Bug
>  Components: Test/unit
>Reporter: Ekaterina Dimitrova
>Assignee: Brandon Williams
>Priority: Normal
> Fix For: 5.x
>
>
> Seen here:
> [https://ci-cassandra.apache.org/job/Cassandra-trunk/1644/testReport/org.apache.cassandra.io/DiskSpaceMetricsTest/testFlushSize__jdk17/]
> h3.  
> {code:java}
> Error Message
> expected:<7200.0> but was:<1367.83970468544>
> Stacktrace
> junit.framework.AssertionFailedError: expected:<7200.0> but 
> was:<1367.83970468544> at 
> org.apache.cassandra.io.DiskSpaceMetricsTest.testFlushSize(DiskSpaceMetricsTest.java:119)
>  at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native 
> Method) at 
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
>  at 
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> {code}
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-17884) [jamm] Test failure: o.a.c.repair.RepairJobTest.testNoTreesRetainedAfterDifference

2023-08-24 Thread Ekaterina Dimitrova (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-17884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ekaterina Dimitrova updated CASSANDRA-17884:

Fix Version/s: (was: 5.x)

> [jamm] Test failure: 
> o.a.c.repair.RepairJobTest.testNoTreesRetainedAfterDifference
> --
>
> Key: CASSANDRA-17884
> URL: https://issues.apache.org/jira/browse/CASSANDRA-17884
> Project: Cassandra
>  Issue Type: Bug
>  Components: Jamm, Test/unit
>Reporter: Andres de la Peña
>Priority: Normal
> Fix For: 4.0.x, 4.1.x
>
> Attachments: RepairSessionTree.txt
>
>
> The unit test 
> {{org.apache.cassandra.repair.RepairJobTest#testNoTreesRetainedAfterDifference}}
>  seems to be slightly flaky at least in 4.0. We haven't seen it failing on 
> Butler, but after [a failure on a patch 
> branch|https://app.circleci.com/pipelines/github/jacek-lewandowski/cassandra/281/workflows/e6094c00-b611-4772-9772-205f4c76ecba/jobs/2126/tests],
>  this repeated run shows a 0.28% flakiness:
> * 
> https://app.circleci.com/pipelines/github/adelapena/cassandra/2076/workflows/8adbfe99-afb5-43af-84ad-43df2a2a86e2/jobs/20816/tests
> * 
> https://app.circleci.com/pipelines/github/adelapena/cassandra/2076/workflows/e550d8c2-7c35-4326-bd95-6909978d344b/jobs/20817/tests
> {code}
> java.lang.reflect.InaccessibleObjectException: Unable to make field private 
> jdk.internal.platform.cgroupv1.SubSystem$MemorySubSystem 
> jdk.internal.platform.cgroupv1.Metrics.memory accessible: module java.base 
> does not "opens jdk.internal.platform.cgroupv1" to unnamed module @157853da
>   at 
> java.base/java.lang.reflect.AccessibleObject.checkCanSetAccessible(AccessibleObject.java:340)
>   at 
> java.base/java.lang.reflect.AccessibleObject.checkCanSetAccessible(AccessibleObject.java:280)
>   at 
> java.base/java.lang.reflect.Field.checkCanSetAccessible(Field.java:176)
>   at java.base/java.lang.reflect.Field.setAccessible(Field.java:170)
>   at org.github.jamm.MemoryMeter.addFieldChildren(MemoryMeter.java:330)
>   at org.github.jamm.MemoryMeter.measureDeep(MemoryMeter.java:269)
>   at 
> org.apache.cassandra.utils.ObjectSizes.measureDeep(ObjectSizes.java:216)
>   at 
> org.apache.cassandra.repair.RepairJobTest.testNoTreesRetainedAfterDifference(RepairJobTest.java:271)
>   at 
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>   at 
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> {code}
> Flakiness is really low but the failure is clearly reproducible in j11.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Commented] (CASSANDRA-18750) Make unit tests compatible with the tmp.dir property

2023-08-24 Thread Brandon Williams (Jira)


[ 
https://issues.apache.org/jira/browse/CASSANDRA-18750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758691#comment-17758691
 ] 

Brandon Williams commented on CASSANDRA-18750:
--

bq. At most to 4.1 as that is the first branch having checkstyle.

Good point.  4.1, 5.0, and trunk make sense to me, then.


> Make unit tests compatible with the tmp.dir property
> 
>
> Key: CASSANDRA-18750
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18750
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Build
>Reporter: Derek Chen-Becker
>Assignee: Derek Chen-Becker
>Priority: Normal
> Attachments: signature.asc
>
>
> Several unit tests hard-code file paths under the "/tmp" directory, which 
> means they do not honor the {{tmp.dir}} ant build property. These should be 
> updated so that when the user specifies {{tmp.dir}}, they can be certain that 
> any files or directories created by the unit tests will be in their specified 
> location.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-18750) Make unit tests compatible with the tmp.dir property

2023-08-24 Thread miklosovic (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-18750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

miklosovic updated CASSANDRA-18750:
---
Attachment: signature.asc

I was thinking this will go to 5.0 and trunk only. At most to 4.1 as that is 
the first branch having checkstyle.

Given the fact 3.x is going to be dropped in few months I consider that to be 
an unneccessary exercise.


Sent from ProtonMail mobile



\

> Make unit tests compatible with the tmp.dir property
> 
>
> Key: CASSANDRA-18750
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18750
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Build
>Reporter: Derek Chen-Becker
>Assignee: Derek Chen-Becker
>Priority: Normal
> Attachments: signature.asc
>
>
> Several unit tests hard-code file paths under the "/tmp" directory, which 
> means they do not honor the {{tmp.dir}} ant build property. These should be 
> updated so that when the user specifies {{tmp.dir}}, they can be certain that 
> any files or directories created by the unit tests will be in their specified 
> location.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Commented] (CASSANDRA-18065) Flaky test org.apache.cassandra.tools.TopPartitionsTest#testStartAndStopScheduledSampling

2023-08-24 Thread Brandon Williams (Jira)


[ 
https://issues.apache.org/jira/browse/CASSANDRA-18065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758681#comment-17758681
 ] 

Brandon Williams commented on CASSANDRA-18065:
--

This fails on its initial commit from CASSANDRA-17821, 
[here|https://app.circleci.com/pipelines/github/driftx/cassandra/1236/workflows/44d9e1b6-ec35-4a49-b8cd-6ce440212c23/jobs/47758]:
{noformat}
[junit-timeout] Testcase: 
testStartAndStopScheduledSampling(org.apache.cassandra.tools.TopPartitionsTest):
  FAILED
[junit-timeout] Scheduled sampled tasks should be removed expected:<[]> but 
was:<[*.*]>
[junit-timeout] junit.framework.AssertionFailedError: Scheduled sampled tasks 
should be removed expected:<[]> but was:<[*.*]>
[junit-timeout] at 
org.apache.cassandra.tools.TopPartitionsTest.testStartAndStopScheduledSampling(TopPartitionsTest.java:116)
[junit-timeout] at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit-timeout] at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit-timeout] at 
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
{noformat}
 
/cc [~jmckenzie]

> Flaky test 
> org.apache.cassandra.tools.TopPartitionsTest#testStartAndStopScheduledSampling
> -
>
> Key: CASSANDRA-18065
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18065
> Project: Cassandra
>  Issue Type: Bug
>  Components: Tool/nodetool
>Reporter: Andres de la Peña
>Assignee: Brandon Williams
>Priority: Normal
> Fix For: 5.0.x, 5.x
>
>
> The test 
> {{org.apache.cassandra.tools.TopPartitionsTest#testStartAndStopScheduledSampling}}
>  is fails intermittently on trunk with CircleCI:
> * 
> https://app.circleci.com/pipelines/github/adelapena/cassandra/2508/workflows/92f054d7-9386-498f-9ba4-330181cd4782/jobs/24692
> * 
> https://app.circleci.com/pipelines/github/adelapena/cassandra/2511/workflows/7aba8baa-0a6d-404a-b08b-c6a8078caca3/jobs/24706/tests
> The failure looks like:
> {code}
> junit.framework.AssertionFailedError: Scheduled sampled tasks should be 
> removed expected:<[]> but was:<[*.*]>
>   at 
> org.apache.cassandra.tools.TopPartitionsTest.testStartAndStopScheduledSampling(TopPartitionsTest.java:116)
> {code}
> I haven't seen this failure on Butler/Jenkins yet, but it can be reproduced 
> with the CircleCI multiplexer:
> {code}
> .circleci/generate.sh -m \
>   -e REPEATED_UTESTS_COUNT=2000 \
>   -e REPEATED_UTESTS=org.apache.cassandra.tools.TopPartitionsTest
> {code}
> It seems to fail 11 times on 2000 runs.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Commented] (CASSANDRA-18564) Test Failure: MixedModeAvailabilityV30AllOneTest.testAvailabilityCoordinatorUpgraded

2023-08-24 Thread Jira


[ 
https://issues.apache.org/jira/browse/CASSANDRA-18564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758678#comment-17758678
 ] 

Andres de la Peña commented on CASSANDRA-18564:
---

The test seems to pass in 4.1: 
[https://app.circleci.com/pipelines/github/adelapena/cassandra/3141/workflows/5e7f85e7-ce66-4e8a-af8d-23f7de9d2205]

It only fails in 5.0 and trunk. This test has always been quite long and prone 
to timeouts. The new v50 and v51 branches have almost doubled the number of 
upgrade paths, and this probably is what is producing the timeouts.

[Increasing {{read_request_timeout}} and {{write_request_timeout}} to 30 
seconds|https://github.com/apache/cassandra/commit/d7775660bfe94ab2353faab95a4a7cd0e2cf79ee]
 seems to be enough to make the test survive 500 runs: 
https://app.circleci.com/pipelines/github/adelapena/cassandra/3142/workflows/0c680c43-c988-4fa5-8e05-7ab81aea8ae1

However, increasing the timeouts to one minute seems to risk a CircleCI 
timeout: 
https://app.circleci.com/pipelines/github/adelapena/cassandra/3143/workflows/66ca0ccc-f6a0-4ba6-9376-59b9b03b57fb

The tricky bit with this test is that it runs both queries that should 
succeeded and queries that should timeout. So, if we increase the timeout 
thresholds for the queries that should succeed, then the queries that should 
timeout make the test incredibly slow.

Maybe we can live with those 30s timeouts, even if they make the test quite 
expensive. However, it occurs to me that we could relax the conditions of the 
test to only verify the queries that should succeed with the expected 
consistency levels and down replicas. We could simply skip testing the cases 
where the query should timeout. After all, those expected timeouts due to down 
replicas seem indistinguishable from the timeouts produced by an overloaded CI 
environment. wdyt?

> Test Failure: 
> MixedModeAvailabilityV30AllOneTest.testAvailabilityCoordinatorUpgraded
> 
>
> Key: CASSANDRA-18564
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18564
> Project: Cassandra
>  Issue Type: Bug
>  Components: Test/dtest/java
>Reporter: Andres de la Peña
>Assignee: Andres de la Peña
>Priority: Normal
> Fix For: 5.0.x, 5.x
>
>
> The JVM upgrade dtest 
> {{MixedModeAvailabilityV3XAllOneTest.testAvailabilityCoordinatorUpgraded}} 
> seems to be flaky at least in {{trunk}}:
> {code}
> junit.framework.AssertionFailedError: Error in test '4.0.11 -> [5.0]' while 
> upgrading to '5.0'; successful upgrades []
>   at 
> org.apache.cassandra.distributed.upgrade.UpgradeTestBase$TestCase.run(UpgradeTestBase.java:348)
>   at 
> org.apache.cassandra.distributed.upgrade.MixedModeAvailabilityTestBase.testAvailability(MixedModeAvailabilityTestBase.java:154)
>   at 
> org.apache.cassandra.distributed.upgrade.MixedModeAvailabilityTestBase.testAvailabilityCoordinatorUpgraded(MixedModeAvailabilityTestBase.java:74)
> Caused by: java.lang.AssertionError: Unexpected error while reading in case 
> write-read consistency ALL-ONE with upgraded coordinator and 2 nodes down: 
> org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - 
> received only 0 responses.
>   at 
> org.apache.cassandra.distributed.upgrade.MixedModeAvailabilityTestBase.lambda$testAvailability$6(MixedModeAvailabilityTestBase.java:145)
>   at 
> org.apache.cassandra.distributed.upgrade.UpgradeTestBase$TestCase.run(UpgradeTestBase.java:339)
> Caused by: org.apache.cassandra.exceptions.ReadTimeoutException: Operation 
> timed out - received only 0 responses.
>   at 
> org.apache.cassandra.service.reads.ReadCallback.awaitResults(ReadCallback.java:162)
>   at 
> org.apache.cassandra.service.reads.AbstractReadExecutor.awaitResponses(AbstractReadExecutor.java:387)
>   at 
> org.apache.cassandra.service.StorageProxy.fetchRows(StorageProxy.java:2124)
>   at 
> org.apache.cassandra.service.StorageProxy.readRegular(StorageProxy.java:1995)
>   at 
> org.apache.cassandra.service.StorageProxy.read(StorageProxy.java:1873)
>   at 
> org.apache.cassandra.db.SinglePartitionReadCommand$Group.execute(SinglePartitionReadCommand.java:1286)
>   at 
> org.apache.cassandra.cql3.statements.SelectStatement.execute(SelectStatement.java:364)
>   at 
> org.apache.cassandra.cql3.statements.SelectStatement.execute(SelectStatement.java:293)
>   at 
> org.apache.cassandra.cql3.statements.SelectStatement.execute(SelectStatement.java:105)
>   at 
> org.apache.cassandra.distributed.impl.Coordinator.unsafeExecuteInternal(Coordinator.java:122)
>   at 
> org.apache.cassandra.distributed.impl.Coordinator.unsafeExecuteInternal(Coordinator.java:103)
>   at 
> 

[cassandra-website] branch asf-staging updated (1670ede7d -> c03b5d639)

2023-08-24 Thread git-site-role
This is an automated email from the ASF dual-hosted git repository.

git-site-role pushed a change to branch asf-staging
in repository https://gitbox.apache.org/repos/asf/cassandra-website.git


 discard 1670ede7d generate docs for ce048d19
 new c03b5d639 generate docs for ce048d19

This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version.  This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:

 * -- * -- B -- O -- O -- O   (1670ede7d)
\
 N -- N -- N   refs/heads/asf-staging (c03b5d639)

You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.

Any revisions marked "omit" are not gone; other references still
refer to them.  Any revisions marked "discard" are gone forever.

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 content/search-index.js |   2 +-
 site-ui/build/ui-bundle.zip | Bin 4852435 -> 4852435 bytes
 2 files changed, 1 insertion(+), 1 deletion(-)


-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Created] (CASSANDRA-18795) Compaction purger doesn't handle seeing random slices of state correctly

2023-08-24 Thread Ariel Weisberg (Jira)
Ariel Weisberg created CASSANDRA-18795:
--

 Summary: Compaction purger doesn't handle seeing random slices of 
state correctly
 Key: CASSANDRA-18795
 URL: https://issues.apache.org/jira/browse/CASSANDRA-18795
 Project: Cassandra
  Issue Type: Bug
Reporter: Ariel Weisberg
Assignee: Ariel Weisberg


Compaction purger was written assuming it will be compacting the latest state 
of the command row, but this is far from the case and it will actually be 
compacting a random slice of command row columns and their versions based on 
whatever input sstables are selected for the compaction.

This is not very problematic to fix. A lot of the logic is based on just the 
value of the field, and the remaining can wait until enough of the command is 
visible to determine if cleanup is possible cleanup.

Eventually durability is `universal` and we can drop the row contents based on 
just the `txnid` so there is always a fallback no matter how badly we have torn 
up the state of a command by dropping portions. We don't want to rely on that 
so we do drop a tombstone in the `erase` case which we can later drop when 
durability is `universal` without any expensive tombstone handling checks.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Commented] (CASSANDRA-18710) Test failure: org.apache.cassandra.io.DiskSpaceMetricsTest.testFlushSize-.jdk17 (from org.apache.cassandra.io.DiskSpaceMetricsTest-.jdk17)

2023-08-24 Thread Brandon Williams (Jira)


[ 
https://issues.apache.org/jira/browse/CASSANDRA-18710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758650#comment-17758650
 ] 

Brandon Williams commented on CASSANDRA-18710:
--

I don't see anything wrong with the metrics so I'm currently out of ideas here. 
 I did manage to repro once in 
[circle|https://app.circleci.com/pipelines/github/driftx/cassandra/1220/workflows/e0c90c4a-115b-45f7-a798-c5e21dc937f9/jobs/46827/tests],
 with the mistaken flush commit removed.

> Test failure: 
> org.apache.cassandra.io.DiskSpaceMetricsTest.testFlushSize-.jdk17 (from 
> org.apache.cassandra.io.DiskSpaceMetricsTest-.jdk17)
> --
>
> Key: CASSANDRA-18710
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18710
> Project: Cassandra
>  Issue Type: Bug
>  Components: Test/unit
>Reporter: Ekaterina Dimitrova
>Assignee: Brandon Williams
>Priority: Normal
> Fix For: 5.x
>
>
> Seen here:
> [https://ci-cassandra.apache.org/job/Cassandra-trunk/1644/testReport/org.apache.cassandra.io/DiskSpaceMetricsTest/testFlushSize__jdk17/]
> h3.  
> {code:java}
> Error Message
> expected:<7200.0> but was:<1367.83970468544>
> Stacktrace
> junit.framework.AssertionFailedError: expected:<7200.0> but 
> was:<1367.83970468544> at 
> org.apache.cassandra.io.DiskSpaceMetricsTest.testFlushSize(DiskSpaceMetricsTest.java:119)
>  at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native 
> Method) at 
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
>  at 
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> {code}
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Assigned] (CASSANDRA-18065) Flaky test org.apache.cassandra.tools.TopPartitionsTest#testStartAndStopScheduledSampling

2023-08-24 Thread Brandon Williams (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-18065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Brandon Williams reassigned CASSANDRA-18065:


Assignee: Brandon Williams

> Flaky test 
> org.apache.cassandra.tools.TopPartitionsTest#testStartAndStopScheduledSampling
> -
>
> Key: CASSANDRA-18065
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18065
> Project: Cassandra
>  Issue Type: Bug
>  Components: Tool/nodetool
>Reporter: Andres de la Peña
>Assignee: Brandon Williams
>Priority: Normal
> Fix For: 5.0.x, 5.x
>
>
> The test 
> {{org.apache.cassandra.tools.TopPartitionsTest#testStartAndStopScheduledSampling}}
>  is fails intermittently on trunk with CircleCI:
> * 
> https://app.circleci.com/pipelines/github/adelapena/cassandra/2508/workflows/92f054d7-9386-498f-9ba4-330181cd4782/jobs/24692
> * 
> https://app.circleci.com/pipelines/github/adelapena/cassandra/2511/workflows/7aba8baa-0a6d-404a-b08b-c6a8078caca3/jobs/24706/tests
> The failure looks like:
> {code}
> junit.framework.AssertionFailedError: Scheduled sampled tasks should be 
> removed expected:<[]> but was:<[*.*]>
>   at 
> org.apache.cassandra.tools.TopPartitionsTest.testStartAndStopScheduledSampling(TopPartitionsTest.java:116)
> {code}
> I haven't seen this failure on Butler/Jenkins yet, but it can be reproduced 
> with the CircleCI multiplexer:
> {code}
> .circleci/generate.sh -m \
>   -e REPEATED_UTESTS_COUNT=2000 \
>   -e REPEATED_UTESTS=org.apache.cassandra.tools.TopPartitionsTest
> {code}
> It seems to fail 11 times on 2000 runs.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[cassandra-website] branch asf-staging updated (fa54a85ca -> 1670ede7d)

2023-08-24 Thread git-site-role
This is an automated email from the ASF dual-hosted git repository.

git-site-role pushed a change to branch asf-staging
in repository https://gitbox.apache.org/repos/asf/cassandra-website.git


 discard fa54a85ca generate docs for ce048d19
 new 1670ede7d generate docs for ce048d19

This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version.  This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:

 * -- * -- B -- O -- O -- O   (fa54a85ca)
\
 N -- N -- N   refs/heads/asf-staging (1670ede7d)

You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.

Any revisions marked "omit" are not gone; other references still
refer to them.  Any revisions marked "discard" are gone forever.

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .../developing/cql/dynamic_data_masking.html   |  21 +++--
 .../5.0/cassandra/developing/cql/functions.html|   2 +-
 .../developing/cql/dynamic_data_masking.html   |  21 +++--
 .../5.1/cassandra/developing/cql/functions.html|   2 +-
 .../developing/cql/dynamic_data_masking.html   |  21 +++--
 .../trunk/cassandra/developing/cql/functions.html  |   2 +-
 content/search-index.js|   2 +-
 site-ui/build/ui-bundle.zip| Bin 4852435 -> 4852435 
bytes
 8 files changed, 37 insertions(+), 34 deletions(-)


-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Commented] (CASSANDRA-18750) Make unit tests compatible with the tmp.dir property

2023-08-24 Thread Brandon Williams (Jira)


[ 
https://issues.apache.org/jira/browse/CASSANDRA-18750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758617#comment-17758617
 ] 

Brandon Williams commented on CASSANDRA-18750:
--

Probably all of them. 3.0, 3.11, 4.0, 4.1, 5.0 and trunk.

> Make unit tests compatible with the tmp.dir property
> 
>
> Key: CASSANDRA-18750
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18750
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Build
>Reporter: Derek Chen-Becker
>Assignee: Derek Chen-Becker
>Priority: Normal
>
> Several unit tests hard-code file paths under the "/tmp" directory, which 
> means they do not honor the {{tmp.dir}} ant build property. These should be 
> updated so that when the user specifies {{tmp.dir}}, they can be certain that 
> any files or directories created by the unit tests will be in their specified 
> location.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Commented] (CASSANDRA-18750) Make unit tests compatible with the tmp.dir property

2023-08-24 Thread Derek Chen-Becker (Jira)


[ 
https://issues.apache.org/jira/browse/CASSANDRA-18750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758614#comment-17758614
 ] 

Derek Chen-Becker commented on CASSANDRA-18750:
---

Yup, sorry, I just realized I had my upstream branch set incorrectly so I 
wasn't seeing updates to trunk. PR is updated and I'll start working on 
backporting.

https://cassandra.apache.org/_/development/patches.html seems out of date. 
Which branches should I target with this? 

> Make unit tests compatible with the tmp.dir property
> 
>
> Key: CASSANDRA-18750
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18750
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Build
>Reporter: Derek Chen-Becker
>Assignee: Derek Chen-Becker
>Priority: Normal
>
> Several unit tests hard-code file paths under the "/tmp" directory, which 
> means they do not honor the {{tmp.dir}} ant build property. These should be 
> updated so that when the user specifies {{tmp.dir}}, they can be certain that 
> any files or directories created by the unit tests will be in their specified 
> location.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Commented] (CASSANDRA-18717) Fix errors or remove ant javadoc task

2023-08-24 Thread Ekaterina Dimitrova (Jira)


[ 
https://issues.apache.org/jira/browse/CASSANDRA-18717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758603#comment-17758603
 ] 

Ekaterina Dimitrova commented on CASSANDRA-18717:
-

{quote}{quote}let's just not forget all the issues we put on hold
{quote}
100% agreed
{quote}
 

+1, thus my suggestion to help with that. I believe in teamwor. :) 

 

Also, talking explicitly about not forgetting to push things before the release 
- [~mmuzaf], how about we put those tickets on hold under a specific label or 
in an umbrella epic? 

 

> Fix errors or remove ant javadoc task
> -
>
> Key: CASSANDRA-18717
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18717
> Project: Cassandra
>  Issue Type: Bug
>  Components: Documentation/Javadoc
>Reporter: Ekaterina Dimitrova
>Assignee: Maxim Muzafarov
>Priority: Normal
> Fix For: 5.0.x, 5.x
>
>  Time Spent: 50m
>  Remaining Estimate: 0h
>
> As discussed on CASSANDRA-17687, the javadoc task completes successfully, but 
> there are errors that deserve to be fixed if we keep the task around.
> If we do not plan to use it, we should remove it and reduce the clutter. 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Commented] (CASSANDRA-18789) Update commons-lang3 to 3.13.0

2023-08-24 Thread Ekaterina Dimitrova (Jira)


[ 
https://issues.apache.org/jira/browse/CASSANDRA-18789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758599#comment-17758599
 ] 

Ekaterina Dimitrova commented on CASSANDRA-18789:
-

{quote}If we're not being religious about his, which is what I gather from the 
ML, I think we can go ahead with 5.0.
{quote}
 

Indeed. I will wait today to see if someone joins with an additional/different 
opinion, and I can announce a consensus tomorrow and move on. 

> Update commons-lang3 to 3.13.0
> --
>
> Key: CASSANDRA-18789
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18789
> Project: Cassandra
>  Issue Type: Task
>  Components: Dependencies
>Reporter: Ekaterina Dimitrova
>Assignee: Ekaterina Dimitrova
>Priority: Low
> Fix For: 5.0.x, 5.x
>
>
> It seems we are on a version that was testing up to Java 11 - 3.11.0
> In the latest one the community goes up to JDK21 so I think it is good to 
> update, hopefully also on cassandra-5.0
> Below are the release notes:
> https://commons.apache.org/proper/commons-lang/changes-report.html#a3.12.0



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Comment Edited] (CASSANDRA-18688) Limit Java runtime in 5.0 to JDK 11 and 17 in scripts; add a flag to opt out of that

2023-08-24 Thread Ekaterina Dimitrova (Jira)


[ 
https://issues.apache.org/jira/browse/CASSANDRA-18688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758598#comment-17758598
 ] 

Ekaterina Dimitrova edited comment on CASSANDRA-18688 at 8/24/23 1:41 PM:
--

bq. This was almost ready. Is anything pending I am blocking as a reviewer?

I see an ongoing discussion between [~skokoori] and [~mck] in regard:
bq. -J option is inline with -R, f etc. we already provide for bin/cassandra. 
By env var, I assume you mean something like what we had to enable JDK11 in 
4.x, with a -D.

I am still not clear on which of the two options we go for:
bq. The options after this patch are:
bq. 1) Leave it that way and add the J flag only for 17+ if anyone wants to run 
Cassandra experimentally on any of the newer versions.
bq. 2) Change it to the J flag suggested (same as 17+). Reject running on those 
versions in general, give the people the chance to run Cassandra experimentally 
on version 11-17 and 17+ by using the J flag

Also, [~skokoori] is off these days





was (Author: e.dimitrova):
bq. This was almost ready. Is anything pending I am blocking as a reviewer?

I see an ongoing discussion between [~skokoori] and [~mck] in regard:
bq. -J option is inline with -R, f etc. we already provide for bin/cassandra. 
By env var, I assume you mean something like what we had to enable JDK11 in 
4.x, with a -D.

I am still not clear on which of the two options we go for:
bq. The options after this patch are:
1) Leave it that way and add the J flag only for 17+ if anyone wants to run 
Cassandra experimentally on any of the newer versions.
2) Change it to the J flag suggested (same as 17+). Reject running on those 
versions in general, give the people the chance to run Cassandra experimentally 
on version 11-17 and 17+ by using the J flag

Also, [~skokoori] is off these days




> Limit Java runtime in 5.0 to JDK 11 and 17 in scripts; add a flag to opt out 
> of that
> 
>
> Key: CASSANDRA-18688
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18688
> Project: Cassandra
>  Issue Type: Task
>  Components: Build
>Reporter: Ekaterina Dimitrova
>Assignee: shylaja kokoori
>Priority: Normal
> Fix For: 5.0.x
>
>  Time Spent: 1h 20m
>  Remaining Estimate: 0h
>
> Currently, we limit our users from building with non-default Java versions in 
> build.xml.
> They can easily hack build.xml for test purposes with different versions.
> Cassandra–5.0 will be run on JDK11 and JDK17, but on startup, we do not limit 
> people to those two, but only to everything >= 11. We should also put an 
> upper limit of 17 in our Cassandra startup scripts. We can also add a flag to 
> opt-out if someone wants to test with newer versions.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Commented] (CASSANDRA-18688) Limit Java runtime in 5.0 to JDK 11 and 17 in scripts; add a flag to opt out of that

2023-08-24 Thread Ekaterina Dimitrova (Jira)


[ 
https://issues.apache.org/jira/browse/CASSANDRA-18688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758598#comment-17758598
 ] 

Ekaterina Dimitrova commented on CASSANDRA-18688:
-

bq. This was almost ready. Is anything pending I am blocking as a reviewer?

I see an ongoing discussion between [~skokoori] and [~mck] in regard:
bq. -J option is inline with -R, f etc. we already provide for bin/cassandra. 
By env var, I assume you mean something like what we had to enable JDK11 in 
4.x, with a -D.

I am still not clear on which of the two options we go for:
bq. The options after this patch are:
1) Leave it that way and add the J flag only for 17+ if anyone wants to run 
Cassandra experimentally on any of the newer versions.
2) Change it to the J flag suggested (same as 17+). Reject running on those 
versions in general, give the people the chance to run Cassandra experimentally 
on version 11-17 and 17+ by using the J flag

Also, [~skokoori] is off these days




> Limit Java runtime in 5.0 to JDK 11 and 17 in scripts; add a flag to opt out 
> of that
> 
>
> Key: CASSANDRA-18688
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18688
> Project: Cassandra
>  Issue Type: Task
>  Components: Build
>Reporter: Ekaterina Dimitrova
>Assignee: shylaja kokoori
>Priority: Normal
> Fix For: 5.0.x
>
>  Time Spent: 1h 20m
>  Remaining Estimate: 0h
>
> Currently, we limit our users from building with non-default Java versions in 
> build.xml.
> They can easily hack build.xml for test purposes with different versions.
> Cassandra–5.0 will be run on JDK11 and JDK17, but on startup, we do not limit 
> people to those two, but only to everything >= 11. We should also put an 
> upper limit of 17 in our Cassandra startup scripts. We can also add a flag to 
> opt-out if someone wants to test with newer versions.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Commented] (CASSANDRA-18750) Make unit tests compatible with the tmp.dir property

2023-08-24 Thread Brandon Williams (Jira)


[ 
https://issues.apache.org/jira/browse/CASSANDRA-18750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758596#comment-17758596
 ] 

Brandon Williams commented on CASSANDRA-18750:
--

Yep, just ignore bcprov.

> Make unit tests compatible with the tmp.dir property
> 
>
> Key: CASSANDRA-18750
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18750
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Build
>Reporter: Derek Chen-Becker
>Assignee: Derek Chen-Becker
>Priority: Normal
>
> Several unit tests hard-code file paths under the "/tmp" directory, which 
> means they do not honor the {{tmp.dir}} ant build property. These should be 
> updated so that when the user specifies {{tmp.dir}}, they can be certain that 
> any files or directories created by the unit tests will be in their specified 
> location.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Commented] (CASSANDRA-18750) Make unit tests compatible with the tmp.dir property

2023-08-24 Thread Stefan Miklosovic (Jira)


[ 
https://issues.apache.org/jira/browse/CASSANDRA-18750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758595#comment-17758595
 ] 

Stefan Miklosovic commented on CASSANDRA-18750:
---

CVE in bcprov was fixed by this,

https://issues.apache.org/jira/browse/CASSANDRA-18729?focusedCommentId=17752323=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-17752323

Your trunk is just too much behind.

> Make unit tests compatible with the tmp.dir property
> 
>
> Key: CASSANDRA-18750
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18750
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Build
>Reporter: Derek Chen-Becker
>Assignee: Derek Chen-Becker
>Priority: Normal
>
> Several unit tests hard-code file paths under the "/tmp" directory, which 
> means they do not honor the {{tmp.dir}} ant build property. These should be 
> updated so that when the user specifies {{tmp.dir}}, they can be certain that 
> any files or directories created by the unit tests will be in their specified 
> location.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Commented] (CASSANDRA-18750) Make unit tests compatible with the tmp.dir property

2023-08-24 Thread Derek Chen-Becker (Jira)


[ 
https://issues.apache.org/jira/browse/CASSANDRA-18750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758590#comment-17758590
 ] 

Derek Chen-Becker commented on CASSANDRA-18750:
---

Before (tested against current trunk):

{code}
...
[checkstyle] [ERROR] 
/ssdhome/software/projects/cassandra/test/unit/org/apache/cassandra/streaming/StreamSessionTest.java:79:
 Please do not hardcode /tmp for test files and directories. Use 
Files.createTempDirectory to create a base test directory instead. 
[hardcodeTmpDirectoryUsage]

BUILD FAILED
/ssdhome/software/projects/cassandra/build.xml:521: The following error 
occurred while executing this line:
/ssdhome/software/projects/cassandra/.build/build-checkstyle.xml:57: Got 30 
errors and 0 warnings.
{code}

After the change it still failed, but on a CVE vulnerability in {{bcprov}}. 
Total runtime with the new rule was 2:42.



> Make unit tests compatible with the tmp.dir property
> 
>
> Key: CASSANDRA-18750
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18750
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Build
>Reporter: Derek Chen-Becker
>Assignee: Derek Chen-Becker
>Priority: Normal
>
> Several unit tests hard-code file paths under the "/tmp" directory, which 
> means they do not honor the {{tmp.dir}} ant build property. These should be 
> updated so that when the user specifies {{tmp.dir}}, they can be certain that 
> any files or directories created by the unit tests will be in their specified 
> location.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Commented] (CASSANDRA-18750) Make unit tests compatible with the tmp.dir property

2023-08-24 Thread Derek Chen-Becker (Jira)


[ 
https://issues.apache.org/jira/browse/CASSANDRA-18750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758581#comment-17758581
 ] 

Derek Chen-Becker commented on CASSANDRA-18750:
---

It takes ripgrep all of 30ms to check the entire codebase, so hopefully 
checkstyle can come within an order of magnitude or two :) Let me add the rule 
and test. 

> Make unit tests compatible with the tmp.dir property
> 
>
> Key: CASSANDRA-18750
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18750
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Build
>Reporter: Derek Chen-Becker
>Assignee: Derek Chen-Becker
>Priority: Normal
>
> Several unit tests hard-code file paths under the "/tmp" directory, which 
> means they do not honor the {{tmp.dir}} ant build property. These should be 
> updated so that when the user specifies {{tmp.dir}}, they can be certain that 
> any files or directories created by the unit tests will be in their specified 
> location.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Commented] (CASSANDRA-18765) Add CASSANDRA-14227 to 5.0 new features page

2023-08-24 Thread Berenguer Blasi (Jira)


[ 
https://issues.apache.org/jira/browse/CASSANDRA-18765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758527#comment-17758527
 ] 

Berenguer Blasi commented on CASSANDRA-18765:
-

Ah good call!

> Add CASSANDRA-14227 to 5.0 new features page
> 
>
> Key: CASSANDRA-18765
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18765
> Project: Cassandra
>  Issue Type: Bug
>  Components: Documentation
>Reporter: Berenguer Blasi
>Assignee: Berenguer Blasi
>Priority: Normal
> Fix For: 5.0, 5.0.x
>
>
> The [page|https://cassandra.apache.org/doc/trunk/cassandra/new/index.html] 
> listing the 5.0 new features is not mentioning the extended TTL implemented 
> in CASSANDRA-14227



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Assigned] (CASSANDRA-18564) Test Failure: MixedModeAvailabilityV30AllOneTest.testAvailabilityCoordinatorUpgraded

2023-08-24 Thread Jira


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-18564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andres de la Peña reassigned CASSANDRA-18564:
-

Assignee: Andres de la Peña

> Test Failure: 
> MixedModeAvailabilityV30AllOneTest.testAvailabilityCoordinatorUpgraded
> 
>
> Key: CASSANDRA-18564
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18564
> Project: Cassandra
>  Issue Type: Bug
>  Components: Test/dtest/java
>Reporter: Andres de la Peña
>Assignee: Andres de la Peña
>Priority: Normal
> Fix For: 5.0.x, 5.x
>
>
> The JVM upgrade dtest 
> {{MixedModeAvailabilityV3XAllOneTest.testAvailabilityCoordinatorUpgraded}} 
> seems to be flaky at least in {{trunk}}:
> {code}
> junit.framework.AssertionFailedError: Error in test '4.0.11 -> [5.0]' while 
> upgrading to '5.0'; successful upgrades []
>   at 
> org.apache.cassandra.distributed.upgrade.UpgradeTestBase$TestCase.run(UpgradeTestBase.java:348)
>   at 
> org.apache.cassandra.distributed.upgrade.MixedModeAvailabilityTestBase.testAvailability(MixedModeAvailabilityTestBase.java:154)
>   at 
> org.apache.cassandra.distributed.upgrade.MixedModeAvailabilityTestBase.testAvailabilityCoordinatorUpgraded(MixedModeAvailabilityTestBase.java:74)
> Caused by: java.lang.AssertionError: Unexpected error while reading in case 
> write-read consistency ALL-ONE with upgraded coordinator and 2 nodes down: 
> org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - 
> received only 0 responses.
>   at 
> org.apache.cassandra.distributed.upgrade.MixedModeAvailabilityTestBase.lambda$testAvailability$6(MixedModeAvailabilityTestBase.java:145)
>   at 
> org.apache.cassandra.distributed.upgrade.UpgradeTestBase$TestCase.run(UpgradeTestBase.java:339)
> Caused by: org.apache.cassandra.exceptions.ReadTimeoutException: Operation 
> timed out - received only 0 responses.
>   at 
> org.apache.cassandra.service.reads.ReadCallback.awaitResults(ReadCallback.java:162)
>   at 
> org.apache.cassandra.service.reads.AbstractReadExecutor.awaitResponses(AbstractReadExecutor.java:387)
>   at 
> org.apache.cassandra.service.StorageProxy.fetchRows(StorageProxy.java:2124)
>   at 
> org.apache.cassandra.service.StorageProxy.readRegular(StorageProxy.java:1995)
>   at 
> org.apache.cassandra.service.StorageProxy.read(StorageProxy.java:1873)
>   at 
> org.apache.cassandra.db.SinglePartitionReadCommand$Group.execute(SinglePartitionReadCommand.java:1286)
>   at 
> org.apache.cassandra.cql3.statements.SelectStatement.execute(SelectStatement.java:364)
>   at 
> org.apache.cassandra.cql3.statements.SelectStatement.execute(SelectStatement.java:293)
>   at 
> org.apache.cassandra.cql3.statements.SelectStatement.execute(SelectStatement.java:105)
>   at 
> org.apache.cassandra.distributed.impl.Coordinator.unsafeExecuteInternal(Coordinator.java:122)
>   at 
> org.apache.cassandra.distributed.impl.Coordinator.unsafeExecuteInternal(Coordinator.java:103)
>   at 
> org.apache.cassandra.distributed.impl.Coordinator.lambda$executeWithResult$0(Coordinator.java:66)
>   at org.apache.cassandra.concurrent.FutureTask.call(FutureTask.java:61)
>   at org.apache.cassandra.concurrent.FutureTask.run(FutureTask.java:71)
>   at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
>   at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>   at 
> io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
>   at java.lang.Thread.run(Thread.java:750)
> {code}
> This has failed 143 times in 500 iterations of this CircleCI run:
> * 
> https://app.circleci.com/pipelines/github/adelapena/cassandra/2927/workflows/fcd1cd60-826b-484a-8e81-d3ba640f7de9/jobs/47659/tests
> The failure has also recently appeared on Jenkins too:
> * 
> https://ci-cassandra.apache.org/job/Cassandra-trunk/1585/testReport/org.apache.cassandra.distributed.upgrade/MixedModeAvailabilityV3XAllOneTest/testAvailabilityCoordinatorUpgraded__jdk11/
> Given that the failure has just appeared on Jenkins and it fails relatively 
> easily on CircleCI, it's likely that it has been broken by a very recent 
> change.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Commented] (CASSANDRA-18750) Make unit tests compatible with the tmp.dir property

2023-08-24 Thread Brandon Williams (Jira)


[ 
https://issues.apache.org/jira/browse/CASSANDRA-18750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758513#comment-17758513
 ] 

Brandon Williams commented on CASSANDRA-18750:
--

I think it makes sense and is easy enough to do.  I just worry about checkstyle 
suddenly blowing up to 15 minutes of runtime when we change it. :)

> Make unit tests compatible with the tmp.dir property
> 
>
> Key: CASSANDRA-18750
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18750
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Build
>Reporter: Derek Chen-Becker
>Assignee: Derek Chen-Becker
>Priority: Normal
>
> Several unit tests hard-code file paths under the "/tmp" directory, which 
> means they do not honor the {{tmp.dir}} ant build property. These should be 
> updated so that when the user specifies {{tmp.dir}}, they can be certain that 
> any files or directories created by the unit tests will be in their specified 
> location.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Commented] (CASSANDRA-16999) system.peers and system.peers_v2 do not contain the native_transport and/or native_transport_port_ssl

2023-08-24 Thread Brandon Williams (Jira)


[ 
https://issues.apache.org/jira/browse/CASSANDRA-16999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758512#comment-17758512
 ] 

Brandon Williams commented on CASSANDRA-16999:
--

[~absurdfarce] ping again, 5.0 alpha1 is slated to release soon.

> system.peers and system.peers_v2 do not contain the native_transport and/or 
> native_transport_port_ssl
> -
>
> Key: CASSANDRA-16999
> URL: https://issues.apache.org/jira/browse/CASSANDRA-16999
> Project: Cassandra
>  Issue Type: Bug
>  Components: Local/Other
>Reporter: Steve Lacerda
>Assignee: Brandon Williams
>Priority: Normal
> Fix For: 4.0.x, 4.1.x, 5.x
>
>
> system.peers_v2 includes a “native_port” but has no notion of 
> native_transport_port vs. native_transport_port_ssl.  Given this limited 
> information, there’s no clear way for the driver to know that different ports 
> are being used for SSL vs. non-SSL or which of those two ports is identified 
> by “native_port”.
>  
> The issue we ran into is that the java driver, since it has no notion of the 
> transport port SSL, the driver was only using the contact points and was not 
> load balancing.
>  
> The customer had both set:
> native_transport_port: 9042
> native_transport_port_ssl: 9142
>  
> They were attempting to connect to 9142, but that was failing. They could 
> only use 9042, and so their applications load balancing was failing. We found 
> that any node that was a contact point was connecting, but the other nodes 
> were never acting as coordinators.
>  
> There are still issues in the driver, for which I have created JAVA-2967, 
> which also refers to JAVA-2638, but the system.peers and system.peers_v2 
> tables should both contain native_transport_port and 
> native_transport_port_ssl.
>  
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[cassandra-website] branch asf-staging updated (3bc6a8391 -> fa54a85ca)

2023-08-24 Thread git-site-role
This is an automated email from the ASF dual-hosted git repository.

git-site-role pushed a change to branch asf-staging
in repository https://gitbox.apache.org/repos/asf/cassandra-website.git


 discard 3bc6a8391 generate docs for ce048d19
 new fa54a85ca generate docs for ce048d19

This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version.  This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:

 * -- * -- B -- O -- O -- O   (3bc6a8391)
\
 N -- N -- N   refs/heads/asf-staging (fa54a85ca)

You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.

Any revisions marked "omit" are not gone; other references still
refer to them.  Any revisions marked "discard" are gone forever.

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 site-ui/build/ui-bundle.zip | Bin 4852435 -> 4852435 bytes
 1 file changed, 0 insertions(+), 0 deletions(-)


-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Commented] (CASSANDRA-18794) Add missing features to 5.0 new features page

2023-08-24 Thread Stefan Miklosovic (Jira)


[ 
https://issues.apache.org/jira/browse/CASSANDRA-18794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758501#comment-17758501
 ] 

Stefan Miklosovic commented on CASSANDRA-18794:
---

LGTM

> Add missing features to 5.0 new features page
> -
>
> Key: CASSANDRA-18794
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18794
> Project: Cassandra
>  Issue Type: Bug
>  Components: Documentation
>Reporter: Andres de la Peña
>Assignee: Andres de la Peña
>Priority: Normal
> Fix For: 5.0.x, 5.x
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> The [page|https://cassandra.apache.org/doc/trunk/cassandra/new/index.html] 
> listing the 5.0 new features is not mentioning multiple new features like 
> trie sstables, unified compaction strategy, dynamic data masking, etc.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-18790) Fix spelling errors in the documentation for DDM

2023-08-24 Thread Jira


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-18790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andres de la Peña updated CASSANDRA-18790:
--
  Fix Version/s: 5.0
 5.1
 (was: 5.x)
 (was: 5.0.x)
  Since Version: 5.0-alpha1
Source Control Link: 
https://github.com/apache/cassandra/commit/410018ab165b54c378648d52fb4ec815c557e80e
 Resolution: Fixed
 Status: Resolved  (was: Ready to Commit)

> Fix spelling errors in the documentation for DDM
> 
>
> Key: CASSANDRA-18790
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18790
> Project: Cassandra
>  Issue Type: Bug
>  Components: Documentation
>Reporter: Andres de la Peña
>Assignee: Andres de la Peña
>Priority: Normal
> Fix For: 5.0, 5.1
>
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> [~polandll] has pointed out multiple spelling errors on the documentation for 
> dynamic data masking. This ticket aims to fix them.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Commented] (CASSANDRA-18790) Fix spelling errors in the documentation for DDM

2023-08-24 Thread Jira


[ 
https://issues.apache.org/jira/browse/CASSANDRA-18790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758500#comment-17758500
 ] 

Andres de la Peña commented on CASSANDRA-18790:
---

Thanks for the review.

Committed to {{cassandra-5.0}} as 
[410018ab165b54c378648d52fb4ec815c557e80e|https://github.com/apache/cassandra/commit/410018ab165b54c378648d52fb4ec815c557e80e]
 and merged to 
[{{trunk}}|https://github.com/apache/cassandra/commit/cbaef9094e83364e6812c65b8411ff7dbffaf9c6].

> Fix spelling errors in the documentation for DDM
> 
>
> Key: CASSANDRA-18790
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18790
> Project: Cassandra
>  Issue Type: Bug
>  Components: Documentation
>Reporter: Andres de la Peña
>Assignee: Andres de la Peña
>Priority: Normal
> Fix For: 5.0.x, 5.x
>
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> [~polandll] has pointed out multiple spelling errors on the documentation for 
> dynamic data masking. This ticket aims to fix them.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[cassandra] branch cassandra-5.0 updated: Fix spelling errors in the documentation for DDM

2023-08-24 Thread adelapena
This is an automated email from the ASF dual-hosted git repository.

adelapena pushed a commit to branch cassandra-5.0
in repository https://gitbox.apache.org/repos/asf/cassandra.git


The following commit(s) were added to refs/heads/cassandra-5.0 by this push:
 new 410018ab16 Fix spelling errors in the documentation for DDM
410018ab16 is described below

commit 410018ab165b54c378648d52fb4ec815c557e80e
Author: Andrés de la Peña 
AuthorDate: Wed Aug 23 10:54:11 2023 +0100

Fix spelling errors in the documentation for DDM

patch by Andrés de la Peña; reviewed by Brandon Williams for CASSANDRA-18790

Co-authored-by: Andrés de la Peña 
Co-authored-by: Lorina Poland 
---
 .../pages/developing/cql/dynamic_data_masking.adoc| 19 ++-
 doc/modules/cassandra/partials/masking_functions.adoc |  2 +-
 2 files changed, 11 insertions(+), 10 deletions(-)

diff --git 
a/doc/modules/cassandra/pages/developing/cql/dynamic_data_masking.adoc 
b/doc/modules/cassandra/pages/developing/cql/dynamic_data_masking.adoc
index 8f523ac2ed..16599c9053 100644
--- a/doc/modules/cassandra/pages/developing/cql/dynamic_data_masking.adoc
+++ b/doc/modules/cassandra/pages/developing/cql/dynamic_data_masking.adoc
@@ -1,7 +1,7 @@
 = Dynamic Data Masking
 
 Dynamic data masking (DDM) allows to obscure sensitive information while still 
allowing access to the masked columns.
-DDM doesn't change the stored data. Instead, it just presents the data on 
their obscured form during `SELECT` queries.
+DDM doesn't change the stored data. Instead, it just presents the data in its 
obscured form during `SELECT` queries.
 This aims to provide some degree of protection against accidental data 
exposure. However, it's important to know that
 anyone with direct access to the sstable files will be able to read the clear 
data.
 
@@ -20,10 +20,10 @@ include::example$CQL/select_with_mask_functions.cql[]
 
 == Attaching masking functions to table columns
 
-The masking functions can be permanently attached to the columns of a table.
-In that case, `SELECT` queries will always return the column values in their 
masked form.
-The masking will be transparent for the users running `SELECT` queries,
-so their only way to know that a column is masked will be consulting the table 
definition.
+The masking functions can be permanently attached to any column of a table.
+If a masking columns is defined, `SELECT` queries will always return the 
column values in their masked form.
+The masking will be transparent to the users running `SELECT` queries,
+so their only way to know that a column is masked will be to consult the table 
definition.
 
 This is an optional feature that should be enabled with the 
`dynamic_data_masking_enabled` property in `cassandra.yaml`,
 since it's disabled by default.
@@ -74,8 +74,9 @@ include::example$CQL/ddm_drop_mask.cql[]
 == Permissions
 
 The `UNMASK` permission allows users to retrieve the unmasked values of masked 
columns.
-The masks will only be applied to the results of a `SELECT` query if the user 
doesn't have the `UNMASK` permission.
-Ordinary users are created without the `UNMASK` permission, whereas superusers 
do have it.
+Ordinary users are created without the `UNMASK` permission and will see masked 
values.
+Superusers are created with the `UNMASK` permission,
+and will be able to see the unmasked values in a SELECT query results.
 
 As an example, suppose that we have a table with masked columns:
 
@@ -104,7 +105,7 @@ the users:
 include::example$CQL/ddm_create_users.cql[]
 
 
-We can now see that the user with the `UNMASK` permission can see the clear 
data, without any masking:
+We can now see that the user with the `UNMASK` permission can see the clear 
data, unmasked:
 
 [source,cql]
 
@@ -130,7 +131,7 @@ Since it includes the `UNMASK` permission, that anonymous 
user will always see t
 In other words, attaching data masking functions to columns only makes sense 
if authentication is enabled.
 
 Users without the `UNMASK` permission are not allowed to use masked columns in 
the `WHERE` clause of a `SELECT` query.
-This prevents malicious users from figuring out the clear data by running 
exhaustive queries. For instance:
+This prevents malicious users from figuring out the clear data by running 
exhaustive queries. For example:
 
 [source,cql]
 
diff --git a/doc/modules/cassandra/partials/masking_functions.adoc 
b/doc/modules/cassandra/partials/masking_functions.adoc
index afadcd001e..43fb25c38d 100644
--- a/doc/modules/cassandra/partials/masking_functions.adoc
+++ b/doc/modules/cassandra/partials/masking_functions.adoc
@@ -2,7 +2,7 @@
 |===
 |Function | Description
 
-| `mask_null(value)` | Replaces the first argument by a `null` column. The 
returned value is always an absent column, as it didn't exist, and not a 
not-null column representing a `null` value.
+| `mask_null(value)` | Replaces the first argument with a `null` column. The 
returned value is always a 

[cassandra] 01/01: Merge branch 'cassandra-5.0' into trunk

2023-08-24 Thread adelapena
This is an automated email from the ASF dual-hosted git repository.

adelapena pushed a commit to branch trunk
in repository https://gitbox.apache.org/repos/asf/cassandra.git

commit cbaef9094e83364e6812c65b8411ff7dbffaf9c6
Merge: 4226cbbec6 410018ab16
Author: Andrés de la Peña 
AuthorDate: Thu Aug 24 11:23:23 2023 +0100

Merge branch 'cassandra-5.0' into trunk

 .../pages/developing/cql/dynamic_data_masking.adoc| 19 ++-
 doc/modules/cassandra/partials/masking_functions.adoc |  2 +-
 2 files changed, 11 insertions(+), 10 deletions(-)


-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[cassandra] branch trunk updated (4226cbbec6 -> cbaef9094e)

2023-08-24 Thread adelapena
This is an automated email from the ASF dual-hosted git repository.

adelapena pushed a change to branch trunk
in repository https://gitbox.apache.org/repos/asf/cassandra.git


from 4226cbbec6 Merge branch 'cassandra-5.0' into trunk
 new 410018ab16 Fix spelling errors in the documentation for DDM
 new cbaef9094e Merge branch 'cassandra-5.0' into trunk

The 2 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .../pages/developing/cql/dynamic_data_masking.adoc| 19 ++-
 doc/modules/cassandra/partials/masking_functions.adoc |  2 +-
 2 files changed, 11 insertions(+), 10 deletions(-)


-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-18794) Add missing features to 5.0 new features page

2023-08-24 Thread Jira


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-18794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andres de la Peña updated CASSANDRA-18794:
--
Test and Documentation Plan: This is a doc change
 Status: Patch Available  (was: Open)

> Add missing features to 5.0 new features page
> -
>
> Key: CASSANDRA-18794
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18794
> Project: Cassandra
>  Issue Type: Bug
>  Components: Documentation
>Reporter: Andres de la Peña
>Assignee: Andres de la Peña
>Priority: Normal
> Fix For: 5.0.x, 5.x
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> The [page|https://cassandra.apache.org/doc/trunk/cassandra/new/index.html] 
> listing the 5.0 new features is not mentioning multiple new features like 
> trie sstables, unified compaction strategy, dynamic data masking, etc.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Commented] (CASSANDRA-18765) Add CASSANDRA-14227 to 5.0 new features page

2023-08-24 Thread Jira


[ 
https://issues.apache.org/jira/browse/CASSANDRA-18765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758493#comment-17758493
 ] 

Andres de la Peña commented on CASSANDRA-18765:
---

Created CASSANDRA-18794 for adding the rest of the missing features (sstable 
tries, DDM, UCS, etc.)

> Add CASSANDRA-14227 to 5.0 new features page
> 
>
> Key: CASSANDRA-18765
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18765
> Project: Cassandra
>  Issue Type: Bug
>  Components: Documentation
>Reporter: Berenguer Blasi
>Assignee: Berenguer Blasi
>Priority: Normal
> Fix For: 5.0, 5.0.x
>
>
> The [page|https://cassandra.apache.org/doc/trunk/cassandra/new/index.html] 
> listing the 5.0 new features is not mentioning the extended TTL implemented 
> in CASSANDRA-14227



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-18794) Add missing features to 5.0 new features page

2023-08-24 Thread Jira


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-18794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andres de la Peña updated CASSANDRA-18794:
--
 Bug Category: Parent values: Documentation(13562)
   Complexity: Low Hanging Fruit
Discovered By: Code Inspection
Fix Version/s: 5.0.x
   5.x
 Severity: Normal
   Status: Open  (was: Triage Needed)

> Add missing features to 5.0 new features page
> -
>
> Key: CASSANDRA-18794
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18794
> Project: Cassandra
>  Issue Type: Bug
>  Components: Documentation
>Reporter: Andres de la Peña
>Assignee: Andres de la Peña
>Priority: Normal
> Fix For: 5.0.x, 5.x
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> The [page|https://cassandra.apache.org/doc/trunk/cassandra/new/index.html] 
> listing the 5.0 new features is not mentioning multiple new features like 
> trie sstables, unified compaction strategy, dynamic data masking, etc.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Commented] (CASSANDRA-18794) Add missing features to 5.0 new features page

2023-08-24 Thread Jira


[ 
https://issues.apache.org/jira/browse/CASSANDRA-18794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758492#comment-17758492
 ] 

Andres de la Peña commented on CASSANDRA-18794:
---

I understand that [that 
page|https://cassandra.apache.org/doc/trunk/cassandra/new/index.html] doesn't 
need to contain all the entries in 
[{{NEWS.txt}}|https://github.com/apache/cassandra/blob/cassandra-5.0/NEWS.txt#L69-L188]
 but only relatively major things. [This 
PR|https://github.com/apache/cassandra/pull/2629] tries to do that. Please let 
me know if something is missing or if some entries are not needed.

> Add missing features to 5.0 new features page
> -
>
> Key: CASSANDRA-18794
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18794
> Project: Cassandra
>  Issue Type: Bug
>  Components: Documentation
>Reporter: Andres de la Peña
>Assignee: Andres de la Peña
>Priority: Normal
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> The [page|https://cassandra.apache.org/doc/trunk/cassandra/new/index.html] 
> listing the 5.0 new features is not mentioning multiple new features like 
> trie sstables, unified compaction strategy, dynamic data masking, etc.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Created] (CASSANDRA-18794) Add missing features to 5.0 new features page

2023-08-24 Thread Jira
Andres de la Peña created CASSANDRA-18794:
-

 Summary: Add missing features to 5.0 new features page
 Key: CASSANDRA-18794
 URL: https://issues.apache.org/jira/browse/CASSANDRA-18794
 Project: Cassandra
  Issue Type: Bug
  Components: Documentation
Reporter: Andres de la Peña
Assignee: Andres de la Peña


The [page|https://cassandra.apache.org/doc/trunk/cassandra/new/index.html] 
listing the 5.0 new features is not mentioning multiple new features like trie 
sstables, unified compaction strategy, dynamic data masking, etc.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Commented] (CASSANDRA-18786) Javadoc BigFormat

2023-08-24 Thread Berenguer Blasi (Jira)


[ 
https://issues.apache.org/jira/browse/CASSANDRA-18786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758475#comment-17758475
 ] 

Berenguer Blasi commented on CASSANDRA-18786:
-

I found out individual serializers and components to have javadoc already or be 
easy to parse the code. My main difficulty was in lifting a sensible big 
picture of the structure, what each component did and what role they played. I 
hope this javadoc eases the ramp-up to this section of the code.

> Javadoc BigFormat
> -
>
> Key: CASSANDRA-18786
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18786
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Documentation/Javadoc
>Reporter: Berenguer Blasi
>Assignee: Berenguer Blasi
>Priority: Normal
> Fix For: 5.0.x
>
>
> This ticket intends to go through the current sstables code and javadoc the 
> format at high-level.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-18786) Javadoc BigFormat

2023-08-24 Thread Berenguer Blasi (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-18786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Berenguer Blasi updated CASSANDRA-18786:

Test and Documentation Plan: Tested javadoc in IDE
 Status: Patch Available  (was: In Progress)

> Javadoc BigFormat
> -
>
> Key: CASSANDRA-18786
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18786
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Documentation/Javadoc
>Reporter: Berenguer Blasi
>Assignee: Berenguer Blasi
>Priority: Normal
> Fix For: 5.0.x
>
>
> This ticket intends to go through the current sstables code and javadoc the 
> format at high-level.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-18782) Forbid analyzed SAI indexes on primary key columns

2023-08-24 Thread Jira


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-18782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andres de la Peña updated CASSANDRA-18782:
--
  Fix Version/s: 5.0
 5.1
 (was: 5.x)
 (was: 5.0.x)
  Since Version: 5.0-alpha1
Source Control Link: 
https://github.com/apache/cassandra/commit/b265b4658e007b6943d543a11c609b7ba5fd979f
 Resolution: Fixed
 Status: Resolved  (was: Ready to Commit)

> Forbid analyzed SAI indexes on primary key columns
> --
>
> Key: CASSANDRA-18782
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18782
> Project: Cassandra
>  Issue Type: Bug
>  Components: Feature/SAI
>Reporter: Andres de la Peña
>Assignee: Andres de la Peña
>Priority: Normal
> Fix For: 5.0, 5.1
>
>  Time Spent: 0.5h
>  Remaining Estimate: 0h
>
> Queries using SAI indexes don't find any results when the index is on a 
> primary key column, the indexing uses analysis, and the queried value is 
> different to the exact value of the column. For example:
> {code:java}
> CREATE TABLE t(k int, c text, PRIMARY KEY (k, c));
> CREATE INDEX ON t(c) USING 'sai' WITH OPTIONS = { 'case_sensitive' : false };
> INSERT INTO t(k, c) VALUES (1, 'A');
> SELECT * FROM t WHERE c = 'a'; -- no results found!!!
> {code}
> This happens because the {{ClusteringIndexFilter}} for the query doesn't take 
> analysis into account. Thus, when that filter is applied by 
> [{{QueryController#doesNotSelect(PrimaryKey)}}|https://github.com/apache/cassandra/blob/655a2455ac29395b0a303e6ad7fc4d458b18932d/src/java/org/apache/cassandra/index/sai/plan/QueryController.java#L194-L210]
>  it rejects the results that have been correctly found by the index.
> An initial approach to solve this problem could be making 
> {{ClusteringIndexFilter}} aware of the index analysis options. However, this 
> would be problematic for paging. The first page of the query contains a 
> restriction in the clustering that requires analysis. But subsequent queries 
> will contain the last seen clustering, and we don’t want analysis in that 
> case.
> Another approach would be not adding a {{ClusteringIndexFilter}} to the query 
> restrictions when it contains this type of restriction on columns. However, 
> this approach would create a weird situation where adding an index might make 
> {{ALLOW FILTERING}} necessary in queries that wouldn’t need it without the 
> index. This is the opposite of the natural way of things, where more indexes 
> mean less AF needed. For example:
> {code:java}
> CREATE TABLE t(k int, c1 text, c2 int, PRIMARY KEY (k, c1, c2));
> CREATE INDEX idx ON t(c1) USING 'sai' WITH OPTIONS = { 'case_sensitive' : 
> false };
> SELECT * FROM t WHERE k = 0 AND c1 = 'a' AND c2 = 0 ALLOW FILTERING;
> {code}
> The query would need AF because it has been translated into an index query 
> without a clustering filter, and {{c2}} is not indexed.
> I think there is an ambiguity in the query, and it's not clear if it should 
> use the secondary index filter and use analysis, or it should be a primary 
> index query and not use analysis. Although we can default to one or another 
> interpretation, both can serve different use cases. We will probably need 
> some new CQL syntax to allow users to specify whether they want to use the 
> secondary index or not.
> We can work on those CQL improvements during the second phase of SAI. In the 
> meantime, I think we should simply forbid the creation of analyzed indexes on 
> primary key columns.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Commented] (CASSANDRA-18782) Forbid analyzed SAI indexes on primary key columns

2023-08-24 Thread Jira


[ 
https://issues.apache.org/jira/browse/CASSANDRA-18782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758471#comment-17758471
 ] 

Andres de la Peña commented on CASSANDRA-18782:
---

Committed to {{cassandra-5.0}} as 
[b265b4658e007b6943d543a11c609b7ba5fd979f|https://github.com/apache/cassandra/commit/b265b4658e007b6943d543a11c609b7ba5fd979f]
 and merged to 
[{{trunk}}|https://github.com/apache/cassandra/commit/4226cbbec6c2ac92ed8d3834140f8ea3e3260e59]

> Forbid analyzed SAI indexes on primary key columns
> --
>
> Key: CASSANDRA-18782
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18782
> Project: Cassandra
>  Issue Type: Bug
>  Components: Feature/SAI
>Reporter: Andres de la Peña
>Assignee: Andres de la Peña
>Priority: Normal
> Fix For: 5.0.x, 5.x
>
>  Time Spent: 0.5h
>  Remaining Estimate: 0h
>
> Queries using SAI indexes don't find any results when the index is on a 
> primary key column, the indexing uses analysis, and the queried value is 
> different to the exact value of the column. For example:
> {code:java}
> CREATE TABLE t(k int, c text, PRIMARY KEY (k, c));
> CREATE INDEX ON t(c) USING 'sai' WITH OPTIONS = { 'case_sensitive' : false };
> INSERT INTO t(k, c) VALUES (1, 'A');
> SELECT * FROM t WHERE c = 'a'; -- no results found!!!
> {code}
> This happens because the {{ClusteringIndexFilter}} for the query doesn't take 
> analysis into account. Thus, when that filter is applied by 
> [{{QueryController#doesNotSelect(PrimaryKey)}}|https://github.com/apache/cassandra/blob/655a2455ac29395b0a303e6ad7fc4d458b18932d/src/java/org/apache/cassandra/index/sai/plan/QueryController.java#L194-L210]
>  it rejects the results that have been correctly found by the index.
> An initial approach to solve this problem could be making 
> {{ClusteringIndexFilter}} aware of the index analysis options. However, this 
> would be problematic for paging. The first page of the query contains a 
> restriction in the clustering that requires analysis. But subsequent queries 
> will contain the last seen clustering, and we don’t want analysis in that 
> case.
> Another approach would be not adding a {{ClusteringIndexFilter}} to the query 
> restrictions when it contains this type of restriction on columns. However, 
> this approach would create a weird situation where adding an index might make 
> {{ALLOW FILTERING}} necessary in queries that wouldn’t need it without the 
> index. This is the opposite of the natural way of things, where more indexes 
> mean less AF needed. For example:
> {code:java}
> CREATE TABLE t(k int, c1 text, c2 int, PRIMARY KEY (k, c1, c2));
> CREATE INDEX idx ON t(c1) USING 'sai' WITH OPTIONS = { 'case_sensitive' : 
> false };
> SELECT * FROM t WHERE k = 0 AND c1 = 'a' AND c2 = 0 ALLOW FILTERING;
> {code}
> The query would need AF because it has been translated into an index query 
> without a clustering filter, and {{c2}} is not indexed.
> I think there is an ambiguity in the query, and it's not clear if it should 
> use the secondary index filter and use analysis, or it should be a primary 
> index query and not use analysis. Although we can default to one or another 
> interpretation, both can serve different use cases. We will probably need 
> some new CQL syntax to allow users to specify whether they want to use the 
> secondary index or not.
> We can work on those CQL improvements during the second phase of SAI. In the 
> meantime, I think we should simply forbid the creation of analyzed indexes on 
> primary key columns.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[cassandra] branch cassandra-5.0 updated: Forbid SAI indexes with analysis options on primary key columns

2023-08-24 Thread adelapena
This is an automated email from the ASF dual-hosted git repository.

adelapena pushed a commit to branch cassandra-5.0
in repository https://gitbox.apache.org/repos/asf/cassandra.git


The following commit(s) were added to refs/heads/cassandra-5.0 by this push:
 new b265b4658e Forbid SAI indexes with analysis options on primary key 
columns
b265b4658e is described below

commit b265b4658e007b6943d543a11c609b7ba5fd979f
Author: Andrés de la Peña 
AuthorDate: Wed Jul 19 17:40:50 2023 +0100

Forbid SAI indexes with analysis options on primary key columns

patch by Andrés de la Peña; reviewed by Caleb Rackliffe for CASSANDRA-18782
---
 CHANGES.txt|  1 +
 .../cassandra/index/sai/StorageAttachedIndex.java  | 11 +++-
 .../index/sai/analyzer/AbstractAnalyzer.java   | 12 ++---
 .../index/sai/analyzer/NonTokenizingOptions.java   |  5 
 .../index/sai/cql/StorageAttachedIndexDDLTest.java | 31 ++
 5 files changed, 56 insertions(+), 4 deletions(-)

diff --git a/CHANGES.txt b/CHANGES.txt
index 262a2edcb6..68515312fe 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,4 +1,5 @@
 5.0-alpha2
+ * Forbid SAI indexes with analysis options on primary key columns 
(CASSANDRA-18782)
 Merged from 4.1:
 Merged from 4.0:
 Merged from 3.11:
diff --git a/src/java/org/apache/cassandra/index/sai/StorageAttachedIndex.java 
b/src/java/org/apache/cassandra/index/sai/StorageAttachedIndex.java
index e8c4b53f4e..805a6b65e1 100644
--- a/src/java/org/apache/cassandra/index/sai/StorageAttachedIndex.java
+++ b/src/java/org/apache/cassandra/index/sai/StorageAttachedIndex.java
@@ -48,6 +48,7 @@ import org.slf4j.LoggerFactory;
 
 import org.apache.cassandra.config.DatabaseDescriptor;
 import org.apache.cassandra.cql3.CQL3Type;
+import org.apache.cassandra.cql3.CqlBuilder;
 import org.apache.cassandra.cql3.Operator;
 import org.apache.cassandra.cql3.statements.schema.IndexTarget;
 import org.apache.cassandra.db.CassandraWriteContext;
@@ -96,6 +97,9 @@ import org.apache.cassandra.utils.concurrent.OpOrder;
 public class StorageAttachedIndex implements Index
 {
 public static final String NAME = "sai";
+
+@VisibleForTesting
+public static final String ANALYSIS_ON_KEY_COLUMNS_MESSAGE = "Analysis 
options are not supported on primary key columns, but found ";
 
 private static final Logger logger = 
LoggerFactory.getLogger(StorageAttachedIndex.class);
 
@@ -253,7 +257,12 @@ public class StorageAttachedIndex implements Index
 throw new InvalidRequestException("Unsupported type: " + 
type.asCQL3Type());
 }
 
-AbstractAnalyzer.fromOptions(type, options);
+Map analysisOptions = 
AbstractAnalyzer.getAnalyzerOptions(options);
+if (target.left.isPrimaryKeyColumn() && !analysisOptions.isEmpty())
+{
+throw new InvalidRequestException(ANALYSIS_ON_KEY_COLUMNS_MESSAGE 
+ new CqlBuilder().append(analysisOptions));
+}
+AbstractAnalyzer.fromOptions(type, analysisOptions);
 
 return Collections.emptyMap();
 }
diff --git 
a/src/java/org/apache/cassandra/index/sai/analyzer/AbstractAnalyzer.java 
b/src/java/org/apache/cassandra/index/sai/analyzer/AbstractAnalyzer.java
index 1f5e339657..da0b2a4d19 100644
--- a/src/java/org/apache/cassandra/index/sai/analyzer/AbstractAnalyzer.java
+++ b/src/java/org/apache/cassandra/index/sai/analyzer/AbstractAnalyzer.java
@@ -22,6 +22,7 @@ import java.nio.ByteBuffer;
 import java.util.Iterator;
 import java.util.Map;
 import java.util.NoSuchElementException;
+import java.util.stream.Collectors;
 
 import org.apache.cassandra.db.marshal.AbstractType;
 import org.apache.cassandra.db.marshal.StringType;
@@ -103,9 +104,14 @@ public abstract class AbstractAnalyzer implements 
Iterator
 
 private static boolean hasNonTokenizingOptions(Map options)
 {
-return options.get(NonTokenizingOptions.ASCII) != null ||
-   options.containsKey(NonTokenizingOptions.CASE_SENSITIVE) ||
-   options.containsKey(NonTokenizingOptions.NORMALIZE);
+return 
options.keySet().stream().anyMatch(NonTokenizingOptions::hasOption);
+}
+
+public static Map getAnalyzerOptions(Map 
options)
+{
+return options.entrySet().stream()
+  .filter(e -> NonTokenizingOptions.hasOption(e.getKey()))
+  .collect(Collectors.toMap(Map.Entry::getKey, 
Map.Entry::getValue));
 }
 
 }
diff --git 
a/src/java/org/apache/cassandra/index/sai/analyzer/NonTokenizingOptions.java 
b/src/java/org/apache/cassandra/index/sai/analyzer/NonTokenizingOptions.java
index ab6485acf5..66c7740a53 100644
--- a/src/java/org/apache/cassandra/index/sai/analyzer/NonTokenizingOptions.java
+++ b/src/java/org/apache/cassandra/index/sai/analyzer/NonTokenizingOptions.java
@@ -65,6 +65,11 @@ public class NonTokenizingOptions
 this.normalized = normalized;
 }
 
+static boolean hasOption(String option)
+

[jira] [Updated] (CASSANDRA-18786) Javadoc BigFormat

2023-08-24 Thread Berenguer Blasi (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-18786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Berenguer Blasi updated CASSANDRA-18786:

Summary: Javadoc BigFormat  (was: Javadoc sstable format)

> Javadoc BigFormat
> -
>
> Key: CASSANDRA-18786
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18786
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Documentation/Javadoc
>Reporter: Berenguer Blasi
>Assignee: Berenguer Blasi
>Priority: Normal
> Fix For: 5.0.x
>
>
> This ticket intends to go through the current sstables code and javadoc the 
> format at high-level.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[cassandra] branch trunk updated (77cf2185b6 -> 4226cbbec6)

2023-08-24 Thread adelapena
This is an automated email from the ASF dual-hosted git repository.

adelapena pushed a change to branch trunk
in repository https://gitbox.apache.org/repos/asf/cassandra.git


from 77cf2185b6 Add jmh microbenchmarks to eclipse IDE
 new b265b4658e Forbid SAI indexes with analysis options on primary key 
columns
 new 4226cbbec6 Merge branch 'cassandra-5.0' into trunk

The 2 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 CHANGES.txt|  1 +
 .../cassandra/index/sai/StorageAttachedIndex.java  | 11 +++-
 .../index/sai/analyzer/AbstractAnalyzer.java   | 12 ++---
 .../index/sai/analyzer/NonTokenizingOptions.java   |  5 
 .../index/sai/cql/StorageAttachedIndexDDLTest.java | 31 ++
 5 files changed, 56 insertions(+), 4 deletions(-)


-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[cassandra] 01/01: Merge branch 'cassandra-5.0' into trunk

2023-08-24 Thread adelapena
This is an automated email from the ASF dual-hosted git repository.

adelapena pushed a commit to branch trunk
in repository https://gitbox.apache.org/repos/asf/cassandra.git

commit 4226cbbec6c2ac92ed8d3834140f8ea3e3260e59
Merge: 77cf2185b6 b265b4658e
Author: Andrés de la Peña 
AuthorDate: Thu Aug 24 10:14:40 2023 +0100

Merge branch 'cassandra-5.0' into trunk

 CHANGES.txt|  1 +
 .../cassandra/index/sai/StorageAttachedIndex.java  | 11 +++-
 .../index/sai/analyzer/AbstractAnalyzer.java   | 12 ++---
 .../index/sai/analyzer/NonTokenizingOptions.java   |  5 
 .../index/sai/cql/StorageAttachedIndexDDLTest.java | 31 ++
 5 files changed, 56 insertions(+), 4 deletions(-)

diff --cc CHANGES.txt
index cfc0a9aace,68515312fe..a412b7a8d9
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -1,5 -1,12 +1,6 @@@
 -5.0-alpha2
 +5.1
 +Merged from 5.0:
+  * Forbid SAI indexes with analysis options on primary key columns 
(CASSANDRA-18782)
 -Merged from 4.1:
 -Merged from 4.0:
 -Merged from 3.11:
 -Merged from 3.0:
 - * Make alternation of a user type validate the same way as creation of a 
user type does (CASSANDRA-18585)
 -
 -5.0-alpha1
   * Expose bootstrap failure state via JMX and nodetool info (CASSANDRA-18749)
   * Reduce size of per-SSTable index components for SAI (CASSANDRA-18673)
   * Remove unnecessary Netty dependencies after upgrade to version 4.1.96 
(CASSANDRA-18729)


-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[cassandra-website] branch asf-staging updated (343e4f5af -> 3bc6a8391)

2023-08-24 Thread git-site-role
This is an automated email from the ASF dual-hosted git repository.

git-site-role pushed a change to branch asf-staging
in repository https://gitbox.apache.org/repos/asf/cassandra-website.git


 discard 343e4f5af generate docs for ce048d19
 new 3bc6a8391 generate docs for ce048d19

This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version.  This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:

 * -- * -- B -- O -- O -- O   (343e4f5af)
\
 N -- N -- N   refs/heads/asf-staging (3bc6a8391)

You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.

Any revisions marked "omit" are not gone; other references still
refer to them.  Any revisions marked "discard" are gone forever.

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 content/search-index.js |   2 +-
 site-ui/build/ui-bundle.zip | Bin 4852435 -> 4852435 bytes
 2 files changed, 1 insertion(+), 1 deletion(-)


-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Commented] (CASSANDRA-18782) Forbid analyzed SAI indexes on primary key columns

2023-08-24 Thread Jira


[ 
https://issues.apache.org/jira/browse/CASSANDRA-18782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758448#comment-17758448
 ] 

Andres de la Peña commented on CASSANDRA-18782:
---

CI looks good:
 * {{testLoadingIncompleteSSTable}} is CASSANDRA-18737
 * {{testStartAndStopScheduledSampling}} is CASSANDRA-18065

> Forbid analyzed SAI indexes on primary key columns
> --
>
> Key: CASSANDRA-18782
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18782
> Project: Cassandra
>  Issue Type: Bug
>  Components: Feature/SAI
>Reporter: Andres de la Peña
>Assignee: Andres de la Peña
>Priority: Normal
> Fix For: 5.0.x, 5.x
>
>  Time Spent: 0.5h
>  Remaining Estimate: 0h
>
> Queries using SAI indexes don't find any results when the index is on a 
> primary key column, the indexing uses analysis, and the queried value is 
> different to the exact value of the column. For example:
> {code:java}
> CREATE TABLE t(k int, c text, PRIMARY KEY (k, c));
> CREATE INDEX ON t(c) USING 'sai' WITH OPTIONS = { 'case_sensitive' : false };
> INSERT INTO t(k, c) VALUES (1, 'A');
> SELECT * FROM t WHERE c = 'a'; -- no results found!!!
> {code}
> This happens because the {{ClusteringIndexFilter}} for the query doesn't take 
> analysis into account. Thus, when that filter is applied by 
> [{{QueryController#doesNotSelect(PrimaryKey)}}|https://github.com/apache/cassandra/blob/655a2455ac29395b0a303e6ad7fc4d458b18932d/src/java/org/apache/cassandra/index/sai/plan/QueryController.java#L194-L210]
>  it rejects the results that have been correctly found by the index.
> An initial approach to solve this problem could be making 
> {{ClusteringIndexFilter}} aware of the index analysis options. However, this 
> would be problematic for paging. The first page of the query contains a 
> restriction in the clustering that requires analysis. But subsequent queries 
> will contain the last seen clustering, and we don’t want analysis in that 
> case.
> Another approach would be not adding a {{ClusteringIndexFilter}} to the query 
> restrictions when it contains this type of restriction on columns. However, 
> this approach would create a weird situation where adding an index might make 
> {{ALLOW FILTERING}} necessary in queries that wouldn’t need it without the 
> index. This is the opposite of the natural way of things, where more indexes 
> mean less AF needed. For example:
> {code:java}
> CREATE TABLE t(k int, c1 text, c2 int, PRIMARY KEY (k, c1, c2));
> CREATE INDEX idx ON t(c1) USING 'sai' WITH OPTIONS = { 'case_sensitive' : 
> false };
> SELECT * FROM t WHERE k = 0 AND c1 = 'a' AND c2 = 0 ALLOW FILTERING;
> {code}
> The query would need AF because it has been translated into an index query 
> without a clustering filter, and {{c2}} is not indexed.
> I think there is an ambiguity in the query, and it's not clear if it should 
> use the secondary index filter and use analysis, or it should be a primary 
> index query and not use analysis. Although we can default to one or another 
> interpretation, both can serve different use cases. We will probably need 
> some new CQL syntax to allow users to specify whether they want to use the 
> secondary index or not.
> We can work on those CQL improvements during the second phase of SAI. In the 
> meantime, I think we should simply forbid the creation of analyzed indexes on 
> primary key columns.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-18782) Forbid analyzed SAI indexes on primary key columns

2023-08-24 Thread Jira


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-18782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andres de la Peña updated CASSANDRA-18782:
--
Status: Ready to Commit  (was: Review In Progress)

> Forbid analyzed SAI indexes on primary key columns
> --
>
> Key: CASSANDRA-18782
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18782
> Project: Cassandra
>  Issue Type: Bug
>  Components: Feature/SAI
>Reporter: Andres de la Peña
>Assignee: Andres de la Peña
>Priority: Normal
> Fix For: 5.0.x, 5.x
>
>  Time Spent: 0.5h
>  Remaining Estimate: 0h
>
> Queries using SAI indexes don't find any results when the index is on a 
> primary key column, the indexing uses analysis, and the queried value is 
> different to the exact value of the column. For example:
> {code:java}
> CREATE TABLE t(k int, c text, PRIMARY KEY (k, c));
> CREATE INDEX ON t(c) USING 'sai' WITH OPTIONS = { 'case_sensitive' : false };
> INSERT INTO t(k, c) VALUES (1, 'A');
> SELECT * FROM t WHERE c = 'a'; -- no results found!!!
> {code}
> This happens because the {{ClusteringIndexFilter}} for the query doesn't take 
> analysis into account. Thus, when that filter is applied by 
> [{{QueryController#doesNotSelect(PrimaryKey)}}|https://github.com/apache/cassandra/blob/655a2455ac29395b0a303e6ad7fc4d458b18932d/src/java/org/apache/cassandra/index/sai/plan/QueryController.java#L194-L210]
>  it rejects the results that have been correctly found by the index.
> An initial approach to solve this problem could be making 
> {{ClusteringIndexFilter}} aware of the index analysis options. However, this 
> would be problematic for paging. The first page of the query contains a 
> restriction in the clustering that requires analysis. But subsequent queries 
> will contain the last seen clustering, and we don’t want analysis in that 
> case.
> Another approach would be not adding a {{ClusteringIndexFilter}} to the query 
> restrictions when it contains this type of restriction on columns. However, 
> this approach would create a weird situation where adding an index might make 
> {{ALLOW FILTERING}} necessary in queries that wouldn’t need it without the 
> index. This is the opposite of the natural way of things, where more indexes 
> mean less AF needed. For example:
> {code:java}
> CREATE TABLE t(k int, c1 text, c2 int, PRIMARY KEY (k, c1, c2));
> CREATE INDEX idx ON t(c1) USING 'sai' WITH OPTIONS = { 'case_sensitive' : 
> false };
> SELECT * FROM t WHERE k = 0 AND c1 = 'a' AND c2 = 0 ALLOW FILTERING;
> {code}
> The query would need AF because it has been translated into an index query 
> without a clustering filter, and {{c2}} is not indexed.
> I think there is an ambiguity in the query, and it's not clear if it should 
> use the secondary index filter and use analysis, or it should be a primary 
> index query and not use analysis. Although we can default to one or another 
> interpretation, both can serve different use cases. We will probably need 
> some new CQL syntax to allow users to specify whether they want to use the 
> secondary index or not.
> We can work on those CQL improvements during the second phase of SAI. In the 
> meantime, I think we should simply forbid the creation of analyzed indexes on 
> primary key columns.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Commented] (CASSANDRA-18065) Flaky test org.apache.cassandra.tools.TopPartitionsTest#testStartAndStopScheduledSampling

2023-08-24 Thread Jira


[ 
https://issues.apache.org/jira/browse/CASSANDRA-18065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758445#comment-17758445
 ] 

Andres de la Peña commented on CASSANDRA-18065:
---

I saw it on {{trunk}} at the time of opening the ticket (22/Nov/22).

I have just hit it on 5.0: 
https://app.circleci.com/pipelines/github/adelapena/cassandra/3134/workflows/53f427a0-3303-40ee-810e-69141f35174d/jobs/71095/tests

> Flaky test 
> org.apache.cassandra.tools.TopPartitionsTest#testStartAndStopScheduledSampling
> -
>
> Key: CASSANDRA-18065
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18065
> Project: Cassandra
>  Issue Type: Bug
>  Components: Tool/nodetool
>Reporter: Andres de la Peña
>Priority: Normal
> Fix For: 5.0.x, 5.x
>
>
> The test 
> {{org.apache.cassandra.tools.TopPartitionsTest#testStartAndStopScheduledSampling}}
>  is fails intermittently on trunk with CircleCI:
> * 
> https://app.circleci.com/pipelines/github/adelapena/cassandra/2508/workflows/92f054d7-9386-498f-9ba4-330181cd4782/jobs/24692
> * 
> https://app.circleci.com/pipelines/github/adelapena/cassandra/2511/workflows/7aba8baa-0a6d-404a-b08b-c6a8078caca3/jobs/24706/tests
> The failure looks like:
> {code}
> junit.framework.AssertionFailedError: Scheduled sampled tasks should be 
> removed expected:<[]> but was:<[*.*]>
>   at 
> org.apache.cassandra.tools.TopPartitionsTest.testStartAndStopScheduledSampling(TopPartitionsTest.java:116)
> {code}
> I haven't seen this failure on Butler/Jenkins yet, but it can be reproduced 
> with the CircleCI multiplexer:
> {code}
> .circleci/generate.sh -m \
>   -e REPEATED_UTESTS_COUNT=2000 \
>   -e REPEATED_UTESTS=org.apache.cassandra.tools.TopPartitionsTest
> {code}
> It seems to fail 11 times on 2000 runs.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Commented] (CASSANDRA-18793) Fix or remove nodetool compaction completion time estimate

2023-08-24 Thread Stefan Miklosovic (Jira)


[ 
https://issues.apache.org/jira/browse/CASSANDRA-18793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758428#comment-17758428
 ] 

Stefan Miklosovic commented on CASSANDRA-18793:
---

I see that [~cam1982] is logging the current compaction throughput as part of 
his debug logging in this ticket. Maybe we can just extract that, refactor a 
little bit and call it a day.

(1) https://issues.apache.org/jira/browse/CASSANDRA-18773

> Fix or remove nodetool compaction completion time estimate
> --
>
> Key: CASSANDRA-18793
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18793
> Project: Cassandra
>  Issue Type: Bug
>  Components: Local/Compaction
>Reporter: Jonathan Ellis
>Priority: Normal
> Fix For: 5.x
>
>
> It looks like many years ago the author of this code thought that the 
> compactionthroughput from the server was the current rate when it is actually 
> the configured maximum.  So using it to estimate time remaining is not useful.
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-18778) Empty keystore_password no longer allowed on encryption_options

2023-08-24 Thread Stefan Miklosovic (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-18778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Stefan Miklosovic updated CASSANDRA-18778:
--
Reviewers: Jon Meredith, Stefan Miklosovic, Stefan Miklosovic  (was: Jon 
Meredith)
   Jon Meredith, Stefan Miklosovic, Stefan Miklosovic  (was: Jon 
Meredith, Stefan Miklosovic)
   Status: Review In Progress  (was: Patch Available)

> Empty keystore_password no longer allowed on encryption_options
> ---
>
> Key: CASSANDRA-18778
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18778
> Project: Cassandra
>  Issue Type: Bug
>  Components: Local/Config
>Reporter: Andy Tolbert
>Assignee: Andy Tolbert
>Priority: Normal
> Fix For: 4.1.x, 5.0.x
>
>
> After CASSANDRA-18124 (introduced in 4.1.2 and 5.0) it is no longer possible 
> to set an empty {{keystore_password}} under {{client_encryption_options}} or 
> {{server_encryption_options}} using the default implementation 
> {{{}DefaultSslContextFactory{}}}.
> While keytool does not allow generating keystores with empty passwords, it 
> does support reading them. It is not uncommon to use PKCS12 certificates 
> generated by other tools (eg. openssl) that do not enforce passwords.
> The fix for this should be pretty straightforward, which should involve 
> changing 
> [FileBasedSslContextFactory.validatePassword|https://github.com/apache/cassandra/blob/cassandra-4.1.2/src/java/org/apache/cassandra/security/FileBasedSslContextFactory.java#L128-L135]
>  to only disallow null passwords (which would be consistent with previous 
> versions). I will create pull requests against the relevant branches shortly.
> {noformat}
> Exception (org.apache.cassandra.exceptions.ConfigurationException) 
> encountered during startup: Failed to initialize SSL
> org.apache.cassandra.exceptions.ConfigurationException: Failed to initialize 
> SSL
>   at 
> org.apache.cassandra.config.DatabaseDescriptor.applySslContext(DatabaseDescriptor.java:1155)
>   at 
> org.apache.cassandra.config.DatabaseDescriptor.applyAll(DatabaseDescriptor.java:390)
>   at 
> org.apache.cassandra.config.DatabaseDescriptor.daemonInitialization(DatabaseDescriptor.java:204)
>   at 
> org.apache.cassandra.config.DatabaseDescriptor.daemonInitialization(DatabaseDescriptor.java:188)
>   at 
> org.apache.cassandra.service.CassandraDaemon.applyConfig(CassandraDaemon.java:804)
>   at 
> org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:747)
>   at 
> org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:875)
> Caused by: java.io.IOException: Failed to create SSL context using Native 
> transport
>   at 
> org.apache.cassandra.security.SSLFactory.validateSslContext(SSLFactory.java:405)
>   at 
> org.apache.cassandra.config.DatabaseDescriptor.applySslContext(DatabaseDescriptor.java:1150)
>   ... 6 more
> Caused by: java.lang.IllegalArgumentException: 'keystore_password' must be 
> specified
>   at 
> org.apache.cassandra.security.FileBasedSslContextFactory.validatePassword(FileBasedSslContextFactory.java:133)
>   at 
> org.apache.cassandra.security.FileBasedSslContextFactory.buildKeyManagerFactory(FileBasedSslContextFactory.java:151)
>   at 
> org.apache.cassandra.security.AbstractSslContextFactory.createNettySslContext(AbstractSslContextFactory.java:181)
>   at 
> org.apache.cassandra.security.SSLFactory.createNettySslContext(SSLFactory.java:168)
>   at 
> org.apache.cassandra.security.SSLFactory.validateSslContext(SSLFactory.java:355)
>   ... 7 more
> {noformat}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-18778) Empty keystore_password no longer allowed on encryption_options

2023-08-24 Thread Stefan Miklosovic (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-18778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Stefan Miklosovic updated CASSANDRA-18778:
--
Test and Documentation Plan: CI
 Status: Patch Available  (was: In Progress)

> Empty keystore_password no longer allowed on encryption_options
> ---
>
> Key: CASSANDRA-18778
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18778
> Project: Cassandra
>  Issue Type: Bug
>  Components: Local/Config
>Reporter: Andy Tolbert
>Assignee: Andy Tolbert
>Priority: Normal
> Fix For: 4.1.x, 5.0.x
>
>
> After CASSANDRA-18124 (introduced in 4.1.2 and 5.0) it is no longer possible 
> to set an empty {{keystore_password}} under {{client_encryption_options}} or 
> {{server_encryption_options}} using the default implementation 
> {{{}DefaultSslContextFactory{}}}.
> While keytool does not allow generating keystores with empty passwords, it 
> does support reading them. It is not uncommon to use PKCS12 certificates 
> generated by other tools (eg. openssl) that do not enforce passwords.
> The fix for this should be pretty straightforward, which should involve 
> changing 
> [FileBasedSslContextFactory.validatePassword|https://github.com/apache/cassandra/blob/cassandra-4.1.2/src/java/org/apache/cassandra/security/FileBasedSslContextFactory.java#L128-L135]
>  to only disallow null passwords (which would be consistent with previous 
> versions). I will create pull requests against the relevant branches shortly.
> {noformat}
> Exception (org.apache.cassandra.exceptions.ConfigurationException) 
> encountered during startup: Failed to initialize SSL
> org.apache.cassandra.exceptions.ConfigurationException: Failed to initialize 
> SSL
>   at 
> org.apache.cassandra.config.DatabaseDescriptor.applySslContext(DatabaseDescriptor.java:1155)
>   at 
> org.apache.cassandra.config.DatabaseDescriptor.applyAll(DatabaseDescriptor.java:390)
>   at 
> org.apache.cassandra.config.DatabaseDescriptor.daemonInitialization(DatabaseDescriptor.java:204)
>   at 
> org.apache.cassandra.config.DatabaseDescriptor.daemonInitialization(DatabaseDescriptor.java:188)
>   at 
> org.apache.cassandra.service.CassandraDaemon.applyConfig(CassandraDaemon.java:804)
>   at 
> org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:747)
>   at 
> org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:875)
> Caused by: java.io.IOException: Failed to create SSL context using Native 
> transport
>   at 
> org.apache.cassandra.security.SSLFactory.validateSslContext(SSLFactory.java:405)
>   at 
> org.apache.cassandra.config.DatabaseDescriptor.applySslContext(DatabaseDescriptor.java:1150)
>   ... 6 more
> Caused by: java.lang.IllegalArgumentException: 'keystore_password' must be 
> specified
>   at 
> org.apache.cassandra.security.FileBasedSslContextFactory.validatePassword(FileBasedSslContextFactory.java:133)
>   at 
> org.apache.cassandra.security.FileBasedSslContextFactory.buildKeyManagerFactory(FileBasedSslContextFactory.java:151)
>   at 
> org.apache.cassandra.security.AbstractSslContextFactory.createNettySslContext(AbstractSslContextFactory.java:181)
>   at 
> org.apache.cassandra.security.SSLFactory.createNettySslContext(SSLFactory.java:168)
>   at 
> org.apache.cassandra.security.SSLFactory.validateSslContext(SSLFactory.java:355)
>   ... 7 more
> {noformat}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Commented] (CASSANDRA-18688) Limit Java runtime in 5.0 to JDK 11 and 17 in scripts; add a flag to opt out of that

2023-08-24 Thread Berenguer Blasi (Jira)


[ 
https://issues.apache.org/jira/browse/CASSANDRA-18688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758395#comment-17758395
 ] 

Berenguer Blasi commented on CASSANDRA-18688:
-

This was almost ready. Is anything pending I am blocking as a reviewer?

> Limit Java runtime in 5.0 to JDK 11 and 17 in scripts; add a flag to opt out 
> of that
> 
>
> Key: CASSANDRA-18688
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18688
> Project: Cassandra
>  Issue Type: Task
>  Components: Build
>Reporter: Ekaterina Dimitrova
>Assignee: shylaja kokoori
>Priority: Normal
> Fix For: 5.0.x
>
>  Time Spent: 1h 20m
>  Remaining Estimate: 0h
>
> Currently, we limit our users from building with non-default Java versions in 
> build.xml.
> They can easily hack build.xml for test purposes with different versions.
> Cassandra–5.0 will be run on JDK11 and JDK17, but on startup, we do not limit 
> people to those two, but only to everything >= 11. We should also put an 
> upper limit of 17 in our Cassandra startup scripts. We can also add a flag to 
> opt-out if someone wants to test with newer versions.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-18702) Add jmh microbenchmarks to eclipse IDE

2023-08-24 Thread Berenguer Blasi (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-18702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Berenguer Blasi updated CASSANDRA-18702:

  Fix Version/s: 5.0.x
 (was: 5.x)
  Since Version: 5.0
Source Control Link: 
https://github.com/apache/cassandra/commit/77cf2185b6c6261f3a6c3a2e3c8047b028190e8c
 Resolution: Fixed
 Status: Resolved  (was: Ready to Commit)

> Add jmh microbenchmarks to eclipse IDE
> --
>
> Key: CASSANDRA-18702
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18702
> Project: Cassandra
>  Issue Type: Bug
>  Components: Build
>Reporter: Berenguer Blasi
>Assignee: Berenguer Blasi
>Priority: Normal
> Fix For: 5.0.x
>
>
> Currently jmh tests are not being picked up by the Eclipse IDE.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-18702) Add jmh microbenchmarks to eclipse IDE

2023-08-24 Thread Berenguer Blasi (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-18702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Berenguer Blasi updated CASSANDRA-18702:

Status: Ready to Commit  (was: Review In Progress)

> Add jmh microbenchmarks to eclipse IDE
> --
>
> Key: CASSANDRA-18702
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18702
> Project: Cassandra
>  Issue Type: Bug
>  Components: Build
>Reporter: Berenguer Blasi
>Assignee: Berenguer Blasi
>Priority: Normal
> Fix For: 5.x
>
>
> Currently jmh tests are not being picked up by the Eclipse IDE.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[cassandra] branch trunk updated: Add jmh microbenchmarks to eclipse IDE

2023-08-24 Thread bereng
This is an automated email from the ASF dual-hosted git repository.

bereng pushed a commit to branch trunk
in repository https://gitbox.apache.org/repos/asf/cassandra.git


The following commit(s) were added to refs/heads/trunk by this push:
 new 77cf2185b6 Add jmh microbenchmarks to eclipse IDE
77cf2185b6 is described below

commit 77cf2185b6c6261f3a6c3a2e3c8047b028190e8c
Author: Bereng 
AuthorDate: Fri Jul 28 08:05:46 2023 +0200

Add jmh microbenchmarks to eclipse IDE

patch by Berenguer Blasi; reviewed by Benjamin Lerer, Maxim Muzafarov for 
CASSANDRA-18702
---
 build.xml | 4 
 ide/idea-iml-file.xml | 1 +
 2 files changed, 5 insertions(+)

diff --git a/build.xml b/build.xml
index bc9d6eedc5..7c9c68555f 100644
--- a/build.xml
+++ b/build.xml
@@ -1978,6 +1978,10 @@
   
   
   
+  
+  
+  
+  
   
   
   
diff --git a/ide/idea-iml-file.xml b/ide/idea-iml-file.xml
index e6860f8e0b..01c071a728 100644
--- a/ide/idea-iml-file.xml
+++ b/ide/idea-iml-file.xml
@@ -35,6 +35,7 @@
 
 
 
+
 
 
 


-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Commented] (CASSANDRA-18789) Update commons-lang3 to 3.13.0

2023-08-24 Thread Berenguer Blasi (Jira)


[ 
https://issues.apache.org/jira/browse/CASSANDRA-18789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758381#comment-17758381
 ] 

Berenguer Blasi commented on CASSANDRA-18789:
-

If we're not being religious about his, which is what I gather from the ML, I 
think we can go ahead with 5.0.

> Update commons-lang3 to 3.13.0
> --
>
> Key: CASSANDRA-18789
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18789
> Project: Cassandra
>  Issue Type: Task
>  Components: Dependencies
>Reporter: Ekaterina Dimitrova
>Assignee: Ekaterina Dimitrova
>Priority: Low
> Fix For: 5.0.x, 5.x
>
>
> It seems we are on a version that was testing up to Java 11 - 3.11.0
> In the latest one the community goes up to JDK21 so I think it is good to 
> update, hopefully also on cassandra-5.0
> Below are the release notes:
> https://commons.apache.org/proper/commons-lang/changes-report.html#a3.12.0



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org