RE: CASSANDRA-19268: Improve Cassandra compression performance using hardware accelerators

: Tuesday, January 23, 2024 10:36 PM To: dev@cassandra.apache.org Subject: Re: CASSANDRA-19268: Improve Cassandra compression performance using hardware accelerators Hi Shylaja, If you'd like we can continue this on the ticket you opened. Here are my concerns - 1. QPL Java Library[1] (JNI bindings

Re: CASSANDRA-19268: Improve Cassandra compression performance using hardware accelerators

; > Thank you, > > Shylaja > > > > *From:* Dinesh Joshi > *Sent:* Monday, January 22, 2024 11:18 AM > *To:* dev@cassandra.apache.org > *Subject:* Re: CASSANDRA-19268: Improve Cassandra compression performance > using hardware accelerators > > > > Shylaja, >

RE: CASSANDRA-19268: Improve Cassandra compression performance using hardware accelerators

try to come up with a solution to work around the 4k window limitation. Thank you, Shylaja From: Dinesh Joshi Sent: Monday, January 22, 2024 11:18 AM To: dev@cassandra.apache.org Subject: Re: CASSANDRA-19268: Improve Cassandra compression performance using hardware accelerators Shylaja, Cassa

Re: CASSANDRA-19268: Improve Cassandra compression performance using hardware accelerators

Shylaja, Cassandra uses ZStd, LZ4 and other compression libraries via JNI to compress data. The intel hardware accelerator support is integrated into those libraries and we can benefit from it. If there are special parameters that need to be passed in to these libraries we can make those changes

Re: CASSANDRA-19268: Improve Cassandra compression performance using hardware accelerators

Hardware acceleration for more things would be great, especially based on the success of ACCP (CASSANDRA-18624 ). But I think it would be ideal to use existing compressor names and use hardware acceleration if a given JAR is present on the