dependabot[bot] opened a new pull request, #6483: URL: https://github.com/apache/ignite-3/pull/6483
Bumps [org.rocksdb:rocksdbjni](https://github.com/facebook/rocksdb) from 10.2.1 to 10.4.2. <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/facebook/rocksdb/releases";>org.rocksdb:rocksdbjni's releases</a>.</em></p> <blockquote> <h2>v10.4.2</h2> <h2>10.4.2 (07/09/2025)</h2> <h3>Bug Fixes</h3> <ul> <li>Fix a race condition between concurrent DB::Open sharing the same SstFileManager instance.</li> </ul> <h2>10.4.1 (07/01/2025)</h2> <h3>Behavior Changes</h3> <ul> <li>RocksDB now triggers eligible compactions every 12 hours when periodic compaction is configured. This solves a limitation of the compaction trigger mechanism, which would only trigger compaction after specific events like flush, compaction, or SetOptions.</li> </ul> <h3>Bug Fixes</h3> <ul> <li>Fix a bug in BackupEngine that can crash backup due to a null FSWritableFile passed to WritableFileWriter.</li> </ul> <h2>10.4.0 (06/20/2025)</h2> <h3>New Features</h3> <ul> <li>Add a new CF option <code>memtable_avg_op_scan_flush_trigger</code> that supports triggering memtable flush when an iterator scans through an expensive range of keys, with the average number of skipped keys from the active memtable exceeding the threshold.</li> <li>Vector based memtable now supports concurrent writers (DBOptions::allow_concurrent_memtable_write) <a href="https://redirect.github.com/facebook/rocksdb/issues/13675";>#13675</a>.</li> <li>Add new experimental <code>TransactionOptions::large_txn_commit_optimize_byte_threshold</code> to enable optimizations for large transaction commit by transaction batch data size.</li> <li>Add a new option <code>CompactionOptionsUniversal::reduce_file_locking</code> and if it's true, auto universal compaction picking will adjust to minimize locking of input files when bottom priority compactions are waiting to run. This can increase the likelihood of existing L0s being selected for compaction, thereby improving write stall and reducing read regression.</li> <li>Add new <code>format_version=7</code> to aid experimental support of custom compression algorithms with CompressionManager and block-based table. This format version includes changing the format of <code>TableProperties::compression_name</code>.</li> </ul> <h3>Public API Changes</h3> <ul> <li>Change NewExternalTableFactory to return a unique_ptr instead of shared_ptr.</li> <li>Add an optional min file size requirement for deletion triggered compaction. It can be specified when creating <code>CompactOnDeletionCollectorFactory</code>.</li> </ul> <h3>Behavior Changes</h3> <ul> <li><code>TransactionOptions::large_txn_commit_optimize_threshold</code> now has default value 0 for disabled. <code>TransactionDBOptions::txn_commit_bypass_memtable_threshold</code> now has no effect on transactions.</li> </ul> <h3>Bug Fixes</h3> <ul> <li>Fix a bug where CreateColumnFamilyWithImport() could miss the SST file for the memtable flush it triggered. The exported CF then may not contain the updates in the memtable when CreateColumnFamilyWithImport() is called.</li> <li>Fix iterator operations returning NotImplemented status if disallow_memtable_writes and paranoid_memory_checks CF options are both set.</li> <li>Fixed handling of file checksums in IngestExternalFile() to allow providing checksums using recognized but not necessarily the DB's preferred checksum function, to ease migration between checksum functions.</li> </ul> </blockquote> </details> <details> <summary>Changelog</summary> <p><em>Sourced from <a href="https://github.com/facebook/rocksdb/blob/v10.4.2/HISTORY.md";>org.rocksdb:rocksdbjni's changelog</a>.</em></p> <blockquote> <h2>10.4.2 (07/09/2025)</h2> <h3>Bug Fixes</h3> <ul> <li>Fix a race condition between concurrent DB::Open sharing the same SstFileManager instance.</li> </ul> <h2>10.4.1 (07/01/2025)</h2> <h3>Behavior Changes</h3> <ul> <li>RocksDB now triggers eligible compactions every 12 hours when periodic compaction is configured. This solves a limitation of the compaction trigger mechanism, which would only trigger compaction after specific events like flush, compaction, or SetOptions.</li> </ul> <h3>Bug Fixes</h3> <ul> <li>Fix a bug in BackupEngine that can crash backup due to a null FSWritableFile passed to WritableFileWriter.</li> </ul> <h2>10.4.0 (06/20/2025)</h2> <h3>New Features</h3> <ul> <li>Add a new CF option <code>memtable_avg_op_scan_flush_trigger</code> that supports triggering memtable flush when an iterator scans through an expensive range of keys, with the average number of skipped keys from the active memtable exceeding the threshold.</li> <li>Vector based memtable now supports concurrent writers (DBOptions::allow_concurrent_memtable_write) <a href="https://redirect.github.com/facebook/rocksdb/issues/13675";>#13675</a>.</li> <li>Add new experimental <code>TransactionOptions::large_txn_commit_optimize_byte_threshold</code> to enable optimizations for large transaction commit by transaction batch data size.</li> <li>Add a new option <code>CompactionOptionsUniversal::reduce_file_locking</code> and if it's true, auto universal compaction picking will adjust to minimize locking of input files when bottom priority compactions are waiting to run. This can increase the likelihood of existing L0s being selected for compaction, thereby improving write stall and reducing read regression.</li> <li>Add new <code>format_version=7</code> to aid experimental support of custom compression algorithms with CompressionManager and block-based table. This format version includes changing the format of <code>TableProperties::compression_name</code>.</li> </ul> <h3>Public API Changes</h3> <ul> <li>Change NewExternalTableFactory to return a unique_ptr instead of shared_ptr.</li> <li>Add an optional min file size requirement for deletion triggered compaction. It can be specified when creating <code>CompactOnDeletionCollectorFactory</code>.</li> </ul> <h3>Behavior Changes</h3> <ul> <li><code>TransactionOptions::large_txn_commit_optimize_threshold</code> now has default value 0 for disabled. <code>TransactionDBOptions::txn_commit_bypass_memtable_threshold</code> now has no effect on transactions.</li> </ul> <h3>Bug Fixes</h3> <ul> <li>Fix a bug where CreateColumnFamilyWithImport() could miss the SST file for the memtable flush it triggered. The exported CF then may not contain the updates in the memtable when CreateColumnFamilyWithImport() is called.</li> <li>Fix iterator operations returning NotImplemented status if disallow_memtable_writes and paranoid_memory_checks CF options are both set.</li> <li>Fixed handling of file checksums in IngestExternalFile() to allow providing checksums using recognized but not necessarily the DB's preferred checksum function, to ease migration between checksum functions.</li> </ul> <h2>10.3.0 (05/17/2025)</h2> <h3>New Features</h3> <ul> <li>Add new experimental <code>CompactionOptionsFIFO::allow_trivial_copy_when_change_temperature</code> along with <code>CompactionOptionsFIFO::trivial_copy_buffer_size</code> to allow optimizing FIFO compactions with tiering when kChangeTemperature to move files from source tier FileSystem to another tier FileSystem via trivial and direct copying raw sst file instead of reading thru the content of the SST file then rebuilding the table files.</li> <li>Add a new field to Compaction Stats in LOG files for the pre-compression size written to each level.</li> <li>Add new experimental <code>TransactionOptions::large_txn_commit_optimize_threshold</code> to enable optimizations for large transaction commit with per transaction threshold. <code>TransactionDBOptions::txn_commit_bypass_memtable_threshold</code> is deprecated in favor of this transaction option.</li> <li>[internal team use only] Allow an application-defined <code>request_id</code> to be passed to RocksDB and propagated to the filesystem via IODebugContext</li> </ul> <h3>Bug Fixes</h3> <ul> <li>Fix a bug where transaction lock upgrade can incorrectly fail with a Deadlock status. This happens when a transaction has a non-zero timeout and tries to upgrade a shared lock that is also held by another transaction.</li> <li>Pass wrapped WritableFileWriter pointer to ExternalTableBuilder so that the file checksum can be correctly calculated and returned by SstFileWriter for external table files.</li> <li>Fix an infinite-loop bug in transaction locking. This can happen if a transaction reaches lock limit and its time out expires before it attempts to wait for it.</li> <li>Fixed a potential data race with <code>CompressionOptions::parallel_threads > 1</code> and a <code>TablePropertiesCollector</code> overriding <code>BlockAdd()</code>.</li> </ul> <h2>10.2.0 (04/21/2025)</h2> <h3>New Features</h3> <ul> <li>Provide histogram stats <code>COMPACTION_PREFETCH_BYTES</code> to measure number of bytes for RocksDB's prefetching (as opposed to file system's prefetch) on SST file during compaction read</li> <li>A new API DB::GetNewestUserDefinedTimestamp is added to return the newest user defined timestamp seen in a column family</li> <li>Introduce API <code>IngestWriteBatchWithIndex()</code> for ingesting updates into DB while bypassing memtable writes. This improves performance when writing a large write batch to the DB.</li> <li>Add a new CF option <code>memtable_op_scan_flush_trigger</code> that triggers a flush of the memtable if an iterator's Seek()/Next() scans over a certain number of invisible entries from the memtable.</li> </ul> <!-- raw HTML omitted --> </blockquote> <p>... (truncated)</p> </details> <details> <summary>Commits</summary> <ul> <li><a href="https://github.com/facebook/rocksdb/commit/410c5623195ecbe4699b9b5a5f622c7325cec6fe";><code>410c562</code></a> Merge pull request <a href="https://redirect.github.com/facebook/rocksdb/issues/13756";>#13756</a> from mszeszko-meta/backport_13609_to_10.4</li> <li><a href="https://github.com/facebook/rocksdb/commit/49d0c21baf37949a717eb0f9e666dd52432c8898";><code>49d0c21</code></a> Bump patch version, update HISTORY.md</li> <li><a href="https://github.com/facebook/rocksdb/commit/b72fe4f2b9a7838a63487ae2fbf3d40a4c7b6f58";><code>b72fe4f</code></a> Remove stats_ field from SstFileManagerImpl (<a href="https://redirect.github.com/facebook/rocksdb/issues/13757";>#13757</a>)</li> <li><a href="https://github.com/facebook/rocksdb/commit/8725d9014bbeebc7cc9e0f58b801e3896ea32eeb";><code>8725d90</code></a> Update compression libraries to latest releases (<a href="https://redirect.github.com/facebook/rocksdb/issues/13609";>#13609</a>)</li> <li><a href="https://github.com/facebook/rocksdb/commit/3df9173a8c7201501a28c392e03c62cbf1717c46";><code>3df9173</code></a> 10.4.1 Patch Release (<a href="https://redirect.github.com/facebook/rocksdb/issues/13748";>#13748</a>)</li> <li><a href="https://github.com/facebook/rocksdb/commit/c3edaf57f3c654d30f4d3c5a4fdb58453cedbe63";><code>c3edaf5</code></a> Release 10.4</li> <li><a href="https://github.com/facebook/rocksdb/commit/f340a2eccccdc0013f74c75a12e2ad638ebcddce";><code>f340a2e</code></a> Port codemod changes from fbcode/rocksdb (<a href="https://redirect.github.com/facebook/rocksdb/issues/13714";>#13714</a>)</li> <li><a href="https://github.com/facebook/rocksdb/commit/78c83ac1ec719c72b444f68c07551fb190a9f739";><code>78c83ac</code></a> Publish/support format_version=7, related enhancements (<a href="https://redirect.github.com/facebook/rocksdb/issues/13713";>#13713</a>)</li> <li><a href="https://github.com/facebook/rocksdb/commit/190bb0bd241b605382b7225ad7c66bd65dd89a13";><code>190bb0b</code></a> Disable AutoSkipCompressionManager test (<a href="https://redirect.github.com/facebook/rocksdb/issues/13715";>#13715</a>)</li> <li><a href="https://github.com/facebook/rocksdb/commit/fdc2970d37e7043836966d95bddfd415d8c98a23";><code>fdc2970</code></a> Connect custom compression to crash test and ObjectLibrary (<a href="https://redirect.github.com/facebook/rocksdb/issues/13710";>#13710</a>)</li> <li>Additional commits viewable in <a href="https://github.com/facebook/rocksdb/compare/v10.2.1...v10.4.2";>compare view</a></li> </ul> </details> <br /> [](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- <details> <summary>Dependabot commands and options</summary> <br /> You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
