dependabot[bot] opened a new pull request, #1702: URL: https://github.com/apache/stormcrawler/pull/1702
Bumps [com.github.crawler-commons:urlfrontier-API](https://github.com/crawler-commons/url-frontier) from 2.4 to 2.5. <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/crawler-commons/url-frontier/releases";>com.github.crawler-commons:urlfrontier-API's releases</a>.</em></p> <blockquote> <h2>2.5</h2> <h2>What's Changed</h2> <p>This release adds the following notables changes:</p> <ul> <li>Implementation of setCrawlLimit</li> <li>gRPC server reflection is now enabled</li> <li>Addition of new method CountURLs to count the URLs for a given crawl.</li> <li>Internal use a concurrent ordered map instead of a synchronized LinkedHashMap to allow for better concurrency (especially while using ListURLs and CountURLs which can be lengthy operations)</li> </ul> <p>##Detailed list of changes</p> <ul> <li>Implement <code>setCrawlLimit</code> inside the service by <a href="https://github.com/zaibacu";><code>@zaibacu</code></a> in <a href="https://redirect.github.com/crawler-commons/url-frontier/pull/109";>crawler-commons/url-frontier#109</a></li> <li>enable grpc server reflection by <a href="https://github.com/jdpedrie";><code>@jdpedrie</code></a> in <a href="https://redirect.github.com/crawler-commons/url-frontier/pull/112";>crawler-commons/url-frontier#112</a></li> <li>Use replace instead of replaceall by <a href="https://github.com/klockla";><code>@klockla</code></a> in <a href="https://redirect.github.com/crawler-commons/url-frontier/pull/113";>crawler-commons/url-frontier#113</a></li> <li>Added CloseableIterator interface by <a href="https://github.com/klockla";><code>@klockla</code></a> in <a href="https://redirect.github.com/crawler-commons/url-frontier/pull/115";>crawler-commons/url-frontier#115</a></li> <li>Added method to count URLs in a frontier by <a href="https://github.com/klockla";><code>@klockla</code></a> in <a href="https://redirect.github.com/crawler-commons/url-frontier/pull/114";>crawler-commons/url-frontier#114</a></li> <li>Added ConcurrentOrdereredMap to avoid synchronization on GetQueues by <a href="https://github.com/klockla";><code>@klockla</code></a> in <a href="https://redirect.github.com/crawler-commons/url-frontier/pull/117";>crawler-commons/url-frontier#117</a></li> <li>Bump logback version to 1.5.17 by <a href="https://github.com/klockla";><code>@klockla</code></a> in <a href="https://redirect.github.com/crawler-commons/url-frontier/pull/118";>crawler-commons/url-frontier#118</a></li> <li>Updated versions of actions to v4 by <a href="https://github.com/jnioche";><code>@jnioche</code></a> in <a href="https://redirect.github.com/crawler-commons/url-frontier/pull/121";>crawler-commons/url-frontier#121</a></li> <li>Fix iterators in case we have removed an entry by <a href="https://github.com/klockla";><code>@klockla</code></a> in <a href="https://redirect.github.com/crawler-commons/url-frontier/pull/120";>crawler-commons/url-frontier#120</a></li> <li>Fix deadlock between remove and pollFirstEntry by <a href="https://github.com/klockla";><code>@klockla</code></a> in <a href="https://redirect.github.com/crawler-commons/url-frontier/pull/123";>crawler-commons/url-frontier#123</a></li> <li>Optimize RocksDBURLItemIterator.next() by <a href="https://github.com/klockla";><code>@klockla</code></a> in <a href="https://redirect.github.com/crawler-commons/url-frontier/pull/124";>crawler-commons/url-frontier#124</a></li> <li>Added test for reschedule of Known URL by <a href="https://github.com/klockla";><code>@klockla</code></a> in <a href="https://redirect.github.com/crawler-commons/url-frontier/pull/125";>crawler-commons/url-frontier#125</a></li> <li>Bump org.apache.commons:commons-lang3 from 3.17.0 to 3.18.0 in /service in the maven group across 1 directory by <a href="https://github.com/dependabot";><code>@dependabot</code></a>[bot] in <a href="https://redirect.github.com/crawler-commons/url-frontier/pull/126";>crawler-commons/url-frontier#126</a></li> <li>Make sure iterator will be closed in case of early exceptions by <a href="https://github.com/klockla";><code>@klockla</code></a> in <a href="https://redirect.github.com/crawler-commons/url-frontier/pull/129";>crawler-commons/url-frontier#129</a></li> <li>Adding missing synchronized on pollFirstEntry by <a href="https://github.com/klockla";><code>@klockla</code></a> in <a href="https://redirect.github.com/crawler-commons/url-frontier/pull/130";>crawler-commons/url-frontier#130</a></li> <li>Update protobuf to 3.25.8 and grpc to 1.75.0 by <a href="https://github.com/klockla";><code>@klockla</code></a> in <a href="https://redirect.github.com/crawler-commons/url-frontier/pull/131";>crawler-commons/url-frontier#131</a></li> <li>Bump grpc, rocksb, commons-lang & maven shade plugin dependencies by <a href="https://github.com/klockla";><code>@klockla</code></a> in <a href="https://redirect.github.com/crawler-commons/url-frontier/pull/132";>crawler-commons/url-frontier#132</a></li> <li>Use protobuf-maven-plugin to generate Protobuf and Grpc code by <a href="https://github.com/klockla";><code>@klockla</code></a> in <a href="https://redirect.github.com/crawler-commons/url-frontier/pull/133";>crawler-commons/url-frontier#133</a></li> <li>Update Protobuf documentation by <a href="https://github.com/klockla";><code>@klockla</code></a> in <a href="https://redirect.github.com/crawler-commons/url-frontier/pull/135";>crawler-commons/url-frontier#135</a></li> <li>Migrate publishing from OSSRH to Central Portal by <a href="https://github.com/klockla";><code>@klockla</code></a> in <a href="https://redirect.github.com/crawler-commons/url-frontier/pull/134";>crawler-commons/url-frontier#134</a></li> <li>Release 2.5 by <a href="https://github.com/klockla";><code>@klockla</code></a> in <a href="https://redirect.github.com/crawler-commons/url-frontier/pull/136";>crawler-commons/url-frontier#136</a></li> </ul> <h2>New Contributors</h2> <ul> <li><a href="https://github.com/jdpedrie";><code>@jdpedrie</code></a> made their first contribution in <a href="https://redirect.github.com/crawler-commons/url-frontier/pull/112";>crawler-commons/url-frontier#112</a></li> </ul> <p><strong>Full Changelog</strong>: <a href="https://github.com/crawler-commons/url-frontier/compare/2.4...2.5";>https://github.com/crawler-commons/url-frontier/compare/2.4...2.5</a></p> </blockquote> </details> <details> <summary>Commits</summary> <ul> <li><a href="https://github.com/crawler-commons/url-frontier/commit/902b55e4e527b37aeec47d183d4735872a41a3fe";><code>902b55e</code></a> Release 2.5 (<a href="https://redirect.github.com/crawler-commons/url-frontier/issues/136";>#136</a>)</li> <li><a href="https://github.com/crawler-commons/url-frontier/commit/a65aa530584d12b29df12bfb48d8365ed235a68e";><code>a65aa53</code></a> Migrate publishing from OSSRH to Central Portal (<a href="https://redirect.github.com/crawler-commons/url-frontier/issues/134";>#134</a>)</li> <li><a href="https://github.com/crawler-commons/url-frontier/commit/a7b876ddc3a35a82fbdde2bda95d8d368728e1c6";><code>a7b876d</code></a> Update Protobuf documentation (<a href="https://redirect.github.com/crawler-commons/url-frontier/issues/135";>#135</a>)</li> <li><a href="https://github.com/crawler-commons/url-frontier/commit/32291d862195167bd1596d6894600dd9ee0b3922";><code>32291d8</code></a> Use protobuf-maven-plugin to generate Protobuf and Grpc code (<a href="https://redirect.github.com/crawler-commons/url-frontier/issues/133";>#133</a>)</li> <li><a href="https://github.com/crawler-commons/url-frontier/commit/faa8ee4ff0c32caed808e364bf47b121476ddf14";><code>faa8ee4</code></a> Bump dependencies: (<a href="https://redirect.github.com/crawler-commons/url-frontier/issues/132";>#132</a>)</li> <li><a href="https://github.com/crawler-commons/url-frontier/commit/5d95427cb2eda54439a1de6e4ed2bdf748051097";><code>5d95427</code></a> Update protobuf to 3.25.8 and grpc to 1.75.0 (<a href="https://redirect.github.com/crawler-commons/url-frontier/issues/131";>#131</a>)</li> <li><a href="https://github.com/crawler-commons/url-frontier/commit/f0d4293a40b791d1cee5350664789ce4a74bcb35";><code>f0d4293</code></a> Adding missing synchronized on pollFirstEntry (<a href="https://redirect.github.com/crawler-commons/url-frontier/issues/130";>#130</a>)</li> <li><a href="https://github.com/crawler-commons/url-frontier/commit/cafda67b60033731201f606077dd3e33cfd46e0c";><code>cafda67</code></a> Merge pull request <a href="https://redirect.github.com/crawler-commons/url-frontier/issues/129";>#129</a> from klockla/iterator-trywith-rsrc</li> <li><a href="https://github.com/crawler-commons/url-frontier/commit/ac6ef9c34bb3c55bd719cdccb9c3cf7f56c5c336";><code>ac6ef9c</code></a> Make sure iterator will be closed in case of early exceptions</li> <li><a href="https://github.com/crawler-commons/url-frontier/commit/f343a0e667a1bd88e32032e45b9fd31a3eaeda30";><code>f343a0e</code></a> Bump org.apache.commons:commons-lang3 (<a href="https://redirect.github.com/crawler-commons/url-frontier/issues/126";>#126</a>)</li> <li>Additional commits viewable in <a href="https://github.com/crawler-commons/url-frontier/compare/2.4...2.5";>compare view</a></li> </ul> </details> <br /> [](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- <details> <summary>Dependabot commands and options</summary> <br /> You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
