[jira] [Commented] (SOLR-17851) Remove BlobHandler and .system collection from 10
[ https://issues.apache.org/jira/browse/SOLR-17851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18014143#comment-18014143 ] ASF subversion and git services commented on SOLR-17851: Commit 87dff3e7b56b7017119925036f7a4ebd77a32965 in solr's branch refs/heads/main from Eric Pugh [ https://gitbox.apache.org/repos/asf?p=solr.git;h=87dff3e7b56 ] SOLR-17851: Remove BlobHandler and .system collection support (#3464) Remove code that was deprecated in 9x. > Remove BlobHandler and .system collection from 10 > - > > Key: SOLR-17851 > URL: https://issues.apache.org/jira/browse/SOLR-17851 > Project: Solr > Issue Type: Task > Components: blobstore >Affects Versions: main (10.0) >Reporter: Eric Pugh >Assignee: Eric Pugh >Priority: Major > Labels: pull-request-available > Attachments: image-2025-08-15-10-26-29-954.png, > remove-blob-handler.patch > > Time Spent: 1h 40m > Remaining Estimate: 0h > > Once the Schema Designer migration to the Filestore API is completed, we > should remove the BlobHandler and associated .system collection. > This issue proposes deprecating it in 9x now and removing in 10. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
[jira] [Commented] (SOLR-17851) Remove BlobHandler and .system collection from 10
[ https://issues.apache.org/jira/browse/SOLR-17851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18014128#comment-18014128 ] Eric Pugh commented on SOLR-17851: -- okay, added a place in ref guide, we can go bigger later... !image-2025-08-15-10-26-29-954.png! > Remove BlobHandler and .system collection from 10 > - > > Key: SOLR-17851 > URL: https://issues.apache.org/jira/browse/SOLR-17851 > Project: Solr > Issue Type: Task > Components: blobstore >Affects Versions: main (10.0) >Reporter: Eric Pugh >Assignee: Eric Pugh >Priority: Major > Labels: pull-request-available > Attachments: image-2025-08-15-10-26-29-954.png, > remove-blob-handler.patch > > Time Spent: 1.5h > Remaining Estimate: 0h > > Once the Schema Designer migration to the Filestore API is completed, we > should remove the BlobHandler and associated .system collection. > This issue proposes deprecating it in 9x now and removing in 10. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
[jira] [Commented] (SOLR-17851) Remove BlobHandler and .system collection from 10
[ https://issues.apache.org/jira/browse/SOLR-17851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18013946#comment-18013946 ] Gus Heck commented on SOLR-17851: - Yes we should be working harder to communicate our extensibility. For a first pass to improve this particular situation I think a small note here: https://solr.apache.org/guide/solr/latest/configuration-guide/requesthandlers-searchcomponents.html#shipped-custom-components (overall I think that section has a terminology problem ... "custom" is misapplied. The components are not custom, they are standard Solr components. That page is really discussing "Custom configurations of standard components") > Remove BlobHandler and .system collection from 10 > - > > Key: SOLR-17851 > URL: https://issues.apache.org/jira/browse/SOLR-17851 > Project: Solr > Issue Type: Task > Components: blobstore >Affects Versions: main (10.0) >Reporter: Eric Pugh >Assignee: Eric Pugh >Priority: Major > Labels: pull-request-available > Attachments: remove-blob-handler.patch > > Time Spent: 50m > Remaining Estimate: 0h > > Once the Schema Designer migration to the Filestore API is completed, we > should remove the BlobHandler and associated .system collection. > This issue proposes deprecating it in 9x now and removing in 10. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
[jira] [Commented] (SOLR-17851) Remove BlobHandler and .system collection from 10
[ https://issues.apache.org/jira/browse/SOLR-17851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18013938#comment-18013938 ] Jason Gerlowski commented on SOLR-17851: bq. We have our /dev-docs folder that has content... There is stuff about the new UI, about the Overseer etc. Do you think we should add soemthing about writing custom components? Or even just a "components" in general? +1, that'd be awesome. Extensibility is a big draw for Solr I think, and that'd really be bolstered if we had docs that clarified even basic things, like what extension points are available to folks. IMO the "ref guide" would be a better place for that than "dev-docs". I think of "dev-docs" as being specific to developing the Solr project itself (and not external plugins, etc.) But I might be hair-splitting there, and docs would be awesome where-ever an author wants to put them. > Remove BlobHandler and .system collection from 10 > - > > Key: SOLR-17851 > URL: https://issues.apache.org/jira/browse/SOLR-17851 > Project: Solr > Issue Type: Task > Components: blobstore >Affects Versions: main (10.0) >Reporter: Eric Pugh >Assignee: Eric Pugh >Priority: Major > Labels: pull-request-available > Attachments: remove-blob-handler.patch > > Time Spent: 50m > Remaining Estimate: 0h > > Once the Schema Designer migration to the Filestore API is completed, we > should remove the BlobHandler and associated .system collection. > This issue proposes deprecating it in 9x now and removing in 10. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
[jira] [Commented] (SOLR-17851) Remove BlobHandler and .system collection from 10
[ https://issues.apache.org/jira/browse/SOLR-17851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18013896#comment-18013896 ] Eric Pugh commented on SOLR-17851: -- I think I'm done with the removeal step, would love a +1 on the PR... > Remove BlobHandler and .system collection from 10 > - > > Key: SOLR-17851 > URL: https://issues.apache.org/jira/browse/SOLR-17851 > Project: Solr > Issue Type: Task > Components: blobstore >Affects Versions: main (10.0) >Reporter: Eric Pugh >Assignee: Eric Pugh >Priority: Major > Labels: pull-request-available > Attachments: remove-blob-handler.patch > > Time Spent: 50m > Remaining Estimate: 0h > > Once the Schema Designer migration to the Filestore API is completed, we > should remove the BlobHandler and associated .system collection. > This issue proposes deprecating it in 9x now and removing in 10. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
[jira] [Commented] (SOLR-17851) Remove BlobHandler and .system collection from 10
[ https://issues.apache.org/jira/browse/SOLR-17851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18013894#comment-18013894 ] Eric Pugh commented on SOLR-17851: -- I just updated the major-changes-in-solr-10.adoc document to mention the getObjectCache method. > Remove BlobHandler and .system collection from 10 > - > > Key: SOLR-17851 > URL: https://issues.apache.org/jira/browse/SOLR-17851 > Project: Solr > Issue Type: Task > Components: blobstore >Affects Versions: main (10.0) >Reporter: Eric Pugh >Assignee: Eric Pugh >Priority: Major > Labels: pull-request-available > Attachments: remove-blob-handler.patch > > Time Spent: 50m > Remaining Estimate: 0h > > Once the Schema Designer migration to the Filestore API is completed, we > should remove the BlobHandler and associated .system collection. > This issue proposes deprecating it in 9x now and removing in 10. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
[jira] [Commented] (SOLR-17851) Remove BlobHandler and .system collection from 10
[ https://issues.apache.org/jira/browse/SOLR-17851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18013893#comment-18013893 ] Eric Pugh commented on SOLR-17851: -- We have our /dev-docs folder that has content... There is stuff about the new UI, about the Overseer etc. Do you think we should add soemthing about writing custom components? Or even just a "components" in general? > Remove BlobHandler and .system collection from 10 > - > > Key: SOLR-17851 > URL: https://issues.apache.org/jira/browse/SOLR-17851 > Project: Solr > Issue Type: Task > Components: blobstore >Affects Versions: main (10.0) >Reporter: Eric Pugh >Assignee: Eric Pugh >Priority: Major > Labels: pull-request-available > Attachments: remove-blob-handler.patch > > Time Spent: 50m > Remaining Estimate: 0h > > Once the Schema Designer migration to the Filestore API is completed, we > should remove the BlobHandler and associated .system collection. > This issue proposes deprecating it in 9x now and removing in 10. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
[jira] [Commented] (SOLR-17851) Remove BlobHandler and .system collection from 10
[ https://issues.apache.org/jira/browse/SOLR-17851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18013551#comment-18013551 ] Gus Heck commented on SOLR-17851: - And the punchline is that the ObjectCache [~ab] added in SOLR-11642 is quite similar in concept to my original implementation for SOLR-8349 (I also used a field on CoreContainer) before I was convinced to move it to the blob store. So I guess if we have a unit test that demonstrates that two cores can access the same cached object, and perhaps find a place to document this feature (something my original ticket unfortunately lacked in retrospect).. I guess that should go as a note/hint in the ref guide where we mention custom components... Although looking it doesn't seem like we really address writing your own. > Remove BlobHandler and .system collection from 10 > - > > Key: SOLR-17851 > URL: https://issues.apache.org/jira/browse/SOLR-17851 > Project: Solr > Issue Type: Task > Components: blobstore >Affects Versions: main (10.0) >Reporter: Eric Pugh >Assignee: Eric Pugh >Priority: Major > Labels: pull-request-available > Attachments: remove-blob-handler.patch > > Time Spent: 50m > Remaining Estimate: 0h > > Once the Schema Designer migration to the Filestore API is completed, we > should remove the BlobHandler and associated .system collection. > This issue proposes deprecating it in 9x now and removing in 10. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
[jira] [Commented] (SOLR-17851) Remove BlobHandler and .system collection from 10
[
https://issues.apache.org/jira/browse/SOLR-17851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18013212#comment-18013212
]
Jason Gerlowski commented on SOLR-17851:
Ooh, didn't know about {{getObjectCache}}; interesting...does that seem like a
suitable workaround [~gus]?
One other minor concern with nuking BlobHandler is its "mode" compatibility:
BlobHandler appears to work in both standalone and cloud, while "filestore"
only supports SolrCloud. That's not a blocker IMO; mostly just mentioning it
so that it can be a part of our CHANGES / upgrade-notes documentation.
> Remove BlobHandler and .system collection from 10
> -
>
> Key: SOLR-17851
> URL: https://issues.apache.org/jira/browse/SOLR-17851
> Project: Solr
> Issue Type: Task
> Components: blobstore
>Affects Versions: main (10.0)
>Reporter: Eric Pugh
>Assignee: Eric Pugh
>Priority: Major
> Labels: pull-request-available
> Attachments: remove-blob-handler.patch
>
> Time Spent: 40m
> Remaining Estimate: 0h
>
> Once the Schema Designer migration to the Filestore API is completed, we
> should remove the BlobHandler and associated .system collection.
> This issue proposes deprecating it in 9x now and removing in 10.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
[jira] [Commented] (SOLR-17851) Remove BlobHandler and .system collection from 10
[
https://issues.apache.org/jira/browse/SOLR-17851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18013150#comment-18013150
]
David Smiley commented on SOLR-17851:
-
In the last 5+ years of modern Solr, given such a requirement, I'd have a
plugin/class that places the object into the
{{{}CoreContainer.getObjectCache{}}}. It's already being used within Solr for
streaming expressions "ModelCache". I could swear I've used it before as well
but don't recall. Am I missing something?
> Remove BlobHandler and .system collection from 10
> -
>
> Key: SOLR-17851
> URL: https://issues.apache.org/jira/browse/SOLR-17851
> Project: Solr
> Issue Type: Task
> Components: blobstore
>Affects Versions: main (10.0)
>Reporter: Eric Pugh
>Assignee: Eric Pugh
>Priority: Major
> Labels: pull-request-available
> Attachments: remove-blob-handler.patch
>
> Time Spent: 40m
> Remaining Estimate: 0h
>
> Once the Schema Designer migration to the Filestore API is completed, we
> should remove the BlobHandler and associated .system collection.
> This issue proposes deprecating it in 9x now and removing in 10.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
[jira] [Commented] (SOLR-17851) Remove BlobHandler and .system collection from 10
[ https://issues.apache.org/jira/browse/SOLR-17851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18013117#comment-18013117 ] Eric Pugh commented on SOLR-17851: -- I *think* where we are today with Solr 10 is that we no longer have any support for the "custom components with large memory object". It spelunking back in history, it looks like SOLR-17284 did remove that capability, regardless of what happens in this JIRA. I think that if bring back that capability is important, then it needs to be re-implemented on top of the FilestoreAPI? Just to be clear, that isn't something I am contemplating as I don't have a current use case for it to guide me in any kind of resonable implmentation. Though ironically, I think my colleague [~sstults] did a project beginning of the year that MIGHT have benefited from this capability. > Remove BlobHandler and .system collection from 10 > - > > Key: SOLR-17851 > URL: https://issues.apache.org/jira/browse/SOLR-17851 > Project: Solr > Issue Type: Task > Components: blobstore >Affects Versions: main (10.0) >Reporter: Eric Pugh >Assignee: Eric Pugh >Priority: Major > Attachments: remove-blob-handler.patch > > > Once the Schema Designer migration to the Filestore API is completed, we > should remove the BlobHandler and associated .system collection. > This issue proposes deprecating it in 9x now and removing in 10. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
[jira] [Commented] (SOLR-17851) Remove BlobHandler and .system collection from 10
[ https://issues.apache.org/jira/browse/SOLR-17851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18013005#comment-18013005 ] Gus Heck commented on SOLR-17851: - For convenience I'll tell the story of SOLR-8349 here - it was added so that custom components that want to use a large memory object don't have to replicate that resource across all cores (the specific motivating case was a 1GB map of US/Brittish post/zip-codes to gps coordinates used to infer GPS location for radius queries in response to post-codes and zipcodes). When I first implemented it, it didn't have anything to do with the blob store, but the feedback on that issue was that the blob store was the "right" way to manage large resources, and so it got rolled into that effort. The specific challenge with sharing large resources in SOLR-8349 is that the SolrResourceLoader has it's own ClassLoader, so a resource loaded into a static field on a custom component is duplicated if that component is used in multiple cores (each core has it's own independent definition of the component class loaded by it's own ClassLoader). When you've got 30 cores, a 1GB map duplicated 30 times gets painful. > Remove BlobHandler and .system collection from 10 > - > > Key: SOLR-17851 > URL: https://issues.apache.org/jira/browse/SOLR-17851 > Project: Solr > Issue Type: Task > Components: blobstore >Affects Versions: main (10.0) >Reporter: Eric Pugh >Assignee: Eric Pugh >Priority: Major > Attachments: remove-blob-handler.patch > > > Once the Schema Designer migration to the Filestore API is completed, we > should remove the BlobHandler and associated .system collection. > This issue proposes deprecating it in 9x now and removing in 10. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
[jira] [Commented] (SOLR-17851) Remove BlobHandler and .system collection from 10
[ https://issues.apache.org/jira/browse/SOLR-17851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18013004#comment-18013004 ] Gus Heck commented on SOLR-17851: - Better link to even clearer comment that was not addressed: https://github.com/apache/solr/pull/2447/files#diff-feb7eb44c92210d9dd1f3119e59f0d93409d3b4c55e2fddc1a4dc2ca25fbc4d1L78 > Remove BlobHandler and .system collection from 10 > - > > Key: SOLR-17851 > URL: https://issues.apache.org/jira/browse/SOLR-17851 > Project: Solr > Issue Type: Task > Components: blobstore >Affects Versions: main (10.0) >Reporter: Eric Pugh >Assignee: Eric Pugh >Priority: Major > Attachments: remove-blob-handler.patch > > > Once the Schema Designer migration to the Filestore API is completed, we > should remove the BlobHandler and associated .system collection. > This issue proposes deprecating it in 9x now and removing in 10. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
[jira] [Commented] (SOLR-17851) Remove BlobHandler and .system collection from 10
[ https://issues.apache.org/jira/browse/SOLR-17851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18013003#comment-18013003 ] Gus Heck commented on SOLR-17851: - The deletion of a unit test that shouldn't have been deleted (see pr link above) seems specific enough? > Remove BlobHandler and .system collection from 10 > - > > Key: SOLR-17851 > URL: https://issues.apache.org/jira/browse/SOLR-17851 > Project: Solr > Issue Type: Task > Components: blobstore >Affects Versions: main (10.0) >Reporter: Eric Pugh >Assignee: Eric Pugh >Priority: Major > Attachments: remove-blob-handler.patch > > > Once the Schema Designer migration to the Filestore API is completed, we > should remove the BlobHandler and associated .system collection. > This issue proposes deprecating it in 9x now and removing in 10. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
[jira] [Commented] (SOLR-17851) Remove BlobHandler and .system collection from 10
[ https://issues.apache.org/jira/browse/SOLR-17851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18013000#comment-18013000 ] David Smiley commented on SOLR-17851: - Gus, can you point to something specific for Eric to look at? There's a massive conversation at SOLR-8349. In general, I expect the file store could achieve the same thing albeit with its own API which is different than BlobHandler stuff. The file store even has the advantage of working with actual files, that could be memory mapped or work with other APIs that want real files. > Remove BlobHandler and .system collection from 10 > - > > Key: SOLR-17851 > URL: https://issues.apache.org/jira/browse/SOLR-17851 > Project: Solr > Issue Type: Task > Components: blobstore >Affects Versions: main (10.0) >Reporter: Eric Pugh >Assignee: Eric Pugh >Priority: Major > Attachments: remove-blob-handler.patch > > > Once the Schema Designer migration to the Filestore API is completed, we > should remove the BlobHandler and associated .system collection. > This issue proposes deprecating it in 9x now and removing in 10. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
[jira] [Commented] (SOLR-17851) Remove BlobHandler and .system collection from 10
[ https://issues.apache.org/jira/browse/SOLR-17851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18012998#comment-18012998 ] Gus Heck commented on SOLR-17851: - Also you never responded to this question on ... https://github.com/apache/solr/pull/2447/files#diff-1e6904fed8cf6d27cce62ba87577bf1e527748d50dcd0f7871bc9ce5ebb70a5eL38 (https://github.com/apache/solr/pull/2447) for SOLR-17284 > Remove BlobHandler and .system collection from 10 > - > > Key: SOLR-17851 > URL: https://issues.apache.org/jira/browse/SOLR-17851 > Project: Solr > Issue Type: Task > Components: blobstore >Affects Versions: main (10.0) >Reporter: Eric Pugh >Assignee: Eric Pugh >Priority: Major > Attachments: remove-blob-handler.patch > > > Once the Schema Designer migration to the Filestore API is completed, we > should remove the BlobHandler and associated .system collection. > This issue proposes deprecating it in 9x now and removing in 10. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
[jira] [Commented] (SOLR-17851) Remove BlobHandler and .system collection from 10
[ https://issues.apache.org/jira/browse/SOLR-17851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18012997#comment-18012997 ] Gus Heck commented on SOLR-17851: - https://issues.apache.org/jira/browse/SOLR-8349 relied on the blob store. How have you handled that? > Remove BlobHandler and .system collection from 10 > - > > Key: SOLR-17851 > URL: https://issues.apache.org/jira/browse/SOLR-17851 > Project: Solr > Issue Type: Task > Components: blobstore >Affects Versions: main (10.0) >Reporter: Eric Pugh >Assignee: Eric Pugh >Priority: Major > Attachments: remove-blob-handler.patch > > > Once the Schema Designer migration to the Filestore API is completed, we > should remove the BlobHandler and associated .system collection. > This issue proposes deprecating it in 9x now and removing in 10. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
[jira] [Commented] (SOLR-17851) Remove BlobHandler and .system collection from 10
[ https://issues.apache.org/jira/browse/SOLR-17851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18012996#comment-18012996 ] Eric Pugh commented on SOLR-17851: -- I've attached a patch that goes on top of [https://github.com/apache/solr/pull/3031] to remove BlobHandler and friends. > Remove BlobHandler and .system collection from 10 > - > > Key: SOLR-17851 > URL: https://issues.apache.org/jira/browse/SOLR-17851 > Project: Solr > Issue Type: Task > Components: blobstore >Affects Versions: main (10.0) >Reporter: Eric Pugh >Assignee: Eric Pugh >Priority: Major > Attachments: remove-blob-handler.patch > > > Once the Schema Designer migration to the Filestore API is completed, we > should remove the BlobHandler and associated .system collection. > This issue proposes deprecating it in 9x now and removing in 10. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
