Re: Filestore, subsume userfiles requirement

2020-09-25 Thread Alexandre Rafalovitch
We are talking specifically about 'cat', I think. Nothing else accesses that directory: https://lucene.apache.org/solr/guide/8_6/stream-source-reference.html#cat Seems standalone-ready. Very file-centric in fact. Makes me wonder if it is SolrCloud ready Regards, Alex. On Fri, 25 Sep 2020

Re: Filestore, subsume userfiles requirement

2020-09-25 Thread Jason Gerlowski
I think some expressions are SolrCloud specific, but there are expressions that work in standalone e.g. https://paste.apache.org/zm3sw and https://paste.apache.org/vs35m On Fri, Sep 25, 2020 at 11:53 AM Eric Pugh wrote: > > Can you do streaming expression in standalone solr? I was under the >

Re: Filestore, subsume userfiles requirement

2020-09-25 Thread Eric Pugh
Can you do streaming expression in standalone solr? I was under the impression that it required SolrCloud. > On Sep 25, 2020, at 11:45 AM, Alexandre Rafalovitch > wrote: > > It is not just a directory. There is a security feature that only > allows to read from several file locations (confi

Re: Filestore, subsume userfiles requirement

2020-09-25 Thread Alexandre Rafalovitch
It is not just a directory. There is a security feature that only allows to read from several file locations (configurable in solr.xml). Userfiles is part of default list, so whatever replacement is there will need to be explicitly-named as well. Regards, Alex. On Fri, 25 Sep 2020 at 11:43, Ja

Re: Filestore, subsume userfiles requirement

2020-09-25 Thread Jason Gerlowski
> You're left with the /filestore/ dir to put there what you want in > standalone mode. That's fine by me as that's effectively what "userfiles" provides now. The main difference I imagine is that the 'filestore' directory won't exist at all in standalone? In that case standalone users will have t

Re: Filestore, subsume userfiles requirement

2020-09-25 Thread David Smiley
The "userfiles" thing is merely a directory. There's no CRUD API on it. Even if the CRUD API of the file store isn't active in standalone -- I think that doesn't matter. You're left with the /filestore/ dir to put there what you want in standalone mode. ~ David Smiley Apache Lucene/Solr Search D

Re: Filestore, subsume userfiles requirement

2020-09-25 Thread Ishan Chattopadhyaya
Standalone isn't supported. We need to transition away from the standalone mode and get rid of it completely. On Fri, 25 Sep, 2020, 7:50 pm Jason Gerlowski, wrote: > I don't know much about the new package/file-store, but it does sound > like a good replacement for 'userfiles' (which Eric is ri

Re: restlet dependencies

2020-09-25 Thread David Smiley
I think it can simply be a limitation of standalone. If you want something similar to managed-resources, use SolrCloud. I want to get to this for 8.7, maybe this weekend, https://issues.apache.org/jira/browse/SOLR-12987 which can be used to help inform users of deprecations. ~ David Smiley Apache

Re: restlet dependencies

2020-09-25 Thread Eric Pugh
What if we suggest that you just change the files directly using the same configset discussion we had, with caveats etc. And maybe someday we get a nicer api etc for doing this type of thing... > On Sep 25, 2020, at 9:49 AM, Timothy Potter wrote: > > Ok, so we're removing from 9 (I can do th

Re: Filestore, subsume userfiles requirement

2020-09-25 Thread Jason Gerlowski
I don't know much about the new package/file-store, but it does sound like a good replacement for 'userfiles' (which Eric is right- is pretty awkward to work with). My only concerns with using the filestore would be around its availability. Is it enabled by default (or will it be in an upcoming r

Re: restlet dependencies

2020-09-25 Thread Timothy Potter
Ok, so we're removing from 9 (I can do that) but what should we do about the upcoming 8.7 release? I'm fine with deprecating, but usually an alternative approach is suggested with the deprecation notice. For cloud mode, we can suggest our hypothetical users of this MR API to use the config set API

Re: Filestore, subsume userfiles requirement

2020-09-25 Thread Eric Pugh
+1. I’ve found the user files really useful when doing things with streaming, but it’s also awkward to reach to put files into. > On Sep 25, 2020, at 8:47 AM, David Smiley wrote: > > Yes. And I think it's high time that coreRootDirectory default to > /something (e.g. "cores") > > ~ David S

Re: Filestore, subsume userfiles requirement

2020-09-25 Thread Ishan Chattopadhyaya
+1 We can even obsolete the blob store on favour of the package store (once it is renamed to file store). We built the package store as a general purpose distributed file store. Since we were running fast with the package manager, we didn't advertise it for all of its capabilities as a generic fil

Re: Filestore, subsume userfiles requirement

2020-09-25 Thread David Smiley
Yes. And I think it's high time that coreRootDirectory default to /something (e.g. "cores") ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Fri, Sep 25, 2020 at 8:42 AM Alexandre Rafalovitch wrote: > Would that file store also be under solr.home?

Re: Filestore, subsume userfiles requirement

2020-09-25 Thread Alexandre Rafalovitch
Would that file store also be under solr.home? Because if it is and the user can upload core.property into it as well as other things that core discovery will then load bypassing security Regards, Alex. On Fri, 25 Sep 2020 at 08:32, David Smiley wrote: > > I'm looking to see that we can de

Filestore, subsume userfiles requirement

2020-09-25 Thread David Smiley
I'm looking to see that we can deprecate "userfiles" and remove for 9.0 Solr has a "userfiles" directory under Solr home that Jason added in some issue relating to streaming expressions accessing a local file. I bet only a few of you have even heard of it. I think the "File Store" that came alon