What is this limit limiting? Is this effectively a stored field, and the
bigger it gets, the more issues we'll have with segment merges/etc?

Upayavira

On Tue, Oct 20, 2015, at 09:25 AM, Shalin Shekhar Mangar wrote:
> Yes, sorry I checked as well and the limit is 5MB. And it is
> configurable using the property mentioned by Jack. Thanks for
> correcting me.
> 
> On Tue, Oct 20, 2015 at 7:48 PM, Jack Krupansky
> <jack.krupan...@gmail.com> wrote:
> > I checked the code and the limit is actually 5MB and configurable via
> > the blob.max.size.mb config property. I posted a comment on the Solr doc
> > for this.
> >
> > In any case, thanks for sharing info that you gleaned from the conference,
> > for all of us who couldn't make it.
> >
> > -- Jack Krupansky
> >
> > On Tue, Oct 20, 2015 at 9:00 AM, Upayavira <u...@odoko.co.uk> wrote:
> >
> >> Okay, thx. I heard it mentioned at Lucene Revolution as a location for
> >> storing machine learning models. Do people really have models coming in
> >> at under 2Mb?
> >>
> >> It'd be good to get this limitation into the BlobStore docs.
> >>
> >> Upayavira
> >>
> >> On Tue, Oct 20, 2015, at 07:19 AM, Shalin Shekhar Mangar wrote:
> >> > No, the maximum size is limited to 2MB for now. The use-case behind
> >> > the blob store is to store small jars (custom plugins) and stopwords,
> >> > synonyms etc (even though those aren't usable right now) so maybe we
> >> > can relax the limits a little bit. However, it is definitely not meant
> >> > for GBs of data.
> >> >
> >> > On Tue, Oct 20, 2015 at 5:26 PM, Upayavira <u...@odoko.co.uk> wrote:
> >> > > Is there a maximum size to objects in the blob store? How are objects
> >> > > stored? As a stored field?
> >> > >
> >> > > I've got some machine learning models that are 2-4Gb in size, and
> >> whilst
> >> > > machine learning models is one of the intended uses of the blob store,
> >> > > putting GB of data in it scares me a little. Is it reasonable and does
> >> > > it work?
> >> > >
> >> > > Upayavira
> >> >
> >> >
> >> >
> >> > --
> >> > Regards,
> >> > Shalin Shekhar Mangar.
> >>
> 
> 
> 
> -- 
> Regards,
> Shalin Shekhar Mangar.

Reply via email to