Re: Using Ignite as blob store?

2019-08-23 Thread colinc
>From anecdotal experience of storing larger objects (up to say 10MB) in Ignite, I find that the overall access performance is significantly better than storing lots of small objects. The main thing to watch out for is that very large objects can cause unbalanced data distribution. Similar to

Re: Using Ignite as blob store?

2019-08-23 Thread Pavel Kovalenko
Denis, You can't set page size greater than 16Kb due to our page memory limitations. чт, 22 авг. 2019 г. в 22:34, Denis Magda : > How about setting page size to more KBs or MBs based on the average value? > That should work perfectly fine. > > - > Denis > > > On Thu, Aug 22, 2019 at 8:11 AM

Re: Using Ignite as blob store?

2019-08-23 Thread colinc
I understand from this post: https://stackoverflow.com/questions/50116444/unable-to-increase-pagesize/50121410#50121410 that the maximum page size is 16K. Is that still true? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Using Ignite as blob store?

2019-08-22 Thread Denis Magda
How about setting page size to more KBs or MBs based on the average value? That should work perfectly fine. - Denis On Thu, Aug 22, 2019 at 8:11 AM Shane Duan wrote: > Thanks, Ilya. The blob size varies from a few KBs to a few MBs. > > Cheers, > Shane > > > On Thu, Aug 22, 2019 at 5:02 AM

Re: Using Ignite as blob store?

2019-08-22 Thread Shane Duan
Thanks, Ilya. The blob size varies from a few KBs to a few MBs. Cheers, Shane On Thu, Aug 22, 2019 at 5:02 AM Ilya Kasnacheev wrote: > Hello! > > How large are these blobs? Ignite is going to divide blobs into <4k > chunks. We have no special optimizations for storing large key-value pairs. >

Re: Using Ignite as blob store?

2019-08-22 Thread Ilya Kasnacheev
Hello! How large are these blobs? Ignite is going to divide blobs into <4k chunks. We have no special optimizations for storing large key-value pairs. Regards, -- Ilya Kasnacheev чт, 22 авг. 2019 г. в 02:53, Shane Duan : > Hi Igniters, is it a good idea to use Ignite(with persistence) as a

Using Ignite as blob store?

2019-08-21 Thread Shane Duan
Hi Igniters, is it a good idea to use Ignite(with persistence) as a blob store? I did run some testing with a small dataset, and it looks performing okay, even with a small off-heap mem for the data region. Thanks! Shane