Re: Effective Data through DataStream

2018-04-26 Thread Dave Harvey
When you set the stream receiver, an instance of its class is created and serialized, which will also include any class it is nested in. On each Data Streamer buffer, the serialized form of that class is sent. If the class containing the stream receiver has a pointer that is not

Re: Effective Data through DataStream

2018-04-25 Thread Ilya Lantukh
Hi, Ignite DataStreamer protocol has overhead for metadata: 11 bytes per key-value pair + metadata for the whole batch, which size depends on many factors. So, 400 MB of raw data that you observe is rather logical. On Tue, Apr 24, 2018 at 9:42 PM, mimmo_c wrote: >

Re: Effective Data through DataStream

2018-04-24 Thread mimmo_c
Hi, Someone could help me? Thanks -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Effective Data through DataStream

2018-04-22 Thread Mimmo Celano
Hi, i need a receiver because i want to increase the value of item if it is stored in cache, like a word-count example. I agree with you about flush. Thanks, Mimmo Il dom 22 apr 2018, 08:57 begineer ha scritto: > I dont understand why you need to define receiver to update

Re: Effective Data through DataStream

2018-04-22 Thread begineer
I dont understand why you need to define receiver to update value in the cache. streamer does is for you. you just need to write something like this try (IgniteDataStreamer streamer = ignite.dataStreamer("cacheName")) { for(Entry entry : maps.entrySet()){

Re: Effective Data through DataStream

2018-04-21 Thread mimmo_c
Hi, Thanks for response. The versione of Ignite is 2.0. Configuration of Server: for all 4 Server. Code: try(IgniteDataStreamer stmr = ignite.dataStreamer("default")){ stmr.allowOverwrite(true); --->//Increase time

Re: Effective Data through DataStream

2018-04-20 Thread aealexsandrov
Hi, Could you please provide your code example, configuration and used Ignite version? Thank you, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/