Re: Transaction Throughput in Data Streamer

2018-08-13 Thread dkarachentsev
Hi, It looks like the most of the time transactions in receiver are waiting for locks. Any lock adds serialization for parallel code. And in your case I don't think it's possible to tune throughput with settings, because ten transactions could wait when one finish. You need to change algorithm.

Transaction Throughput in Data Streamer

2018-08-09 Thread Dave Harvey
We are trying to load and transform a large amount of data using the IgniteDataStreamer using a custom StreamReceiver.We'd like this to run a lot faster, and we cannot find anything that is close to saturated, except the data-streamer threads, queues. This is 2.5, with Ignite persistence,