Re: 回复： Ignite Data Streamer Hung after a period

Hello! The reason for slow index building, as well as workaround, is described in: http://apache-ignite-users.70518.x6.nabble.com/Performance-degradation-in-case-of-high-volumes-tp27150p27204.html Regards, -- Ilya Kasnacheev чт, 28 февр. 2019 г. в 14:34, Justin Ji : > I have tried to load

Re: 回复： Ignite Data Streamer Hung after a period

I have tried to load data without indexes, but it does not have any help! -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: 回复： Ignite Data Streamer Hung after a period

I have tried to load data without indexes, but it does not have any help! -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: 回复： Ignite Data Streamer Hung after a period

After I dig in the issue, I found that the streamer threads are waiting for building the index. This looks normal in a database based system, the more data, the slower insertion. But ignite is a wide used system, I think other people may encounter this problem, and have ways to improve the

?????? Ignite Data Streamer Hung after a period

n(StripedExecutor.java:511) at java.lang.Thread.run(Thread.java:748) -- -- ??: "BinaryTree"; : 2019??2??28??(??) 11:27 ??: "user";"ilya.kasnacheev"; : ?? Ignite Data Streamer Hung after a period Ilya

?????? Ignite Data Streamer Hung after a period

); streamer.perNodeBufferSize(1); streamer.perNodeParallelOperations(32); -- -- ??: "Ilya Kasnacheev"; : 2019??2??27??(??) 9:59 ??: "user"; ????: Re: Ignite Data Streamer Hung after a period Hello!

Re: Ignite Data Streamer Hung after a period

Hello! It's hard to say. Do you have persistence? Are you sure that cache store is not the bottleneck? I would start with gathering thread dumps from whole cluster when in stuck state. Regards, -- Ilya Kasnacheev ср, 27 февр. 2019 г. в 15:06, Justin Ji : > Dmitry - > > I also encountered

Re: Ignite Data Streamer Hung after a period

Dmitry - I also encountered this problem. I used both persistence and indexing, when I loaded 20 million records, the loading speed became much slower than before, but the CPU of the ignite server is low.

Re: Ignite Data Streamer Hung after a period

Hi, Blocked threads show only the fact that there are no tasks to process in pool. Do you use persistence and/or indexing? Could you please attach your configs and logs from all nodes? Please take few sequential thread dumps when throughput is low. Thanks! -Dmitry -- Sent from: