Hello, I have found this discussion <http://apache-ignite-users.70518.x6.nabble.com/Clearing-a-distributed-queue-hangs-after-taking-down-one-node-td7353.html> about the same topic and indeed the example there works and the queues poll fair.
And when I tweak the sleep after put and take, so that the queue stays mostly empty all the, I can reproduce the unfair behaviour! https://github.com/karussell/igniteexample/blob/master/src/main/java/test/IgniteTest.java I'm not sure if this is a bug as it should be the responsibility of the client to avoid overloading itself. E.g. in my case this happened because I allowed too many threads for the tasks on the polling side, leading to too frequent polling, which leads to this mostly empty queue. But IMO it should be clarified in the documentation as one expects a round robin behaviour even for empty queues. And e.g. in low latency environments and/or environments with many clients this could make problems. I have created an issue about it here: https://issues.apache.org/jira/browse/IGNITE-10496 Kind Regards Peter Am 30.11.18 um 01:44 schrieb Peter: > > Hello, > > My aim is a queue for load balancing that is described in the > documentation > <https://apacheignite.readme.io/v2.6/docs/queue-and-set#section-cache-queues-and-load-balancing>: > create an "ideally balanced system where every node only takes the > number of jobs it can process, and not more." > > I'm using jdk8 and ignite 2.6.0. I have successfully set up a two node > ignite cluster where node1 has same CPU count (8) and same RAM as > node2 but slightly slower CPU (virtual vs. dedicated). I created one > unbounded queue in this system (no collection configuration, also no > config for cluster except TcpDiscoveryVmIpFinder). > > I call queue.put on both nodes at an equal rate and have one > non-ignite-thread per node that does "queue.take()" and what I expect > is that both machines go equally fast into the 100% CPU usage as both > machines poll at their best frequency. But what I observe is that the > slower node (node1) gets approx. 5 times more items via queue.take > than node2. This leads to 10% CPU usage on node2 and 100% CPU usage on > node1 and I never had the case where it was equal. > > What could be the reason? Is there a fair polling configuration or > some anti-affine? Or is it required to do queue.take() inside a > Runnable submitted via ignite.compute().something? > > I also played with CollectionConfiguration.setCacheMode but the > problem persists. Any pointers are appreciated. > > Kind Regards > Peter >
