1. If max-connection is set to 800 on server-side. When the server reaches the max-connection, it rejects any new client connections. That means any client trying to connect to the server may be unable to do so...If you expect more than 800 client connection at any time, you can increase this by changing the max-connection...it was set to 800 for historical reason (to control number of file-descriptors open), thats been addressed in later releases...
2. Putall with batch-size around 1 MB. And using 800 threads to insert. If you are trying to speed-up the data ingestion rate using multiple threads; there could be factors you need to consider; thread context-switching, network buffer size, parallelizing data communication between sockets (data pockets are written and consumed at the tcp layer), cpu availability, etc.. You may need to try out with small number and keep increasing it to find the optimal setting that gives max through-put on your environment. Also, are you trying to do put-all on PR region, in that case (with single-hop enabled) the putall will be broken into multiple batches/putall, based on the bucket regions (to forward the data to right bucket/destination). -Anil. On Wed, Feb 8, 2017 at 12:45 AM, Michael Stolz <mst...@pivotal.io> wrote: > In my opinion, 1MB is too big. I believe it will cause congestion on the > network. Keep to a moderate size on the order of less than 100K. > > -- > Mike Stolz > Principal Engineer, GemFire Product Manager > Mobile: +1-631-835-4771 > > On Mon, Feb 6, 2017 at 9:20 PM, Goutam Tadi <gt...@pivotal.io> wrote: > > > Hi, > > > > I have a couple of questions regarding max-connections attribute in > > cache.xml. > > > > 1. If max-connections is set to 800 by default, does that mean if I have > > 800+ region.put() methods from multiple clients in parallel, Will this > > cause issue to some of the inserts or requests from server ? > > > > 2. If I would like to try multi threading (inserts/puts) by buffering > rows > > to some size of 1MB and use putAll() to insert batch of rows into a > region > > with max-connections set to 800 by default, will this cause issue to the > > client, if the client launches 800+ threads of batch inserts ? > > > > > > Thanks, > > Goutam Tadi. > > -- > > Regards, > > *Goutam Tadi.* > > >
