Thanks Erik for the reply. We even had 92G heap size for some time at one time. We were able to run and survive with 64G for the last several months although with some issues mainly this issue "Can not talk to ZK Updates are disabled". We have dedicated zk quorum. When we have reduced to 32G we ran into some other issues. So given all of that wondering is there any options like G1 GC tuning ?
We are running in 256 GB boxes. The os cache is quiet huge too. /usr/java/latest/bin/java -server -Xms32g -Xmx64g -DsharedLib=/opt/mw/solrlib -XX:+UseG1GC -XX:MaxGCPauseMillis=5000 -XX:ParallelGCThreads=30 -XX:ConcGCThreads=10 -Djute.maxbuffer=41943040 -XX:G1HeapWastePercent=20 -XX:InitiatingHeapOccupancyPercent=45 -XX:+UnlockExperimentalVMOptions -XX:NewSize=10g -XX:MaxNewSize=32g -XX:SurvivorRatio=2 -XX:-ResizePLAB -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html