Hello, we are aware of this, as you can find in mail list archives.
You can get things better, but not completely remove this issue for now. It mostly depend on number of files in folder when doing ls. Small files provide much lower performance than big one during copy & co. Replicate option slow down read, as your client contact both servers to get metada. Things I did to get things better in this setup: fstab option (on client) : defaults,direct-io-mode=disable,_netdev,backupvolfile-server=mysecondservername fstab option (on gluster server volumes): defaults,noatime,nodiratime,logbufs=8,logbsize=256k,largeio,inode64,swalloc,allocsize=131072k,nobarrier *sysctl (clients and servers):* vm.swappiness=0 net.core.rmem_max=67108864 net.core.wmem_max=67108864 # increase Linux autotuning TCP buffer limit to 32MB net.ipv4.tcp_rmem=4096 87380 33554432 net.ipv4.tcp_wmem=4096 65536 33554432 # increase the length of the processor input queue net.core.netdev_max_backlog=30000 # recommended default congestion control is htcp net.ipv4.tcp_congestion_control=htcp *Gluster volume options:* performance.cache-size: 1GB performance.io-thread-count: 16 performance.readdir-ahead: enable performance.read-ahead: disable performance.client-io-threads: on performance.write-behind-window-size: 1MB cluster.lookup-optimize: on client.event-threads: 4 server.event-threads: 4 cluster.readdir-optimize: on Cordialement, Mathieu CHATEAU http://www.lotp.fr 2016-01-13 7:39 GMT+01:00 Arash Shams <[email protected]>: > Hello > > Im using 2 standalone servers as share storage servers with glusterfs 3.7 > when i change directory and run command inside a mounted volume for each > operation i have to wait at least 5 seconds for result and prompt > Im using replicate option and delay maybe for write but not for reading > > im using gluster as my /var/www/ share along all of my instance and > servers but for a simple ls or cd command to this directory i have to wait > 5 seconds any suggestion for me ? > > here is some information about the servers and glusterfs : > > OS : Ubuntu 14.04.3 LTS > Version info : glusterfs 3.7.6 built on Nov 9 2015 15:17:05 > > Ping between 2 nodes result : > 4 packets transmitted, 4 received, 0% packet loss, time 2998ms > rtt min/avg/max/mdev = 0.042/0.056/0.071/0.014 ms > > iperf : > Interval Transfer Bandwidth > 0.0-10.0 sec 10.5 GBytes 9.03 Gbits/sec > > dd test : > 1573468160 bytes (1.6 GB) copied, 70.8977 s, 22.2 MB/s > > > > > _______________________________________________ > Gluster-users mailing list > [email protected] > http://www.gluster.org/mailman/listinfo/gluster-users >
_______________________________________________ Gluster-users mailing list [email protected] http://www.gluster.org/mailman/listinfo/gluster-users
