Re: [Gluster-users] small files performance

2017-10-15 Thread Ben Turner
> To: "Szymon Miotk" <szymon.mi...@gmail.com>, "gluster-users" > <Gluster-users@gluster.org> > Sent: Friday, October 13, 2017 3:56:14 AM > Subject: Re: [Gluster-users] small files performance > > Where did you read 2k IOPS? > > Each disk is ab

Re: [Gluster-users] small files performance

2017-10-13 Thread Gandalf Corvotempesta
Where did you read 2k IOPS? Each disk is able to do about 75iops as I'm using SATA disk, getting even closer to 2000 it's impossible Il 13 ott 2017 9:42 AM, "Szymon Miotk" ha scritto: > Depends what you need. > 2K iops for small file writes is not a bad result. > In my

Re: [Gluster-users] small files performance

2017-10-11 Thread Poornima Gurusiddaiah
- Original Message - > From: "Alastair Neil" <ajneil.t...@gmail.com> > To: "gluster-users" <Gluster-users@gluster.org> > Sent: Wednesday, October 11, 2017 3:29:10 AM > Subject: Re: [Gluster-users] small files performance > I just tried setting: >

Re: [Gluster-users] small files performance

2017-10-10 Thread Alastair Neil
I just tried setting: performance.parallel-readdir on features.cache-invalidation on features.cache-invalidation-timeout 600 performance.stat-prefetch performance.cache-invalidation performance.md-cache-timeout 600 network.inode-lru-limit 5 performance.cache-invalidation on and clients could

Re: [Gluster-users] small files performance

2017-10-10 Thread Gandalf Corvotempesta
2017-10-10 8:25 GMT+02:00 Karan Sandha : > Hi Gandalf, > > We have multiple tuning to do for small-files which decrease the time for > negative lookups , meta-data caching, parallel readdir. Bumping the server > and client event threads will help you out in increasing the

[Gluster-users] small files performance

2017-10-06 Thread Gandalf Corvotempesta
Any update about this? I've seen some works about optimizing performance for small files, is now gluster "usable" for storing, in example, Maildirs or git sources ? at least in 3.7 (or 3.8, I don't remember exactly), extracting kernel sources took about 4-5 minutes.

[Gluster-users] Small files performance on SSD

2017-04-28 Thread Szymon Miotk
Hello, I have problems with tuning Gluster for optimal small files performance. My usage scenario is, as I've learned, worst possible scenario, but it's not up to me to change it: - small 1KB files - at least 20M of those - approx. 10 files/directory - mostly writes - average speed 1000 files/sec

Re: [Gluster-users] Small files performance on SSD

2017-04-28 Thread Amar Tumballi
On Fri, Apr 28, 2017 at 3:44 PM, Szymon Miotk wrote: > Dear Gluster community, > > I have problems with tuning Gluster for small files performance on SSD. > > My usage scenario is, as I've learned, worst possible scenario, but > it's not up to me to change it: > - small

[Gluster-users] Small files performance on SSD

2017-04-28 Thread Szymon Miotk
Dear Gluster community, I have problems with tuning Gluster for small files performance on SSD. My usage scenario is, as I've learned, worst possible scenario, but it's not up to me to change it: - small 1KB files - at least 20M of those - approx. 10 files/directory - mostly writes - average

Re: [Gluster-users] Small files performance

2016-06-24 Thread Luciano Giacchetta
About 40~60 MB/s with a 30% IOWait... -- Saludos, LG On Wed, Jun 22, 2016 at 10:04 AM, Gandalf Corvotempesta < gandalf.corvotempe...@gmail.com> wrote: > Il 21 giu 2016 19:02, "Luciano Giacchetta" ha > scritto: > > > > Hi, > > > > I have similar scenario, for a cars

Re: [Gluster-users] Small files performance

2016-06-24 Thread Luciano Giacchetta
This is my fstab localhost:/root /mnt/root glusterfs defaults,*direct-io-mode=enable* 0 0 -- Saludos, LG On Wed, Jun 22, 2016 at 9:49 AM, ML mail wrote: > Luciano, how do you enable direct-io-mode? > > > On Wednesday, June 22, 2016 7:09 AM, Luciano Giacchetta < >

Re: [Gluster-users] Small files performance

2016-06-22 Thread Gandalf Corvotempesta
Il 21 giu 2016 19:02, "Luciano Giacchetta" ha scritto: > > Hi, > > I have similar scenario, for a cars classified with millions of small files, mounted with gluster native client in a replica config. > The gluster server has 16gb RAM and 4 cores and mount the glusterfs

Re: [Gluster-users] Small files performance

2016-06-22 Thread ML mail
Luciano, how do you enable direct-io-mode? On Wednesday, June 22, 2016 7:09 AM, Luciano Giacchetta wrote: Hi, I have similar scenario, for a cars classified with millions of small files, mounted with gluster native client in a replica config. The gluster server

Re: [Gluster-users] Small files performance

2016-06-21 Thread Luciano Giacchetta
Hi, I have similar scenario, for a cars classified with millions of small files, mounted with gluster native client in a replica config. The gluster server has 16gb RAM and 4 cores and mount the glusterfs with direct-io-mode=enable. Then i export to all servers ( windows included with CIFS )

Re: [Gluster-users] Small files performance

2016-06-01 Thread Gmail
> On Jun 1, 2016, at 1:41 PM, Gandalf Corvotempesta > wrote: > > Il 01 giu 2016 22:34, "Gmail" > ha scritto: > > > > > >> On Jun 1, 2016, at 1:25 PM, Gandalf Corvotempesta > >>

Re: [Gluster-users] Small files performance

2016-06-01 Thread Gandalf Corvotempesta
Il 01 giu 2016 22:34, "Gmail" ha scritto: > > >> On Jun 1, 2016, at 1:25 PM, Gandalf Corvotempesta < gandalf.corvotempe...@gmail.com> wrote: >> with nfs replication is made directly by gluster servers with no client involved? > > correct This is good what i really don't

Re: [Gluster-users] Small files performance

2016-06-01 Thread Gmail
> On Jun 1, 2016, at 1:25 PM, Gandalf Corvotempesta > wrote: > > Il 01 giu 2016 22:06, "Gmail" > ha scritto: > > stat() on NFS, is just a single stat() from the client to the storage node, > > then all

Re: [Gluster-users] Small files performance

2016-06-01 Thread Gandalf Corvotempesta
Il 01 giu 2016 22:06, "Gmail" ha scritto: > stat() on NFS, is just a single stat() from the client to the storage node, then all the storage nodes in the same replica group talk to each other using libgfapi (no FUSE overhead) > > conclusion, I’d prefer NFS over FUSE with

Re: [Gluster-users] Small files performance

2016-06-01 Thread Gmail
Find my answer inline. > On Jun 1, 2016, at 12:30 PM, Gandalf Corvotempesta > wrote: > > Il 28/05/2016 11:46, Gandalf Corvotempesta ha scritto: >> >> if i remember properly, each stat() on a file needs to be sent to all host >> in replica to check if are in

Re: [Gluster-users] Small files performance

2016-06-01 Thread Gandalf Corvotempesta
Il 28/05/2016 11:46, Gandalf Corvotempesta ha scritto: if i remember properly, each stat() on a file needs to be sent to all host in replica to check if are in sync Is this true for both gluster native client and nfs ganesha? Which is the best for a shared hosting storage with many millions

[Gluster-users] Small files performance

2016-05-28 Thread Gandalf Corvotempesta
if i remember properly, each stat() on a file needs to be sent to all host in replica to check if are in sync Is this true for both gluster native client and nfs ganesha? Which is the best for a shared hosting storage with many millions of small files? About 15.000.000 small files in 800gb ? Or