I've had performance issues with EXT4 on ubuntu 16.04 with ~4TB of DBs. Now I'm using XFS on ubuntu 16.04 and have no issues with ~12TB of DBs. I'm using CouchDB 2.0.
Here are some insights I learned over time - https://github.com/assafmo/couchdb-linux-performance On Fri, May 25, 2018 at 1:34 AM Sean Lang <[email protected]> wrote: > I'm using CoreOS - I run CouchDB inside of a Docker container and use > containers for just about everything else I run, so it's a nice fit. > However, I think that btrfs comes standard on most Linux distros now, since > it has been included in the mainline kernel since 2.6. > > Also, I've never tried out RAID5 with btrfs, so I can't comment on the data > loss that Touzet mentioned. I don't think that the btrfs wiki recommends > using RAID5/6 at all, since it's slower and isn't stable yet. > > On Thu, May 24, 2018 at 4:45 PM max <[email protected]> wrote: > > > Thank you. Which OS are you using with btfrs? > > > > Le jeu. 24 mai 2018 à 22:41, Sean Lang <[email protected]> a écrit : > > > > > I use BTRFS in RAID10 and it works well. I've been running it on 3 > > servers > > > for more than a year under near 24/7 load and haven't run into any > issues > > > with the filesystem. However, it's not a "production" setup where I've > > even > > > attempted to maintain 99.999% uptime, it's just a personal project > doing > > > data processing. Also, I don't have any benchmarks to say whether it's > > > faster or slower than another filesystem. > > > > > > On Thu, May 24, 2018 at 12:46 PM Joan Touzet <[email protected]> > wrote: > > > > > > > Sorry, I should have qualified - I recommend ZFS on *BSD and Solaris > > > > derivatives, and xfs on Linuxes. Performance is a concern on Linux, > > yes. > > > I > > > > personally also don't buy Shuttleworth's argument that ZFS on Linux > > > doesn't > > > > taint the kernel. But that's a discussion for a different forum... :) > > > > > > > > > > > > -Joan > > > > > > > > ----- Original Message ----- > > > > > > > > From: "max" <[email protected]> > > > > To: [email protected], "Joan Touzet" <[email protected]> > > > > Sent: Thursday, May 24, 2018 12:40:40 PM > > > > Subject: Re: Which filesystem are you using? > > > > > > > > > > > > Thank you for your quick answer. > > > > > > > > > > > > No fear about zfs on ubuntu? I could hear about degraded disk perf on > > > > other system than FreeBSD... > > > > > > > > > > > > 2018-05-24 18:09 GMT+02:00 Joan Touzet < [email protected] > : > > > > > > > > > > > > zfs and xfs are great choices, especially for filesystem snapshots > and > > > > backup. > > > > > > > > personally, i recommend against btrfs due to certain data loss > > scenarios > > > > in RAID 5 setups, which is a common approach for database servers. > > > > > > > > > > > > > > > > ----- Original Message ----- > > > > From: "max" < [email protected] > > > > > To: [email protected] > > > > Sent: Thursday, May 24, 2018 12:07:09 PM > > > > Subject: Which filesystem are you using? > > > > > > > > Hi, > > > > > > > > I'm using CouchDB 1.7.1 on Ubuntu 16.04 with ext4 filesystem and it > > works > > > > great. > > > > But I'm gonna migrate my data to a bigger server and I'd like to find > > > some > > > > advice about filesystem I should or should not use. > > > > > > > > I'll install Ubuntu 16.04, and I need to backup my data (*.couch), I > > know > > > > CouchDB is tail-append but some of .couch database are close 100 GB > and > > > > then was wondering about my next filesystem to store those .couch > > files. > > > > Which one is better faster stronger? Which one cannot (should not) be > > > > used? > > > > I was thinking about zfs, xfs, btrfs... > > > > > > > > Any advice? > > > > > > > > Thanks. > > > > > > > > Max. > > > > > > > > > > > > > > > > > > > > > > > > > >
