[Gluster-users] Feature Requests About Redistribution
Hello All, İs there any way to implament redistribute already distributed data when new brick added to DHT distributer ? Means if a new server added and DHT was used then I would like to balanace capacity and performance with redistributing data to new added server ? Regards Vahric ___ Gluster-users mailing list Gluster-users@gluster.org http://zresearch.com/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] Configuration validation needed
Maybe you should make some io test with iometer for get it What kind of raid configurtion will you have on each physcal server ? radi 5 or raid 6 or raid10 ? Also whak kind of application will you use , you know DHT is file based and maybe using it for mysql or mssql couldn't make you happy but maybe stripe translator make you happy İf your files are big maybe jumbo frames could help you better for getting much throughput Also ram is important you know if you have too much ram and if you are making read more then write it can help too -Original Message- From: gluster-users-boun...@gluster.org [mailto:gluster-users-boun...@gluster.org] On Behalf Of Julien Cornuwel Sent: Monday, June 01, 2009 9:31 PM To: gluster-users@gluster.org Subject: Re: [Gluster-users] Configuration validation needed My test servers were not available today, so I had to test my design on virtual machines :-/ All I can tell is : it works (after correcting minor errors in the config file). But I have no idea what performances I can expect on real servers... Le lundi 01 juin 2009 à 02:35 +0200, Julien Cornuwel a écrit : > I asked because I cannot perform tests until tomorrow and I wanted to be > sure. I'll keep you posted about the result... > > Le dimanche 31 mai 2009 à 15:15 +0300, Vahriç Muhtaryan a écrit : > > I'm new to glusterfs but looks like your config file is okay. > > Why don't you execute your conf and test it ;) go ahead. > > İf something wrong glusterfs or glusterfsd will kick you ;) > > > > Pls keep informed , its work or not ! I can simulate same environment on my > > servers. > > > > Regards > > Vahric > > > > -Original Message- > > From: gluster-users-boun...@gluster.org > > [mailto:gluster-users-boun...@gluster.org] On Behalf Of Julien Cornuwel > > Sent: Sunday, May 31, 2009 2:55 PM > > To: gluster-users@gluster.org > > Subject: [Gluster-users] Configuration validation needed > > > > Hi, > > > > > > I will soon have to deploy a glusterFS across several servers. Here are my > > goals : > > > > - Every server can access the all filesystem > > - Every file must be replicated > > > > I used a combination of Replicate and Distribute to be able to add new > > servers. > > > > Each server storage is divided in two bricks (primary and secondary). > > First server's primary storage is replicated on second server's secondary. > > Second server's primary is replicated on third servers secondary and so on. > > > > And then, I use Distribute across these replicated volumes. I think this > > should work, but could you please review the attached configuration file > > for errors ? > > > > > > Regards, > > > > > ___ > Gluster-users mailing list > Gluster-users@gluster.org > http://zresearch.com/cgi-bin/mailman/listinfo/gluster-users ___ Gluster-users mailing list Gluster-users@gluster.org http://zresearch.com/cgi-bin/mailman/listinfo/gluster-users ___ Gluster-users mailing list Gluster-users@gluster.org http://zresearch.com/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] Configuration validation needed
My test servers were not available today, so I had to test my design on virtual machines :-/ All I can tell is : it works (after correcting minor errors in the config file). But I have no idea what performances I can expect on real servers... Le lundi 01 juin 2009 à 02:35 +0200, Julien Cornuwel a écrit : > I asked because I cannot perform tests until tomorrow and I wanted to be > sure. I'll keep you posted about the result... > > Le dimanche 31 mai 2009 à 15:15 +0300, Vahriç Muhtaryan a écrit : > > I'm new to glusterfs but looks like your config file is okay. > > Why don't you execute your conf and test it ;) go ahead. > > İf something wrong glusterfs or glusterfsd will kick you ;) > > > > Pls keep informed , its work or not ! I can simulate same environment on my > > servers. > > > > Regards > > Vahric > > > > -Original Message- > > From: gluster-users-boun...@gluster.org > > [mailto:gluster-users-boun...@gluster.org] On Behalf Of Julien Cornuwel > > Sent: Sunday, May 31, 2009 2:55 PM > > To: gluster-users@gluster.org > > Subject: [Gluster-users] Configuration validation needed > > > > Hi, > > > > > > I will soon have to deploy a glusterFS across several servers. Here are my > > goals : > > > > - Every server can access the all filesystem > > - Every file must be replicated > > > > I used a combination of Replicate and Distribute to be able to add new > > servers. > > > > Each server storage is divided in two bricks (primary and secondary). > > First server's primary storage is replicated on second server's secondary. > > Second server's primary is replicated on third servers secondary and so on. > > > > And then, I use Distribute across these replicated volumes. I think this > > should work, but could you please review the attached configuration file > > for errors ? > > > > > > Regards, > > > > > ___ > Gluster-users mailing list > Gluster-users@gluster.org > http://zresearch.com/cgi-bin/mailman/listinfo/gluster-users ___ Gluster-users mailing list Gluster-users@gluster.org http://zresearch.com/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] Could be the bug of Glusterfs? The file system is unstable and hang
Hello, I replacedif (priv->incoming.buf_p) -free (priv->incoming.buf_p); With +if (priv->incoming.iobuf) +iobuf_unref (priv->incoming.iobuf); And its working . Now, I will test to see whats going on ! Regards Vahric -Original Message- From: Shehjar Tikoo [mailto:shehj...@gluster.com] Sent: Monday, June 01, 2009 7:30 AM To: Vahriç Muhtaryan Cc: 'Alpha Electronics'; gluster-users@gluster.org Subject: Re: [Gluster-users] Could be the bug of Glusterfs? The file system is unstable and hang Vahriç Muhtaryan wrote: > > Hello, > > > > I was installed new version like you and making test for something > should be or not . We have same configuration but I got differnet error, > I couldn't create directory or file , "it was giving Invalid Argument" > and I saw that one of server give an error like below , still testing Hi If you're comfortable with applying a patch, you could test with the following patch. We've seen the crash mentioned by you and this patch fixes it for us. http://patches.gluster.com/patch/436/ Please confirm if it does the same for you. Thanks Shehjar > > > > pending frames: > > frame : type(1) op(WRITE) > > > > patchset: 5c1d9108c1529a1155963cb1911f8870a674ab5b > > signal received: 6 > > configuration details:argp 1 > > backtrace 1 > > db.h 1 > > dlfcn 1 > > fdatasync 1 > > libpthread 1 > > llistxattr 1 > > setfsid 1 > > spinlock 1 > > epoll.h 1 > > xattr.h 1 > > st_atim.tv_nsec 1 > > package-string: glusterfs 2.0.1 > > [0xfa9420] > > /lib/libc.so.6(abort+0x101)[0x218691] > > /lib/libc.so.6[0x24f24b] > > /lib/libc.so.6[0x2570f1] > > /lib/libc.so.6(cfree+0x90)[0x25abc0] > > /usr/local/lib/glusterfs/2.0.1/transport/socket.so(__socket_reset+0x3e)[0xc8 155e] > > /usr/local/lib/glusterfs/2.0.1/transport/socket.so(socket_event_poll_err+0x3 b)[0xc8303b] > > /usr/local/lib/glusterfs/2.0.1/transport/socket.so(socket_event_handler+0x8b )[0xc833bb] > > /usr/local/lib/libglusterfs.so.0[0x9820ca] > > /usr/local/lib/libglusterfs.so.0(event_dispatch+0x21)[0x980fb1] > > glusterfsd(main+0xdf3)[0x804b1a3] > > /lib/libc.so.6(__libc_start_main+0xdc)[0x203e8c] > > glusterfsd[0x8049911] > > - ___ Gluster-users mailing list Gluster-users@gluster.org http://zresearch.com/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] Configuration validation needed
- "Julien Cornuwel" wrote: > Hi, > > > I will soon have to deploy a glusterFS across several servers. Here > are > my goals : > > - Every server can access the all filesystem > - Every file must be replicated > > I used a combination of Replicate and Distribute to be able to add > new > servers. > > Each server storage is divided in two bricks (primary and secondary). > First server's primary storage is replicated on second server's > secondary. Second server's primary is replicated on third servers > secondary and so on. > > And then, I use Distribute across these replicated volumes. I think > this > should work, but could you please review the attached configuration > file > for errors ? The configuration looks fine. Vikas -- Engineer - Z Research http://gluster.com/ ___ Gluster-users mailing list Gluster-users@gluster.org http://zresearch.com/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] Glusterfs 2.0 hangs on high load
Shehjar Tikoo wrote: Ma-ris Ruskulis wrote: Seems now, when autoscaling is off, glusterfs running stable, at least I could not kill it with iozone. Yes, autoscaling is still under consideration as a feature worth having. Please avoid using it for the time being. Thanks Shehjar So if this feature is not stable, than this should be documented, for example there: http://www.gluster.org/docs/index.php/Translators_v2.0 this will avoid lot of trouble using glusterfs. Thanks! Maris Ruskulis wrote: Thank You, for reply! As You can see from config, ping-timeout is not set - default is asumed. Now started glusterfs with 8 threads on both server and client (autoscaling switched off). Hardware: *server1:* lspci 00:00.0 Host bridge: Intel Corporation E7505 Memory Controller Hub (rev 03) 00:00.1 Class ff00: Intel Corporation E7505/E7205 Series RAS Controller (rev 03) 00:01.0 PCI bridge: Intel Corporation E7505/E7205 PCI-to-AGP Bridge (rev 03) 00:02.0 PCI bridge: Intel Corporation E7505 Hub Interface B PCI-to-PCI Bridge (rev 03) 00:02.1 Class ff00: Intel Corporation E7505 Hub Interface B PCI-to-PCI Bridge RAS Controller (rev 03) 00:1d.0 USB Controller: Intel Corporation 82801DB/DBL/DBM (ICH4/ICH4-L/ICH4-M) USB UHCI Controller #1 (rev 02) 00:1d.1 USB Controller: Intel Corporation 82801DB/DBL/DBM (ICH4/ICH4-L/ICH4-M) USB UHCI Controller #2 (rev 02) 00:1d.2 USB Controller: Intel Corporation 82801DB/DBL/DBM (ICH4/ICH4-L/ICH4-M) USB UHCI Controller #3 (rev 02) 00:1e.0 PCI bridge: Intel Corporation 82801 PCI Bridge (rev 82) 00:1f.0 ISA bridge: Intel Corporation 82801DB/DBL (ICH4/ICH4-L) LPC Interface Bridge (rev 02) 00:1f.1 IDE interface: Intel Corporation 82801DB (ICH4) IDE Controller (rev 02) 00:1f.3 SMBus: Intel Corporation 82801DB/DBL/DBM (ICH4/ICH4-L/ICH4-M) SMBus Controller (rev 02) 02:1c.0 PIC: Intel Corporation 82870P2 P64H2 I/OxAPIC (rev 04) 02:1d.0 PCI bridge: Intel Corporation 82870P2 P64H2 Hub PCI Bridge (rev 04) 02:1e.0 PIC: Intel Corporation 82870P2 P64H2 I/OxAPIC (rev 04) 02:1f.0 PCI bridge: Intel Corporation 82870P2 P64H2 Hub PCI Bridge (rev 04) 03:01.0 RAID bus controller: Intel Corporation RAID Controller 04:02.0 Ethernet controller: Intel Corporation 82540EM Gigabit Ethernet Controller (rev 02) 05:02.0 VGA compatible controller: ATI Technologies Inc Rage XL (rev 27) 05:03.0 Ethernet controller: Intel Corporation 82557/8/9/0/1 Ethernet Pro 100 (rev 0d) cat /proc/cpuinfo processor: 0 vendor_id: GenuineIntel cpu family: 15 model: 2 model name: Intel(R) Xeon(TM) CPU 2.40GHz stepping: 5 cpu MHz: 2392.024 cache size: 512 KB physical id: 0 siblings: 2 core id: 0 cpu cores: 1 apicid: 0 initial apicid: 0 fdiv_bug: no hlt_bug: no f00f_bug: no coma_bug: no fpu: yes fpu_exception: yes cpuid level: 2 wp: yes flags: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe pebs bts cid xtpr bogomips: 4784.04 clflush size: 64 power management: processor: 1 vendor_id: GenuineIntel cpu family: 15 model: 2 model name: Intel(R) Xeon(TM) CPU 2.40GHz stepping: 5 cpu MHz: 2392.024 cache size: 512 KB physical id: 0 siblings: 2 core id: 0 cpu cores: 1 apicid: 1 initial apicid: 1 fdiv_bug: no hlt_bug: no f00f_bug: no coma_bug: no fpu: yes fpu_exception: yes cpuid level: 2 wp: yes flags: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe pebs bts cid xtpr bogomips: 4784.16 clflush size: 64 power management: *server2:* lspci00:00.0 Host bridge: Intel Corporation E7520 Memory Controller Hub (rev 0c) 00:00.1 Class ff00: Intel Corporation E7525/E7520 Error Reporting Registers (rev 0c) 00:01.0 System peripheral: Intel Corporation E7520 DMA Controller (rev 0c) 00:02.0 PCI bridge: Intel Corporation E7525/E7520/E7320 PCI Express Port A (rev 0c) 00:04.0 PCI bridge: Intel Corporation E7525/E7520 PCI Express Port B (rev 0c) 00:05.0 PCI bridge: Intel Corporation E7520 PCI Express Port B1 (rev 0c) 00:06.0 PCI bridge: Intel Corporation E7520 PCI Express Port C (rev 0c) 00:1d.0 USB Controller: Intel Corporation 82801EB/ER (ICH5/ICH5R) USB UHCI Controller #1 (rev 02) 00:1d.1 USB Controller: Intel Corporation 82801EB/ER (ICH5/ICH5R) USB UHCI Controller #2 (rev 02) 00:1d.2 USB Controller: Intel Corporation 82801EB/ER (ICH5/ICH5R) USB UHCI Controller #3 (rev 02) 00:1d.7 USB Controller: Intel Corporation 82801EB/ER (ICH5/ICH5R) USB2 EHCI Controller (rev 02) 00:1e.0 PCI bridge: Intel Corporation 82801 PCI Bridge (rev c2) 00:1f.0 ISA bridge: Intel Corporation 82801EB/ER (ICH5/ICH5R) LPC Interface Bridge (rev 02) 00:1f.1 IDE interface: Intel Corporation 82801EB/ER (ICH5/ICH5R) IDE Controller (rev 02) 00:1f.3 SMB
