Re: [Gluster-users] Reliable Geo-Replication
Dear Gluster-users, I deleted a further the geo-replication session with [reset-sync-time] option. Afterwards, I recreated the session, and as expected, the session starts in the hybrid crawl. I can see some sync jobs are running in the gsyncd.log file and after a couple of hours, there are no such entries anymore. I switched into the log_level DEBUG mode to see what's going on: gluster volume masterVOlume geoRepHost:slaveVol config log_level DEBUG It seems to me that the xsync mode is in loop since the same files appear over and over again in the log-file. Now we have two volume in this "loop"-state and the third volume also still has a broken geo-replication. So any help is appreciated how to fix this or which information is required to find the root cause? As mentioned before, all these gathered information could be used to improve the geo-replication trouble-shooting documentation. Thanks in advance. Regards, Felix Community Meeting Calendar: Schedule - Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC Bridge: https://bluejeans.com/441850968 Gluster-users mailing list Gluster-users@gluster.org https://lists.gluster.org/mailman/listinfo/gluster-users
Re: [Gluster-users] build options
First, not a question, but wort mentioning; I configured with --with-ipv6-default, but under the configure summary at the end it says: IPV6 default : no Figured this one; tirpc is necessary for the ipv6. Community Meeting Calendar: Schedule - Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC Bridge: https://bluejeans.com/441850968 Gluster-users mailing list Gluster-users@gluster.org https://lists.gluster.org/mailman/listinfo/gluster-users
[Gluster-users] build options
Hi List, today I am playing with building gluster from sources. First, not a question, but wort mentioning; I configured with --with-ipv6-default, but under the configure summary at the end it says: IPV6 default : no Next, I was wondering about memory pooler, I would expect it would be a good thing, but about the only thing that google leads me to when trying to verify that is this bug report: https://bugzilla.redhat.com/show_bug.cgi?id=1405165 Which claims "It's almost never good for performance/scalability, and sometimes it's catastrophic". So am I better off disabling this? Similarly with the XML output option; I can't seem to find anything on google that indicates why/if I would want this? And lastly, I find in the configure summary Cloudsync, but also can't find anything on google on what this is. Wondering if someone could provide a brief explanation, or point me at a place I can find said explanation? -- Bob Miller Cell: 867-334-7117 Office: 867-633-3760 Office: 867-322-0362 www.computerisms.ca Community Meeting Calendar: Schedule - Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC Bridge: https://bluejeans.com/441850968 Gluster-users mailing list Gluster-users@gluster.org https://lists.gluster.org/mailman/listinfo/gluster-users
Re: [Gluster-users] State of Gluster project
Been using Gluster since the 3.3.x days, been burned a few times and if it was not for the help of the community (one specific time saved big by Joe Julian), I would had not continued using it. My main use was originally as a self hosted engine via NFS and a file server for windows clients with Samba. After a couple of years, decided to get rid of virtualization so now exclusively used as a file server. I never dared turn on sharding because of the horror stories I saw in the old days for people who turned it on, then back off and then lost VMs to corruption. The 3.3.x to 3.7.x days were good. Burned somewhere in the post 3.7.x version. Mostly problems with samba VFS gluster and also gluster mounts for the file server. Since I stopped using VFS gluster in samba due to problems with specific files breaking and no longer working form the Windows side, I had to permanently go to using gluster mounts. So since the > 3.7.x and throughout all the 4.x versions I lived with memory leaks related to the gluster mounts, where I had to reboot servers once a month or even once every 15 days. Memory would start at around 11GB from the get go, and slowly go up till it would crash the server after eating up all 64GB of RAM in 15 to 30 days. After finally upgrading to 6.6.x I no longer have the memory leak. I have seen many improvements in speed but really did suffer with very slow performance for a long time. Nowadays, with 6.6.x and the sam gluster mounts, memory usage stays at around 4-5GB total even after 80 days of uptime! I can definitively echo the ease of use and setup that others have mentioned, but I really cannot vouch for the stability until now, with 6.6.x. I have not dared going back to using VFS gluster diue to the bad experience I had, so I guess I could try again and probably even get some performance gains, but why try to fix what ain't broken at the moment and make my life harder? I have tried other solutions and they are fast (significantly faster than gluster for as a file server), reliable and stable. Unfortunately, they are not free (well, the version with automatic failover isn't free), otherwise, I would gladly give up glusterfs for MooseFS in my file server use case. Diego On Tue, Jun 23, 2020 at 4:13 AM Mahdi Adnan wrote: > Hello Gionatan, > > Using Gluster brick in a RAID configuration might be safer and require > less work from Gluster admins but, it is a waste of disk space. > Gluster bricks are replicated "assuming you're creating a > distributed-replica volume" so when brick went down, it should be easy to > recover it and should not affect the client's IO. > We are using JBOD in all of our Gluster setups, overall, performance is > good, and replacing a brick would work "most" of the time without issues. > > On Sun, Jun 21, 2020 at 8:43 PM Gionatan Danti wrote: > >> Il 2020-06-21 14:20 Strahil Nikolov ha scritto: >> > With every community project , you are in the position of a Betta >> > Tester - no matter Fedora, Gluster or CEPH. So far , I had >> > issues with upstream projects only diring and immediately after >> > patching - but this is properly mitigated with a reasonable >> > patching strategy (patch test environment and several months later >> > patch prod with the same repos). >> > Enterprise Linux breaks (and alot) having 10-times more users and >> > use cases, so you cannot expect to start to use Gluster and assume >> > that a free peoject won't break at all. >> > Our part in this project is to help the devs to create a test case for >> > our workload , so regressions will be reduced to minimum. >> >> Well, this is true, and both devs & community deserve a big thanks for >> all the work done. >> >> > In the past 2 years, we got 2 major issues with VMware VSAN and 1 >> > major issue with a Enterprise Storage cluster (both solutions are >> > quite expensive) - so I always recommend proper testing of your >> > software . >> >> Interesting, I am almost tempted to ask you what issue you had with >> vSAN, but this is not the right mailing list ;) >> >> > From my observations, almost nobody is complaining about Ganesha in >> > the mailing list -> 50% are having issues with geo replication,20% >> > are having issues with small file performance and the rest have >> > issues with very old version of gluster -> v5 or older. >> >> Mmm, I would swear to have read quite a few posts where the problem was >> solved by migrating away from NFS Ganesha. Still, for hyperconverged >> setup a problem remains: NFS on loopback/localhost is not 100% supported >> (or, at least, RH is not willing to declare it supportable/production >> ready [1]). A fuse mount would be the more natural way to access the >> underlying data. >> >> > I can't say that a replace-brick on a 'replica 3' volume is more >> > riskier than a rebuild of a raid, but I have noticed that nobody is >> > following Red Hat's guide to use either: >> > - a Raid6 of 12 Disks (2
Re: [Gluster-users] GlusterFS - 8.0RC Test day (29th Jun 2020)
Apologies for spamming. I haven't checked the mail sent by Rinku about Test day before sending. On Wed, Jun 24, 2020 at 5:09 PM Sanju Rakonde wrote: > Hi glusterfs community, > > We are planning a Test day on 29th Jun 2020, mainly to focus on upgrade > testing to release-8.0RC. > > Also, we are planning to automate the upgrade test flow. @Prajith Kesava > Prasad be automating the rolling upgrade flow > using ansible. We need to capture the tests which have to be performed as a > basic sanity check with respect to every component. > > As part of test day, we want to focus on upgrade to Glusterfs-8 and report > the bugs if any. Some of the key things we are looking as bug reports are: > >- Please check if the upgrade from any of the supported to version to >release-8 is smooth, report bugs if you find anything unexpected >- Please check the functionality is all expected in your component or >use-case. >- Please check if the logs are in good shape and not flooding > > Please send us the scripts or tests which you have tested as a basic > sanity check for your component or use case. so that they can be included > in automation. > > our goal is to identify as many issues as possible, and if any major > issues are found, we fix them before making a release. So, please feel free > to report more issue. > > -- > Thanks, > Sanju > -- Thanks, Sanju Community Meeting Calendar: Schedule - Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC Bridge: https://bluejeans.com/441850968 Gluster-users mailing list Gluster-users@gluster.org https://lists.gluster.org/mailman/listinfo/gluster-users
Re: [Gluster-users] Gluster Test Day
Hi Rinku, can you tell me how the packages for CentOS 7 are build, as I had issues yesterday bulding both latest and v7 branches ? Best Regards, Strahil Nikolov На 24 юни 2020 г. 14:00:47 GMT+03:00, Rinku Kothiya написа: >Hi All, > >Release-8 RC0 packages are built. As this is a major release we want to >ensure that the >upgrades are possible without any problems from gluster version 5, 6 >and 7. >For this we have organized an online test day on Tuesday 30-Jun-2020, >from >11am to 4:30pm IST. > >Prerequisite would be to have your specific distro machine where you >can >clone gluster and work on it. >I was facing challenges to compile the glusterfs release-7 on fedora32 >so I >used a fedora30. >If others are seeing similar problems then please help with a work >around >or a fix for this before the test day. >Another option would be to use some other version of the distro like I >used >Fedora30. > >Also for people who would like to contribute to automating this test >can >join and contribute. >Sanju Rakonde will be leading this effort. I request you all to >participate >and make this >a successful event. > >[1] To join the video meeting, click the below link : >https://meet.google.com/qey-fvmt-uda >you can also join via phone, Dial-in: (US) +1 361-271-3542 PIN: 122 789 >544# > >[2] Date and Time : Tuesday 30-Jun-2020, from 11am to 4:30pm IST > >[3] The document link where the results can be shared : > >https://docs.google.com/spreadsheets/d/16NaDFgiotJRLBgMQV4-Z0j0qhqdwenkQa_MkY7XHBQ8/edit?usp=sharing > >[4] Packages are available at : > https://download.gluster.org/pub/gluster/glusterfs/qa-releases/8.0rc0/ > >[5] Packages are signed and the public key is at : >https://download.gluster.org/pub/gluster/glusterfs/6/rsa.pub > >Regards >Rinku Community Meeting Calendar: Schedule - Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC Bridge: https://bluejeans.com/441850968 Gluster-users mailing list Gluster-users@gluster.org https://lists.gluster.org/mailman/listinfo/gluster-users
Re: [Gluster-users] Gluster Test Day
On Wed, Jun 24, 2020 at 8:32 AM Strahil Nikolov wrote: > Hi Rinku, > > can you tell me how the packages for CentOS 7 are build, as I had issues > yesterday bulding both latest and v7 branches ? > Generally speaking, CentOS packages are built in CBS (CentOS Build System). They are built using the glusterfs.spec in the CentOS dist-git repo at https://git.centos.org/rpms/glusterfs. Each gluster release has a separate dist-git .spec on a branch for the CentOS release, i.e. 6, 7, and 8. These .specs are, generally, very close the .specs in the glusterfs tree. There is a README.md file there that describes how the rpms are built. In a nutshell, a .src.rpm is created using rpmbuild, and then the rpms are built in mock in CBS. There aren't branches for glusterfs-8 yet, so in this case the gluster-8 RC0 packages that are on download.gluster.org were built using upstream glusterfs.spec. There are .src.rpms on download.gluster.org from which you can extract the glusterfs.spec that was used to build the rpms. -- Kaleb Community Meeting Calendar: Schedule - Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC Bridge: https://bluejeans.com/441850968 Gluster-users mailing list Gluster-users@gluster.org https://lists.gluster.org/mailman/listinfo/gluster-users
[Gluster-users] GlusterFS - 8.0RC Test day (29th Jun 2020)
Hi glusterfs community, We are planning a Test day on 29th Jun 2020, mainly to focus on upgrade testing to release-8.0RC. Also, we are planning to automate the upgrade test flow. @Prajith Kesava Prasad be automating the rolling upgrade flow using ansible. We need to capture the tests which have to be performed as a basic sanity check with respect to every component. As part of test day, we want to focus on upgrade to Glusterfs-8 and report the bugs if any. Some of the key things we are looking as bug reports are: - Please check if the upgrade from any of the supported to version to release-8 is smooth, report bugs if you find anything unexpected - Please check the functionality is all expected in your component or use-case. - Please check if the logs are in good shape and not flooding Please send us the scripts or tests which you have tested as a basic sanity check for your component or use case. so that they can be included in automation. our goal is to identify as many issues as possible, and if any major issues are found, we fix them before making a release. So, please feel free to report more issue. -- Thanks, Sanju Community Meeting Calendar: Schedule - Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC Bridge: https://bluejeans.com/441850968 Gluster-users mailing list Gluster-users@gluster.org https://lists.gluster.org/mailman/listinfo/gluster-users
[Gluster-users] Updated invitation: Gluster Test Day @ Tue Jun 30, 2020 11am - 4:30pm (IST) (gluster-users@gluster.org)
BEGIN:VCALENDAR PRODID:-//Google Inc//Google Calendar 70.9054//EN VERSION:2.0 CALSCALE:GREGORIAN METHOD:REQUEST BEGIN:VEVENT DTSTART:20200630T053000Z DTEND:20200630T11Z DTSTAMP:20200624T110516Z ORGANIZER;CN=rkoth...@redhat.com:mailto:rkoth...@redhat.com UID:2i4mcfli3cv25o34g91iplr...@google.com ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=DECLINED;RSVP=TRUE ;CN=gluster-users;X-NUM-GUESTS=0:mailto:gluster-users@gluster.org ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE ;CN=rkoth...@redhat.com;X-NUM-GUESTS=0:mailto:rkoth...@redhat.com ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=TENTATIVE;RSVP=TRU E;CN=gluster-devel;X-NUM-GUESTS=0:mailto:gluster-de...@gluster.org X-MICROSOFT-CDO-OWNERAPPTID:163047472 CREATED:20200624T110444Z DESCRIPTION:Hi All\, Release-8 RC0 packages are built. As this is a major release we want to ensure that the upgrades are possible without any problems from gluster version 5\, 6 and 7. For this we have organi zed an online test day on Tuesday 30-Jun-2020\, from 11am to 4:30pm IST. Prerequisite would be to have your specific distro machine where you can clone gluster and work on it.I was facing challenges to compile the glusterfs release-7 on fedora32 so I used a fedora30. If others ar e seeing similar problems then please help with a work around or a fix for this before the test day. Another option would be to use some other ver sion of the distro like I used Fedora30. Also for people who would like to contribute to automating this test can join and contribute. Sanju R akonde will be leading this effort. I request you all to participate and ma ke this a successful event. [1] To join the video meeting\, cli ck the below link : \; \; https://meet.google.com/qe y-fvmt-uda">https://meet.google.com/qey-fvmt-uda \; \ ; you can also join via phone\, Dial-in: (US) +1 361-271-3542 PIN: 122 789 544#[2] Date and Time : Tuesday 30-Jun-2020\, from 11am to 4:30pm I ST[3] The document link where the results can be shared : \; \; https://docs.google.com/spreadsheets/d/16NaDFgiotJRLBgM QV4-Z0j0qhqdwenkQa_MkY7XHBQ8/edit?usp=sharing">https://docs.google.com/spreadsheets/d/16NaDFgiotJRLBgMQV4-Z0j0qhqdwenkQa_MkY7XHBQ8/edit ?usp=sharing[4] Packages are available at : \; &nb sp\; https://download.gluster.org/pub/gluster/glusterfs/qa-release s/8.0rc0/">https://download.gluster.org/pub/gluster/glusterfs/qa- releases/8.0rc0/[5] Packages are signed and the public key is a t : \; \; https://download.gluster.org/pub/gluster/gl usterfs/6/rsa.pub">https://download.gluster.org/pub/gluster/glusterfs/ 6/rsa.pubRegardsRinku \n\n-: :~:~::~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~ :~::~:~::-\nPlease do not edit this section of the description.\n\nView you r event at https://www.google.com/calendar/event?action=VIEW&eid=Mmk0bWNmbG kzY3YyNW8zNGc5MWlwbHI1bHQgZ2x1c3Rlci11c2Vyc0BnbHVzdGVyLm9yZw&tok=MTkjcmtvdG hpeWFAcmVkaGF0LmNvbWFjODI1N2M4NWEzNmEyNDQxODU5MmQ1ZTVmNWU2M2NmNGY4ZWY3NjQ&c tz=Asia%2FKolkata&hl=en&es=0.\n-::~:~::~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~: ~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~::~:~::- LAST-MODIFIED:20200624T110514Z LOCATION: SEQUENCE:0 STATUS:CONFIRMED SUMMARY:Gluster Test Day TRANSP:OPAQUE END:VEVENT END:VCALENDAR invite.ics Description: application/ics Community Meeting Calendar: Schedule - Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC Bridge: https://bluejeans.com/441850968 Gluster-users mailing list Gluster-users@gluster.org https://lists.gluster.org/mailman/listinfo/gluster-users
[Gluster-users] Invitation: Gluster Test Day @ Tue Jun 30, 2020 11am - 12pm (IST) (gluster-users@gluster.org)
BEGIN:VCALENDAR PRODID:-//Google Inc//Google Calendar 70.9054//EN VERSION:2.0 CALSCALE:GREGORIAN METHOD:REQUEST BEGIN:VEVENT DTSTART:20200630T053000Z DTEND:20200630T063000Z DTSTAMP:20200624T110445Z ORGANIZER;CN=rkoth...@redhat.com:mailto:rkoth...@redhat.com UID:2i4mcfli3cv25o34g91iplr...@google.com ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP= TRUE;CN=gluster-users;X-NUM-GUESTS=0:mailto:gluster-users@gluster.org ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE ;CN=rkoth...@redhat.com;X-NUM-GUESTS=0:mailto:rkoth...@redhat.com ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP= TRUE;CN=gluster-devel;X-NUM-GUESTS=0:mailto:gluster-de...@gluster.org X-MICROSOFT-CDO-OWNERAPPTID:163047472 CREATED:20200624T110444Z DESCRIPTION:Hi All\, Release-8 RC0 packages are built. As this is a major release we want to ensure that the upgrades are possible without any problems from gluster version 5\, 6 and 7. For this we have organi zed an online test day on Tuesday 30-Jun-2020\, from 11am to 4:30pm IST. Prerequisite would be to have your specific distro machine where you can clone gluster and work on it.I was facing challenges to compile the glusterfs release-7 on fedora32 so I used a fedora30. If others ar e seeing similar problems then please help with a work around or a fix for this before the test day. Another option would be to use some other ver sion of the distro like I used Fedora30. Also for people who would like to contribute to automating this test can join and contribute. Sanju R akonde will be leading this effort. I request you all to participate and ma ke this a successful event. [1] To join the video meeting\, cli ck the below link : \; \; https://meet.google.com/qe y-fvmt-uda">https://meet.google.com/qey-fvmt-uda \; \ ; you can also join via phone\, Dial-in: (US) +1 361-271-3542 PIN: 122 789 544#[2] Date and Time : Tuesday 30-Jun-2020\, from 11am to 4:30pm I ST[3] The document link where the results can be shared : \; \; https://docs.google.com/spreadsheets/d/16NaDFgiotJRLBgM QV4-Z0j0qhqdwenkQa_MkY7XHBQ8/edit?usp=sharing">https://docs.google.com/spreadsheets/d/16NaDFgiotJRLBgMQV4-Z0j0qhqdwenkQa_MkY7XHBQ8/edit ?usp=sharing[4] Packages are available at : \; &nb sp\; https://download.gluster.org/pub/gluster/glusterfs/qa-release s/8.0rc0/">https://download.gluster.org/pub/gluster/glusterfs/qa- releases/8.0rc0/[5] Packages are signed and the public key is a t : \; \; https://download.gluster.org/pub/gluster/gl usterfs/6/rsa.pub">https://download.gluster.org/pub/gluster/glusterfs/ 6/rsa.pubRegardsRinku \n\n-: :~:~::~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~ :~::~:~::-\nPlease do not edit this section of the description.\n\nView you r event at https://www.google.com/calendar/event?action=VIEW&eid=Mmk0bWNmbG kzY3YyNW8zNGc5MWlwbHI1bHQgZ2x1c3Rlci11c2Vyc0BnbHVzdGVyLm9yZw&tok=MTkjcmtvdG hpeWFAcmVkaGF0LmNvbWFjODI1N2M4NWEzNmEyNDQxODU5MmQ1ZTVmNWU2M2NmNGY4ZWY3NjQ&c tz=Asia%2FKolkata&hl=en&es=1.\n-::~:~::~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~: ~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~::~:~::- LAST-MODIFIED:20200624T110444Z LOCATION: SEQUENCE:0 STATUS:CONFIRMED SUMMARY:Gluster Test Day TRANSP:OPAQUE END:VEVENT END:VCALENDAR invite.ics Description: application/ics Community Meeting Calendar: Schedule - Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC Bridge: https://bluejeans.com/441850968 Gluster-users mailing list Gluster-users@gluster.org https://lists.gluster.org/mailman/listinfo/gluster-users
[Gluster-users] Gluster Test Day
Hi All, Release-8 RC0 packages are built. As this is a major release we want to ensure that the upgrades are possible without any problems from gluster version 5, 6 and 7. For this we have organized an online test day on Tuesday 30-Jun-2020, from 11am to 4:30pm IST. Prerequisite would be to have your specific distro machine where you can clone gluster and work on it. I was facing challenges to compile the glusterfs release-7 on fedora32 so I used a fedora30. If others are seeing similar problems then please help with a work around or a fix for this before the test day. Another option would be to use some other version of the distro like I used Fedora30. Also for people who would like to contribute to automating this test can join and contribute. Sanju Rakonde will be leading this effort. I request you all to participate and make this a successful event. [1] To join the video meeting, click the below link : https://meet.google.com/qey-fvmt-uda you can also join via phone, Dial-in: (US) +1 361-271-3542 PIN: 122 789 544# [2] Date and Time : Tuesday 30-Jun-2020, from 11am to 4:30pm IST [3] The document link where the results can be shared : https://docs.google.com/spreadsheets/d/16NaDFgiotJRLBgMQV4-Z0j0qhqdwenkQa_MkY7XHBQ8/edit?usp=sharing [4] Packages are available at : https://download.gluster.org/pub/gluster/glusterfs/qa-releases/8.0rc0/ [5] Packages are signed and the public key is at : https://download.gluster.org/pub/gluster/glusterfs/6/rsa.pub Regards Rinku Community Meeting Calendar: Schedule - Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC Bridge: https://bluejeans.com/441850968 Gluster-users mailing list Gluster-users@gluster.org https://lists.gluster.org/mailman/listinfo/gluster-users
