Which version of PVFS are you using? Becky
On Fri, Jan 27, 2012 at 6:28 AM, Phil Carns <ca...@mcs.anl.gov> wrote: > It is in the range for server 10.10.8.10, actually. That part looks ok. > It looks like you are setting up a configuration with exactly two servers; > one that is dedicated to metadata and one that is dedicated to file data. > Is that correct? > > -Phil > > > On 01/27/2012 02:38 AM, Dimokritos Stamatakis wrote: > >> Hello all, >> it seems that the meta handle range is the problem! >> The Root Handle is 1048576, but it is not anywhere in the meta handle >> ranges. >> >> Here's my conf file: >> >> <Defaults> >> UnexpectedRequests 50 >> EventLogging none >> EnableTracing no >> LogStamp datetime >> BMIModules bmi_tcp >> FlowModules flowproto_multiqueue >> PerfUpdateInterval 1000 >> ServerJobBMITimeoutSecs 30 >> ServerJobFlowTimeoutSecs 30 >> ClientJobBMITimeoutSecs 300 >> ClientJobFlowTimeoutSecs 300 >> ClientRetryLimit 5 >> ClientRetryDelayMilliSecs 2000 >> PrecreateBatchSize 512 >> PrecreateLowThreshold 256 >> >> StorageSpace /pvfs2-storage-space >> LogFile /tmp/pvfs2-server.log >> </Defaults> >> >> <Aliases> >> Alias 10.10.8.10 tcp://10.10.8.10:3334 >> Alias 10.10.8.6 tcp://10.10.8.6:3334 >> </Aliases> >> >> <Filesystem> >> Name pvfs2-fs >> ID 1937082333 >> RootHandle 1048576 >> FileStuffing no >> <MetaHandleRanges> >> Range 10.10.8.10 3-4611686018427387904 >> </MetaHandleRanges> >> <DataHandleRanges> >> Range 10.10.8.6 4611686018427387905-**9223372036854775806 >> </DataHandleRanges> >> <StorageHints> >> TroveSyncMeta yes >> TroveSyncData no >> TroveMethod alt-aio >> </StorageHints> >> </Filesystem> >> >> >> How shall I fix it? >> Many thanks, >> Dimos. >> >> >> >> >> >> >> >> >> Hi Dimos, You might want to post your current conf file again. In there >>> you should see a line that says something like "RootHandle 1048576". That >>> is the identifier for the root handle that pvfs2-ping is trying to find in >>> the file system. If you then look a little further down in the >>> configuration file there is a section called <MetaHandleRanges> which >>> allocates ranges of metadata identifiers to different servers. The number >>> listed in the RootHandle line _must_ fall into exactly one of these meta >>> handle ranges. Assuming that it is in there, then it is the corresponding >>> server that is causing a problem. -Phil On 01/26/2012 03:47 PM, Dimokritos >>> Stamatakis wrote: >>> >>>> I just erased the storage (/mnt/pvfs2) and the /pvfs2-storage-space/ >>>> and tried again, but nothing happened. >>>> Maybe another setup to the code or the DB_CONFIG? >>>> As the error says noone is root for that file system, right? >>>> >>>> Thanks, >>>> Dimos. >>>> >>>> >>>> >>>> I would delete the storage spaces and try again. The error message >>>>> is saying that ithe root doesn't exist. >>>>> >>>>> Becky >>>>> >>>>> On Thursday, January 26, 2012, Dimokritos Stamatakis >>>>> <dimsta...@gmail.com<mailto:di**msta...@gmail.com<dimsta...@gmail.com>>> >>>>> wrote: >>>>> >>>>>> Yes , I did! >>>>>> Another possible solution? >>>>>> Thanks. >>>>>> >>>>>> >>>>>> >>>>>> Did you create the storage space on each server? (pvfs2-server -f >>>>>> >>>>> pvfs2-fs.conf -a<alias>) >>>>> >>>>>> Becky >>>>>> >>>>>> On Thu, Jan 26, 2012 at 11:42 AM, Dimokritos Stamatakis >>>>>> >>>>> <dimsta...@gmail.com<mailto:di**msta...@gmail.com<dimsta...@gmail.com>>> >>>>> wrote: >>>>> >>>>>> Thanks for your answers, >>>>>>> I generated the conf file once and I copy-pasted the contents to >>>>>>> >>>>>> the other nodes. >>>>> >>>>>> But in pvfs2-ping -m /mnt/pvfs2 I still get the same error : >>>>>>> >>>>>>> (7) Verifying that root handle is owned by one server... >>>>>>> >>>>>>> Root handle: 1048576 >>>>>>> Failure: check root handle failed >>>>>>> PVFS_mgmt_setparam_all: Detailed per-server errors are available >>>>>>> >>>>>> (error class: 0) >>>>> >>>>>> Exactly one server must own the root handle. >>>>>>> In this setup, no servers own the root handle. >>>>>>> >>>>>>> Per-server errors: >>>>>>> ==============================**==============================**= >>>>>>> >>>>>>> The PVFS2 filesystem at /mnt/pvfs2/ appears to have problems. >>>>>>> >>>>>>> >>>>>>> >>>>>>> What does it mean that the root handle is owned by more than one >>>>>>> >>>>>> servers? >>>>> >>>>>> All the previous tests (1-6) are successful. >>>>>>> >>>>>>> Many thanks to all, >>>>>>> Dimos. >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> You should generate it once and copy it to all servers. If it >>>>>>>> >>>>>>> isn't exactly the same on all servers things won't work (potentially, >>>>> the error you got). >>>>> >>>>>> Walt >>>>>>>> >>>>>>>> On 1/26/12 10:26 AM, Dimokritos Stamatakis wrote: >>>>>>>> >>>>>>>>> Hello all, >>>>>>>>> I finally deployed the pvfs to the cloud, but I get the >>>>>>>>> >>>>>>>> following error when I run pvfs-ping -m /mnt pvfs2 : >>>>> >>>>>> (7) Verifying that root handle is owned by one server... >>>>>>>>> >>>>>>>>> Root handle: 1048576 >>>>>>>>> Failure: check root handle failed >>>>>>>>> PVFS_mgmt_setparam_all: Detailed per-server errors are >>>>>>>>> >>>>>>>> available (error class: 0) >>>>> >>>>>> Exactly one server must own the root handle. >>>>>>>>> In this setup, no servers own the root handle. >>>>>>>>> >>>>>>>>> Per-server errors: >>>>>>>>> ==============================**==============================**= >>>>>>>>> >>>>>>>>> The PVFS2 filesystem at /mnt/pvfs2/ appears to have problems. >>>>>>>>> >>>>>>>>> How can I solve it? >>>>>>>>> >>>>>>>>> Another question: >>>>>>>>> The ideal way is to produce the /etc/pvfs2-fs.conf just once >>>>>>>>> >>>>>>>> with pvfs2-genconf /etc/pvfs2-fs.conf , or separately to each node? >>>>> >>>>>> Many thanks, >>>>>>>>> Dimos. >>>>>>>>> ______________________________**_________________ >>>>>>>>> Pvfs2-developers mailing list >>>>>>>>> Pvfs2-developers@beowulf-**underground.org<Pvfs2-developers@beowulf-underground.org> >>>>>>>>> >>>>>>>> <mailto:Pvfs2-developers@**beowulf-underground.org<Pvfs2-developers@beowulf-underground.org> >>>>> > >>>>> http://www.beowulf-**underground.org/mailman/** >>>>> listinfo/pvfs2-developers<http://www.beowulf-underground.org/mailman/listinfo/pvfs2-developers> >>>>> >>>>>> >>>>>>> ______________________________**_________________ >>>>>>> Pvfs2-developers mailing list >>>>>>> Pvfs2-developers@beowulf-**underground.org<Pvfs2-developers@beowulf-underground.org> >>>>>>> >>>>>> <mailto:Pvfs2-developers@**beowulf-underground.org<Pvfs2-developers@beowulf-underground.org> >>>>> > >>>>> >>>>>> http://www.beowulf-**underground.org/mailman/** >>>>>>> listinfo/pvfs2-developers<http://www.beowulf-underground.org/mailman/listinfo/pvfs2-developers> >>>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> Becky Ligon >>>>>> OrangeFS Support and Development >>>>>> Omnibond Systems >>>>>> Anderson, South Carolina >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> -- >>>>> Becky Ligon >>>>> OrangeFS Support and Development >>>>> Omnibond Systems >>>>> Anderson, South Carolina >>>>> >>>>> >>>>> >>>> >>>> ______________________________**_________________ >>>> Pvfs2-developers mailing list >>>> Pvfs2-developers@beowulf-**underground.org<Pvfs2-developers@beowulf-underground.org> >>>> http://www.beowulf-**underground.org/mailman/** >>>> listinfo/pvfs2-developers<http://www.beowulf-underground.org/mailman/listinfo/pvfs2-developers> >>>> >>> -------------- next part -------------- >>> An HTML attachment was scrubbed... >>> URL: http://www.beowulf-**underground.org/pipermail/** >>> pvfs2-developers/attachments/**20120126/976b3bf7/attachment-**0001.htm<http://www.beowulf-underground.org/pipermail/pvfs2-developers/attachments/20120126/976b3bf7/attachment-0001.htm> >>> >>> ------------------------------ >>> >>> Message: 3 >>> Date: Thu, 26 Jan 2012 16:11:37 -0500 >>> From: Becky Ligon<li...@omnibond.com> >>> Subject: Re: [Pvfs2-developers] Re: pvfs2 "check root handle failed" >>> error >>> To: Phil Carns<ca...@mcs.anl.gov> >>> Cc: >>> pvfs2-developers@beowulf-**underground.org<pvfs2-developers@beowulf-underground.org> >>> Message-ID: >>> <CAJBnF31V7kobmWwZ_**TdWHoettGsWzi1_hf8NYg717=wDSMd**a...@mail.gmail.com<wdsmd...@mail.gmail.com> >>> > >>> Content-Type: text/plain; charset="iso-8859-1" >>> >>> That's a good point, Phil. >>> >>> Are you using the same storage space for your servers? >>> >>> Becky >>> >>> On Thu, Jan 26, 2012 at 3:59 PM, Phil Carns<ca...@mcs.anl.gov> wrote: >>> >>> Hi Dimos, >>>> >>>> You might want to post your current conf file again. In there you >>>> should >>>> see a line that says something like "RootHandle 1048576". That is the >>>> identifier for the root handle that pvfs2-ping is trying to find in the >>>> file system. If you then look a little further down in the >>>> configuration >>>> file there is a section called<MetaHandleRanges> which allocates >>>> ranges of >>>> metadata identifiers to different servers. The number listed in the >>>> RootHandle line _must_ fall into exactly one of these meta handle >>>> ranges. >>>> Assuming that it is in there, then it is the corresponding server that >>>> is >>>> causing a problem. >>>> >>>> -Phil >>>> >>>> >>>> On 01/26/2012 03:47 PM, Dimokritos Stamatakis wrote: >>>> >>>> I just erased the storage (/mnt/pvfs2) and the /pvfs2-storage-space/ and >>>> tried again, but nothing happened. >>>> Maybe another setup to the code or the DB_CONFIG? >>>> As the error says noone is root for that file system, right? >>>> >>>> Thanks, >>>> Dimos. >>>> >>>> >>>> >>>> I would delete the storage spaces and try again. The error message is >>>> saying that ithe root doesn't exist. >>>> >>>> Becky >>>> >>>> On Thursday, January 26, 2012, Dimokritos Stamatakis< >>>> dimsta...@gmail.com**> >>>> wrote: >>>> >>>>> Yes , I did! >>>>> Another possible solution? >>>>> Thanks. >>>>> >>>>> >>>>> >>>>> Did you create the storage space on each server? (pvfs2-server -f >>>>> >>>> pvfs2-fs.conf -a<alias>) >>>> >>>>> Becky >>>>> >>>>> On Thu, Jan 26, 2012 at 11:42 AM, Dimokritos Stamatakis< >>>>> >>>> dimsta...@gmail.com> wrote: >>>> >>>>> Thanks for your answers, >>>>>> I generated the conf file once and I copy-pasted the contents to the >>>>>> >>>>> other nodes. >>>> >>>>> But in pvfs2-ping -m /mnt/pvfs2 I still get the same error : >>>>>> >>>>>> (7) Verifying that root handle is owned by one server... >>>>>> >>>>>> Root handle: 1048576 >>>>>> Failure: check root handle failed >>>>>> PVFS_mgmt_setparam_all: Detailed per-server errors are available >>>>>> (error >>>>>> >>>>> class: 0) >>>> >>>>> Exactly one server must own the root handle. >>>>>> In this setup, no servers own the root handle. >>>>>> >>>>>> Per-server errors: >>>>>> ==============================**==============================**= >>>>>> >>>>>> The PVFS2 filesystem at /mnt/pvfs2/ appears to have problems. >>>>>> >>>>>> >>>>>> >>>>>> What does it mean that the root handle is owned by more than one >>>>>> >>>>> servers? >>>> >>>>> All the previous tests (1-6) are successful. >>>>>> >>>>>> Many thanks to all, >>>>>> Dimos. >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> You should generate it once and copy it to all servers. If it isn't >>>>>>> >>>>>> exactly the same on all servers things won't work (potentially, the >>>> error >>>> you got). >>>> >>>>> Walt >>>>>>> >>>>>>> On 1/26/12 10:26 AM, Dimokritos Stamatakis wrote: >>>>>>> >>>>>>>> Hello all, >>>>>>>> I finally deployed the pvfs to the cloud, but I get the following >>>>>>>> >>>>>>> error when I run pvfs-ping -m /mnt pvfs2 : >>>> >>>>> (7) Verifying that root handle is owned by one server... >>>>>>>> >>>>>>>> Root handle: 1048576 >>>>>>>> Failure: check root handle failed >>>>>>>> PVFS_mgmt_setparam_all: Detailed per-server errors are available >>>>>>>> >>>>>>> (error class: 0) >>>> >>>>> Exactly one server must own the root handle. >>>>>>>> In this setup, no servers own the root handle. >>>>>>>> >>>>>>>> Per-server errors: >>>>>>>> ==============================**==============================**= >>>>>>>> >>>>>>>> The PVFS2 filesystem at /mnt/pvfs2/ appears to have problems. >>>>>>>> >>>>>>>> How can I solve it? >>>>>>>> >>>>>>>> Another question: >>>>>>>> The ideal way is to produce the /etc/pvfs2-fs.conf just once with >>>>>>>> >>>>>>> pvfs2-genconf /etc/pvfs2-fs.conf , or separately to each node? >>>> >>>>> Many thanks, >>>>>>>> Dimos. >>>>>>>> ______________________________**_________________ >>>>>>>> Pvfs2-developers mailing list >>>>>>>> Pvfs2-developers@beowulf-**underground.org<Pvfs2-developers@beowulf-underground.org> >>>>>>>> http://www.beowulf-**underground.org/mailman/** >>>>>>>> listinfo/pvfs2-developers<http://www.beowulf-underground.org/mailman/listinfo/pvfs2-developers> >>>>>>>> >>>>>>> >>>>>> ______________________________**_________________ >>>>>> Pvfs2-developers mailing list >>>>>> Pvfs2-developers@beowulf-**underground.org<Pvfs2-developers@beowulf-underground.org> >>>>>> http://www.beowulf-**underground.org/mailman/** >>>>>> listinfo/pvfs2-developers<http://www.beowulf-underground.org/mailman/listinfo/pvfs2-developers> >>>>>> >>>>> >>>>> >>>>> -- >>>>> Becky Ligon >>>>> OrangeFS Support and Development >>>>> Omnibond Systems >>>>> Anderson, South Carolina >>>>> >>>>> >>>>> >>>>> >>>>> -- >>>> Becky Ligon >>>> OrangeFS Support and Development >>>> Omnibond Systems >>>> Anderson, South Carolina >>>> >>>> >>>> >>>> >>>> >>>> ______________________________**_________________ >>>> Pvfs2-developers mailing listPvfs2-developers@beowulf-** >>>> underground.orghttp://www.**beowulf-underground.org/** >>>> mailman/listinfo/pvfs2-**developers<http://www.beowulf-underground.org/mailman/listinfo/pvfs2-developers> >>>> >>>> >>>> >>>> ______________________________**_________________ >>>> Pvfs2-developers mailing list >>>> Pvfs2-developers@beowulf-**underground.org<Pvfs2-developers@beowulf-underground.org> >>>> http://www.beowulf-**underground.org/mailman/** >>>> listinfo/pvfs2-developers<http://www.beowulf-underground.org/mailman/listinfo/pvfs2-developers> >>>> >>>> >>>> >>> >> ______________________________**_________________ >> Pvfs2-developers mailing list >> Pvfs2-developers@beowulf-**underground.org<Pvfs2-developers@beowulf-underground.org> >> http://www.beowulf-**underground.org/mailman/**listinfo/pvfs2-developers<http://www.beowulf-underground.org/mailman/listinfo/pvfs2-developers> >> > > ______________________________**_________________ > Pvfs2-developers mailing list > Pvfs2-developers@beowulf-**underground.org<Pvfs2-developers@beowulf-underground.org> > http://www.beowulf-**underground.org/mailman/**listinfo/pvfs2-developers<http://www.beowulf-underground.org/mailman/listinfo/pvfs2-developers> > -- Becky Ligon OrangeFS Support and Development Omnibond Systems Anderson, South Carolina
_______________________________________________ Pvfs2-developers mailing list Pvfs2-developers@beowulf-underground.org http://www.beowulf-underground.org/mailman/listinfo/pvfs2-developers
