Attached are the files that we use.

Becky

On Thu, Apr 5, 2012 at 6:13 PM, Becky Ligon <[email protected]> wrote:

> Sure.  No problem.
>
> Becky
>
>
> On Thu, Apr 5, 2012 at 5:53 PM, Jim Kusznir <[email protected]> wrote:
>
>> Can you also provide the pvfs2.[c]sh files you use?  I'm kinda short
>> on time, and I was unable to rebuild the RPM the way my previous RPM
>> built (installing into the main filesystem), so I'm hesitant to try
>> and develop it now.
>>
>> --Jim
>>
>> On Tue, Apr 3, 2012 at 2:06 PM, Becky Ligon <[email protected]> wrote:
>> > Jim:
>> >
>> > We use the info in profile.d to make sure our environments have the
>> correct
>> > areas to look for libraries.  I've attached copies of those files, so
>> you
>> > can see what we setup.  You can choose to use them or not.  However,
>> when
>> > you compile PVFS, you need to make sure it can find the appropriate
>> > libraries and include directory for BDB.
>> >
>> > I don't know if that DropBox file service is home grown or is a 3rd
>> party
>> > software.  I can find out.
>> >
>> > Becky
>> >
>> >
>> > On Tue, Apr 3, 2012 at 4:31 PM, Jim Kusznir <[email protected]> wrote:
>> >>
>> >> Thanks for the spec file, its building pretty well.
>> >>
>> >> Is there anything special in your profile.d/db.[c]sh files?
>> >>
>> >> Also, I'm really curious about the webapp that creates the webdrop
>> >> service..Is that a customized open source package, or something
>> >> in-house?
>> >>
>> >> Thanks!
>> >> --Jim
>> >>
>> >>
>> >> On Mon, Apr 2, 2012 at 11:19 AM, Becky Ligon <[email protected]>
>> wrote:
>> >> > Jim:
>> >> >
>> >> > We downloaded the software from the Oracle site and created an rpm
>> from
>> >> > that.  We are running Centos5 on our productions servers with
>> >> > kernel=2.6.18-238.9.1.el5 and have been running a version of db4 for
>> at
>> >> > least the past 3 years.  So, you should be able to create the rpm.  I
>> >> > can
>> >> > send you the rpm that we are using but it is taylored to our
>> >> > environment; we
>> >> > install db4 in /opt/db4, because other items depend on the installed
>> >> > version.
>> >> >
>> >> > Becky
>> >> >
>> >> >
>> >> > On Mon, Apr 2, 2012 at 1:37 PM, Jim Kusznir <[email protected]>
>> wrote:
>> >> >>
>> >> >> I've been trying to build a db4 rpm on my centos box, but it appears
>> >> >> it has dependencies that require an OS upgrade...how did you get
>> >> >> anything newer than the stock db4 installed on centos5?
>> >> >>
>> >> >> --Jim
>> >> >>
>> >> >> On Sat, Mar 31, 2012 at 3:07 PM, Becky Ligon <[email protected]>
>> >> >> wrote:
>> >> >> > Jim:
>> >> >> >
>> >> >> > I understand your situation.  Here at Clemson University, we went
>> >> >> > through
>> >> >> > the same situation a couple of years ago.  Now, we backup the
>> >> >> > metadata
>> >> >> > databases.  We don't have the space to backup our data either!
>> >> >> >
>> >> >> > Under no circumstances should you run pvfs2-fsck.  If you do,
>> then we
>> >> >> > won't
>> >> >> > be able to help at all, if you run this command in the destructive
>> >> >> > mode.
>> >> >> >  If
>> >> >> > you're willing, Omnibond MAY be able to write some utilities that
>> we
>> >> >> > help
>> >> >> > you recover most of the data.  You will have to speak to Boyd
>> Wilson
>> >> >> > ([email protected]) and workout something.
>> >> >> >
>> >> >> > Becky Ligon
>> >> >> >
>> >> >> >
>> >> >> > On Fri, Mar 30, 2012 at 5:55 PM, Jim Kusznir <[email protected]>
>> >> >> > wrote:
>> >> >> >>
>> >> >> >> I made no changes to my environment; it was up and running just
>> >> >> >> fine.
>> >> >> >> I ran db_recover, and it immediately returned, with no apparent
>> sign
>> >> >> >> of doing anything but creating a log.000000001 file.
>> >> >> >>
>> >> >> >> I have the centos DB installed, db4-4.3.29-10.el5
>> >> >> >>
>> >> >> >> I have no backups; this is my high performance filesystem of
>> 99TB;
>> >> >> >> it
>> >> >> >> is the largest disk we have and therefore have no means of
>> backing
>> >> >> >> it
>> >> >> >> up.  We don't have anything big enough to hold that much data.
>> >> >> >>
>> >> >> >> Is there any hope?  Can we just identify and delete the files
>> that
>> >> >> >> have the db dammange on it?  (Note that I don't even have
>> anywhere
>> >> >> >> to
>> >> >> >> back up this data to temporally if we do get it running, so I'd
>> need
>> >> >> >> to "fix in place".
>> >> >> >>
>> >> >> >> thanks!
>> >> >> >> --Jim
>> >> >> >>
>> >> >> >> --Jim
>> >> >> >>
>> >> >> >> On Fri, Mar 30, 2012 at 2:44 PM, Becky Ligon <[email protected]
>> >
>> >> >> >> wrote:
>> >> >> >> > Jim:
>> >> >> >> >
>> >> >> >> > If you haven't made any recent changes to your pvfs
>> environment or
>> >> >> >> > Berkeley
>> >> >> >> > Db installation, then it looks like you have a corrupted
>> metadata
>> >> >> >> > database.
>> >> >> >> > There is no way to easily recover.  Sometimes, the Berkeley db
>> >> >> >> > command
>> >> >> >> > "db_recover" might work, but PVFS doesn't have transactions
>> turned
>> >> >> >> > on,
>> >> >> >> > so
>> >> >> >> > normally it doesn't work.  It's worth a try, just to be sure.
>> >> >> >> >
>> >> >> >> > Do you have any recent backups of the databases?  If so, then
>> you
>> >> >> >> > will
>> >> >> >> > need
>> >> >> >> > to use a set of backups that were created around the same
>> time, so
>> >> >> >> > the
>> >> >> >> > databases will be somewhat consistent with each other.
>> >> >> >> >
>> >> >> >> > Which version of Berkeley are you using?  We have had
>> corruption
>> >> >> >> > issues
>> >> >> >> > with
>> >> >> >> > older versions of it.  We strongly recommend 4.8 or higher.
>> There
>> >> >> >> > are
>> >> >> >> > some
>> >> >> >> > know problems with threads in the older versions .
>> >> >> >> >
>> >> >> >> > Becky Ligon
>> >> >> >> >
>> >> >> >> > On Fri, Mar 30, 2012 at 3:28 PM, Jim Kusznir <
>> [email protected]>
>> >> >> >> > wrote:
>> >> >> >> >>
>> >> >> >> >> Hi all:
>> >> >> >> >>
>> >> >> >> >> I got some notices from my users with "wierdness with pvfs2"
>> this
>> >> >> >> >> morning, and went and investagated.  eventually, I found the
>> >> >> >> >> following
>> >> >> >> >> on one of my 3 serers:
>> >> >> >> >>
>> >> >> >> >> [S 03/30 12:22] PVFS2 Server on node pvfs2-io-0-2 version
>> 2.8.2
>> >> >> >> >> starting...
>> >> >> >> >> [E 03/30 12:23] Warning: got invalid handle or key size in
>> >> >> >> >> dbpf_dspace_iterate_handles().
>> >> >> >> >> [E 03/30 12:23] Warning: skipping entry.
>> >> >> >> >> [E 03/30 12:23] c_get failed on iteration 3044
>> >> >> >> >> [E 03/30 12:23] dbpf_dspace_iterate_handles_op_svc: Invalid
>> >> >> >> >> argument
>> >> >> >> >> [E 03/30 12:23] Error adding handle range
>> >> >> >> >> 1431655768-2147483649,3579139414-4294967295 to filesystem
>> >> >> >> >> pvfs2-fs
>> >> >> >> >> [E 03/30 12:23] Error: Could not initialize server interfaces;
>> >> >> >> >> aborting.
>> >> >> >> >> [E 03/30 12:23] Error: Could not initialize server; aborting.
>> >> >> >> >>
>> >> >> >> >> ------------
>> >> >> >> >> pvfs2-fs.conf:
>> >> >> >> >> -----------
>> >> >> >> >>
>> >> >> >> >> <Defaults>
>> >> >> >> >>        UnexpectedRequests 50
>> >> >> >> >>        EventLogging none
>> >> >> >> >>        LogStamp datetime
>> >> >> >> >>        BMIModules bmi_tcp
>> >> >> >> >>        FlowModules flowproto_multiqueue
>> >> >> >> >>        PerfUpdateInterval 1000
>> >> >> >> >>        ServerJobBMITimeoutSecs 30
>> >> >> >> >>        ServerJobFlowTimeoutSecs 30
>> >> >> >> >>        ClientJobBMITimeoutSecs 300
>> >> >> >> >>        ClientJobFlowTimeoutSecs 300
>> >> >> >> >>        ClientRetryLimit 5
>> >> >> >> >>        ClientRetryDelayMilliSecs 2000
>> >> >> >> >>        StorageSpace /mnt/pvfs2
>> >> >> >> >>        LogFile /var/log/pvfs2-server.log
>> >> >> >> >> </Defaults>
>> >> >> >> >>
>> >> >> >> >> <Aliases>
>> >> >> >> >>        Alias pvfs2-io-0-0 tcp://pvfs2-io-0-0:3334
>> >> >> >> >>        Alias pvfs2-io-0-1 tcp://pvfs2-io-0-1:3334
>> >> >> >> >>        Alias pvfs2-io-0-2 tcp://pvfs2-io-0-2:3334
>> >> >> >> >> </Aliases>
>> >> >> >> >>
>> >> >> >> >> <Filesystem>
>> >> >> >> >>        Name pvfs2-fs
>> >> >> >> >>        ID 62659950
>> >> >> >> >>        RootHandle 1048576
>> >> >> >> >>        <MetaHandleRanges>
>> >> >> >> >>                Range pvfs2-io-0-0 4-715827885
>> >> >> >> >>                Range pvfs2-io-0-1 715827886-1431655767
>> >> >> >> >>                Range pvfs2-io-0-2 1431655768-2147483649
>> >> >> >> >>        </MetaHandleRanges>
>> >> >> >> >>        <DataHandleRanges>
>> >> >> >> >>                Range pvfs2-io-0-0 2147483650-2863311531
>> >> >> >> >>                Range pvfs2-io-0-1 2863311532-3579139413
>> >> >> >> >>                Range pvfs2-io-0-2 3579139414-4294967295
>> >> >> >> >>        </DataHandleRanges>
>> >> >> >> >>        <StorageHints>
>> >> >> >> >>                TroveSyncMeta yes
>> >> >> >> >>                TroveSyncData no
>> >> >> >> >>        </StorageHints>
>> >> >> >> >> </Filesystem>
>> >> >> >> >> -------------
>> >> >> >> >> Any suggestions for recovery?
>> >> >> >> >>
>> >> >> >> >> Thanks!
>> >> >> >> >> --Jim
>> >> >> >> >> _______________________________________________
>> >> >> >> >> Pvfs2-users mailing list
>> >> >> >> >> [email protected]
>> >> >> >> >>
>> http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
>> >> >> >> >
>> >> >> >> >
>> >> >> >> >
>> >> >> >> >
>> >> >> >> > --
>> >> >> >> > Becky Ligon
>> >> >> >> > OrangeFS Support and Development
>> >> >> >> > Omnibond Systems
>> >> >> >> > Anderson, South Carolina
>> >> >> >> >
>> >> >> >> >
>> >> >> >
>> >> >> >
>> >> >> >
>> >> >> >
>> >> >> > --
>> >> >> > Becky Ligon
>> >> >> > OrangeFS Support and Development
>> >> >> > Omnibond Systems
>> >> >> > Anderson, South Carolina
>> >> >> >
>> >> >> >
>> >> >
>> >> >
>> >> >
>> >> >
>> >> > --
>> >> > Becky Ligon
>> >> > OrangeFS Support and Development
>> >> > Omnibond Systems
>> >> > Anderson, South Carolina
>> >> >
>> >> >
>> >
>> >
>> >
>> >
>> > --
>> > Becky Ligon
>> > OrangeFS Support and Development
>> > Omnibond Systems
>> > Anderson, South Carolina
>> >
>> >
>>
>
>
>
> --
> Becky Ligon
> OrangeFS Support and Development
> Omnibond Systems
> Anderson, South Carolina
>
>
>


-- 
Becky Ligon
OrangeFS Support and Development
Omnibond Systems
Anderson, South Carolina

Attachment: pvfs.csh
Description: C-Shell script

Attachment: pvfs.sh
Description: Bourne shell script

_______________________________________________
Pvfs2-users mailing list
[email protected]
http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users

Reply via email to