Re: readdirplus is very cool, any other nfs client suggestions?

1999-07-30 Thread Alfred Perlstein

On Fri, 30 Jul 1999, Doug wrote:

>   Spent quite a bit of time today playing around with the newly
> repaired readdirplus option for nfs clients in -current. My thanks to Matt
> Dillon and Bill Paul. For those that don't remember, I'm trying to use
> amd/nfs client stuff on some freebsd web servers that read their data from
> our sun (and now sun + netapp) web farm. I have a script that used to lock
> up amd and/or nfs and/or the whole machine pretty regularly. I've run it
> about 100 times today in various conditions with no ill effects. About
> this I am quite pleased. :)

...

> amd.Interfaces:
> 
> /defaults   type:=nfs;opts:=rw,vers=3,readdirplus,intr,proto=udp
> 
> *   rhost:=IP${key};rfs:=/Space/${key}

Not to rain on your parade, but Dag-Erling informed me that there
was problems using NFSv3 over the loopback interface that can cause
lockups.

DES: can you elaborate?  you think it may cause problems with amd
since it's like an NFS buffer isn't it and would work over the 
loopback...

-Alfred



To Unsubscribe: send mail to [EMAIL PROTECTED]
with "unsubscribe freebsd-hackers" in the body of the message



Re: readdirplus is very cool, any other nfs client suggestions?

1999-07-30 Thread Matthew Dillon

:   Spent quite a bit of time today playing around with the newly
:repaired readdirplus option for nfs clients in -current. My thanks to Matt
:Dillon and Bill Paul. For those that don't remember, I'm trying to use
:amd/nfs client stuff on some freebsd web servers that read their data from
:our sun (and now sun + netapp) web farm. I have a script that used to lock
:up amd and/or nfs and/or the whole machine pretty regularly. I've run it
:about 100 times today in various conditions with no ill effects. About
:this I am quite pleased. :)
:
:   Since I'm new to nfs, and wasn't aware of the readdirplus option,
:it dawns on me that there might be other cool things I'm not using that
:also might be a benefit. I'm using amd for now, although this might be
:replaced with plain old hard mounts at some time in the near future. The
:following options I've cobbled together from advice on the lists, my
:reading of the man pages and other documentation, and a lot of
:experimentation. Any comments or suggestions for improvements would be
:welcome. 
:
:Thanks,
:
:Doug

The only other major feature is the nq leasing stuff for cache coherency,
but it is highly experimental and you probably shouldn't use it.  Plus
very few other OS's support it.

There is a lot of tweaking you can do with 'normal' nfs options,
such as tuning the read & write block size, adjusting cache timeouts
for various parameters, and so forth.

man mount_nfs and look at the various -o options available.

-Matt
Matthew Dillon 
<[EMAIL PROTECTED]>


To Unsubscribe: send mail to [EMAIL PROTECTED]
with "unsubscribe freebsd-hackers" in the body of the message



Re: readdirplus is very cool, any other nfs client suggestions?

1999-07-30 Thread Matthew Dillon

:
:> amd.Interfaces:
:> 
:> /defaults   type:=nfs;opts:=rw,vers=3,readdirplus,intr,proto=udp
:> 
:> *   rhost:=IP${key};rfs:=/Space/${key}
:
:Not to rain on your parade, but Dag-Erling informed me that there
:was problems using NFSv3 over the loopback interface that can cause
:lockups.
:
:DES: can you elaborate?  you think it may cause problems with amd
:since it's like an NFS buffer isn't it and would work over the 
:loopback...
:
:-Alfred

If there are easily reproducable problems with the kernel nfs client
or server, please report them to me and we can almost certainly get
them fixed.Problems related to amd are harder - it's really up to
the author to fix those if it turns out to be a bug in amd rather then
the kernel.  So far, though, most of the recent bugs have been on
the kernel side.

-Matt
Matthew Dillon 
<[EMAIL PROTECTED]>


To Unsubscribe: send mail to [EMAIL PROTECTED]
with "unsubscribe freebsd-hackers" in the body of the message



Re: readdirplus is very cool, any other nfs client suggestions?

1999-07-30 Thread Doug

On Fri, 30 Jul 1999, Matthew Dillon wrote:

> The only other major feature is the nq leasing stuff for cache coherency,
> but it is highly experimental and you probably shouldn't use it.  Plus
> very few other OS's support it.

heh... I'm just happy when the stuff works that's supposed to
work. I really don't want to push my luck.

> There is a lot of tweaking you can do with 'normal' nfs options,
> such as tuning the read & write block size, adjusting cache timeouts
> for various parameters, and so forth.
> 
> man mount_nfs and look at the various -o options available.

Yeah, I've been reading the various man pages and things for quite
a while now and it's starting to synch in. Do you have any suggestions for
additional reading? The O'Reilly book seems a bit out of date, but I'll
try it if folks say it's good. Basically my problem is that there are so
MANY options, and my knowledged about potential side effects is very
limited. 

Thanks for your response,

Doug
-- 
On account of being a democracy and run by the people, we are the only
nation in the world that has to keep a government four years, no matter
what it does.
-- Will Rogers



To Unsubscribe: send mail to [EMAIL PROTECTED]
with "unsubscribe freebsd-hackers" in the body of the message



Re: readdirplus is very cool, any other nfs client suggestions?

1999-08-01 Thread Dag-Erling Smorgrav

Alfred Perlstein <[EMAIL PROTECTED]> writes:
> DES: can you elaborate?  you think it may cause problems with amd
> since it's like an NFS buffer isn't it and would work over the 
> loopback...

I used loopback mounts to test NFS make worlds a while ago (there were
places where make world would bomb because chflags doesn't work on
NFS) and experienced deadlock problems. Somebody (I don't remember who
exactly) told me that this was a known problem with the NFSv3 code;
reading over loopback mounts works fine, but writing apparently
results in deadlocks. Search the archives; the commit logs should give
you an idea of when this was (check the logs for Makefiles that use
chflags).

root@des ~# current -l -F Makefile chflags 
src/Makefile.inc1
src/lib/libc/sys/Makefile.inc
src/lib/libc_r/Makefile
src/release/Makefile
src/sys/alpha/conf/Makefile.alpha
src/sys/i386/conf/Makefile.i386
src/sys/pc98/conf/Makefile.pc98
src/usr.bin/Makefile
src/usr.bin/chflags/Makefile
src/usr.bin/chpass/Makefile
src/usr.bin/passwd/Makefile

DES
-- 
Dag-Erling Smorgrav - [EMAIL PROTECTED]


To Unsubscribe: send mail to [EMAIL PROTECTED]
with "unsubscribe freebsd-hackers" in the body of the message



Re: readdirplus is very cool, any other nfs client suggestions?

1999-08-02 Thread Matthew Dillon


:Alfred Perlstein <[EMAIL PROTECTED]> writes:
:> DES: can you elaborate?  you think it may cause problems with amd
:> since it's like an NFS buffer isn't it and would work over the 
:> loopback...
:
:I used loopback mounts to test NFS make worlds a while ago (there were
:places where make world would bomb because chflags doesn't work on
:NFS) and experienced deadlock problems. Somebody (I don't remember who
:exactly) told me that this was a known problem with the NFSv3 code;
:reading over loopback mounts works fine, but writing apparently
:results in deadlocks. Search the archives; the commit logs should give
:you an idea of when this was (check the logs for Makefiles that use
:chflags).
:
:root@des ~# current -l -F Makefile chflags 
:src/Makefile.inc1
:src/lib/libc/sys/Makefile.inc
:src/lib/libc_r/Makefile
:src/release/Makefile
:src/sys/alpha/conf/Makefile.alpha
:src/sys/i386/conf/Makefile.i386
:src/sys/pc98/conf/Makefile.pc98
:src/usr.bin/Makefile
:src/usr.bin/chflags/Makefile
:src/usr.bin/chpass/Makefile
:src/usr.bin/passwd/Makefile
:
:DES
:-- 
:Dag-Erling Smorgrav - [EMAIL PROTECTED]

The buildworld chflags problems were fixed around a month ago I think.
Since then there have been many NFS fixes committed.  I have not tested
running buildworld over a loopbacked NFS mount -- I'll do that today --
but I'd say there is a good chance that it will simply work.

-Matt
Matthew Dillon 
<[EMAIL PROTECTED]>


To Unsubscribe: send mail to [EMAIL PROTECTED]
with "unsubscribe freebsd-hackers" in the body of the message



Re: readdirplus is very cool, any other nfs client suggestions?

1999-08-02 Thread Tim Vanderhoek

On Mon, Aug 02, 1999 at 09:25:52AM +0200, Dag-Erling Smorgrav wrote:
>(there were
> places where make world would bomb because chflags doesn't work on
[...]
>  (check the logs for Makefiles that use
> chflags).
[...]
> root@des ~# current -l -F Makefile chflags 
> src/Makefile.inc1

Set INSTALLFLAGS_EDIT=:S/schg/,/ to remove these when doing a make
world, if needed.

[A make world actually works from usermode now with the right set of
options (one of which is -DNOGAMES)].


-- 
This is my .signature which gets appended to the end of my messages.


To Unsubscribe: send mail to [EMAIL PROTECTED]
with "unsubscribe freebsd-hackers" in the body of the message



Re: readdirplus is very cool, any other nfs client suggestions?

1999-08-02 Thread Dag-Erling Smorgrav

Matthew Dillon <[EMAIL PROTECTED]> writes:
> The buildworld chflags problems were fixed around a month ago I think.

No, I fixed them in february or march.

DES
-- 
Dag-Erling Smorgrav - [EMAIL PROTECTED]


To Unsubscribe: send mail to [EMAIL PROTECTED]
with "unsubscribe freebsd-hackers" in the body of the message



Re: readdirplus is very cool, any other nfs client suggestions?

1999-08-02 Thread Dag-Erling Smorgrav

Tim Vanderhoek <[EMAIL PROTECTED]> writes:
> Set INSTALLFLAGS_EDIT=:S/schg/,/ to remove these when doing a make
> world, if needed.

Please try to understand what the issue is before butting in.

DES
-- 
Dag-Erling Smorgrav - [EMAIL PROTECTED]


To Unsubscribe: send mail to [EMAIL PROTECTED]
with "unsubscribe freebsd-hackers" in the body of the message



Re: readdirplus is very cool, any other nfs client suggestions?

1999-08-02 Thread Matthew Dillon


:Matthew Dillon <[EMAIL PROTECTED]> writes:
:> The buildworld chflags problems were fixed around a month ago I think.
:
:No, I fixed them in february or march.
:
:DES
:-- 
:Dag-Erling Smorgrav - [EMAIL PROTECTED]

Ok, then there is a real good chance localhost mounts will work now.

I'm running a buildworld test right now with /usr/src and /usr/obj both
on NFSv3 localhost mounts.

-Matt
Matthew Dillon 
<[EMAIL PROTECTED]>


To Unsubscribe: send mail to [EMAIL PROTECTED]
with "unsubscribe freebsd-hackers" in the body of the message



Re: readdirplus is very cool, any other nfs client suggestions?

1999-08-02 Thread Dag-Erling Smorgrav

Matthew Dillon <[EMAIL PROTECTED]> writes:
> Ok, then there is a real good chance localhost mounts will work now.

I'm happy to hear that, since NFSv3 is significantly faster than NFSv2
on loopback mounts :)

> I'm running a buildworld test right now with /usr/src and /usr/obj both
> on NFSv3 localhost mounts.

Yeah, I was doing installworlds with /usr, /usr/src and /usr/obj
NFS-mounted (in a chroot tree on the server, because I got tired of
doing it over PLIP).

DES
-- 
Dag-Erling Smorgrav - [EMAIL PROTECTED]


To Unsubscribe: send mail to [EMAIL PROTECTED]
with "unsubscribe freebsd-hackers" in the body of the message



Re: readdirplus is very cool, any other nfs client suggestions?

1999-08-02 Thread Matthew Dillon

:Matthew Dillon <[EMAIL PROTECTED]> writes:
:> Ok, then there is a real good chance localhost mounts will work now.
:
:I'm happy to hear that, since NFSv3 is significantly faster than NFSv2
:on loopback mounts :)
:
:> I'm running a buildworld test right now with /usr/src and /usr/obj both
:> on NFSv3 localhost mounts.
:
:Yeah, I was doing installworlds with /usr, /usr/src and /usr/obj
:NFS-mounted (in a chroot tree on the server, because I got tired of
:doing it over PLIP).
:
:DES
:-- 
:Dag-Erling Smorgrav - [EMAIL PROTECTED]

My buildworld finished... it worked!

Now on to the NFSv2 fhlen patch testing.  I haven't run v2 in several
months, hopefully it still works :-)

Filesystem1K-blocks UsedAvail Capacity  Mounted on
/dev/da0s1a   6350349194 922984%/
/dev/da0e 63503 65945182911%/var
/dev/da0f 63503758416 0%/var/tmp
/dev/da0g762223   409496   29175058%/usr
/dev/da1e   1937983   533730  124921530%/usr/ports
procfs440   100%/proc
209.157.86.2:/FreeBSD   5541549  1666874  343135233%/FreeBSD
mfs:250   48415144541 0%/usr/src/sys/compile
/dev/da0h   2338236  1026582  112459648%/mnt
localhost:/mnt  2338236  1026582  112459648%/usr/obj
localhost:/mnt/fbsd42338236  1026582  112459648%/usr/src

-Matt
Matthew Dillon 
<[EMAIL PROTECTED]>

Client Info:
Rpc Counts:
  Getattr   SetattrLookup  Readlink  Read WriteCreateRemove
0 11072   1225413   875112634291389 28334  4476
   Rename  Link   Symlink Mkdir Rmdir   Readdir  RdirPlusAccess
1017151  1315  1976   181  9607 0684339
MknodFsstatFsinfo  PathConfCommitGLeaseVacate Evict
0 40637 4 0 34030 0 0 0
Rpc Info:
 TimedOut   Invalid X Replies   Retries  Requests
0 0  2762  9845   2456504
Cache Info:
Attr HitsMisses Lkup HitsMisses BioR HitsMisses BioW HitsMisses
 13741790633709  10186640   1223043   2103674112555526820291389
BioRLHitsMisses BioD HitsMisses DirE HitsMisses
23340   875 64231  9607 24430 0

Server Info:
  Getattr   SetattrLookup  Readlink  Read WriteCreateRemove
0 11072   1184725   873 65872292432 28334  4476
   Rename  Link   Symlink Mkdir Rmdir   Readdir  RdirPlusAccess
1017151  1315  1976   181  5437 0618927
MknodFsstatFsinfo  PathConfCommitGLeaseVacate Evict
0 36461 3 0 34093 0 0 0
Server Ret-Failed
  1080044
Server Faults
0
Server Cache Stats:
   Inprog  Idem  Non-idemMisses
 6973   697   784   2295706
Server Lease Stats:
   Leases PeakL   GLeases
0 0 0
Server Write Gathering:
 WriteOps  WriteRPC   Opsaved
   292432292432 0



To Unsubscribe: send mail to [EMAIL PROTECTED]
with "unsubscribe freebsd-hackers" in the body of the message



Re: readdirplus is very cool, any other nfs client suggestions?

1999-08-02 Thread Doug

On 2 Aug 1999, Dag-Erling Smorgrav wrote:

> Alfred Perlstein <[EMAIL PROTECTED]> writes:
> > DES: can you elaborate?  you think it may cause problems with amd
> > since it's like an NFS buffer isn't it and would work over the 
> > loopback...
> 
> I used loopback mounts to test NFS make worlds a while ago

Hrrmmm... I'm not sure where the concern about loopback stuff
comes from. Does amd use the loopback interface to communicate with
anything? 

Thanks,

Doug
-- 
On account of being a democracy and run by the people, we are the only
nation in the world that has to keep a government four years, no matter
what it does.
-- Will Rogers



To Unsubscribe: send mail to [EMAIL PROTECTED]
with "unsubscribe freebsd-hackers" in the body of the message



Re: readdirplus is very cool, any other nfs client suggestions?

1999-08-02 Thread Matthew Dillon

:Now on to the NFSv2 fhlen patch testing.  I haven't run v2 in several
:months, hopefully it still works :-)

My buildworld using the NFSv2 file handle length patch succeeded as
well.

I've included the patch again for reference.  (Note:  I didn't write
this patch, refer back to the thread for that info).

-Matt

Index: nfsm_subs.h
===
RCS file: /home/ncvs/src/sys/nfs/nfsm_subs.h,v
retrieving revision 1.24
diff -u -r1.24 nfsm_subs.h
--- nfsm_subs.h 1999/06/23 04:44:14 1.24
+++ nfsm_subs.h 1999/08/02 17:22:38
@@ -419,24 +419,25 @@
} }
 
 #define nfsm_srvmtofh(f) \
-   { int fhlen = NFSX_V3FH; \
+   do { \
+   int fhlen; \
if (nfsd->nd_flag & ND_NFSV3) { \
nfsm_dissect(tl, u_int32_t *, NFSX_UNSIGNED); \
fhlen = fxdr_unsigned(int, *tl); \
-   if (fhlen == 0) { \
-   bzero((caddr_t)(f), NFSX_V3FH); \
-   } else if (fhlen != NFSX_V3FH) { \
+   if (fhlen != 0 && fhlen != NFSX_V3FH) { \
error = EBADRPC; \
nfsm_reply(0); \
} \
+   } else { \
+   fhlen = NFSX_V2FH; \
} \
if (fhlen != 0) { \
-   nfsm_dissect(tl, u_int32_t *, NFSX_V3FH); \
-   bcopy((caddr_t)tl, (caddr_t)(f), NFSX_V3FH); \
-   if ((nfsd->nd_flag & ND_NFSV3) == 0) \
-   nfsm_adv(NFSX_V2FH - NFSX_V3FH); \
+   nfsm_dissect(tl, u_int32_t *, fhlen); \
+   bcopy((caddr_t)tl, (caddr_t)(f), fhlen); \
+   } else { \
+   bzero((caddr_t)(f), NFSX_V3FH); /* XXX why not do a EBADRPC? 
+*/ \
} \
-   }
+   } while (0)
 
 #definenfsm_clget \
if (bp >= be) { \


To Unsubscribe: send mail to [EMAIL PROTECTED]
with "unsubscribe freebsd-hackers" in the body of the message



Re: readdirplus is very cool, any other nfs client suggestions?

1999-08-02 Thread Alfred Perlstein

On Mon, 2 Aug 1999, Matthew Dillon wrote:

> :Now on to the NFSv2 fhlen patch testing.  I haven't run v2 in several
> :months, hopefully it still works :-)
> 
> My buildworld using the NFSv2 file handle length patch succeeded as
> well.
> 
> I've included the patch again for reference.  (Note:  I didn't write
> this patch, refer back to the thread for that info).
> 
>   -Matt

any percievable performance gain? I doubt it...

-Alfred Perlstein - [[EMAIL PROTECTED]|[EMAIL PROTECTED]] 
systems administrator and programmer
Wintelcom - http://www.wintelcom.net/



To Unsubscribe: send mail to [EMAIL PROTECTED]
with "unsubscribe freebsd-hackers" in the body of the message



Re: readdirplus is very cool, any other nfs client suggestions?

1999-08-02 Thread Matthew Dillon


:> My buildworld using the NFSv2 file handle length patch succeeded as
:> well.
:> 
:> I've included the patch again for reference.  (Note:  I didn't write
:> this patch, refer back to the thread for that info).
:> 
:>  -Matt
:
:any percievable performance gain? I doubt it...
:
:-Alfred Perlstein - [[EMAIL PROTECTED]|[EMAIL PROTECTED]] 

I didn't measure the performance.  I doubt it.

-Matt
Matthew Dillon 
<[EMAIL PROTECTED]>


To Unsubscribe: send mail to [EMAIL PROTECTED]
with "unsubscribe freebsd-hackers" in the body of the message



Re: readdirplus is very cool, any other nfs client suggestions?

1999-07-30 Thread Alfred Perlstein
On Fri, 30 Jul 1999, Doug wrote:

>   Spent quite a bit of time today playing around with the newly
> repaired readdirplus option for nfs clients in -current. My thanks to Matt
> Dillon and Bill Paul. For those that don't remember, I'm trying to use
> amd/nfs client stuff on some freebsd web servers that read their data from
> our sun (and now sun + netapp) web farm. I have a script that used to lock
> up amd and/or nfs and/or the whole machine pretty regularly. I've run it
> about 100 times today in various conditions with no ill effects. About
> this I am quite pleased. :)

...

> amd.Interfaces:
> 
> /defaults   type:=nfs;opts:=rw,vers=3,readdirplus,intr,proto=udp
> 
> *   rhost:=IP${key};rfs:=/Space/${key}

Not to rain on your parade, but Dag-Erling informed me that there
was problems using NFSv3 over the loopback interface that can cause
lockups.

DES: can you elaborate?  you think it may cause problems with amd
since it's like an NFS buffer isn't it and would work over the 
loopback...

-Alfred



To Unsubscribe: send mail to majord...@freebsd.org
with "unsubscribe freebsd-hackers" in the body of the message



Re: readdirplus is very cool, any other nfs client suggestions?

1999-07-30 Thread Matthew Dillon
:   Spent quite a bit of time today playing around with the newly
:repaired readdirplus option for nfs clients in -current. My thanks to Matt
:Dillon and Bill Paul. For those that don't remember, I'm trying to use
:amd/nfs client stuff on some freebsd web servers that read their data from
:our sun (and now sun + netapp) web farm. I have a script that used to lock
:up amd and/or nfs and/or the whole machine pretty regularly. I've run it
:about 100 times today in various conditions with no ill effects. About
:this I am quite pleased. :)
:
:   Since I'm new to nfs, and wasn't aware of the readdirplus option,
:it dawns on me that there might be other cool things I'm not using that
:also might be a benefit. I'm using amd for now, although this might be
:replaced with plain old hard mounts at some time in the near future. The
:following options I've cobbled together from advice on the lists, my
:reading of the man pages and other documentation, and a lot of
:experimentation. Any comments or suggestions for improvements would be
:welcome. 
:
:Thanks,
:
:Doug

The only other major feature is the nq leasing stuff for cache coherency,
but it is highly experimental and you probably shouldn't use it.  Plus
very few other OS's support it.

There is a lot of tweaking you can do with 'normal' nfs options,
such as tuning the read & write block size, adjusting cache timeouts
for various parameters, and so forth.

man mount_nfs and look at the various -o options available.

-Matt
Matthew Dillon 



To Unsubscribe: send mail to majord...@freebsd.org
with "unsubscribe freebsd-hackers" in the body of the message



Re: readdirplus is very cool, any other nfs client suggestions?

1999-07-30 Thread Matthew Dillon
:
:> amd.Interfaces:
:> 
:> /defaults   type:=nfs;opts:=rw,vers=3,readdirplus,intr,proto=udp
:> 
:> *   rhost:=IP${key};rfs:=/Space/${key}
:
:Not to rain on your parade, but Dag-Erling informed me that there
:was problems using NFSv3 over the loopback interface that can cause
:lockups.
:
:DES: can you elaborate?  you think it may cause problems with amd
:since it's like an NFS buffer isn't it and would work over the 
:loopback...
:
:-Alfred

If there are easily reproducable problems with the kernel nfs client
or server, please report them to me and we can almost certainly get
them fixed.Problems related to amd are harder - it's really up to
the author to fix those if it turns out to be a bug in amd rather then
the kernel.  So far, though, most of the recent bugs have been on
the kernel side.

-Matt
Matthew Dillon 



To Unsubscribe: send mail to majord...@freebsd.org
with "unsubscribe freebsd-hackers" in the body of the message



Re: readdirplus is very cool, any other nfs client suggestions?

1999-07-30 Thread Doug
On Fri, 30 Jul 1999, Matthew Dillon wrote:

> The only other major feature is the nq leasing stuff for cache coherency,
> but it is highly experimental and you probably shouldn't use it.  Plus
> very few other OS's support it.

heh... I'm just happy when the stuff works that's supposed to
work. I really don't want to push my luck.

> There is a lot of tweaking you can do with 'normal' nfs options,
> such as tuning the read & write block size, adjusting cache timeouts
> for various parameters, and so forth.
> 
> man mount_nfs and look at the various -o options available.

Yeah, I've been reading the various man pages and things for quite
a while now and it's starting to synch in. Do you have any suggestions for
additional reading? The O'Reilly book seems a bit out of date, but I'll
try it if folks say it's good. Basically my problem is that there are so
MANY options, and my knowledged about potential side effects is very
limited. 

Thanks for your response,

Doug
-- 
On account of being a democracy and run by the people, we are the only
nation in the world that has to keep a government four years, no matter
what it does.
-- Will Rogers



To Unsubscribe: send mail to majord...@freebsd.org
with "unsubscribe freebsd-hackers" in the body of the message



Re: readdirplus is very cool, any other nfs client suggestions?

1999-08-02 Thread Dag-Erling Smorgrav
Alfred Perlstein  writes:
> DES: can you elaborate?  you think it may cause problems with amd
> since it's like an NFS buffer isn't it and would work over the 
> loopback...

I used loopback mounts to test NFS make worlds a while ago (there were
places where make world would bomb because chflags doesn't work on
NFS) and experienced deadlock problems. Somebody (I don't remember who
exactly) told me that this was a known problem with the NFSv3 code;
reading over loopback mounts works fine, but writing apparently
results in deadlocks. Search the archives; the commit logs should give
you an idea of when this was (check the logs for Makefiles that use
chflags).

r...@des ~# current -l -F Makefile chflags 
src/Makefile.inc1
src/lib/libc/sys/Makefile.inc
src/lib/libc_r/Makefile
src/release/Makefile
src/sys/alpha/conf/Makefile.alpha
src/sys/i386/conf/Makefile.i386
src/sys/pc98/conf/Makefile.pc98
src/usr.bin/Makefile
src/usr.bin/chflags/Makefile
src/usr.bin/chpass/Makefile
src/usr.bin/passwd/Makefile

DES
-- 
Dag-Erling Smorgrav - d...@yes.no


To Unsubscribe: send mail to majord...@freebsd.org
with "unsubscribe freebsd-hackers" in the body of the message



Re: readdirplus is very cool, any other nfs client suggestions?

1999-08-02 Thread Matthew Dillon

:Alfred Perlstein  writes:
:> DES: can you elaborate?  you think it may cause problems with amd
:> since it's like an NFS buffer isn't it and would work over the 
:> loopback...
:
:I used loopback mounts to test NFS make worlds a while ago (there were
:places where make world would bomb because chflags doesn't work on
:NFS) and experienced deadlock problems. Somebody (I don't remember who
:exactly) told me that this was a known problem with the NFSv3 code;
:reading over loopback mounts works fine, but writing apparently
:results in deadlocks. Search the archives; the commit logs should give
:you an idea of when this was (check the logs for Makefiles that use
:chflags).
:
:r...@des ~# current -l -F Makefile chflags 
:src/Makefile.inc1
:src/lib/libc/sys/Makefile.inc
:src/lib/libc_r/Makefile
:src/release/Makefile
:src/sys/alpha/conf/Makefile.alpha
:src/sys/i386/conf/Makefile.i386
:src/sys/pc98/conf/Makefile.pc98
:src/usr.bin/Makefile
:src/usr.bin/chflags/Makefile
:src/usr.bin/chpass/Makefile
:src/usr.bin/passwd/Makefile
:
:DES
:-- 
:Dag-Erling Smorgrav - d...@yes.no

The buildworld chflags problems were fixed around a month ago I think.
Since then there have been many NFS fixes committed.  I have not tested
running buildworld over a loopbacked NFS mount -- I'll do that today --
but I'd say there is a good chance that it will simply work.

-Matt
Matthew Dillon 



To Unsubscribe: send mail to majord...@freebsd.org
with "unsubscribe freebsd-hackers" in the body of the message



Re: readdirplus is very cool, any other nfs client suggestions?

1999-08-02 Thread Tim Vanderhoek
On Mon, Aug 02, 1999 at 09:25:52AM +0200, Dag-Erling Smorgrav wrote:
>(there were
> places where make world would bomb because chflags doesn't work on
[...]
>  (check the logs for Makefiles that use
> chflags).
[...]
> r...@des ~# current -l -F Makefile chflags 
> src/Makefile.inc1

Set INSTALLFLAGS_EDIT=:S/schg/,/ to remove these when doing a make
world, if needed.

[A make world actually works from usermode now with the right set of
options (one of which is -DNOGAMES)].


-- 
This is my .signature which gets appended to the end of my messages.


To Unsubscribe: send mail to majord...@freebsd.org
with "unsubscribe freebsd-hackers" in the body of the message



Re: readdirplus is very cool, any other nfs client suggestions?

1999-08-02 Thread Dag-Erling Smorgrav
Matthew Dillon  writes:
> The buildworld chflags problems were fixed around a month ago I think.

No, I fixed them in february or march.

DES
-- 
Dag-Erling Smorgrav - d...@yes.no


To Unsubscribe: send mail to majord...@freebsd.org
with "unsubscribe freebsd-hackers" in the body of the message



Re: readdirplus is very cool, any other nfs client suggestions?

1999-08-02 Thread Dag-Erling Smorgrav
Tim Vanderhoek  writes:
> Set INSTALLFLAGS_EDIT=:S/schg/,/ to remove these when doing a make
> world, if needed.

Please try to understand what the issue is before butting in.

DES
-- 
Dag-Erling Smorgrav - d...@yes.no


To Unsubscribe: send mail to majord...@freebsd.org
with "unsubscribe freebsd-hackers" in the body of the message



Re: readdirplus is very cool, any other nfs client suggestions?

1999-08-02 Thread Matthew Dillon

:Matthew Dillon  writes:
:> The buildworld chflags problems were fixed around a month ago I think.
:
:No, I fixed them in february or march.
:
:DES
:-- 
:Dag-Erling Smorgrav - d...@yes.no

Ok, then there is a real good chance localhost mounts will work now.

I'm running a buildworld test right now with /usr/src and /usr/obj both
on NFSv3 localhost mounts.

-Matt
Matthew Dillon 



To Unsubscribe: send mail to majord...@freebsd.org
with "unsubscribe freebsd-hackers" in the body of the message



Re: readdirplus is very cool, any other nfs client suggestions?

1999-08-02 Thread Dag-Erling Smorgrav
Matthew Dillon  writes:
> Ok, then there is a real good chance localhost mounts will work now.

I'm happy to hear that, since NFSv3 is significantly faster than NFSv2
on loopback mounts :)

> I'm running a buildworld test right now with /usr/src and /usr/obj both
> on NFSv3 localhost mounts.

Yeah, I was doing installworlds with /usr, /usr/src and /usr/obj
NFS-mounted (in a chroot tree on the server, because I got tired of
doing it over PLIP).

DES
-- 
Dag-Erling Smorgrav - d...@yes.no


To Unsubscribe: send mail to majord...@freebsd.org
with "unsubscribe freebsd-hackers" in the body of the message



Re: readdirplus is very cool, any other nfs client suggestions?

1999-08-02 Thread Matthew Dillon
:Matthew Dillon  writes:
:> Ok, then there is a real good chance localhost mounts will work now.
:
:I'm happy to hear that, since NFSv3 is significantly faster than NFSv2
:on loopback mounts :)
:
:> I'm running a buildworld test right now with /usr/src and /usr/obj both
:> on NFSv3 localhost mounts.
:
:Yeah, I was doing installworlds with /usr, /usr/src and /usr/obj
:NFS-mounted (in a chroot tree on the server, because I got tired of
:doing it over PLIP).
:
:DES
:-- 
:Dag-Erling Smorgrav - d...@yes.no

My buildworld finished... it worked!

Now on to the NFSv2 fhlen patch testing.  I haven't run v2 in several
months, hopefully it still works :-)

Filesystem1K-blocks UsedAvail Capacity  Mounted on
/dev/da0s1a   6350349194 922984%/
/dev/da0e 63503 65945182911%/var
/dev/da0f 63503758416 0%/var/tmp
/dev/da0g762223   409496   29175058%/usr
/dev/da1e   1937983   533730  124921530%/usr/ports
procfs440   100%/proc
209.157.86.2:/FreeBSD   5541549  1666874  343135233%/FreeBSD
mfs:250   48415144541 0%/usr/src/sys/compile
/dev/da0h   2338236  1026582  112459648%/mnt
localhost:/mnt  2338236  1026582  112459648%/usr/obj
localhost:/mnt/fbsd42338236  1026582  112459648%/usr/src

-Matt
Matthew Dillon 


Client Info:
Rpc Counts:
  Getattr   SetattrLookup  Readlink  Read WriteCreateRemove
0 11072   1225413   875112634291389 28334  4476
   Rename  Link   Symlink Mkdir Rmdir   Readdir  RdirPlusAccess
1017151  1315  1976   181  9607 0684339
MknodFsstatFsinfo  PathConfCommitGLeaseVacate Evict
0 40637 4 0 34030 0 0 0
Rpc Info:
 TimedOut   Invalid X Replies   Retries  Requests
0 0  2762  9845   2456504
Cache Info:
Attr HitsMisses Lkup HitsMisses BioR HitsMisses BioW HitsMisses
 13741790633709  10186640   1223043   2103674112555526820291389
BioRLHitsMisses BioD HitsMisses DirE HitsMisses
23340   875 64231  9607 24430 0

Server Info:
  Getattr   SetattrLookup  Readlink  Read WriteCreateRemove
0 11072   1184725   873 65872292432 28334  4476
   Rename  Link   Symlink Mkdir Rmdir   Readdir  RdirPlusAccess
1017151  1315  1976   181  5437 0618927
MknodFsstatFsinfo  PathConfCommitGLeaseVacate Evict
0 36461 3 0 34093 0 0 0
Server Ret-Failed
  1080044
Server Faults
0
Server Cache Stats:
   Inprog  Idem  Non-idemMisses
 6973   697   784   2295706
Server Lease Stats:
   Leases PeakL   GLeases
0 0 0
Server Write Gathering:
 WriteOps  WriteRPC   Opsaved
   292432292432 0



To Unsubscribe: send mail to majord...@freebsd.org
with "unsubscribe freebsd-hackers" in the body of the message



Re: readdirplus is very cool, any other nfs client suggestions?

1999-08-02 Thread Doug
On 2 Aug 1999, Dag-Erling Smorgrav wrote:

> Alfred Perlstein  writes:
> > DES: can you elaborate?  you think it may cause problems with amd
> > since it's like an NFS buffer isn't it and would work over the 
> > loopback...
> 
> I used loopback mounts to test NFS make worlds a while ago

Hrrmmm... I'm not sure where the concern about loopback stuff
comes from. Does amd use the loopback interface to communicate with
anything? 

Thanks,

Doug
-- 
On account of being a democracy and run by the people, we are the only
nation in the world that has to keep a government four years, no matter
what it does.
-- Will Rogers



To Unsubscribe: send mail to majord...@freebsd.org
with "unsubscribe freebsd-hackers" in the body of the message



Re: readdirplus is very cool, any other nfs client suggestions?

1999-08-02 Thread Matthew Dillon
:Now on to the NFSv2 fhlen patch testing.  I haven't run v2 in several
:months, hopefully it still works :-)

My buildworld using the NFSv2 file handle length patch succeeded as
well.

I've included the patch again for reference.  (Note:  I didn't write
this patch, refer back to the thread for that info).

-Matt

Index: nfsm_subs.h
===
RCS file: /home/ncvs/src/sys/nfs/nfsm_subs.h,v
retrieving revision 1.24
diff -u -r1.24 nfsm_subs.h
--- nfsm_subs.h 1999/06/23 04:44:14 1.24
+++ nfsm_subs.h 1999/08/02 17:22:38
@@ -419,24 +419,25 @@
} }
 
 #define nfsm_srvmtofh(f) \
-   { int fhlen = NFSX_V3FH; \
+   do { \
+   int fhlen; \
if (nfsd->nd_flag & ND_NFSV3) { \
nfsm_dissect(tl, u_int32_t *, NFSX_UNSIGNED); \
fhlen = fxdr_unsigned(int, *tl); \
-   if (fhlen == 0) { \
-   bzero((caddr_t)(f), NFSX_V3FH); \
-   } else if (fhlen != NFSX_V3FH) { \
+   if (fhlen != 0 && fhlen != NFSX_V3FH) { \
error = EBADRPC; \
nfsm_reply(0); \
} \
+   } else { \
+   fhlen = NFSX_V2FH; \
} \
if (fhlen != 0) { \
-   nfsm_dissect(tl, u_int32_t *, NFSX_V3FH); \
-   bcopy((caddr_t)tl, (caddr_t)(f), NFSX_V3FH); \
-   if ((nfsd->nd_flag & ND_NFSV3) == 0) \
-   nfsm_adv(NFSX_V2FH - NFSX_V3FH); \
+   nfsm_dissect(tl, u_int32_t *, fhlen); \
+   bcopy((caddr_t)tl, (caddr_t)(f), fhlen); \
+   } else { \
+   bzero((caddr_t)(f), NFSX_V3FH); /* XXX why not do a 
EBADRPC? */ \
} \
-   }
+   } while (0)
 
 #definenfsm_clget \
if (bp >= be) { \


To Unsubscribe: send mail to majord...@freebsd.org
with "unsubscribe freebsd-hackers" in the body of the message



Re: readdirplus is very cool, any other nfs client suggestions?

1999-08-02 Thread Alfred Perlstein
On Mon, 2 Aug 1999, Matthew Dillon wrote:

> :Now on to the NFSv2 fhlen patch testing.  I haven't run v2 in several
> :months, hopefully it still works :-)
> 
> My buildworld using the NFSv2 file handle length patch succeeded as
> well.
> 
> I've included the patch again for reference.  (Note:  I didn't write
> this patch, refer back to the thread for that info).
> 
>   -Matt

any percievable performance gain? I doubt it...

-Alfred Perlstein - [bri...@rush.net|bri...@wintelcom.net] 
systems administrator and programmer
Wintelcom - http://www.wintelcom.net/



To Unsubscribe: send mail to majord...@freebsd.org
with "unsubscribe freebsd-hackers" in the body of the message



Re: readdirplus is very cool, any other nfs client suggestions?

1999-08-02 Thread Matthew Dillon

:> My buildworld using the NFSv2 file handle length patch succeeded as
:> well.
:> 
:> I've included the patch again for reference.  (Note:  I didn't write
:> this patch, refer back to the thread for that info).
:> 
:>  -Matt
:
:any percievable performance gain? I doubt it...
:
:-Alfred Perlstein - [bri...@rush.net|bri...@wintelcom.net] 

I didn't measure the performance.  I doubt it.

-Matt
Matthew Dillon 



To Unsubscribe: send mail to majord...@freebsd.org
with "unsubscribe freebsd-hackers" in the body of the message