Re: [OpenAFS] [SOLVED] Problem with start of fileserver and volserver
One of my KDC was down and this AFS despite of it's configuration in krb5.conf apparently tired to access this KDC. When KDC was restored fileserver magically started after bos start localhost fs and is working ok. In strace there was nothing about it, so this could just be a luck and AFS repaired itself automatically but I am writing about this, maybe someone will find it useful :) Michał Droździewicz pisze: Hello, I have a problem with my openafs server. After power outage fileserver and volserver (fs instance) does not start correctly. File server reports in the logfile that it is starting but nothing more. Volserver is quitting with code 1 because it can not connect to file server through port 2040 (I've straced this out). Stracing fileserver givs only this (see attached file), but I do not know what this could possibly be. Does anybody know how to turn debugging on for fileserver? Running it with -d 10 or any other number gives nothing more in the logfile. This AFS server is running debian sarge. This is one of the 20 server's I have and this is the first time I have this kind of a problem. Any help would be appreciated. -- xmpp/email: [EMAIL PROTECTED] xmpp/email: [EMAIL PROTECTED] ___ OpenAFS-info mailing list OpenAFS-info@openafs.org https://lists.openafs.org/mailman/listinfo/openafs-info
[OpenAFS] How to access files on the server without the client?
Hi, Is it possible to access volumes (files on volumes) without the client? I can log in onto the server as root. Server is not serving volumes (problem I've described erlier - fileserver and volserver are not starting properly) and I really need to copy these files onto another machine for this server to reinstall. Any help would be greatly appreciated. -- xmpp/email: [EMAIL PROTECTED] xmpp/email: [EMAIL PROTECTED] ___ OpenAFS-info mailing list OpenAFS-info@openafs.org https://lists.openafs.org/mailman/listinfo/openafs-info
Re: [OpenAFS] Problem with start of fileserver and volserver
Derrick Brashear pisze: What's in FileLog? To up the debugging, use "kill -TSTP" a few times (3 should be enough; 2, too little) After TSTP in the FileLog there is only this: Tue May 6 16:26:55 2008 File server starting Tue May 6 16:26:55 2008 afs_krb_get_lrealm failed, using ericpol.int. Tue May 6 16:27:11 2008 Set Debug On level = 1 Tue May 6 16:27:14 2008 [0] Set Debug On level = 5 Tue May 6 16:27:15 2008 [0] Set Debug On level = 25 Tue May 6 16:27:18 2008 [0] Set Debug On level = 125 the second line is present on few other systems, so this should not be a problem AFAIK. There is nothing more. -- xmpp/email: [EMAIL PROTECTED] xmpp/email: [EMAIL PROTECTED] ___ OpenAFS-info mailing list OpenAFS-info@openafs.org https://lists.openafs.org/mailman/listinfo/openafs-info
[OpenAFS] Problem with start of fileserver and volserver
Hello,
I have a problem with my openafs server. After power outage fileserver
and volserver (fs instance) does not start correctly.
File server reports in the logfile that it is starting but nothing more.
Volserver is quitting with code 1 because it can not connect to file
server through port 2040 (I've straced this out).
Stracing fileserver givs only this (see attached file), but I do not
know what this could possibly be.
Does anybody know how to turn debugging on for fileserver? Running it
with -d 10 or any other number gives nothing more in the logfile.
This AFS server is running debian sarge. This is one of the 20 server's
I have and this is the first time I have this kind of a problem. Any
help would be appreciated.
--
xmpp/email: [EMAIL PROTECTED]
xmpp/email: [EMAIL PROTECTED]
[pid 4151] <... recvmsg resumed> {msg_name(16)={sa_family=AF_INET,
sin_port=htons(7001), sin_addr=inet_addr("172.17.40.32")},
msg_iov(7)=[{"\201\346\215\206 5\373\4\0\0\0\1\0\0\0\0\0\0\0\30\2!\0"..., 28},
{"\0\0\0\0\0\0\0\1\0\0\0\0\0\0\0\26\7\0\1\1\1\0\0\4\354\0"..., 1416},
{"\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 1416},
{"\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 1416},
{"\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 1416},
{"\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 1416},
{"\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 1420}],
msg_controllen=0, msg_flags=0}, 0) = 65
[pid 4151] time(NULL) = 1210068110
[pid 4151] time(NULL) = 1210068110
[pid 4151] recvmsg(5, {msg_name(16)={sa_family=AF_INET, sin_port=htons(7001),
sin_addr=inet_addr("172.17.36.59")}, msg_iov(7)=[{"\244\226\212%
\2T\364\0\0\0\1\0\0\0\0\0\0\0\261\2#\0\0"..., 28},
{"\0\0\0\0\0\0\0\1\0\0\0\0\0\0\0\0\6\0.gz\0\0\26<\0\0\5\244"..., 1416},
{"\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 1416},
{"\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 1416},
{"\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 1416},
{"\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 1416},
{"\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 1420}],
msg_controllen=0, msg_flags=0}, 0) = 65
[pid 4151] sendmsg(5, {msg_name(16)={sa_family=AF_INET, sin_port=htons(7001),
sin_addr=inet_addr("172.17.36.59")}, msg_iov(2)=[{"\244\226\212%
\2T\364\0\0\0\1\0\0\0\0\0\0\0\30\2 \0\0\0"..., 28},
{"\0\0\0\0\0\0\0\1\0\0\0\1\0\0\0\261\7\1\1\0\0\0\0\0\26<"..., 38}],
msg_controllen=0, msg_flags=0}, 0) = 66
[pid 4151] time(NULL) = 1210068110
[pid 4151] time(NULL) = 1210068110
[pid 4151] recvmsg(5, {msg_name(16)={sa_family=AF_INET, sin_port=htons(7003),
sin_addr=inet_addr("172.22.0.195")},
msg_iov(7)=[{"\234\246\243\350\335\244!D\0\0\0\1\0\0\0\0\0\0\0\6\2\""..., 28},
{"\0\0\0\0\0\0\0\1\0\0\0\1\0\0\0\0\6\1\1\3\0\0\0\0\26<\0"..., 1416},
{"\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 1416},
{"\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 1416},
{"\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 1416},
{"\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 1416},
{"\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 1420}],
msg_controllen=0, msg_flags=0}, 0) = 66
[pid 4151] sendmsg(5, {msg_name(16)={sa_family=AF_INET, sin_port=htons(7003),
sin_addr=inet_addr("172.22.0.195")},
msg_iov(2)=[{"\234\246\243\350\335\244!D\0\0\0\1\0\0\0\0\0\0\0\7\2!\0"..., 28},
{"\0\0\0\0\0\0\0\1\0\0\0\0\0\0\0\6\7\0\1\0\0\0\0\26<\0\0"..., 37}],
msg_controllen=0, msg_flags=0}, 0) = 65
[pid 4151] time(NULL) = 1210068110
[pid 4151] gettimeofday({1210068110, 685443}, NULL) = 0
[pid 4151] time(NULL) = 1210068110
[pid 4151] recvmsg(5, {msg_name(16)={sa_family=AF_INET, sin_port=htons(7001),
sin_addr=inet_addr("172.17.38.123")}, msg_iov(7)=[{"\204\250\260K
_\357,\0\0\0\1\0\0\0\0\0\0\0\265\2#\0\0\0"..., 28},
{"\0\0\0\0\0\0\0\1\0\0\0\0\0\0\0\0\6\0\4\1H\0\0\26<\0\0\5"..., 1416},
{"\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 1416},
{"\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 1416},
{"\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 1416},
{"\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 1416},
{"\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 1420}],
msg_controllen=0, msg_flags=0}, 0) = 65
[pid 4151] sendmsg(5, {msg_name(16)={sa_family=AF_INET, sin_port=htons(7001),
sin_addr=inet_addr("172.17.38.123")}, msg_iov(2)=[{"\204\250\260K
_\357,\0\0\0\1\0\0\0\0\0\0\0\30\2 \0\0\0"..., 28},
{"\0\0\0\0\0\0\0\1\0\0\0\1\0\0\0\265\7\1\1\0\0\0\0\0\26<"..., 38}],
msg_controllen=0, msg_flags=0}, 0) = 66
[pid 4151] time(NULL) = 1210068110
[pid 4151] time(NULL) = 1210068110
[pid 4151] recvmsg(5, {msg_name(16)={sa_family=AF_INET, sin_port=htons(7003),
sin_addr=inet_addr("172.22.0.195")},
msg_iov(7
Re: [OpenAFS] Speed difference between OpenAFS 1.4.x on Debian and CentOS
Jeffrey Altman pisze: Is AFS_CRYPT really that needed that debian is turning this _ON_ by default? One of the benefits that AFS provides over other file systems is privacy. For that you need crypt to be on. The Windows client defaults to use of encrypted sessions as well. Ok, but if I'll turn it of, files on the server still will be "encrypted" (scattered on the /vicep* partitions) and can't be accessed without proper login? Only files trensferred from the server to the client will be possible to read? -- xmpp/email: [EMAIL PROTECTED] xmpp/email: [EMAIL PROTECTED] ___ OpenAFS-info mailing list OpenAFS-info@openafs.org https://lists.openafs.org/mailman/listinfo/openafs-info
Re: [OpenAFS] Speed difference between OpenAFS 1.4.x on Debian and CentOS
S.J.Chun pisze: For debian, /etc/openafs/afs.conf.client in case you installed with package. There you can find AFS_CRYPT and which should be false to make crypt off With crypt disabled I get major speedup (25-31MiB/s) and this is very similiar to the CentOS results. So this mistery is revealed ;) AFS_CRYPT is the culprit. Is AFS_CRYPT really that needed that debian is turning this _ON_ by default? -- xmpp/email: [EMAIL PROTECTED] xmpp/email: [EMAIL PROTECTED] ___ OpenAFS-info mailing list OpenAFS-info@openafs.org https://lists.openafs.org/mailman/listinfo/openafs-info
Re: [OpenAFS] Re: Re: [OpenAFS] Speed difference between OpenAFS 1.4.x on Debian and CentOS
S.J.Chun pisze: For debian, /etc/openafs/afs.conf.client in case you installed with package. There you can find AFS_CRYPT and which should be false to make crypt off On CentOS only options for AFS Client (located in /etc/sysconfig/openafs) are: AFSD_ARGS="-afsdb -fakestat" On Debian in /etc/openafs/afs.conf.client there is AFS_CRYPT set to true. So maybe this is the solution to the speed difference. I do not know however how to turn this on on CentOS. Any ideas? -- xmpp/email: [EMAIL PROTECTED] xmpp/email: [EMAIL PROTECTED] ___ OpenAFS-info mailing list OpenAFS-info@openafs.org https://lists.openafs.org/mailman/listinfo/openafs-info
Re: [OpenAFS] Speed difference between OpenAFS 1.4.x on Debian and CentOS
S.J.Chun pisze: Are you sure on disabling crypt at debian side? For me, it seems that you turned off crypt at centos(which is turned off by default), and debian, you did not(which might be turned on by default?) Crypt in server settings or in client settings? Where can I check this setting? I install and configure server the same on both machines although I do not change defaults embedded into the system. Client installation also have the same config settings for both systems. -- xmpp/email: [EMAIL PROTECTED] xmpp/email: [EMAIL PROTECTED] ___ OpenAFS-info mailing list OpenAFS-info@openafs.org https://lists.openafs.org/mailman/listinfo/openafs-info
Re: [OpenAFS] Speed difference between OpenAFS 1.4.x on Debian and CentOS
Derrick Brashear, dnia 2008-04-07 18:13 napisal: Well, all that's left is compiling CentOS' kernel on Debian; If you're willing it's certainly a valuable data point. I'll try to test it tomorrow and will submit some new data. -- Mike D ___ OpenAFS-info mailing list OpenAFS-info@openafs.org https://lists.openafs.org/mailman/listinfo/openafs-info
Re: [OpenAFS] Speed difference between OpenAFS 1.4.x on Debian and CentOS
Derrick Brashear, dnia 2008-04-07 17:40 napisal: The same in both configs. Well, the kernel config options certainly aren't if you're using CentOS's kernel in one case and Debian's in another. :�§ I've compiled debian kernel package using kernel config from CentOS but this was no help at all. AFS client configs were the same. -- Mike D ___ OpenAFS-info mailing list OpenAFS-info@openafs.org https://lists.openafs.org/mailman/listinfo/openafs-info
Re: [OpenAFS] Speed difference between OpenAFS 1.4.x on Debian and CentOS
Derrick Brashear, dnia 2008-04-07 17:04 napisal: and I've compiled from source with no options for ./configure except from --prefix In both cases the result was the same - slow speed around 8-12MiB (copying from local disk to AFS structure) Parameters you gave to afsd, in both (CentOS and Debian) cases? If that doesn't tell us, next thing is to look at kernel config options. The same in both configs. -- Mike D ___ OpenAFS-info mailing list OpenAFS-info@openafs.org https://lists.openafs.org/mailman/listinfo/openafs-info
Re: [OpenAFS] Speed difference between OpenAFS 1.4.x on Debian and CentOS
Hartmut Reuter, dnia 2008-04-07 16:59 napisal: Are you sure your network interface is used in GBit/s mode with Debian and not just 100MBit-mode? 1) Iface is in 1000Mib mode 2) copying files from local disk to AFS structure (iface is omitted in this test) was slow, not the network copying -- Mike D ___ OpenAFS-info mailing list OpenAFS-info@openafs.org https://lists.openafs.org/mailman/listinfo/openafs-info
Re: [OpenAFS] Speed difference between OpenAFS 1.4.x on Debian and CentOS
Derrick Brashear pisze: Not what I expected. When you self-compiled 1.4.6 on Debian, I assume you downloaded a tarfile from OpenAFS and did ./configure; make, yes? What options, if any, to configure? I've build a debian package using default debian options (1.4.6) and I've compiled from source with no options for ./configure except from --prefix In both cases the result was the same - slow speed around 8-12MiB (copying from local disk to AFS structure) -- xmpp/email: [EMAIL PROTECTED] xmpp/email: [EMAIL PROTECTED] ___ OpenAFS-info mailing list OpenAFS-info@openafs.org https://lists.openafs.org/mailman/listinfo/openafs-info
Re: [OpenAFS] Speed difference between OpenAFS 1.4.x on Debian and CentOS
Derrick Brashear pisze: I care about kernel, not OS. What kernel version on those machines? Default distribution kernel: on Debian: 2.6.18-6-686 i686 on CentOS: 2.6.18-53.1.14.el5 i686 -- xmpp/email: [EMAIL PROTECTED] xmpp/email: [EMAIL PROTECTED] ___ OpenAFS-info mailing list OpenAFS-info@openafs.org https://lists.openafs.org/mailman/listinfo/openafs-info
Re: [OpenAFS] Speed difference between OpenAFS 1.4.x on Debian and CentOS
For starters: I'm replying to the list - maybe somebody would be interested. Sergio Gelato, dnia 2008-04-06 21:20 napisal: * Michał Droździewicz [2008-04-06 10:07:18 +0200]: First I've tried to install OpenAFS with Debian 4.0 (etch) on 3 different machines (beginning from old Celeron, through Pentium 4 and at the end on Xeon 3GHz). Speed was pretty much the same when coping files from local disk to AFS (transfer without the network). It was about 8 to 9 MiB/s and it didn't depend on machine RAM memory nor processor power). Tuning the afs client haven't helped at all (speed was rather dropping than going up). Local disk to AFS isn't a very interesting use case for most people since AFS fileservers tend to be dedicated machines. Some people don't even install an AFS client on their fileservers. Besides, if there is a bottleneck it would be nice to know whether it's on the server or on the client side, and for that the tests over a Gigabit network are probably best. Then you could even test a Debian server with a CentOS client and vice-versa. Local disk to AFS is interesting for me as a benchmark and as a restoring client data from back up, because when machine fails you have to pump it up to the AFS structure somehow, over a network or from a local disk (in both cases using AFS client). Doing a backup also requires local reading. Unless there is better way of doing/restoring incremental backups. Bottleneck is on the server side (as far as I've tested it). When testing server (both on Debian and on CentOS) besides of the local AFS client there were one Ubuntu client and two Fedora 7 clients. Every client had small disk cache and I was testing write using large file (10 GiB) with mc (not very sophisticated, but the same in every try). Using Debian as operating system, local AFS client was transferring data @ max speed of 20MiB when alone. When other client connected, transfer rate was divided equally between two clients. When network client was transferring data, on 100Mib network it was 7MiB and on 1000Mib network it was 12-15MiB @ max. Using Centos local AFS client transfer speed was 38-40MiB, but when I've connected three clients (one Ubuntu and 2 Fedora 7) on the 100Mib network they divided bandwidth quite equally, but local AFS client transfer speed wasn't affected. Top speed for disk write was 120MiB (two SATA disks in software RAID 0) in both cases - Debian and CentOS. Lets say that the performance was like 250% better with 1.4.6 on CentOS 5 than with 1.4.2 on Debian 4.0. I've even compiled 1.4.6 and 1.5.34 on Debian 4.0 but performance was the same. I'd move to 1.4.6 on etch in any case. I like to have software installed from packages, so first I have to build 1.4.6 for etch and then install it ;) -- Mike D ___ OpenAFS-info mailing list OpenAFS-info@openafs.org https://lists.openafs.org/mailman/listinfo/openafs-info
[OpenAFS] Speed difference between OpenAFS 1.4.x on Debian and CentOS
Hello all, Recently I've spent some time testing speed of OpenAFS server installation on different machines and operating systems. First I've tried to install OpenAFS with Debian 4.0 (etch) on 3 different machines (beginning from old Celeron, through Pentium 4 and at the end on Xeon 3GHz). Speed was pretty much the same when coping files from local disk to AFS (transfer without the network). It was about 8 to 9 MiB/s and it didn't depend on machine RAM memory nor processor power). Tuning the afs client haven't helped at all (speed was rather dropping than going up). Second I've taken the strongest computer (with Xeon and 4GiB of RAM) and installed on it CentOS 5 and OpenAFS 1.4.6 using RPM-s from openafs.org. And what was my surprise, when transfer from local disk to afs structure was like 35-50MiB/s. Over a 100Mib network it was 12MiB/s and over a 1000Mib network it was around 25MiB/s. Lets say that the performance was like 250% better with 1.4.6 on CentOS 5 than with 1.4.2 on Debian 4.0. I've even compiled 1.4.6 and 1.5.34 on Debian 4.0 but performance was the same. Could somebody please explain to me how this is even possible and what to do to get the same speed on Debian that I've got on CentOS. Because in our company we prefer to use Debian (company policy) and mixing in new linux distribution isn't the greatest idea ever. Thanks in advance. -- Mike D. ___ OpenAFS-info mailing list OpenAFS-info@openafs.org https://lists.openafs.org/mailman/listinfo/openafs-info
