Re: gmirror with hot spare
On Tue, April 25, 2006 9:19 am, Vladimir Terziev said: Hi hackers, is there a way to assign a hot spare disk/partition to a gmirror -ed disks/partitions ? That's a good question. From the man pages there doesn't seem to exist anything to mark a insert disk as disabled. Atacontrol has a addspare option. Just in case, to replace a faulty (SCSI) disk: gmirror remove gm0 da1 camcontrol stop da1 camcontrol rescan all camcontrol rescan all (after inserting replacement) gmirror insert gm0 da1 The same procedure in atacontrol would be similar to: atacontrol detach 3 atacontrol attach 3 atacontrol addspare ar0 ad6 atacontrol rebuild ar0 Good luck, -- Giovanni P. Tirloni http://www.tirloni.org ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Filesystem monitoring question
Cornelis Swanepoel wrote: I have a FreeBSD 6.0 box with a partition that is accessible to a number of clients via SMB and NFS. I would like to monitor activity on this partition so that every time a write to it is completed, my C program is run (which stats the file and stores some info about it in a database amongst other things) My question is: What do I need to learn in order to construct a trigger for my code? If anyone can point me in the right direction I would greatly appreciate it. Using kqueue you can monitor a file/directory for changes and have it trigger something when that event happens. But you want to monitor you whole partition.. perhaps intercept some syscalls ? -- Giovanni P. Tirloni http://blog.tirloni.org ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: system password's file
Baldur Gislason wrote: This will not work, but I did migrate a 100 users from Linux to FreeBSD a couple of years ago. What I did was I used an application that comes with john the ripper called deshadow or something like that to combine the shadow and the passwd files into a passwd file with the hashes in place. Then I wrote a perl script to convert the linux passwd file into a BSD compatible passwd file, and then just appended it to my master.passwd and rebuilt the database by using vipw. I'm sure there are applications to do this. It's funny but I migrated ~100 users too last month from Slackware 10 to FreeBSD 5.4 and I had no problem with the password hash. I created a small script to extract fields from shadow/passwd and re-added those users using pw and the -H option to supply their encrypted password. It seems to have worked fine and this whole thread just got me by surprise with the feeling that I completely forgot about password differences between Linux and FreeBSD at the time. I'm glad everything worked! -- Giovanni P. Tirloni ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to [EMAIL PROTECTED]
[Fwd: pthread_create: cannot allocate memory]
Perhaps this is more apropriate here..
To clarify it a bit, both server and client are being run from the same
machine connecting to localhost. If the source code is needed I can send
it here but it's a simple while(1) { accept() pthread_create() } on
the server side and for() connect() on the client.
What I'm trying to simulate is the behavior of a IRC server that has
thousands of persistent connections, but with threads.
Original Message
Subject: pthread_create: cannot allocate memory
Date: Thu, 18 Aug 2005 13:29:33 -0300
From: Giovanni P. Tirloni [EMAIL PROTECTED]
To: [EMAIL PROTECTED]
Hi,
I coded a small echo server that creates a thread for every connection
it accepts. It works fine and then I decided to test how many threads it
could handle so I coded a stress.c client program that'd just create as
many connections as I asked without exchanging any data.
First I discovered the kern.threads.max_thread_per_proc limit that was
limiting it to 1500 threads. So I raised it and the max_group_per_proc
to 10k.
I also increased the NMBCLUSTERS limit to 65535 just in case.
What I've seen is that the server stops at 2400-2410 threads when I
ask strees.c to create 8k connections. top shows I still have 150MB of
free memory.
Where should I look to raise this limit ? This is a CeleronM 1.3GHz
and 512MB of RAM.
Another behavior was that it creates 130 threads at once, waits, then
another 130 more. It varies 1-10 threads sometimes but usually this
inverval is constant. I think it might have something to do with the TCP
code doing some normal limitation but I've look at it.
Thanks,
--
Giovanni P. Tirloni / [EMAIL PROTECTED]
___
freebsd-hackers@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-hackers
To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Odd ataraid situation
Vasil Dimov wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 But I'd like to ask if it'd theoretically be possible to create the RAID1 array (ar0) with only one disk and add the second one later? It'd work like a broken array for some time. It's just an idea :) Find some unused disk, plug it into the machine, build the array, see that FreeBSD is happy with ar0, then unplug that disk and you are ready. It's not what you asked for, but it is one possible solution for your issue. If I use a 40GB disk with the 120GB one it creates a 40GB array. It seems correct but doesn't help. I thought about hacking ataraid somehow so it does the opossite but it seems ugly. -- Giovanni P. Tirloni / [EMAIL PROTECTED] / PGP: 0xD0315C26 ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to [EMAIL PROTECTED]
RE: Odd ataraid situation
Gayn Winters disse: Gmirror (geom) will do it in anticipation of the second disk. In fact, it is the recommended way to bootstrap a software mirror. Just do the first couple steps of: http://dannyman.toldme.com/2005/01/24/freebsd-howto-gmirror-system/ Alternatively, do the first few steps of: http://people.freebsd.org/~rse/mirror/ That worked, thank you and everybody that took the time to read this thread. -- Giovanni P. Tirloni ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to [EMAIL PROTECTED]
Odd ataraid situation
Hi, I've to start working on a new server right now that should use ataraid for RAID mirroring but the customer shipped a box with only one disk and the second one won't arrive soon for many reasons. I know ataraid can't build a RAID mirror without two disks and I've already checked both atacontrol.c and ata-raid.c. It's clear it needs two disks and I'm no guru to do anything about it right now since the disk would arrive before I had done any coding. But I'd like to ask if it'd theoretically be possible to create the RAID1 array (ar0) with only one disk and add the second one later? It'd work like a broken array for some time. It's just an idea :) Thanks, -- Giovanni P. Tirloni ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Odd ataraid situation
Aaron Glenn disse: On 7/11/05, Giovanni P. Tirloni [EMAIL PROTECTED] wrote: But I'd like to ask if it'd theoretically be possible to create the RAID1 array (ar0) with only one disk and add the second one later? It'd work like a broken array for some time. It's just an idea :) What is the advantage of building a faulty array? I'd be able to work on this server right now and add the second disk when it arrives without reinstalling everything. I'm not complaining or anything.. I know it's not a commom situation and I'm already looking for something that doesn't involve such hack (suck as waiting the second disk). It's late and I can't think about anything that would make my system installed on ad4 to become ar0 (ad4+ad6) without much work and another spare disk as a temporary storage. -- Giovanni P. Tirloni ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to [EMAIL PROTECTED]
netstat(8) GEN and per-CPU caches
Hi, When is the GEN cache used ? My desktop machine never has mbufs in the GEN pool but some other machine (acting as gateways in small/medium-sized networks) do have them. DESKTOP (no load at all) mbuf usage: GEN cache: 0/0 (in use/in pool) CPU #0 cache: 1/128 (in use/in pool) Total: 1/128 (in use/in pool) mbuf cluster usage: GEN cache: 0/0 (in use/in pool) CPU #0 cache: 0/120 (in use/in pool) Total: 0/120 (in use/in pool) GATEWAY (12 machines, kind of loaded) mbuf usage: GEN cache: 0/32 (in use/in pool) CPU #0 cache: 3/512 (in use/in pool) Total: 3/544 (in use/in pool) mbuf cluster usage: GEN cache: 0/0 (in use/in pool) CPU #0 cache: 0/88 (in use/in pool) Total: 0/88 (in use/in pool) GATEWAY (30 machines) mbuf usage: GEN cache: 0/0 (in use/in pool) CPU #0 cache: 2/256 (in use/in pool) Total: 2/256 (in use/in pool) mbuf cluster usage: GEN cache: 0/56 (in use/in pool) CPU #0 cache: 0/128 (in use/in pool) Total: 0/184 (in use/in pool) Thanks in advance, -- Giovanni P. Tirloni gpt at tirloni.org Fingerprint: 8C3F BEC5 79BD 3E9B EDB8 72F4 16E8 BA5E D031 5C26 ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: FreeBSD 5.1-p10 reproducible crash with Apache2
* Branko F. Gra?nar ([EMAIL PROTECTED]) wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Hi. Today i added the following lines in my kernel config and i recompiled kernel: makeoptionsDEBUG=-g optionsDDB optionsINVARIANTS optionsINVARIANT_SUPPORT optionsWITNESS I reran apache2 ssl test with jmeter. Machine stopped responding after 3-4 seconds (keyboard and console are unresponsible, machine doesn't respond to ping, sshd stops responding...) [ I couldn't find this thread on the archives so I'm jumping in blind. ] Perhaps you're being livelocked by so many interrupts hitting the system that it doesn't do anything productive and only stays there handling interrupts. Can you try polling (http://info.iet.unipi.it/~luigi/polling/) ? -- Giovanni P. Tirloni gpt at tirloni.org Fingerprint: 8C3F BEC5 79BD 3E9B EDB8 72F4 16E8 BA5E D031 5C26 ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: FreeBSD 5.1-p10 reproducible crash with Apache2
* Branko F. Grac(nar ([EMAIL PROTECTED]) wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 | | [ I couldn't find this thread on the archives so I'm jumping in blind. ] | | Perhaps you're being livelocked by so many interrupts hitting the | system that it doesn't do anything productive and only stays there | handling interrupts. | | Can you try polling (http://info.iet.unipi.it/~luigi/polling/) ? This is SMP machine... So polling shouldn't even work. That's true. Although I remember someone here got it working but I can't remember his name. -- Giovanni P. Tirloni gpt at tirloni.org Fingerprint: 8C3F BEC5 79BD 3E9B EDB8 72F4 16E8 BA5E D031 5C26 ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: netisr
* Terry Lambert ([EMAIL PROTECTED]) wrote: No. NETISR is a software interrupt that runs when software interrupts run, which is to say, when the SPL is lowered as a result of returning from the last nested hardware interrupt, which means on hardware and clock interrupts. Yes, I missed the page in 4.4BSD DI. No. There are two LRP papers from Rice University. The first was against FreeBSD 3.2, and dealt with just the idea of LRP. The scond makes things much more complicated than they need to be, in order to introduce a concept called ResCon, or resource containers. Neither set of code is really production, because it uses an alternate protocol family definition and a seperately hacked uipc_socket.c and uipc_socket2.c, along with the totally parallel TCP/IP stack. I've read their first paper. The closest you can come to LRP in FreeBSD 5.x is to use the sysctl's for direct dispatch, which will, in fact, directly call ip_input() from interrupt. I'll be experimenting with it this week (like rwatson requested). This isn't a full LRP, since it doesn't add a receive buffer into the proc structure for per-process enqueuing of packets. When I implemented the 3.x version of Rice's LRP in FreeBSD 4.3, I avoided this hack. The main reason for the hack was to deal with accepting connections, since at interrupt, without a proc structure, there was no way to deal with the socket creation for the accept, due to a lack of an appropriate credential. The sneaky approach I used for this was to create the accept socket using the cred that was present on the listen socket on which the connection had come in. For this to be at all useful, you need to extend kevent accept filters to allow creation of accepted descriptor instances in the process context, and throw them onto the kqueue that was set up against the listen socket. I recommend that if you want to play with LRP, you add an attribute flag to the protocol stack structure to indicate an LRP capable vs. an LRP incapable stack, and then implement it inline, rather than as a separate thing. I also recommend that if you do this, you do it using the Rice 3.x code, and ignore the ResCon stuff, which I think is an interesting idea, but which adds very little in the way of real value to things (though it does add overhead). I'll have to research more about it but I'm taking notes about all this. If you are asking about NETISR, then I recommend W. Richard Steven's books, specifically TCP/IP Illustrated, Volume 2: The Implementation. Yes. I found the page about it 5 minutes after I sent this email. Shame on me.. FWIW: Interrupt threads, as they are used in 5.x, are pretty much antithetical to an LRP implementation, since you can still end up live-locked under heavy load (or denial of service attack), which is why you wanted LRP in the first place: to make progress under a load heavier than you could possibly respond to in a reasonable time. The problem is that the requeing to the interrupt thread adds back in the same type of transition boundary you were trying to take out by getting rid of NETISR in the first place. Thank you very much for answering my question. Things are much clear now! -- Giovanni P. Tirloni gpt at tirloni.org Fingerprint: 8C3F BEC5 79BD 3E9B EDB8 72F4 16E8 BA5E D031 5C26 ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to [EMAIL PROTECTED]
netisr
Hi folks, I'm studying the network stack and now I'm confronted with something called netisr. It seems ether_demux puts the packet in a netisr queue instead of passing it directly to ip_input (if that was the packet's type). Is this derived from LRP ? I've read their paper and it looks like their network channel (ni) but I'm not sure. I also read about it in 5.2 TODO list about fine-grained locking. Where can I find more information on this? Thanks -- Giovanni P. Tirloni gpt at tirloni.org Fingerprint: 8C3F BEC5 79BD 3E9B EDB8 72F4 16E8 BA5E D031 5C26 ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: mbuf doubts
* Jerry Toung ([EMAIL PROTECTED]) wrote: Giovani, you will find the answer to your question in tcp/ip illustrated, volume 2: the implementation in chapter 2. But to briefly answer your question, yes, there are 4 different types of mbufs, depending on the m_flags value. 1) m_flags = 0 and mbuf contains only data up to 108 bytes. 2) m_flags = M_PKTHDR to designate a packet header. 3)m_flags = M_EXT. In a situation where a user process write() in a buffer 256 bytes, the system allocates a cluster to hold that data. 4) m_flags = M_EXT|M_PKTHDR and yes when using clusters, the memory in the mbuf is unsed. hop that helped. Thank you very much Justin and Jerry for the answers. They were very helpful. I'm already getting my copy of Steven's :-) -- Giovanni P. Tirloni gpt at tirloni.org Fingerprint: 8C3F BEC5 79BD 3E9B EDB8 72F4 16E8 BA5E D031 5C26 ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to [EMAIL PROTECTED]
mbuf doubts
Hi, I have been reading the DI chapter about IPC, specially the mbuf section and *many* doubts were raised by my mind. I sending them here in the hope that someone can clarify some bits for me so I can proceed. Reading sys/param.h and sys/mbuf.h I came to the conclusion that there are four types of mbufs regarding it's allocation of memory for data. Is the listing below correct? struct mbuf *m; 1. Normal mbuf using m-M_databuf 2. Normal mbuf with external storage (cluster?) in m-m_hdr-mh_data 3. Header mbuf using m-m_pktdat; 4. Header mbuf with ext. storage (cluster?) in m-m_ext-ext_buf Other questions: 1. When using ext. storage is the space allocated by M_databuf wasted? 2. How the system decides 256 bytes for each mbuf isn't enough and it needs a mbuf cluster? Isn't chaining useful there? 3. How does changing MSIZE affects the whole thing? 4. What about MCLBYTES? Sorry to make so many questions at once but I find it very interesting and I'm really willing to learn how the building blocks of the network stack work. Perhaps my questions are out of reality.. it's risk. Thanks, -- Giovanni P. Tirloni gpt at tirloni.org Fingerprint: 8C3F BEC5 79BD 3E9B EDB8 72F4 16E8 BA5E D031 5C26 ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: FFS Driver for win2000?
Because it's a dual boot machine. He wants to be able to see his FFS volume under Windows just like you are able to see a Windows partition under FreeBSD. You simply can't use NFS in this situation for obvious reasons. On Fri, 9 Feb 2001, Mike Walker wrote: Windoze 2000 is supposed to support NFS, so why not use that instead? Does anybody know of any attempt to write a Fast Filesystem driver for windows 2000?. I have a machine that dual boots, and I can see the NTFS under FreeBSD no problem, but I would like to see my freebsd volume under windows, too. Is this a good project for me to do, or has someone done this already? JAn To Unsubscribe: send mail to [EMAIL PROTECTED] with "unsubscribe freebsd-hackers" in the body of the message Giovanni P. Tirloni [EMAIL PROTECTED] To Unsubscribe: send mail to [EMAIL PROTECTED] with "unsubscribe freebsd-hackers" in the body of the message
Securelevel idea
Hello, I was thinking about securelevels this afternoon and my brain came up with an idea: what about if we could set fine-grained securelevels? Like, each securelevel could have its own set of prohibitons and that could only be changed setting some option in the kernel and compiling a new one. The general idea is to give the machine's admin enough power so he/she can change it to his/her needs. Can anyone comment my idea ? Thanks in advance, Giovanni P. Tirloni [EMAIL PROTECTED] To Unsubscribe: send mail to [EMAIL PROTECTED] with "unsubscribe freebsd-hackers" in the body of the message
PPP failures in 4.2-STABLE
Hi all, After updating to 4.2-STABLE (previous version was 4.1.1-RELEASE) I'm having some strange problem with ppp. When I try to connect for the first time to an ISP the following occurs: ppp[177]: tun0: Chat: Send: ATDT22334455^M ppp[177]: tun0: Chat: Expect(120): CONNECT ppp[177]: tun0: Chat: Received: ATDT22334455^M^M ppp[177]: tun0: Chat: Received: +FHS:11^M ppp[177]: tun0: Chat: Received: ^M ppp[177]: tun0: Chat: Received: OK^M ppp[177]: tun0: Chat: Parent notified of failure (I press ^c here because nothing happens) Then, I try again and it works fine, but If the time between the first and the second connection is too long I receive the same error again, so I can't wait too much to do the second try. Another error that I got these days is the following (a bit like the previous one but with something more): ppp[315]: tun0: Chat: Send: ATDT22335040^M ppp[315]: tun0: Chat: Expect(120): CONNECT ppp[315]: tun0: Chat: Received: ATDT22335040^M^M ppp[315]: tun0: Chat: Received: +FCO^M ppp[315]: tun0: Chat: Received: ^M ppp[315]: tun0: Chat: Received: +FHS:11^M ppp[315]: tun0: Chat: Received: ^M ppp[315]: tun0: Chat: Received: OK^M ppp[315]: tun0: Chat: Parent notified of failure (I press ^C here because nothing happens) When dialing to this particular ISP other strange thing happens, cause even if I try for the second time (without spending too much time bet- ween the two tries) ppp aborts the operation: ppp[325]: tun0: Chat: Send: ATDT22335040^M ppp[325]: tun0: Chat: Expect(120): CONNECT ppp[325]: tun0: Chat: Received: ATDT22335040^M^M ppp[325]: tun0: Chat: Received: CONNECT 50666/ARQ/V90/LAPM/V42BIS^M ppp[325]: tun0: Chat: Parent notified of failure (I didn't press ^C this time) The relevant parts of my ppp.conf follows: # ppp.conf default: set log command chat tun connect set device /dev/cuaa1 set speed 115200 set dial "ABORT BUSY ABORT NO\\sCARRIER TIMEOUT 15 \"\" AT OK-AT-OK ATE1Q0 OK isp1: set redial 1 50 set phone 22334455 set authname isp1-user set authkey isp1-pass set timeout 80 set ifaddr 10.0.0.1/0 10.0.0.2/0 255.255.255.0 0.0.0.0 add default HISADDR isp2: set phone 22335040 set authname isp2-user set authkey isp2-pass set timeout 100 set ifaddr 10.0.0.1/0 10.0.0.2/0 255.255.255.0 0.0.0.0 add default HISADDR # EOF My modem is a internal USRobotics 56k (x2/v90) and as additional information this doesn't happen in Linux (2.2.17). If this isn't the correct mailing list forgive me please (perhaps -stable would be the one, but anyway). Thanks in advance, Giovanni P. Tirloni mail: [EMAIL PROTECTED] mail: [EMAIL PROTECTED] fone: +55 44 225 6267 To Unsubscribe: send mail to [EMAIL PROTECTED] with "unsubscribe freebsd-hackers" in the body of the message
Re: Kernel tutorials
Hi, There are a lot of information about FreeBSD in the Handbook (http://www.freebsd.org/handbook), But if you want to have a deep look into the kernel (BSD in general) you may buy this book: The Design and Implementation of the 4.4BSD Operating System ISBN 0-201-54979-4 , 580 pages BTW, what about that new version covering the FreeBSD's kernel in specific ? On Mon, 30 Oct 2000, qianfeng wrote: Hi,everybody, I am a newbie to the FreeBSD, so I just wander where can I find some kernel tutorials on the internet. Thanks for your help! Qian Feng To Unsubscribe: send mail to [EMAIL PROTECTED] with "unsubscribe freebsd-hackers" in the body of the message Giovanni P. Tirloni [EMAIL PROTECTED] Everyone is born unique, but so many die as copies. To Unsubscribe: send mail to [EMAIL PROTECTED] with "unsubscribe freebsd-hackers" in the body of the message
