Re: 6.1 and NFS
On Sep 21, 2006, at 2:45 PM, Kris Kennaway wrote: On Thu, Sep 21, 2006 at 02:42:44PM -0400, Michael Conlen wrote: On Sep 21, 2006, at 2:22 PM, Kris Kennaway wrote: On Thu, Sep 21, 2006 at 02:21:08PM -0400, Michael Conlen wrote: I recall that FreeBSD 6.1 had some NFS & lockd issues that were a show stopper at one time for me however I'm having trouble finding information on the current state of NFS. Anyone have a pointer to information? rpc.lockd remains unreliable; avoid using it if practical. This is becoming a show stopper for us moving forward with FreeBSD and may require us moving to a different OS (Linux or Solaris, each with significant downsides). Do you have a pointer on where I can track the issue so as to make a decision at some point in the future? There are a number of PRs I filed, but those aren't all of the problems. It will require fairly major work to fix - the best hope would be if someone was funded to work on it. Do you have an estimate of what kind of time is necessary to solve the problem? -- Michael Conlen ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: 6.1 and NFS
On Sep 21, 2006, at 2:22 PM, Kris Kennaway wrote: On Thu, Sep 21, 2006 at 02:21:08PM -0400, Michael Conlen wrote: I recall that FreeBSD 6.1 had some NFS & lockd issues that were a show stopper at one time for me however I'm having trouble finding information on the current state of NFS. Anyone have a pointer to information? rpc.lockd remains unreliable; avoid using it if practical. This is becoming a show stopper for us moving forward with FreeBSD and may require us moving to a different OS (Linux or Solaris, each with significant downsides). Do you have a pointer on where I can track the issue so as to make a decision at some point in the future? -- Michael Conlen ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
6.1 and NFS
I recall that FreeBSD 6.1 had some NFS & lockd issues that were a show stopper at one time for me however I'm having trouble finding information on the current state of NFS. Anyone have a pointer to information? -- Michael Conlen ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: JDK1.5 build and linux-sun-java1.4 problems
p# USB Double Bulk Pipe devices < #device ugen# Generic < #device uhid# "Human Interface Devices" < #device ukbd# Keyboard < #device ulpt# Printer < #device umass # Disks/Mass storage - Requires scbus and da < #device ums # Mouse < #device ural# Ralink Technology RT2500USB wireless NICs < #device urio# Diamond Rio 500 MP3 player < #device uscanner# Scanners --- > deviceuhci# UHCI PCI->USB interface > deviceohci# OHCI PCI->USB interface > deviceehci# EHCI PCI->USB interface (USB 2.0) > deviceusb # USB Bus (required) > #device udbp# USB Double Bulk Pipe devices > deviceugen# Generic > deviceuhid# "Human Interface Devices" > deviceukbd# Keyboard > deviceulpt# Printer > deviceumass # Disks/Mass storage - Requires scbus and da > deviceums # Mouse > deviceural# Ralink Technology RT2500USB wireless NICs > deviceurio# Diamond Rio 500 MP3 player > deviceuscanner# Scanners 272,277c269,274 < #device aue # ADMtek USB Ethernet < #device axe # ASIX Electronics USB Ethernet < #device cdce# Generic USB over Ethernet < #device cue # CATC USB Ethernet < #device kue # Kawasaki LSI USB Ethernet < #device rue # RealTek RTL8150 USB Ethernet --- > deviceaue # ADMtek USB Ethernet > deviceaxe # ASIX Electronics USB Ethernet > devicecdce# Generic USB over Ethernet > devicecue # CATC USB Ethernet > devicekue # Kawasaki LSI USB Ethernet > devicerue # RealTek RTL8150 USB Ethernet 280,282c277,279 < #device firewire# FireWire bus code < #device sbp # SCSI over FireWire (Requires scbus and da) < #device fwe # Ethernet over FireWire (non- standard!) --- > devicefirewire# FireWire bus code > devicesbp # SCSI over FireWire (Requires scbus and da) > devicefwe # Ethernet over FireWire (non-standard!) -- Michael Conlen ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
JDK1.5 build and linux-sun-java1.4 problems
I'm having problems building jdk1.5. It segfaults early in the build. I believe I've tracked it down to the linux-sun-java1.4.2 build not working. I get the following # pwd /usr/local/linux-sun-jdk1.4.2/bin # ./java -v Segmentation fault (core dumped) # Further I get the following # truss ./java -v linux_newuname(0xbfbfe658) = 0 (0x0) linux_brk(0x0) = 134565888 (0x8055000) linux_open("/etc/ld.so.preload",0x0,00) ERR#2 'No such file or directory' linux_open("/etc/ld.so.cache",0x0,00)= 3 (0x3) linux_fstat64(0x3,0xbfbfded8,0x480655c0) = 0 (0x0) linux_mmap(0xbfbfdea8) = 1208377344 (0x48066000) close(3) = 0 (0x0) linux_open("/lib/libpthread.so.0",0x0,00)= 3 (0x3) read(0x3,0xbfbfe06c,0x200) = 512 (0x200) linux_fstat64(0x3,0xbfbfdf88,0x480655c0) = 0 (0x0) linux_mmap(0xbfbfde58) = 1208389632 (0x48069000) linux_mmap(0xbfbfde58) = 1208446976 (0x48077000) linux_mmap(0xbfbfde58) = 1208459264 (0x4807a000) close(3) = 0 (0x0) linux_open("/lib/libdl.so.2",0x0,00) = 3 (0x3) read(0x3,0xbfbfe05c,0x200) = 512 (0x200) linux_fstat64(0x3,0xbfbfdf78,0x480655c0) = 0 (0x0) linux_mmap(0xbfbfde78) = 1208721408 (0x480ba000) linux_mmap(0xbfbfde68) = 1208725504 (0x480bb000) linux_mmap(0xbfbfde68) = 1208733696 (0x480bd000) close(3) = 0 (0x0) linux_open("/lib/libc.so.6",0x0,00) = 3 (0x3) read(0x3,0xbfbfe04c,0x200) = 512 (0x200) linux_fstat64(0x3,0xbfbfdf68,0x480655c0) = 0 (0x0) linux_mmap(0xbfbfde38) = 1208737792 (0x480be000) linux_mmap(0xbfbfde38) = 1209929728 (0x481e1000) linux_mmap(0xbfbfde38) = 1209950208 (0x481e6000) close(3) = 0 (0x0) munmap(0x48066000,0x21a5)= 0 (0x0) linux_getrlimit(0x3,0xbfbfe50c) = 0 (0x0) linux_setrlimit(0x3,0xbfbfe50c) = 0 (0x0) SIGNAL 11 (SIGSEGV) SIGNAL 11 (SIGSEGV) Process stopped because of: 16 process exit, rval = 139 Segmentation fault I got the same result from the linux-sun-java1.5 port as well. This error and the build error are consistent. I've even gone through the step of rebuilding the entire system just to make sure there wasn't some bizarre problem with this particular hardware. FreeBSD system 6.0-RELEASE-p7 FreeBSD 6.0-RELEASE-p7 #0: Wed Apr 19 14:15:18 EDT 2006 root@:/usr/obj/usr/src/sys/AD i386 It was installed as 6.0-RELEASE, updated and purpose built for running java (and later tomcat) so there's not a bunch of other junk on it. Any thoughts on how to debug why java is seg faulting? -- Michael Conlen ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
mmap()
I'm running FreeBSD host 6.0-RELEASE FreeBSD 6.0-RELEASE #0: Tue Nov 22 00:22:53 EST 2005 [EMAIL PROTECTED]:/usr/obj/usr/src/sys/WWW i386 I've also tried the following under 5.4-p1... I try rc = mmap(0, (891*1024*1024 + 0), 0, MAP_ANON | MAP_PRIVATE, -1, 0); and it works but If I try rc = mmap(0, (892*1024*1024 + 0), 0, MAP_ANON | MAP_PRIVATE, -1, 0); it fails returning ENOMEM. limit returns cputime unlimited filesize unlimited datasize 2096128 kbytes stacksize1048576 kbytes coredumpsize unlimited memoryuseunlimited vmemoryuse unlimited descriptors 11095 memorylocked unlimited maxproc 5547 sbsize unlimited If the program isn't doing anything else but that is there any reason I'm getting limited in the amount of memory I can mmap() at about 892 MB? Ideally I'd like to be able to mmap most of the 2 GB available to user procs. No, using malloc() is not an option. I'm not up for maintaining a patch set to java. Oh, yes, there's plenty of free memory. Thanks ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Disk inconsistency
On Sep 28, 2005, at 7:08 AM, Sandy Rutherford wrote: A month ago I had one drive in a raid 1 volume "intermittently fail". I started seeing occasional (as in only once or twice per week) read errors in the logs for the volume in question; however, the drive didn't fail catastrophically enough for me to identify which one of the 2 drives was bad. After this happened a few times, I started seeing exactly the behaviour that you described above. At the time, I conjectured that the mirrored disks had become inconsistent. Fortunately, I was able to identify the bad drive soon after. After replacing the drive and rebuilding the redundant data, the system has been perfectly stable. You didn't state your raid setup (hardware or software?). In my case, I am using hardware raid (a Mylex extremeRAID 1100 controller) with SCSI disks. I'm using a IBM FAStT-100 disk array with 8 drives in a RAID-10 (all hardware RAID on the disk array). I think my only option is to pull an incremental backup and rebuild the file system. Thanks for the info. -- Michael Conlen ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Disk inconsistency
I have reason to believe that a set of mirrored disks became inconsistent recently. Since reviving the disk array the system it's attached to has become highly unstable. It appears to deadlock every few hours. No errors, no logs, no response to keyboard, ping or other network requests. Each reboot takes several passes with FSCK to get the disks in to a clean state to boot with again. Can anyone confirm that reading data from a set of mirrored drives which are inconsistent would cause this type of symptom? ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Nocona Processors
I have an Intel Xeon "nocona" processor. I noticed when I set the CPU type that bsd.cpu.mk still thinks it's an AMD processor (per the old make.conf example file). I was able to change this in the system area and in the recently downloaded release src version and build a running system with -march=nocona and build all the ports with it. This should probably be addressed, but on to the question.. Are there plans to allow for > 4 GB processes on these systems? -- Michael Conlen ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
nocona/prescott
I saw in bsd.cpu.mk that it converts CPUTYPE from prescott to nocona if you're on an AMD processor and a nocona to prescott if you're on an i386 processor. Isn't a nocona an Intel processor? -- Michael Conlen ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
NFS
is there a utility similar to nfslog for FreeBSD? ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
NFS server/client issue
I have several FreeBSD 4.11 webservers mounting a FreeBSD 5.3-p5 NFS server. After rebooting the the NFS server the webservers automatically picked up the NFS mount when the server came back up. I noticed that the NFS mount acted slowly (often generating server not responding/server back messages) and the server would bounce back and forth between high disk usage (100%) and almost none and (oddly enough, this reads correct) low system CPU usage while there's high disk usage and high system CPU while there's low disk usage. unmounting and mounting the mounts on all the clients seemed to fix the issue. Any ideas what's going on? -- Michael Conlen ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: growfs
Sorry for the double post but I found a copy of the actual error... growfs: rdfs: seek error: 237231962044550260: Unknown error: 0 On Feb 20, 2005, at 2:40 AM, Michael Conlen wrote: On FreeBSD 5.3 I added disks to a disk array. The array contained two 250 GB disks stripped (actually four mirrored and striped but it's all done in hardware). I added two more pairs to the virtual disk, rebooted the machine, rewrote the disklabel for the additional capacity and ran growfs. It would grow the filesystem to almost the end and reported growfs: rdfs: seek error: : unknown error: 0 I ran growfs with progressively smaller -s options, but the same thing happens when it gets near the end of the new size of the file system. fdisk reports the new size for the disk in sectors on partition 1 and the cylinders, heads and sectors/track appear proper. the only odd thing I notice is that nfs2# fdisk -s /dev/da1s1 /dev/da1s1: 121341 cyl 255 hd 63 sec PartStartSize Type Flags 4: 0 5 0xa5 0x80 nfs2# fdisk -s /dev/da1 /dev/da1: 121342 cyl 255 hd 63 sec PartStartSize Type Flags 1: 63 1949359167 0xa5 0x80 notice da1s1 lists part 4 as size 5 (25 MB). da1 lists the propersize. disklabel looks right for da1s1 nfs2# disklabel -r /dev/da1s1 # /dev/da1s1: 8 partitions: #size offsetfstype [fsize bsize bps/cpg] c: 19493591670unused0 0 # "raw" part, don't edit d: 194935916704.2BSD 2048 16384 28552 Now, I had gone through this process when upgrading from one pair to two without a problem. I'm not sure where to start looking for issues and am looking for a pointer of where to start looking or a better idea of what info I need to debug this. Does anyone see something completely out of whack? ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]" ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
growfs
On FreeBSD 5.3 I added disks to a disk array. The array contained two 250 GB disks stripped (actually four mirrored and striped but it's all done in hardware). I added two more pairs to the virtual disk, rebooted the machine, rewrote the disklabel for the additional capacity and ran growfs. It would grow the filesystem to almost the end and reported growfs: rdfs: seek error: : unknown error: 0 I ran growfs with progressively smaller -s options, but the same thing happens when it gets near the end of the new size of the file system. fdisk reports the new size for the disk in sectors on partition 1 and the cylinders, heads and sectors/track appear proper. the only odd thing I notice is that nfs2# fdisk -s /dev/da1s1 /dev/da1s1: 121341 cyl 255 hd 63 sec PartStartSize Type Flags 4: 0 5 0xa5 0x80 nfs2# fdisk -s /dev/da1 /dev/da1: 121342 cyl 255 hd 63 sec PartStartSize Type Flags 1: 63 1949359167 0xa5 0x80 notice da1s1 lists part 4 as size 5 (25 MB). da1 lists the propersize. disklabel looks right for da1s1 nfs2# disklabel -r /dev/da1s1 # /dev/da1s1: 8 partitions: #size offsetfstype [fsize bsize bps/cpg] c: 19493591670unused0 0 # "raw" part, don't edit d: 194935916704.2BSD 2048 16384 28552 Now, I had gone through this process when upgrading from one pair to two without a problem. I'm not sure where to start looking for issues and am looking for a pointer of where to start looking or a better idea of what info I need to debug this. Does anyone see something completely out of whack? ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Load Balanceing Recommendations
On Jan 31, 2005, at 5:11 PM, Nick Pavlica wrote: All, I have been searching for a load balancing tool/method for managing the traffic going to my web servers(http(s)). I have found a number of tools/methods out there, but haven't found any that stand out as the "Common Solution" to this task on FreeBSD (I may be overlooking the obvious :)). I'm currently testing on FreeBSD 4.11 and 5.3 on x86. - What method/tool do you use or recommend based on your production experience? I've used two methods that have worked well. One is to use a FreeBSD or OpenBSD as a router and use PF to do the load balancing. The downside with this method is that it doesn't sense when a server is down and remove it from the pool of servers. I also haven't done weighted load balancing with this method so I can't evaluate it. The second method I've used is using a Foundry switch with a load balancer built in to it. This is nice when 1) you don't want to use a FreeBSD or OpenBSD system as a router and 2) you want it to do health checks to remove a down system from the pool automatically. It works really well, the downside being the cost. -- Michael Conlen ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Howto measure packets per seconds
I use net-snmp and cricket. This gives me octets and packets over five minute averages. -- Michael Conlen On Jan 25, 2005, at 2:10 PM, Thomas Vogt wrote: Hello I try to do a benchmark with freebsd 5.x. It's for a routing project. So i'm only interessted in max pps for the integrated GigE interface. I tried netperf. But netperf don't show me the max. limit of pps for 4kbyte packets (only interessted in small udp packets). netstat -w 1 is not really usefull, because it doesn't show the real limit. Is there a way to measure the pps limit? Perhaps with netperf? Regards, Thomas ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]" ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
FreeBSD NFS nfsiod
Is there a reason for #define MAXNFSDCNT 20 in nfsiod.c? can this be adjusted if you adjust vfs.nfs.iodmax, or better yet, shouldn't it get this vaule from the sysctl? -- Michael Conlen ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Disk Usage
I have a NFS server running FreeBSD-4.9-RELEASE. It's run fine for several months with five FreeBSD 4.9 systems mounting it's filesystems. Suddenly something started using disk space at the rate of 10 GB/hour on one of the filesystems (which has exported directories). The catch is that a du -k shows a total usage for that file system of much less than df -k. du -k essentially shows the disk usage before the available space started to disappear! Normally I'd presume someone's hiding files under a mount point when I see this but nothings mounted on a directory in this filesystem. Upon reboot the space is not used anymore, df -k and du -k report similar values. Quite simply odd. Some other details... ...this has happened twice in one day, and the rate of "ghost" disk usage is constant and identical in both graphs. The file server is used to serve files to clustered web servers. There's considerable write activity to the NFS server all the time (40-60Mbit/sec) and moderate read access (~10Mbit/sec). Any ideas what would cause the df -k and du -k discrepancy? -- Michael Conlen ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Adaptec RAID cards
I've got a Supermicro P4 Xeon server with an onboard Adaptec SCSI controller and a 0 channel RAID adapter with one array, plus a 2200S dual channel RAID controller with a second array. FreeBSD 4.9 doesn't find any disks on the system at all. Neither the asr or aac drivers come up during boot. FreeBSD 5.1 does find both sets of disks. If I pull the 2200S and boot FreeBSD 4.9 the asr driver finds the 0 channel controller and array and installs fine. I've tried the 2200S without the 0 channel adapter and neither disk controller driver loads. Any idea why a 2200S would cause the kernel not to see either disk controller in 4.9 but work fine in semi recent versions of 5? In all instances the adapter BIOS loads and works properly. -- Michael Conlen ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
NFS server usage
This might be more of an NFS question in general, but I'm not sure, so I thought I'd try here. I've got a FreeBSD NFS server behind two FreeBSD webservers (all 4.9) who load all their pages from the NFS filesystem and I'm seeing less traffic from the NFS server than I expected. The webservers are serving 20Mbit/sec of traffic while the NFS server is only sending 1Mbit/sec of traffic. I know the bulk of the traffic generated is static pages/images off the filesystem. Does FreeBSD's NFS implementation allow for caching of documents on the client side, either its self or through the VM system's inactive pages? The reason I'm asking is that I'm trying to size an NFS server using a few of many similar sites that I hope to cluster. The performance so far has been great, but I'm worried that there's something I'm missing here that will cause the performance/usage to change in a very nonlinear way. Any thoughts on the subject are appreciated. -- Michael Conlen ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: NFS server usage
On Feb 26, 2004, at 4:33 PM, Charles Swiger wrote: Well, you are going to be bottlenecked potentially by your network or by the maximum I/O rate that your NFS server can sustain. Your data suggests you ought to be able to handle about two orders of magnitude more net traffic, if you're over a dedicated 100 Mbs connection between server and clients (ie, using a switch), so it's likely that you're going to run into limits due to your disks well before then. You can probably switch to using rsync or some other replication scheme instead of NFS if you do run into limits, and keep the files locally if need be. The production system will use dual channel U320 RAID controllers with 12 disks per channel, so disk shouldn't be an issue, and it will connect with GigE, so network is plenty fine, now I'm on to CPU. Low volume tests with live data indicate low CPU usage however when I best fit the graph it's dificult to tell how linear (or non linear) the data is. I've got a ton of points between 7.5Mbit/sec web traffic and and 17Mibt/sec but all the points beyond that are somewhat scattered up to about 23Mibt/sec (with a corresponding 5% load in NFS traffic.) The first interval is pretty linear but the first and second interval are not and appear exponential, and the numbers indicate that a 2Gz Xeon system that's using 2% CPU around 8Mbit in web traffic and 3% around 15 Mbit suddenly using 50% CPU at 52Mbit and 250% at 75Mbit. (presuming 5% of that traffic ends up actually going over NFS). Does that kind of curve look accurate to you (anyone)? Would a web page with pretty pictures help anyone understand what I just said? -- Michael Conlen ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
nlist
if I scan the nlist for a symbol can I count on it being there until I reboot the machine? -- Michael Conlen ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Memory semaphores?
There's a port called lsof (in sysutils I think), running that will tell you what process has what files open and you can see what has that file open if anything. -- Michael Conlen Lowell Gilbert wrote: Mark <[EMAIL PROTECTED]> writes: I just installed Apache/1.3.28, and now I got a lot of files like these in /var/run/: /var/run/httpd.mm.77920.sem They look like memory management semaphores of some kind (from mm?). Can I safely delete these files, prior to staring the httpd daemon? I hate them cluttering up my /var/run/ dir. I don't see anything like that, so I'm not sure why you are. However, they should definitely be safe to remove when httpd isn't running... ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]" ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Script help needed please
Jack, You can setup Apache to deny access to people using that browser. The catch is that it's easy to work around it by changing the browser string. If they are that desperate to do this after you deny access to people using HTTRACK or other clients you can place a link that no human would access that runs a CGI that runs the firewall rule to deny them access. You probably want it to return some data and wait a bit so the user can't figure out easily what URL is killing their access. You can also put on your website that users are not allowed to use the site using non interactive browsers. Then when you find them you send a nasty gram to their ISP and notify them that continued abuse could be a crime under the Computer Fraud and Abuse Act (if you and they are in the US) and let their ISP take care of it. -- Michael Conlen Jack L. Stone wrote: Server Version: Apache/1.3.27 (Unix) FrontPage/5.0.2.2510 PHP/4.3.1 The above is typical of the servers in use, and with csh shells employed, plus IPFW. My apologies for the length of this question, but the background seems necessary as brief as I can make it so the question makes sense. The problem: We have several servers that provide online reading of Technical articles and each have several hundred MB to a GB of content. When we started providing the articles 6-7 years ago, folks used browsers to read the articles. Now, the trend has become a more lazy approach and there is an increasing use of those download utilities which can be left unattended to download entire web sites taking several hours to do so. Multiply this by a number of similar downloads and there goes the bandwidth, denying those other normal online readers the speed needed for loading and browsing in the manner intended. Several hundred will be reading at a time and several 1000 daily. Further, those download utilities do not discriminate on the files downloaded unless the user sets them to exclude certain types of files they don't need for the articles. All or most don't bother to set the parameters. They just turn them loose and go about their day. Essentially a DoS for normal readers who notice the slowdown, but not with malice. This method downloads a tremendous amount of unnecessary content. Some downloaders have been contacted to stop (if we spot an email address from a login) and in response they simply weren't aware of the problems they were making and agreed to at least spread downloads over longer periods of time. I can live with that. A possible solution? Now, my question: Is it possible to write a script that can constantly scan the Apache logs to look for certain footprints of those downloaders, perhaps the names, like "HTTRACK", being one I see a lot. Whenever I see one of those sessions, I have been able to abort them by adding a rule to the firewall to deny the IP address access to the server. This aborts the downloading, but have seen the attempts constantly continue for a day or two, confirming unattended downloads. Thus, if the script could spot an "offender" and then perhaps make use of the firewall to add a rule containing the offender's IP address and then flush to reset the firewall, this would at least abort the download and free up the bandwidth (I already have a script that restarts the firewall). Is this possible and how would I go about it??? Many thanks for any ideas on this! Best regards, Jack L. Stone, Administrator SageOne Net http://www.sage-one.net [EMAIL PROTECTED] ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]" ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Updates from 4.8-RELEASE to 4.8-RELEASE-p1
I did a cvsup of a fresh 4.8 install to RELENG_4_8 and noticed two major things that I haven't seen any documentation on. The first is a group of updates to software involved in authentication such as kerberos and telnet done in April. The second is a set of kernel patches a couple of days ago that are not related to the realpath() issue. What kind of issues are normally slipped in to a RELENG branch without a security notice? -- Michael Conlen ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: simple sh scripting. How to put a result of a command to avariable?
Constantine wrote: Hello! I am writing a script, which involves unzipping some files. I would have to unzip 4 different zip-files from some directory, and I would need to unzip them to the directory, which would have the same name in it as the original zip-file, i.e. I would like to run something like "ls *.zip", have each file name recorded in some variable, and do a loop like "unzip $filename[$i] -d $filename[$i].unzipped/". Can someone help me with the code? How can I put the results of a command to a variable? If I understand you properly I think the following would do what you want #!/bin/sh for i in `ls *.zip` do unzip ${i} -d ${i}.unzipped done ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: ISPs blocking SMTP connections from dynamic IP address space
Mykroft Holmes IV wrote: These Residential/Dynamic blocks are usually reversed. And they cause the vast majority of problems that originate in North America. Frankly, alot of people simply blacklist 24.* for this reason. If your provider's mail servers suck, and they have blocks tagged as Dynamic, and you have no other options, it's time to make a deal with someone to relay your mail for you. I've been trying to stay out of this as it has little relation to FreeBSD anymore, but blocking 24/8 is simply a bad idea. It's cable modem space, not dynamic space. There are a lot of static cable modems that are used at businesses. I've been working on the design of a server based categorization filter to be used with IMAP as a local delivery agent on a UNIX system. The idea is to use something like the Baysean filter to guess which of your email folders mail goes in to. If one of them is Junk mail, there's your spam filter. It would also filter all emails from [EMAIL PROTECTED] in to the same folder I've put all the other emails from the list. I'm looking in to which slgorithm to use at this point, as there are several that do the same as the Baysean approach and some are supposedly better at it. This filter has the advantage of being server based, but user tunable. It will require considerable resources to run as it will require knowing the statistics of all your email that you've ever received (at least since you started using it), so either it requires that you save all your email or it stores token values (and values for strings of tokens) in a database. There's even going to be a way to age values so that as spam evolves it keeps up with it. -- Michael Conlen ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Updates from 4.8-RELEASE to 4.8-RELEASE-p1
Michael Conlen wrote: I did a cvsup of a fresh 4.8 install to RELENG_4_8 and noticed two major things that I haven't seen any documentation on. The first is a group of updates to software involved in authentication such as kerberos and telnet done in April. The second is a set of kernel patches a couple of days ago that are not related to the realpath() issue. What kind of issues are normally slipped in to a RELENG branch without a security notice? I also just noticed that in the last week the RELENG_4_8 branch went from FreeBSD-4.8-p1 to FreeBSD-4.8-p3. -- Michael Conlen ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: ppp woes!!
On your WinXP system you should be able to go start -> run and type cmd as the command to run. This will open a window in which ipconfig /all | more should tell you what your name servers are. On the other hand FreeBSD's DHCP should pick them up for you and set resolv.conf, but then I missed the start of the thread... -- Michael Conlen Jiger Java wrote: From: Jon-Eirik Pettersen <[EMAIL PROTECTED]> Are you running KDE as root? You can add DNS-servers manually to /etc/resolv.conf like: nameserver 62.101.193.44 nameserver 217.118.32.13 The problem is I don't know my ISP's nameservers. They come to me dynamically. On WInXP it works fine. But on FreeBSD I don't know how to make that happen. Also can I connect/configure kppp using non-root user just like in Linux which asks for root password and takes care of the rest? Try this if you dont get KPPP to work: http://www.freebsd.org/doc/en_US.ISO8859-1/books/handbook/userppp.html ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]" _ The Six Sigma edge. Give it to your business. http://server1.msn.co.in/features/6sigma Stay ahead! ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]" ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: FreeBSD programming question
select() should work for you, similar to trigering an interrupt. Instead of triggering an ISR select() will sleep until there's an event on the file descriptors. So you open() the device for the serial port and select() on it. When you return from select() the return value will tell you why you returned and you handle the situation similar to programing for the 8250 (read from the port to see which event). In any case, you can select() on the file descriptors for the standard input and the serial port, though remember that STDIN uses buffered IO and open() will return an unbuffered file descriptor, which is what select() uses, so you need to find the unbuffered file descriptor for the stadard IO, which is either 0, 1 or 2, but I forget which on FreeBSD (I've been doing network daemons to much lately). In any case, you create an FD_SET fd_set mySet; FD_ZERO(&mySet); FD_SET(fd, &mySet); where fd is the file descriptor returned from open, or the file descriptor for the standard input. Use the set as a read set with select along iwth a timeout. struct timeval is struct timeval { longtv_sec; /* seconds */ longtv_usec;/* and microseconds */ }; if the pointer to the struct timeval is NULL then it waits forever. (or until a signal causes an exit). (Note, usleep() is often implemented using select on no file descriptors and a timeval). int rc; struct timeval myTimeout; rc = select(2, &mySet, NULL, NULL, &myTimeout); This call will return when either timeval is up or there's data to read on your file descriptors. Be sure to check errno if select returns -1. When select returns the fd_set will be set to the descriptors that are actionable. Use FD_ISSET(fd, &mySet) to see if that file descriptor is waiting to be actioned on (read, write, or other) until you've found all the ones that are ready (the number returned by select()) and do your thing. There's a really great book called "Advanced Programing in the UNIX environment" and it will show you all the system calls you ever needed to know to work with UNIX, though it's light on the concurrency issues, but it doesn't sound like your writing multithreaded memory shared programs so it's no worry. I haven't really looked at the sio driver, but I doubt it, it still works with the 8250, which only had one IO address (tell it what you want to do, read the result, tell it what you want to do, send it info, tell it what you want to know, read the info it has... ...programing was much more fun back then). J. Seth Henry wrote: It appears that my experience on microcontrollers is throwing me off. I'm used to having a touch more control at the hardware level. It sounds like I would be best served by setting up a loop that sleeps for a certain number of milliseconds, and then looks for new data in the serial port buffers. Knowing the amount of time per loop, I could handle the periodic data polling as well. My largest concern was in creating a CPU hog. I don't want to slow the system down by constantly accessing the serial port. It occurred to me that I may be able to deal with this another way. I can poll the thermostat for MOST things, only the user interface requires fairly speedy interactions. I can simply listen for the "ENTER" button, and then increase the polling rate until the UI exits. As it were, I'm poking around in the ports to see how other programs have dealt with this. Just out of curiousity, since I can check the driver source, does the sio driver add any additional buffering, or does it simply read the 16byte FIFO on the serial port? Most of the messages I am expecting should fit in that FIFO anyway. Thanks, Seth Henry On Wed, 2003-08-06 at 09:58, Malcolm Kay wrote: On Wed, 6 Aug 2003 07:00, J. Seth Henry wrote: Not sure if this is the right list or not, but I could really use some pointers. How can I code trap serial port interrupts in my C program? For any modern hosted system interrupt trapping and servicing is in the province of the system -- it should not be a userland activity. For example, I want to read values from a serial device every user-specified number of seconds, calculate some stuff and then sit for a while. Should the serial device decide it wants to send some data unsolicited, I would like to enter an interrupt service routine, handle the communication, and then return to the previous loop. There are a number of techniques which may or may not suit your needs; it is not too clear just what you are trying to do. Generally the system will provide some buffering of input so it is not usually important that your code processes each character immediately on arrival. In many cases using placing the select(2) system call in a loop will meet the needs. In more difficult cases you may need to look at threading pthread(3) or forking fork(2) or vfork(2) I can get the loop going by using sleep(n), but I don't know how to write the ISR in C, an
Re: Vinum Sub-disk & Directory Structure Mapping
I normally use / /usr /usr/local /var /tmp /home # or /usr/home /usr/ports # either it's own space, or link to /usr/local/ports Here's the rational, / and /usr can be mounted read only, /root shouldn't really get used, since you shouldn't be using the root account. when you update the source and rebuild the system then you can remount read-write. /usr/ports points to /usr/local/ports so it can be read-write as needed. /var has logs that can get out of hand, and /tmp gets out of hand due to all sorts of user/programer tricks that you never count on. Those can be read-write at all times. I haven't sized these in a while since well, I've got disk space like it's going out of style, but 128 megs for /, and 512 for /var and /tmp are good sizes. /home is as needed. The only question is how much you really need in /usr which is probably somewhere around 1 GB, depending on if you need to build sources on that system or not. For the security concious, if /usr is read-only at all times (except when mounted from single user mode) you can be more at ease leaving suid programs there, and disable suid from /usr/local, not that you would never have a problem, but... Also, having /etc/ ro is nice, but none of that is a good substitue for tripwire or the like. -- Michael Conlen Richard Johannesson wrote: Using the unlimited number of sub-disk that can be created using vinum, what's a good way to separate the directory file structure to help limit file system corruption? Or, what's the happy medium between limiting fs corruption and complexity? Here's my guess of which part of directory structure should be on its own sub-disks/filesystem: / Probably /root Overkill? /usrProbably /usr/local /varProbably /var/backups? /tmpProbably - or should be on same as var? /home Maybe - or should be under /usr? /stand ? /boot ? Any feedback is very much appreciated. If there is document that discusses this basic topic while taking vinum into account, please let me know so I can bugger off. :) Thanks again, Richard ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]" ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Page attaches
Is there a way to measure how many times an Inactive page gets reattached versus how many times the system has to go to the backing store (file on disk)? Programatic as well as command would be useful, though with one I can do/figure the other. -- Michael Conlen ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Sendmail_enable
Will Saxon wrote: -Original Message- From: Michael Conlen [mailto:[EMAIL PROTECTED] Sent: Tuesday, July 29, 2003 12:07 PM To: [EMAIL PROTECTED] Subject: Sendmail_enable Is this true? Yes The reason I ask is that sendmail_enable="NO" appears to be starting an inbound process. Are you sure? I am using sendmail_enable="NO" and the only listening process is listening on 127.0.0.1. -Will My presumption was that local only ment non TCP/IP, as you could run it directly. -- Michael Conlen ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Sendmail_enable
FreeBSD 4.8-RELEASE I thought the following were true sendmail_enable="YES" # start all sendmail processes sendmail_enable="NO" # don't start an inbound process sendmail_enable="NONE" # don't start any processes Is this true? The reason I ask is that sendmail_enable="NO" appears to be starting an inbound process. I would like outbound only. -- Michael Conlen ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"