Re: Simple perl script send email
\Mail is an incredibly complex thing, combine that with trying to handle IPC issues when shelling out, then you are reinventing a wheel that should definitely not be re-invented. Net::SMTP is an example, though probably a more difficult one, there are lots, http://search.cpan.org/modlist/Mail_and_Usenet_News/Mail Mail::Mailer Mail::Sender MIME::Lite Are some good choices, I use Mail::Box but generally it is way overkill, but since I know I will have it installed I usually default to it. I wanted to switch from using sendmail in a pipe to using Mail::Sender, but I found that Mail::Sender seems to take a lot longer to send a message - not so much an issue for sending out status messages, but a serious problem for sending out newsletters or the like. Peter. -- http://www.interarchy.com/ http://download.interarchy.com/
Re: backing up using DejaVu
I can't think of any reason why not :), If you examine the source to psync you will find the documentation embedded near the end. If you installed DejaVu, look in /usr/local/bin for psync. I think the help even gives a command for copying an entire volume. Let us know how it turns out... Jerry On May 2, 2004, at 9:50 PM, Joseph Alotta wrote: Jerry, On May 1, 2004, at 2:58 PM, Jerry LeVan wrote: You might try one more time, the first time takes the longest, subsequent invocations just looks at differences... I can't think of any reason why the program is chewing cpu after the task is finished. It works by calling psync ( a perl program to do the copying and adjusting permissions). If DejaVu calls psync to do the work, then why do I need DejaVu. Why can't I just put the psync command in cron? I believe that while it is running it might put a menu in the menu bar (on the right hand side), you might try looking there... It puts a horseshoe shaped logo up by the battery level indicator. But all it says is backup in progess no indication of how much it has done or what remains. Joe. I seems like I recall a program RsyncX that is put out by a consortium of educational users, you might take a look at that. Jerry On May 1, 2004, at 1:38 PM, Joseph Alotta wrote: Greetings, Taking Jerry's recommendation, I downloaded DejaVu and ran it last night. It started about 10pm and at 12:30pm it was still running and I went to bed, (my energy savings preferences were set to dvd playback). I couldn't see any progress bar, although it said it had one. When I awoke this morning it was finished. However, now it is still using 94% of my cpu time and I don't know what it could be doing, preference panel says it is disabled. Also, I was looking at the files it wrote, and though they are all there, the file sizes are different. This is the original: [Abba:~/Desktop] josephal% ls -la total 256 drwx--12 josephal staff 408 30 Apr 22:10 . drwxr-xr-x37 josephal staff1258 29 Apr 10:42 .. -rwx-- 1 josephal staff 21508 30 Apr 22:10 .DS_Store -rw-r--r-- 1 josephal staff 0 2 Oct 2002 .localized drwxr-xr-x 7 josephal staff 238 30 Apr 22:10 DejaVu drwxr-xr-x 334 josephal staff 11356 30 Apr 22:10 bankers box drwxr-xr-x 130 josephal staff4420 29 Apr 11:44 charts drwxrwxrwx 142 josephal staff4828 1 Mar 15:09 contact letters -rw-r--r-- 1 josephal staff 102557 27 Apr 15:25 google.pdf drwxr-xr-x 4080 josephal staff 138720 29 Apr 10:44 historical_data drwxr-xr-x 123 josephal staff4182 29 Apr 10:46 reports drwxr-xr-x30 josephal staff1020 12 Mar 17:30 trifold brochure [Abba:~/Desktop] josephal% This is the copy: [Abba:Users/josephalotta/Desktop] josephal% ls -la total 208 drwx--11 josephal unknown 374 30 Apr 22:10 . drwxr-xr-x36 josephal unknown1224 29 Apr 10:42 .. -rw-r--r-- 1 josephal unknown 0 2 Oct 2002 .localized drwxr-xr-x 6 josephal unknown 204 30 Apr 22:10 DejaVu drwxr-xr-x 333 josephal unknown 11322 30 Apr 22:10 bankers box drwxr-xr-x 129 josephal unknown4386 29 Apr 11:44 charts drwxrwxrwx 141 josephal unknown4794 1 Mar 15:09 contact letters -rw-r--r-- 1 josephal unknown 102557 27 Apr 15:25 google.pdf drwxr-xr-x 4079 josephal unknown 138686 29 Apr 10:44 historical_data drwxr-xr-x 122 josephal unknown4148 29 Apr 10:46 reports drwxr-xr-x29 josephal unknown 986 12 Mar 17:30 trifold brochure [Abba:Users/josephalotta/Desktop] josephal% So, I guess I need to reboot to get my CPU time back. What do you think? Is DejaVu a tested product or is it alpha/beta? Seems it has four strikes against it: 1. Slow, 2. No progress Bar, 3. File sizes, 4. high CPU usage while doing nothing. Also, I do not like the fact it is a preference panel as I can't kill it, in times like this. Joe.
Re: Simple perl script send email
At 03:53 AM 5/3/2004, Peter N Lewis wrote: I wanted to switch from using sendmail in a pipe to using Mail::Sender, but I found that Mail::Sender seems to take a lot longer to send a message - not so much an issue for sending out status messages, but a serious problem for sending out newsletters or the like. Have you considered Mail::Bulkmail? http://search.cpan.org/~jimt/Mail-Bulkmail-3.12/Bulkmail.pm -Jeff Lowrey
Re: [slightlyOT] reading logs with long urls
On May 2, 2004, at 8:17 PM, Joel Rees wrote: My apache log files show that I'm getting two or more of those long url attacks every day, and access_log grows to over 4Mb in just a week, in spite of the fact that there are less than ten valid accesses in any particular day. How about configuring Apache to disregard (and not log) any URL longer than a predefined length? Also, what are those long url attacks, I haven't heard of them. -Ken
Re: backing up using DejaVu
Heh, Heh, I was hoping someone would answer that question, my totally uninformed guess is that something bad *could* happen...but I don't know... Let us know :) Jerry On May 3, 2004, at 5:18 PM, Joseph Alotta wrote: Hi Jerry, I used sudo psync -d / /Volumes/backup and it worked real nice. I kind of like watching it work while I do other things. If my powerbook were to sleep in the middle of it, would it break something or would it just pick up where it left off? Joe. On May 3, 2004, at 6:54 AM, Jerry LeVan wrote: I can't think of any reason why not :), If you examine the source to psync you will find the documentation embedded near the end. If you installed DejaVu, look in /usr/local/bin for psync. I think the help even gives a command for copying an entire volume. Let us know how it turns out... Jerry On May 2, 2004, at 9:50 PM, Joseph Alotta wrote: Jerry, On May 1, 2004, at 2:58 PM, Jerry LeVan wrote: You might try one more time, the first time takes the longest, subsequent invocations just looks at differences... I can't think of any reason why the program is chewing cpu after the task is finished. It works by calling psync ( a perl program to do the copying and adjusting permissions). If DejaVu calls psync to do the work, then why do I need DejaVu. Why can't I just put the psync command in cron? I believe that while it is running it might put a menu in the menu bar (on the right hand side), you might try looking there... It puts a horseshoe shaped logo up by the battery level indicator. But all it says is backup in progess no indication of how much it has done or what remains. Joe. I seems like I recall a program RsyncX that is put out by a consortium of educational users, you might take a look at that. Jerry On May 1, 2004, at 1:38 PM, Joseph Alotta wrote: Greetings, Taking Jerry's recommendation, I downloaded DejaVu and ran it last night. It started about 10pm and at 12:30pm it was still running and I went to bed, (my energy savings preferences were set to dvd playback). I couldn't see any progress bar, although it said it had one. When I awoke this morning it was finished. However, now it is still using 94% of my cpu time and I don't know what it could be doing, preference panel says it is disabled. Also, I was looking at the files it wrote, and though they are all there, the file sizes are different. This is the original: [Abba:~/Desktop] josephal% ls -la total 256 drwx--12 josephal staff 408 30 Apr 22:10 . drwxr-xr-x37 josephal staff1258 29 Apr 10:42 .. -rwx-- 1 josephal staff 21508 30 Apr 22:10 .DS_Store -rw-r--r-- 1 josephal staff 0 2 Oct 2002 .localized drwxr-xr-x 7 josephal staff 238 30 Apr 22:10 DejaVu drwxr-xr-x 334 josephal staff 11356 30 Apr 22:10 bankers box drwxr-xr-x 130 josephal staff4420 29 Apr 11:44 charts drwxrwxrwx 142 josephal staff4828 1 Mar 15:09 contact letters -rw-r--r-- 1 josephal staff 102557 27 Apr 15:25 google.pdf drwxr-xr-x 4080 josephal staff 138720 29 Apr 10:44 historical_data drwxr-xr-x 123 josephal staff4182 29 Apr 10:46 reports drwxr-xr-x30 josephal staff1020 12 Mar 17:30 trifold brochure [Abba:~/Desktop] josephal% This is the copy: [Abba:Users/josephalotta/Desktop] josephal% ls -la total 208 drwx--11 josephal unknown 374 30 Apr 22:10 . drwxr-xr-x36 josephal unknown1224 29 Apr 10:42 .. -rw-r--r-- 1 josephal unknown 0 2 Oct 2002 .localized drwxr-xr-x 6 josephal unknown 204 30 Apr 22:10 DejaVu drwxr-xr-x 333 josephal unknown 11322 30 Apr 22:10 bankers box drwxr-xr-x 129 josephal unknown4386 29 Apr 11:44 charts drwxrwxrwx 141 josephal unknown4794 1 Mar 15:09 contact letters -rw-r--r-- 1 josephal unknown 102557 27 Apr 15:25 google.pdf drwxr-xr-x 4079 josephal unknown 138686 29 Apr 10:44 historical_data drwxr-xr-x 122 josephal unknown4148 29 Apr 10:46 reports drwxr-xr-x29 josephal unknown 986 12 Mar 17:30 trifold brochure [Abba:Users/josephalotta/Desktop] josephal% So, I guess I need to reboot to get my CPU time back. What do you think? Is DejaVu a tested product or is it alpha/beta? Seems it has four strikes against it: 1. Slow, 2. No progress Bar, 3. File sizes, 4. high CPU usage while doing nothing. Also, I do not like the fact it is a preference panel as I can't kill it, in times like this. Joe.
Re: [slightlyOT] reading logs with long urls
My apache log files show that I'm getting two or more of those long url attacks every day, and access_log grows to over 4Mb in just a week, in spite of the fact that there are less than ten valid accesses in any particular day. How about configuring Apache to disregard (and not log) any URL longer than a predefined length? The default settings are correct for rejecting the long URLs, and reporting the attempts is correct behavior. Handling the large logs is a time tax on using inherently incomplete technology. Also, what are those long url attacks, I haven't heard of them. See Daniel Staal's post. Fortunately, our Mac OS X boxes are at present somewhat immune to the code insertions anyway, because the code is almost always x86 code. Part of the purpose of wanting to compress out the bulk of the long url is to make it easier to tell if/when we start getting powerPC code insertion attempts. -- Joel Rees Complaining about systems that are incomplete misses the point. In this world, a system can't be perfect and useful at the same time. Of course, that's no excuse to refuse to fix problems -- we'll never run out of problems.
Re: [slightlyOT] reading logs with long urls
Another idea might be to sleep proportional to the length of the URL. For example, 1k request get 1 second, a 2k request gets 2 seconds. At least this will slow them down. Fortunately, these attacks are not DOS, just looking around for boxes to 0wn. So it's just a matter of rotating the logs properly, and compressing them if I want to keep the old logs around. (At this rate, a year's worth of uncompressed logs would consume my hard drive.) And, of course, the problem of viewing the logs, which is where this thread is closest to being on topic here. Writing a viewer will help me understand the perl approach to parsing characters. Not that I don't understand it, but it's hard for a guy who essentially cut his teeth porting Forth to get used to. -- Joel Rees
Re: backing up using DejaVu
Hmmm, maybe it will work... I started the following shell script #!/bin/sh i=1 while true do echo $i i=`expr $i + 1 ` done I forced the system to sleep for a few seconds, woke it up and the script kept on trucking... While you always want to avoid doing things that push the limits of the system while you're backing it up, in theory, all the timing issues should be handled by the drivers before they allow the system to go to sleep. Or, if some hardware job is in progress when the system goes to sleep, the hardware should be waking the system up to finish the process. So it _should_ keep on trucking. If it doesn't, it's a system bug, and needs to be reported. But risking dropping your backups to find Apple's bugs may or may not be what you want to do, and you can be sure that backups won't proceed while the system is asleep. I think this question has come up before, but if there is an API for the Energy Saving settings (or whatever those are in English), I think I'd want to have my backup script set the system to not sleep while the backup was in progress, and then restore the setting when done. Until that part is working, I'd change the setting by hand, of course. -- Joel Rees
Re: backing up using DejaVu
Hmmm, maybe it will work... I started the following shell script #!/bin/sh i=1 while true do echo $i i=`expr $i + 1 ` done I forced the system to sleep for a few seconds, woke it up and the script kept on trucking... Jerry On May 3, 2004, at 5:18 PM, Joseph Alotta wrote: Hi Jerry, I used sudo psync -d / /Volumes/backup and it worked real nice. I kind of like watching it work while I do other things. If my powerbook were to sleep in the middle of it, would it break something or would it just pick up where it left off? Joe. On May 3, 2004, at 6:54 AM, Jerry LeVan wrote: I can't think of any reason why not :), If you examine the source to psync you will find the documentation embedded near the end. If you installed DejaVu, look in /usr/local/bin for psync. I think the help even gives a command for copying an entire volume. Let us know how it turns out... Jerry On May 2, 2004, at 9:50 PM, Joseph Alotta wrote: Jerry, On May 1, 2004, at 2:58 PM, Jerry LeVan wrote: You might try one more time, the first time takes the longest, subsequent invocations just looks at differences... I can't think of any reason why the program is chewing cpu after the task is finished. It works by calling psync ( a perl program to do the copying and adjusting permissions). If DejaVu calls psync to do the work, then why do I need DejaVu. Why can't I just put the psync command in cron? I believe that while it is running it might put a menu in the menu bar (on the right hand side), you might try looking there... It puts a horseshoe shaped logo up by the battery level indicator. But all it says is backup in progess no indication of how much it has done or what remains. Joe. I seems like I recall a program RsyncX that is put out by a consortium of educational users, you might take a look at that. Jerry On May 1, 2004, at 1:38 PM, Joseph Alotta wrote: Greetings, Taking Jerry's recommendation, I downloaded DejaVu and ran it last night. It started about 10pm and at 12:30pm it was still running and I went to bed, (my energy savings preferences were set to dvd playback). I couldn't see any progress bar, although it said it had one. When I awoke this morning it was finished. However, now it is still using 94% of my cpu time and I don't know what it could be doing, preference panel says it is disabled. Also, I was looking at the files it wrote, and though they are all there, the file sizes are different. This is the original: [Abba:~/Desktop] josephal% ls -la total 256 drwx--12 josephal staff 408 30 Apr 22:10 . drwxr-xr-x37 josephal staff1258 29 Apr 10:42 .. -rwx-- 1 josephal staff 21508 30 Apr 22:10 .DS_Store -rw-r--r-- 1 josephal staff 0 2 Oct 2002 .localized drwxr-xr-x 7 josephal staff 238 30 Apr 22:10 DejaVu drwxr-xr-x 334 josephal staff 11356 30 Apr 22:10 bankers box drwxr-xr-x 130 josephal staff4420 29 Apr 11:44 charts drwxrwxrwx 142 josephal staff4828 1 Mar 15:09 contact letters -rw-r--r-- 1 josephal staff 102557 27 Apr 15:25 google.pdf drwxr-xr-x 4080 josephal staff 138720 29 Apr 10:44 historical_data drwxr-xr-x 123 josephal staff4182 29 Apr 10:46 reports drwxr-xr-x30 josephal staff1020 12 Mar 17:30 trifold brochure [Abba:~/Desktop] josephal% This is the copy: [Abba:Users/josephalotta/Desktop] josephal% ls -la total 208 drwx--11 josephal unknown 374 30 Apr 22:10 . drwxr-xr-x36 josephal unknown1224 29 Apr 10:42 .. -rw-r--r-- 1 josephal unknown 0 2 Oct 2002 .localized drwxr-xr-x 6 josephal unknown 204 30 Apr 22:10 DejaVu drwxr-xr-x 333 josephal unknown 11322 30 Apr 22:10 bankers box drwxr-xr-x 129 josephal unknown4386 29 Apr 11:44 charts drwxrwxrwx 141 josephal unknown4794 1 Mar 15:09 contact letters -rw-r--r-- 1 josephal unknown 102557 27 Apr 15:25 google.pdf drwxr-xr-x 4079 josephal unknown 138686 29 Apr 10:44 historical_data drwxr-xr-x 122 josephal unknown4148 29 Apr 10:46 reports drwxr-xr-x29 josephal unknown 986 12 Mar 17:30 trifold brochure [Abba:Users/josephalotta/Desktop] josephal% So, I guess I need to reboot to get my CPU time back. What do you think? Is DejaVu a tested product or is it alpha/beta? Seems it has four strikes against it: 1. Slow, 2. No progress Bar, 3. File sizes, 4. high CPU usage while doing nothing. Also, I do not like the fact it is a preference panel as I can't kill it, in times like this. Joe.
Re: [slightlyOT] reading logs with long urls
Another idea might be to sleep proportional to the length of the URL. For example, 1k request get 1 second, a 2k request gets 2 seconds. At least this will slow them down. Joe. On May 3, 2004, at 3:16 PM, Ken Williams wrote: On May 2, 2004, at 8:17 PM, Joel Rees wrote: My apache log files show that I'm getting two or more of those long url attacks every day, and access_log grows to over 4Mb in just a week, in spite of the fact that there are less than ten valid accesses in any particular day. How about configuring Apache to disregard (and not log) any URL longer than a predefined length? Also, what are those long url attacks, I haven't heard of them. -Ken
Re: backing up using DejaVu
Hi Jerry, I used sudo psync -d / /Volumes/backup and it worked real nice. I kind of like watching it work while I do other things. If my powerbook were to sleep in the middle of it, would it break something or would it just pick up where it left off? Joe. On May 3, 2004, at 6:54 AM, Jerry LeVan wrote: I can't think of any reason why not :), If you examine the source to psync you will find the documentation embedded near the end. If you installed DejaVu, look in /usr/local/bin for psync. I think the help even gives a command for copying an entire volume. Let us know how it turns out... Jerry On May 2, 2004, at 9:50 PM, Joseph Alotta wrote: Jerry, On May 1, 2004, at 2:58 PM, Jerry LeVan wrote: You might try one more time, the first time takes the longest, subsequent invocations just looks at differences... I can't think of any reason why the program is chewing cpu after the task is finished. It works by calling psync ( a perl program to do the copying and adjusting permissions). If DejaVu calls psync to do the work, then why do I need DejaVu. Why can't I just put the psync command in cron? I believe that while it is running it might put a menu in the menu bar (on the right hand side), you might try looking there... It puts a horseshoe shaped logo up by the battery level indicator. But all it says is backup in progess no indication of how much it has done or what remains. Joe. I seems like I recall a program RsyncX that is put out by a consortium of educational users, you might take a look at that. Jerry On May 1, 2004, at 1:38 PM, Joseph Alotta wrote: Greetings, Taking Jerry's recommendation, I downloaded DejaVu and ran it last night. It started about 10pm and at 12:30pm it was still running and I went to bed, (my energy savings preferences were set to dvd playback). I couldn't see any progress bar, although it said it had one. When I awoke this morning it was finished. However, now it is still using 94% of my cpu time and I don't know what it could be doing, preference panel says it is disabled. Also, I was looking at the files it wrote, and though they are all there, the file sizes are different. This is the original: [Abba:~/Desktop] josephal% ls -la total 256 drwx--12 josephal staff 408 30 Apr 22:10 . drwxr-xr-x37 josephal staff1258 29 Apr 10:42 .. -rwx-- 1 josephal staff 21508 30 Apr 22:10 .DS_Store -rw-r--r-- 1 josephal staff 0 2 Oct 2002 .localized drwxr-xr-x 7 josephal staff 238 30 Apr 22:10 DejaVu drwxr-xr-x 334 josephal staff 11356 30 Apr 22:10 bankers box drwxr-xr-x 130 josephal staff4420 29 Apr 11:44 charts drwxrwxrwx 142 josephal staff4828 1 Mar 15:09 contact letters -rw-r--r-- 1 josephal staff 102557 27 Apr 15:25 google.pdf drwxr-xr-x 4080 josephal staff 138720 29 Apr 10:44 historical_data drwxr-xr-x 123 josephal staff4182 29 Apr 10:46 reports drwxr-xr-x30 josephal staff1020 12 Mar 17:30 trifold brochure [Abba:~/Desktop] josephal% This is the copy: [Abba:Users/josephalotta/Desktop] josephal% ls -la total 208 drwx--11 josephal unknown 374 30 Apr 22:10 . drwxr-xr-x36 josephal unknown1224 29 Apr 10:42 .. -rw-r--r-- 1 josephal unknown 0 2 Oct 2002 .localized drwxr-xr-x 6 josephal unknown 204 30 Apr 22:10 DejaVu drwxr-xr-x 333 josephal unknown 11322 30 Apr 22:10 bankers box drwxr-xr-x 129 josephal unknown4386 29 Apr 11:44 charts drwxrwxrwx 141 josephal unknown4794 1 Mar 15:09 contact letters -rw-r--r-- 1 josephal unknown 102557 27 Apr 15:25 google.pdf drwxr-xr-x 4079 josephal unknown 138686 29 Apr 10:44 historical_data drwxr-xr-x 122 josephal unknown4148 29 Apr 10:46 reports drwxr-xr-x29 josephal unknown 986 12 Mar 17:30 trifold brochure [Abba:Users/josephalotta/Desktop] josephal% So, I guess I need to reboot to get my CPU time back. What do you think? Is DejaVu a tested product or is it alpha/beta? Seems it has four strikes against it: 1. Slow, 2. No progress Bar, 3. File sizes, 4. high CPU usage while doing nothing. Also, I do not like the fact it is a preference panel as I can't kill it, in times like this. Joe.
Re: [slightlyOT] reading logs with long urls
--As of Monday, May 3, 2004 4:16 PM -0400, Ken Williams is alleged to have said: How about configuring Apache to disregard (and not log) any URL longer than a predefined length? Also, what are those long url attacks, I haven't heard of them. --As for the rest, it is mine. I'll have to look into that 'disregard and not log' setup, sounds like it could be fun... A long url attack is just a buffer overflow attack. The attacker (or, more commonly, the attacker's bot) sends a request for some huge length that some webservers can't handle, with the end set to some specific binary data, which is supposed to go straight into memory (since the vulnerable webservers just keep writing past their url buffer). Daniel T. Staal --- This email copyright the author. Unless otherwise noted, you are expressly allowed to retransmit, quote, or otherwise use the contents for non-commercial purposes. This copyright will expire 5 years after the author's death, or in 30 years, whichever is longer, unless such a period is in excess of local copyright law. ---
Re: backing up using DejaVu
On May 3, 2004, at 6:37 PM, Jerry LeVan wrote: Hmmm, maybe it will work... I started the following shell script #!/bin/sh i=1 while true do echo $i i=`expr $i + 1 ` done I forced the system to sleep for a few seconds, woke it up and the script kept on trucking... Oh, certainly - you can interrupt basically anything at all on the computer with sleep, and it will simply continue where it left off. I do this all the time with compilations, long-running scientific experiments, regression tests, etc. on my PowerBook. The wake-from-sleep functionality is very robust and fast. The only trouble you're likely to see is when an external resource (like a network or a printer) doesn't like you pausing in the middle of something you're doing to it, and then some operations involving that resource might not just continue where you left off. -Ken
Re: backing up using DejaVu
On May 3, 2004, at 5:18 PM, Joseph Alotta wrote: Hi Jerry, I used sudo psync -d / /Volumes/backup and it worked real nice. I kind of like watching it work while I do other things. If my powerbook were to sleep in the middle of it, would it break something or would it just pick up where it left off? I think it depends how /Volumes/backup is mounted. If it's a local drive connected by USB or Firewire or whatever, everything should be fine. If it's a remote drive, it might not be happy. -Ken
