Re: Animosity from the press
Paul, Yes, indeed someone has. That was the main thrust of the kernel patching HOWTO that Mike MacIsaac wrote, and I just got up on the linuxvm.org site over the weekend. There is another option, which involves installing a patched Samba, but you'd have to look on linuxvm.org to find that one also. :) (Hint, it comes from David Sainty of Red Hat, and it was in May or April.) Mark Post -Original Message- From: paultz [mailto:[EMAIL PROTECTED]] Sent: Tuesday, May 28, 2002 7:57 PM To: [EMAIL PROTECTED] Subject: Re: Animosity from the press >In this >business we all need to know how to say "I don't know" and "you taught me >something" as things change too fast to have our feet in concrete. Lionel is right ... I say it all the time. Maybe "I don't know", but fortunately the members of this list are more than willing to share their knowledge with me (both on-list and off). I suppose if I were thin-skinned, I might think that some of the comments were 'mostly personal abuse', but I'm not (thin-skinned, that is). I appreciate that people are willing to respond to me to help with the many things about L/390 that I do not understand, even if they carry strong rebuffs about the information I am seeking ('DON'T use TELNET, you idiot use SSH' ... and yes, I got the picture!). I have nothing but high regard and thanks for the members of the list, and owe many of you out there a beer (or two) ;-) . Now off to find that Samba fix for an illegal operation. I know someone out there has already solved this problem, too! Thanks, again, for all the help. Paul
Re: Animosity from the press
>In this >business we all need to know how to say "I don't know" and "you taught me >something" as things change too fast to have our feet in concrete. Lionel is right ... I say it all the time. Maybe "I don't know", but fortunately the members of this list are more than willing to share their knowledge with me (both on-list and off). I suppose if I were thin-skinned, I might think that some of the comments were 'mostly personal abuse', but I'm not (thin-skinned, that is). I appreciate that people are willing to respond to me to help with the many things about L/390 that I do not understand, even if they carry strong rebuffs about the information I am seeking ('DON'T use TELNET, you idiot use SSH' ... and yes, I got the picture!). I have nothing but high regard and thanks for the members of the list, and owe many of you out there a beer (or two) ;-) . Now off to find that Samba fix for an illegal operation. I know someone out there has already solved this problem, too! Thanks, again, for all the help. Paul
Re: Animosity from the press
>>And *no* credible mainstream > computing > > journalist will trust a vendor provided benchmark. They've > seen enough > > such material, most of which appears to be compost. Which again confirms Robinson's Corollary to Sturgeon's Law: 90% of _everything_ is crap. (Sturgeon's Law focuses only on the 90% of science fiction that is crap.) I don't think anyone is asking the mainstream press to take a non-critical view -- it's a different industry and a different set of assumptions than the large systems world posesses. It is however not unreasonable to ask the mainstream press to check their facts and assumptions with someone who possesses the appropriate skills to evaluate whether a particular assertion falls into the diamond or compost piles. This has little to do with whether the claims are true or false; it's basic Journalism 101 -- check your facts and confirm with an expert when it's outside your personal area of expertise. In my case, Mr Murphy's "multiple attempts" consisted of a single email with no identifying comments regarding what he intended to do with the information. A single email does not constitute a reasonable attempt to verify his facts. In either case, there is a reply forthcoming. I honestly don't know when it will appear, because quite frankly, I'm busy doing it, not talking about it, and I have limited time to use. I would pose that as a challenge to Mr Murphy's assertion: if it's such a bad idea, why are so many people interested in doing it? -- db
Re: Animosity from the press
On Sun, 2002-05-26 at 20:31, Phil Payne wrote: > No - you're a power user - the sort of person who would have gone out to buy a 387. >Although > there seem to be lots of power users about, that's because they inhabit similar >places. A few > thousand or a few tens of thousands at most - compared with tems of millions of >processors > shipped. There were more copies of quake sold than that. By your definition they are all power users. > > throughput. They won't be until those features like the FPU become > > economical using either hardware or software to drop into mainstream > > cheap processor silicon. > > The trend is the other way. Major manufacturers are looking at simply >overconfiguring by a > large percentage and then disabling broken bits in software. Such machines will >never be > repaired. IBM's proposed 'Icecube' design almost precludes repair. Thats the same trend. Note I very carefully said _or_ software. The whole self routing chip stuff is almost twenty years old so its about time someone got it to work on useful components. > I don't see that as an issue. IBM has established comparative benchmarks between >its own > products - if you have one, you can relate it to other similar products. LSPR is >the best > example, though even there things like buffer pool redefinitiuons tend to blur the >numbers. > But who should verify and who arbitrate over the inevitable arguments? Vendor provided comparisons between its own products. Comparisons by Ford between Ford cards don't tell you anything about whether its a Porsche or Bicycle equivalent. And *no* credible mainstream computing journalist will trust a vendor provided benchmark. They've seen enough such material, most of which appears to be compost. Until the mainframe folks and the IBM marketing folks involved with it can understand the mainstream viewpoint, and its cynicism of vendor provided data I don't see the coverage of S/390 improving one iota.
Re: Animosity from the press
We actually disclosed all the internal results on the testing to date with zSeries. It is available on our Website in response to the recent articles off linuxworld.com. It is a tremendous effort I can tell you to do Benchmarking with large mail (millions of users) environments, all the so called products/parts, IMAP/POP, MTA, LDAP, Filesystems, Storage, Blasting tools, reporting tools, on and on. I can say that thanks to the SuSE and IBM engineers we have come a long way with Linux results on zSeries. We have made every effort to not be "on the bench with a tone signal" using real profiles, how many users, checking this or that, size of message, time during the day to check/send you name it. Thanks again to Hans Reiser, Chris Mason, Bernd, Hubert Mantel, Andrea Arcangeli, and the 1/2 dozen members of the IBM Engineering team for the work. Regards, Jon On 5/26/02 2:54 PM, "Phil Payne" <[EMAIL PROTECTED]> wrote: >> Vendor provided comparisons between its own products. Comparisons by >> Ford between Ford cards don't tell you anything about whether its a >> Porsche or Bicycle equivalent. And *no* credible mainstream computing >> journalist will trust a vendor provided benchmark. They've seen enough >> such material, most of which appears to be compost. > > Benchmarketing, as it's known. I think most results could be verified - but > they wouldn't be > much more use. It's always fun to dig into the _exact_ configuration used for > the 'headline' > benchmarks - it's usually one that a real user wouldn't dream of installing in > a thousand > years. Exotic front end preprocessors, various bits of error recovery and/or > transaction > logging turned > off - that kind of thing. > > -- > Phil Payne > http://www.isham-research.com > +44 7785 302 803 > +49 173 6242039 >
Re: Animosity from the press
> Vendor provided comparisons between its own products. Comparisons by > Ford between Ford cards don't tell you anything about whether its a > Porsche or Bicycle equivalent. And *no* credible mainstream computing > journalist will trust a vendor provided benchmark. They've seen enough > such material, most of which appears to be compost. Benchmarketing, as it's known. I think most results could be verified - but they wouldn't be much more use. It's always fun to dig into the _exact_ configuration used for the 'headline' benchmarks - it's usually one that a real user wouldn't dream of installing in a thousand years. Exotic front end preprocessors, various bits of error recovery and/or transaction logging turned off - that kind of thing. -- Phil Payne http://www.isham-research.com +44 7785 302 803 +49 173 6242039
Re: Animosity from the press
> On Sun, 2002-05-26 at 10:52, Phil Payne wrote: > > > Your I/O bus is typically PCI however so you are limited to about > > > 100Mbytes/second I/O throughput in the real world. > > > > I would regard 100Mb/sec as a peak (instantaneous) transfer rate. Throughp > ut will be only a > > fraction of that. On some tests only a small fraction. > > That really depends on the system. On an Athlon with 64bit PCI I can do > 150Mbyte/second peak I/O , 120Mbyte/second sustained. Thats with about > $10,000 of loaner hard disks. The sustained disk read/write speed for a > single UDMA hard disk is about a magnitude lower. Well, ... [root@numbat root]# hdparm -t /dev/hda /dev/hda: Timing buffered disk reads: 64 MB in 1.86 seconds = 34.41 MB/sec [root@numbat root]# hdparm -t /dev/hda /dev/hda: Timing buffered disk reads: 64 MB in 1.85 seconds = 34.59 MB/sec [root@numbat root]# hdparm -t /dev/hda /dev/hda: Timing buffered disk reads: 64 MB in 1.84 seconds = 34.78 MB/sec [root@numbat root]# I wouldn't want anyone to think Alan means 15 Mbytes/sec. I can do better than that on a P II/233. Bonnie does produce a similar figure. -- Cheers John Summerfield Microsoft's most solid OS: http://www.geocities.com/rcwoolley/ Note: mail delivered to me is deemed to be intended for me, for my disposition. == If you don't like being told you're wrong, be right!
Re: Animosity from the press
> Lets take a real world benchmark. On < $2000 of PC I can recompile the > entire Linux kernel in 3 minutes, and the entirity of XFree86 in 30. I > can saturate multiple 100Mbit links with web traffic. I can encode video > in real time to mpeg and burn it to VideoCD as I go. I can render > 1024x768 3D scenes with texture and lighting at 80frames/second. > > All of those happen to be useful to me. I think you misunderstand some > of the nature of the commodity processors. No - you're a power user - the sort of person who would have gone out to buy a 387. Although there seem to be lots of power users about, that's because they inhabit similar places. A few thousand or a few tens of thousands at most - compared with tems of millions of processors shipped. > >> Performance measurement should be left to those who know what they're doing. The >first step > > is to define terms of measurement, and these must be related to real world and >real user > > issues, so that the results are relevant to their audience. > > Understand that the majority audience isn't interested in bit errors per > year, component failures per year, floor space per 100Mbyte/sec > throughput. They won't be until those features like the FPU become > economical using either hardware or software to drop into mainstream > cheap processor silicon. The trend is the other way. Major manufacturers are looking at simply overconfiguring by a large percentage and then disabling broken bits in software. Such machines will never be repaired. IBM's proposed 'Icecube' design almost precludes repair. > Why is that relevant - because the computing mainstream press > understands the computing mainstream. They care about desktop > performance properties (latency over throughput, price/performance, > etc). Getting them to think in other terms is hard, especially when any > attempt to get public IBM comparisons that are third party verified is > hitting a wall of silence. I don't see that as an issue. IBM has established comparative benchmarks between its own products - if you have one, you can relate it to other similar products. LSPR is the best example, though even there things like buffer pool redefinitiuons tend to blur the numbers. But who should verify and who arbitrate over the inevitable arguments? -- Phil Payne http://www.isham-research.com +44 7785 302 803 +49 173 6242039
Re: Animosity from the press
On Sun, 2002-05-26 at 10:52, Phil Payne wrote: > > Your I/O bus is typically PCI however so you are limited to about > > 100Mbytes/second I/O throughput in the real world. > > I would regard 100Mb/sec as a peak (instantaneous) transfer rate. Throughput will >be only a > fraction of that. On some tests only a small fraction. That really depends on the system. On an Athlon with 64bit PCI I can do 150Mbyte/second peak I/O , 120Mbyte/second sustained. Thats with about $10,000 of loaner hard disks. The sustained disk read/write speed for a single UDMA hard disk is about a magnitude lower. > The functionality and the performance are indeed there, but they are of no benefit >to 99.999% > of the chip's purchasers. Making an issue out of it as a 'superiority' of that >platform > distracts purchasers from price/benefit issues that are much more relveant to their > environments, and does the industry as a whole a disservice. Lets take a real world benchmark. On < $2000 of PC I can recompile the entire Linux kernel in 3 minutes, and the entirity of XFree86 in 30. I can saturate multiple 100Mbit links with web traffic. I can encode video in real time to mpeg and burn it to VideoCD as I go. I can render 1024x768 3D scenes with texture and lighting at 80frames/second. All of those happen to be useful to me. I think you misunderstand some of the nature of the commodity processors. >> Performance measurement should be left to those who know what they're doing. The >first step > is to define terms of measurement, and these must be related to real world and real >user > issues, so that the results are relevant to their audience. Understand that the majority audience isn't interested in bit errors per year, component failures per year, floor space per 100Mbyte/sec throughput. They won't be until those features like the FPU become economical using either hardware or software to drop into mainstream cheap processor silicon. Why is that relevant - because the computing mainstream press understands the computing mainstream. They care about desktop performance properties (latency over throughput, price/performance, etc). Getting them to think in other terms is hard, especially when any attempt to get public IBM comparisons that are third party verified is hitting a wall of silence. Alan
Re: Animosity from the press
> Other way around. Modern processors are in instructions per clock. On > raw CPU power it doesn't just beat the mainframe - it steamrollers them. > Your I/O bus is typically PCI however so you are limited to about > 100Mbytes/second I/O throughput in the real world. I would regard 100Mb/sec as a peak (instantaneous) transfer rate. Throughput will be only a fraction of that. On some tests only a small fraction. I looked at PC benchmarking quite seriously a few years back. It's very difficult because the design assumptions for a single-user system are so very different from those for a multi-user system. One case in point was OS2, which makes heavy use of background threads for housekeeping purposes. Windows 95 does something similar for cache management. Drive either with a synthetic workload and they're taken out of their design envelopes - both will run into critical resource shortages even in well-configured systems and show 'knee of the curve' phenomena. At one point Ziff Davis was actually running word processing 'benchmarks' using driving systems to simulate 40,000 keystrokes a minute - obviously a real world test. The issue is partly that the Intel processor is overpowered for the majority of purposes. Remember the 386/387 combination? From a logical point of view it made sense - only those who needed serious number-crunching power would buy the 80387 Co-processor. But it's actually cheaper to integrate the function on a standard chip - Intel saves dieing for a second chip, the motherboard manufacturers save the cost of an extra socket, and the users save having to find, purchaes and install a high-value static senstive component. The functionality and the performance are indeed there, but they are of no benefit to 99.999% of the chip's purchasers. Making an issue out of it as a 'superiority' of that platform distracts purchasers from price/benefit issues that are much more relveant to their environments, and does the industry as a whole a disservice. Performance measurement should be left to those who know what they're doing. The first step is to define terms of measurement, and these must be related to real world and real user issues, so that the results are relevant to their audience. -- Phil Payne http://www.isham-research.com +44 7785 302 803 +49 173 6242039
Re: Animosity from the press
On Fri, May 24, 2002 at 02:42:32PM -0700, Lionel Dyck wrote: > Seems that the linuxworld author of the mainframe articles is none too > happy with those on this listserv. > http://www.linuxworld.com/site-stories/2002/0522.mainframelinux.sidebar2.html I haven't been reading this guy's articles...and after reading the sidebar, it's clear I haven't missed anything. He simply Doesn't Get It. "Linux excels at the kinds of tasks that don't fir the mainframer's idea of data processing. I argue Linux mainframe performance must be evaluated in the context set by other uses of Linux, not other uses of zOS[sic]. Mainframe advocates excuse the poor performance of Linux in their environment by denigrating the kind of interactive computing Linux does best." He clearly misses the point: it's a server, dammit, not a single-user desktop. It's not *going* to do well on computation benchmarks. That's not what it was designed for, or optimized for. He should be looking at things like Apache and Samba and PostgreSQL, not KDE and SETI@Home. I think it's revealing as hell that Moshe Bar got comparable performance out of Linux/390 on a 2-way 1 GHz PIII under Hercules - which, I'm guessing, will turn about 10 MIPS with a reasonable I/O load - to what he did out of a PII-450. I daresay that the PII is turning more than 10 MIPS (any guesses? How many clocks per instruction does a PII use, under average workloads?), and that's even though the Linux/390 was having to put up with software emulation of I/O! I suggest we not waste time on someone who 1) appears to have a real axe to grind and 2) is so determined to resist any clue offered to him.
Re: Animosity from the press
At 15:40 25-05-02, Alan Cox wrote: >Other way around. Modern processors are in instructions per clock. Same for mainframe CPU as far as I know, which is one of the reasons why we don't use the MIPS to rate the speed of a processor. Like what is my MIPS rate when we have zero-cycle instructions? ;-) Rob
Re: Animosity from the press
> Seems that the linuxworld author of the mainframe articles is none too > happy with those on this listserv. > > http://www.linuxworld.com/site-stories/2002/0522.mainframelinux.sidebar2.html > > All I can say is I am disappointed that the editors would publish his rant > and as I assume he is still subscribed to this listserv I'm sure he will > see this. The referenced article (see above url) is highly unprofessional > and shows someone who can not accept critism or correction. In this > business we all need to know how to say "I don't know" and "you taught me > something" as things change too fast to have our feet in concrete. For the record, my comments are quoted accurately and the author did ask for and receive permission to publish. I never thought he'd be that dumb. Synthetic loops have indeed been discredited for at least as long as I said - I can cite many and various examples of highly misleading results derived from them, as can my erstwhile colleagues at HDS, Comparex, Amdahl and so on. I actually considered trying to explain the significance of performance features in large multi-user systems, such as the preservation of previously translated virtual-real address pairs when the segment table origin register is changed - but thought the better of it. How do you see a feature like that in a synthetic loop? The man's a fool. His incompetence is now stored in retrieval systems all over the globe and will come back to revisit him whenever he tries to pronounce in the future. His next article might be about triple-bypass heart surgery using a Swiss Army knife. I look forward to it. -- Phil Payne http://www.isham-research.com +44 7785 302 803 +49 173 6242039
Re: Animosity from the press
On Sat, 2002-05-25 at 14:08, [EMAIL PROTECTED] wrote: > existing compute-bound applications are "not a good fit"- > though web-hosting and file serving are two good fits since > they're bursty and don't sit and spin (unless the web host is > facing the "slashdot effect"). With mostly static content and a decent webserver (eg thttpd) you can serve a full slashdotting on 486 class processor. The compute bound parts of web services come mostly from 1. Database queries that are not cached 2. Using SQL when you could field most queries off a db hash front end instead 3. Poor web server designs 4. Java servlets For a very long time www.linux.org.uk ran on an 8Mb MacII running Linux/m68k. It handled the load just fine.
Re: Animosity from the press
>From Jay Maynard: On Fri, May 24, 2002 at 02:42:32PM -0700, Lionel Dyck wrote: > > Seems that the linuxworld author of the mainframe articles is none too > > happy with those on this listserv. > > I haven't been reading this guy's articles...and after reading the sidebar, > it's clear I haven't missed anything. He simply Doesn't Get It. If he got "it" he'd be able to point out what Mainframe Linux is good for and why the lowered performance of the environment on a mainframe is reasonable. Perhaps he needs to read Appendix "A" of the Linux for S/390 Redbook- which compares the two architectures (Intel's Pentium and the s/390) and points out that the s/390 isn't so much a speed demon as it is a RELIABLE place to run _any_ workload. Everything in the world is a trade-off. The s/390 architecture trades some performance advantages of the technology for a big boost in reliability- which would require a LOT of specialized hardware to mimic on a Pentium-class chipset (i.e., a whole new chipset, from ground up, would be needed). Now I'm an AIX geek (wanna pronounce AIX? Here's a Hint: AIX 'n Panes) and there are some things AIX does exceptionally well (i.e. I/O) because it's internal architecture (which has a vaguely Unix-like API wrapped around) doesn't look anything like any Unix I/O system I've ever seen before (and I've seen a few). Linux has a "conventional Unix" (if there is such a thing) I/O architecture, so there may be some issues in getting the most out of the S/390 architecture. Perhaps IBM should bring back AIX on the mainframe but make it like AIX 5L, with full Linux affinity. Of course, with the new Power4 CPUs and their ability to handle LPARs, perhaps it's only a matter of time before p/VM (for the pSeries) gets put together. p/VM and CMS so that you can set up the environment before booting the actual OS in a pSeries virtual machine... Consider the bane of computing: University Computing Centers, where all those clever students are trying to "crack security" (well, there were plenty of these kinds of people 30 years ago at SUNY Stony Brook that I kept bumping into) trying to get "something for nothing" out of the batch system (370-155) and the timesharing system (PDP-10); I suspect the VM+Linux environment looks like a godsend since a student can be issued his own system w/ a root ID- and the VM operator can still adjust the instance's priority and even crash it w/o having to walk up to a physical machine. Additionally, such systems should not be compute bound, so there's no huge waste of potential cycles (the hardware can be amortized by other jobs). I think it's this ability to balance workload to keep the CPU busy that's most likely to explain this. IBM itself (we got a presentation at the SunCoast LUG meeting) indicates that existing compute-bound applications are "not a good fit"- though web-hosting and file serving are two good fits since they're bursty and don't sit and spin (unless the web host is facing the "slashdot effect"). -- John R. Campbell Speaker to Machines [EMAIL PROTECTED] - As a SysAdmin, yes, I CAN read your e-mail, but I DON'T get that bored! Disclaimer: All opinions expressed above are those of John R. Campbell alone and are seriously unlikely to reflect the opinions of his employer(s) or lackeys thereof. Anyone who says differently is itching for a fight!
Re: Animosity from the press
On Sat, 2002-05-25 at 03:10, Jay Maynard wrote: > I think it's revealing as hell that Moshe Bar got comparable performance out > of Linux/390 on a 2-way 1 GHz PIII under Hercules - which, I'm guessing, > will turn about 10 MIPS with a reasonable I/O load - to what he did out of a > PII-450. I daresay that the PII is turning more than 10 MIPS (any guesses? > How many clocks per instruction does a PII use, under average workloads?), Other way around. Modern processors are in instructions per clock. On raw CPU power it doesn't just beat the mainframe - it steamrollers them. Your I/O bus is typically PCI however so you are limited to about 100Mbytes/second I/O throughput in the real world.
Re: Animosity from the press
Lionel, Yes, he is still subscribed, but he might have his account set to nomail. I myself find it interesting that he tries to portray all of us as wild-eyed members of a cult, but doesn't acknowledge that at least one of us (me!) told him that we _already know_ S/390 processors are slow compared to Intel, AMD, etc. when it comes to raw CPU-intensive work. As I've said before, that particular dead horse has been flogged enough. Also, does anyone have any idea where he might have gotten the idea that someone on the mailing list claimed 99,000 instances on one processor? I don't remember seeing that particular bit of nonsense before, but if anyone else does, I'd appreciate a pointer. On to making this beast work, now. Mark Post -Original Message- From: Lionel Dyck [mailto:[EMAIL PROTECTED]] Sent: Friday, May 24, 2002 5:43 PM To: [EMAIL PROTECTED] Subject: Animosity from the press Seems that the linuxworld author of the mainframe articles is none too happy with those on this listserv. http://www.linuxworld.com/site-stories/2002/0522.mainframelinux.sidebar2.htm l All I can say is I am disappointed that the editors would publish his rant and as I assume he is still subscribed to this listserv I'm sure he will see this. The referenced article (see above url) is highly unprofessional and shows someone who can not accept critism or correction. In this business we all need to know how to say "I don't know" and "you taught me something" as things change too fast to have our feet in concrete. Lionel B. Dyck, Systems Software Lead Kaiser Permanente Information Technology 25 N. Via Monte Ave Walnut Creek, Ca 94598 Phone: (925) 926-5332 (tie line 8/473-5332) E-Mail:[EMAIL PROTECTED] Sametime: (use Lotus Notes address) AIM:lbdyck