Re: q re transferring mysql db from redhat to debian
On Jul 26, 2004, at 7:56 PM, Brian Nelson wrote: Jeremy Zawodny <[EMAIL PROTECTED]> writes: On Jul 26, 2004, at 6:21 PM, Shannon R. wrote: hello list! i'll be moving from a RedHat server to a Debian server very soon. despite the different linux distributions, is it ok to transfer my entire mysql database by just copying everything in /var/lib/mysql of the RedHat system to the Debian system? Assuming the directory structures are similar and you're using only MyISAM tables, yes. With InnoDB, you'd have to deal with the logs as well. Surely using mysqldump(1) would be safer, especially if the MySQL versions are different. Well, either way you're copying a bunch of bits from server A to server B. I'm not sure how the actual data format matters. Copying the raw data will be more efficient. Jeremy -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
Re: q re transferring mysql db from redhat to debian
On Jul 26, 2004, at 6:21 PM, Shannon R. wrote: hello list! i'll be moving from a RedHat server to a Debian server very soon. despite the different linux distributions, is it ok to transfer my entire mysql database by just copying everything in /var/lib/mysql of the RedHat system to the Debian system? Assuming the directory structures are similar and you're using only MyISAM tables, yes. With InnoDB, you'd have to deal with the logs as well. Jeremy -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
Re: high performance, highly available web clusters
On May 20, 2004, at 9:27 AM, David Wilk wrote: Now, here's the other question. Now that the web cluster can scale the static content ad infinitum, what about the dynamic content? What can be done with Mysql to load balance? currently they do what everyone does with two stand-alone Mysql servers that are updated simulataneously with the client writing to both. The client can then read from the backup Mysql server if the primary fails. I could just build two massive stand-alones, but a cluster would be more scalable. Yuck. I'd use MySQL's built-in replication. Build a fairly bullet-proof master and have as many slaves as needed. Put the slaves behind some sort of load balancer (LVS or whatnot) and you can scale pretty far with mostly read applications. We've used this quite effectively for many parts of Yahoo. Jeremy
Re: high performance, highly available web clusters
On May 20, 2004, at 9:27 AM, David Wilk wrote: Now, here's the other question. Now that the web cluster can scale the static content ad infinitum, what about the dynamic content? What can be done with Mysql to load balance? currently they do what everyone does with two stand-alone Mysql servers that are updated simulataneously with the client writing to both. The client can then read from the backup Mysql server if the primary fails. I could just build two massive stand-alones, but a cluster would be more scalable. Yuck. I'd use MySQL's built-in replication. Build a fairly bullet-proof master and have as many slaves as needed. Put the slaves behind some sort of load balancer (LVS or whatnot) and you can scale pretty far with mostly read applications. We've used this quite effectively for many parts of Yahoo. Jeremy -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
Re: RaiserFS via NFS
On Monday, April 19, 2004, at 03:07 PM, Markus Schabel wrote: well, i see the same problem as everybody here: i've had some corrupted reiserfs systems, and it wasn't possible to restore the data (except backups of coures ;)). We're still running reiserfs on our proxy servers (squid), but we have the phenomenon that the machines get slower and slower while squid is running, and if you stop squid and wait some time and start it again it all goes fine again. but the problem isn't squid, it seems to be reiserfs which seems to be not able get all data written to disk in time and slows the computer down. (sure this also depends on the harddisks, but we played around with hdparm and the situation was exactly the same with DMA enabled (140MB/s) and disabled (4MB/s), so it cannot be the HDD). I'm confused. How does measuring sequential read/write performance map to squid performance? Doesn't squid usually do lots of little read/write ops, with lots of seeks too? Jeremy
Re: RaiserFS via NFS
On Monday, April 19, 2004, at 03:07 PM, Markus Schabel wrote: well, i see the same problem as everybody here: i've had some corrupted reiserfs systems, and it wasn't possible to restore the data (except backups of coures ;)). We're still running reiserfs on our proxy servers (squid), but we have the phenomenon that the machines get slower and slower while squid is running, and if you stop squid and wait some time and start it again it all goes fine again. but the problem isn't squid, it seems to be reiserfs which seems to be not able get all data written to disk in time and slows the computer down. (sure this also depends on the harddisks, but we played around with hdparm and the situation was exactly the same with DMA enabled (140MB/s) and disabled (4MB/s), so it cannot be the HDD). I'm confused. How does measuring sequential read/write performance map to squid performance? Doesn't squid usually do lots of little read/write ops, with lots of seeks too? Jeremy -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
Techniques for outbound spam filtering with Exim?
I'm looking to setup outbound spam filtering via Exim (preferably with SpamAssassin). What sorts of techniques are folks using to do this? We're currently running Exim 3.xx but upgrading isn't a big deal if necessary. We already have spamc/spamd handling inbound mail via procmail. But I'm tempted to implement scanning during the SMTP transaction for outbound mail if possible. Our outbound volume isn't really that high. Thanks for any pointers, Jeremy -- Jeremy D. Zawodny | Perl, Web, MySQL, Linux Magazine, Yahoo! <[EMAIL PROTECTED]> | http://jeremy.zawodny.com/
Techniques for outbound spam filtering with Exim?
I'm looking to setup outbound spam filtering via Exim (preferably with SpamAssassin). What sorts of techniques are folks using to do this? We're currently running Exim 3.xx but upgrading isn't a big deal if necessary. We already have spamc/spamd handling inbound mail via procmail. But I'm tempted to implement scanning during the SMTP transaction for outbound mail if possible. Our outbound volume isn't really that high. Thanks for any pointers, Jeremy -- Jeremy D. Zawodny | Perl, Web, MySQL, Linux Magazine, Yahoo! <[EMAIL PROTECTED]> | http://jeremy.zawodny.com/ -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
Re: Apache/MySQL question
On Mon, Jan 19, 2004 at 03:05:34PM +0100, Jan Kokoska wrote: > On Mon, 2004-01-19 at 12:30, Francis Tyers wrote: > > hmm, you might want to look into mysql replication, i just googled and > > got: > > > > http://www.mysql.com/doc/en/Replication.html > > http://jeremy.zawodny.com/mysql/managing-mysql-replication.html > > > if you are on a lower budget, perhaps look at rsync ... > > > > http://samba.anu.edu.au/rsync/ > > We have this setup running here on a production server with 500+ web > hosts, fs replicated using rsync (homebrown replication scripts in > python, can be done in bash or just anything) and MySQL replication as > described in the documentation (also managed through scripts). > > We check the replication using Netsaint and both systems are an exact > copy, at worst of 5 minutes ago. We stopped at the point of implementing > some sort of STONITH, so no ip/service takeover yet.. considered how > MySQL replication is crippled and unreliable (IMHO), this should not be > done automagically anyway (or you have to provide really extensive > workarounds and integrity checking). Where does the "crippled and unreliable" opinion come from? I'm not sure if you're talking about replication itself or the failover options. Jeremy -- Jeremy D. Zawodny | Perl, Web, MySQL, Linux Magazine, Yahoo! <[EMAIL PROTECTED]> | http://jeremy.zawodny.com/
Re: Apache/MySQL question
On Mon, Jan 19, 2004 at 03:05:34PM +0100, Jan Kokoska wrote: > On Mon, 2004-01-19 at 12:30, Francis Tyers wrote: > > hmm, you might want to look into mysql replication, i just googled and > > got: > > > > http://www.mysql.com/doc/en/Replication.html > > http://jeremy.zawodny.com/mysql/managing-mysql-replication.html > > > if you are on a lower budget, perhaps look at rsync ... > > > > http://samba.anu.edu.au/rsync/ > > We have this setup running here on a production server with 500+ web > hosts, fs replicated using rsync (homebrown replication scripts in > python, can be done in bash or just anything) and MySQL replication as > described in the documentation (also managed through scripts). > > We check the replication using Netsaint and both systems are an exact > copy, at worst of 5 minutes ago. We stopped at the point of implementing > some sort of STONITH, so no ip/service takeover yet.. considered how > MySQL replication is crippled and unreliable (IMHO), this should not be > done automagically anyway (or you have to provide really extensive > workarounds and integrity checking). Where does the "crippled and unreliable" opinion come from? I'm not sure if you're talking about replication itself or the failover options. Jeremy -- Jeremy D. Zawodny | Perl, Web, MySQL, Linux Magazine, Yahoo! <[EMAIL PROTECTED]> | http://jeremy.zawodny.com/ -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
Re: Apache clustering w/ load balancing and failover
On Fri, Sep 19, 2003 at 06:46:13PM +0200, Markus Oswald wrote: > On Fri, 2003-09-19 at 16:41, Jeremy Zawodny wrote: > > On Thu, Sep 18, 2003 at 06:38:44PM +0200, S?bastien Lefebvre wrote: > > > > > > > You might want to use keepalived which includes a vrrp > > > implementation. I'm running it on the clusters I set up : > > > http://keepalived.sourceforge.net/ I even use it on Netfilter > > > firewalls without any trouble (without the LVS support) > > > > Are there any good docs or howtos that describe how to do that? > > Setting up two web servers with vrrp/keepalived should be easy, but > > everything I looked at seemed intimately tied to LVS. > > Did you take a look at the keepalived documentation? > http://keepalived.sourceforge.net/documentation.html Yes. > All you have to do is patch your kernel with LVS or use the appropriate > netfilter-ipvs-modules, compile and install keepalived and configure it > according to the documentation and/or your special requirements. Well there's the confusing part. You had said: I even use it on Netfilter firewalls without any trouble (without the LVS support). It's the 'without the LVS support' that caught my eye. The docs didn't make it clear that I could do any of this without LVS-related kernel patches. Further backing that, you now say: All you have to do is patch your kernel with LVS or use the appropriate netfilter-ipvs-modules, compile and install keepalived and configure it according to the documentation and/or your special requirements. So I guess I've either misunderstood or asked the wrong question(s). Because the documentation all seems to revolve around LVS implementations. It's not clear which pieces are optional--unless I'm interpreting it incorrectly. Jeremy -- Jeremy D. Zawodny | Perl, Web, MySQL, Linux Magazine, Yahoo! <[EMAIL PROTECTED]> | http://jeremy.zawodny.com/ -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
Re: Apache clustering w/ load balancing and failover
On Thu, Sep 18, 2003 at 06:38:44PM +0200, S?bastien Lefebvre wrote: > > > You might want to use keepalived which includes a vrrp > implementation. I'm running it on the clusters I set up : > http://keepalived.sourceforge.net/ I even use it on Netfilter > firewalls without any trouble (without the LVS support) Are there any good docs or howtos that describe how to do that? Setting up two web servers with vrrp/keepalived should be easy, but everything I looked at seemed intimately tied to LVS. Thanks, Jeremy -- Jeremy D. Zawodny | Perl, Web, MySQL, Linux Magazine, Yahoo! <[EMAIL PROTECTED]> | http://jeremy.zawodny.com/ -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
Re: Slightly OT: They're forcing me to install Red Hat
On Wed, Jun 18, 2003 at 01:36:40PM +1200, Jones, Steven wrote: > Sap is moving to mysql, so I cant see any advantage in using SAP. I think that's an over-simplified view of the situation. The press release was vague, but my understanding is that SAP is providing technology and funding to MySQL. So when they begin telling folks to move to MySQL it'll be less like today's MySQL and more like SAPDB. Jeremy -- Jeremy D. Zawodny | Perl, Web, MySQL, Linux Magazine, Yahoo! <[EMAIL PROTECTED]> | http://jeremy.zawodny.com/
Re: Slightly OT: They're forcing me to install Red Hat
On Wed, Jun 18, 2003 at 01:36:40PM +1200, Jones, Steven wrote: > Sap is moving to mysql, so I cant see any advantage in using SAP. I think that's an over-simplified view of the situation. The press release was vague, but my understanding is that SAP is providing technology and funding to MySQL. So when they begin telling folks to move to MySQL it'll be less like today's MySQL and more like SAPDB. Jeremy -- Jeremy D. Zawodny | Perl, Web, MySQL, Linux Magazine, Yahoo! <[EMAIL PROTECTED]> | http://jeremy.zawodny.com/ -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
Re: Which webmail do you prefer? Why?
On Wed, May 07, 2003 at 01:07:11AM -0400, Jim Popovitch wrote: > > -Original Message- > > From: Jeremy D. Zawodny > > > > Windows == 63M > > Linux == 57M > > Debian== 16M > > Microsoft == 40M > > > > You can try to prove anything with numbers. :-) > > What we as Debian users know as fact (MS+Win has security flaws) is > mirrored in your numbers. Thanks for reinforcing my point. Those numbers have nothing to do with security. They were single word searches. -- Jeremy D. Zawodny | Perl, Web, MySQL, Linux Magazine, Yahoo! <[EMAIL PROTECTED]> | http://jeremy.zawodny.com/
Re: Which webmail do you prefer? Why?
On Tue, May 06, 2003 at 11:33:46PM -0400, Jim Popovitch wrote: > > -Original Message- > > From: Jeremy D. Zawodny > > Subject: Re: Which webmail do you prefer? Why? > > > > > > Why does the implementation language matter? > > Although not a very technical example, you can't ignore this: > > http://www.google.com/search?q=Perl+exploits (about 45,400 hits) > > http://www.google.com/search?q=PHP+exploits (about 128,000 hits) Windows == 63M Linux == 57M Debian== 16M Microsoft == 40M You can try to prove anything with numbers. :-) -- Jeremy D. Zawodny | Perl, Web, MySQL, Linux Magazine, Yahoo! <[EMAIL PROTECTED]> | http://jeremy.zawodny.com/
Re: Which webmail do you prefer? Why?
On Tue, May 06, 2003 at 02:23:58PM +0100, Matthew King wrote: > SquirrelMail. Webmail for nuts. Sounds weird, but it rocks. > > It's in PHP (I'd personally prefer perl) but it still works. Why does the implementation language matter? Do you care if your system binaries are written in C vs C++? I always wonder what people really mean when they say things like that--especially in this sort of context. Can you clarify why it matters? Are you trying to imply that PHP software is less likely to work? Jeremy -- Jeremy D. Zawodny | Perl, Web, MySQL, Linux Magazine, Yahoo! <[EMAIL PROTECTED]> | http://jeremy.zawodny.com/
Re: Apache: one or more instances
On Tue, May 06, 2003 at 01:00:39AM +0200, Eduard Ballester wrote: > hi > I have an Apache with several VirtualHost and now I have a doubt. > > I don't know if is better run all vh in a single instance or use two or > more Apaches in different path. I use IP-based and Port-based vhost NO > Name-based (of course). > Where I can find information or server benchmark for measuring the > performance of Apache (mutli-vhost) Might this be relevant? http://www.radwin.org/michael/blog/archives/000183.html Jeremy -- Jeremy D. Zawodny | Perl, Web, MySQL, Linux Magazine, Yahoo! <[EMAIL PROTECTED]> | http://jeremy.zawodny.com/
Re: Partitioning a Web Server
On Fri, Apr 04, 2003 at 02:11:00PM +1000, Jeremy Lunn wrote: > > I'd consider it to be generally a bad idea to have user writable > directories on the same partition as /. Therefore I always make sure > that I at least have partitions for: > / > /tmp > /home > /var Heh. That's the same scheme I use (plus swap, of course). -- Jeremy D. Zawodny | Perl, Web, MySQL, Linux Magazine, Yahoo! <[EMAIL PROTECTED]> | http://jeremy.zawodny.com/
Re: Partitioning a Web Server
On Fri, Apr 04, 2003 at 02:11:00PM +1000, Jeremy Lunn wrote: > > I'd consider it to be generally a bad idea to have user writable > directories on the same partition as /. Therefore I always make sure > that I at least have partitions for: > / > /tmp > /home > /var Heh. That's the same scheme I use (plus swap, of course). -- Jeremy D. Zawodny | Perl, Web, MySQL, Linux Magazine, Yahoo! <[EMAIL PROTECTED]> | http://jeremy.zawodny.com/ -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
Re: mod_log_sql? also missing: mod_throttle
On Fri, Mar 28, 2003 at 11:44:15AM +1000, Rudi Starcevic wrote: > Jeremy, > > >>I tried "apt-cache search thorttle" and got nothing > > try throttle instead of thorttle I hate it when poor spelling makes me look stupid. :-( Jeremy -- Jeremy D. Zawodny | Perl, Web, MySQL, Linux Magazine, Yahoo! <[EMAIL PROTECTED]> | http://jeremy.zawodny.com/
Re: mod_log_sql? also missing: mod_throttle
On Fri, Mar 28, 2003 at 11:44:15AM +1000, Rudi Starcevic wrote: > Jeremy, > > >>I tried "apt-cache search thorttle" and got nothing > > try throttle instead of thorttle I hate it when poor spelling makes me look stupid. :-( Jeremy -- Jeremy D. Zawodny | Perl, Web, MySQL, Linux Magazine, Yahoo! <[EMAIL PROTECTED]> | http://jeremy.zawodny.com/ -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
Re: mod_log_sql? also missing: mod_throttle
On Fri, Mar 28, 2003 at 01:07:23AM +0100, Peter Holm wrote: > >... also missing: mod_throttle... don?t you isp-guys use these > >essential modules? > > ok, mod_throttle found, but major problems with mod_log_sql... Really? I tried "apt-cache search thorttle" and got nothing. Jeremy -- Jeremy D. Zawodny | Perl, Web, MySQL, Linux Magazine, Yahoo! <[EMAIL PROTECTED]> | http://jeremy.zawodny.com/
Re: mod_log_sql? also missing: mod_throttle
On Fri, Mar 28, 2003 at 01:07:23AM +0100, Peter Holm wrote: > >... also missing: mod_throttle... don?t you isp-guys use these > >essential modules? > > ok, mod_throttle found, but major problems with mod_log_sql... Really? I tried "apt-cache search thorttle" and got nothing. Jeremy -- Jeremy D. Zawodny | Perl, Web, MySQL, Linux Magazine, Yahoo! <[EMAIL PROTECTED]> | http://jeremy.zawodny.com/ -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
Re: mod_log_sql?
On Thu, Mar 27, 2003 at 02:52:56PM +0100, Peter Holm wrote: > Hi, > > are there anywhere debs with mod_log_sql ??? I don't think so. At least I wasn't able to find any the last time I went searching... Jeremy -- Jeremy D. Zawodny | Perl, Web, MySQL, Linux Magazine, Yahoo! <[EMAIL PROTECTED]> | http://jeremy.zawodny.com/
Re: mod_log_sql?
On Thu, Mar 27, 2003 at 02:52:56PM +0100, Peter Holm wrote: > Hi, > > are there anywhere debs with mod_log_sql ??? I don't think so. At least I wasn't able to find any the last time I went searching... Jeremy -- Jeremy D. Zawodny | Perl, Web, MySQL, Linux Magazine, Yahoo! <[EMAIL PROTECTED]> | http://jeremy.zawodny.com/ -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
Re: Limit MySQL database sizes
On Thu, Jan 23, 2003 at 06:50:30AM +0800, Jason Lim wrote: > > > Normal filesystem quotas don't work, since the database is owned by > user > > > "MySQL" and not the user him/herself. > > > > You can chown the data files and make sure they're group-writable. > > Could you expand on that a bit? You mean make it owned by the user, and > group writable by MySQL? Exactly. > > > Right now we're using a custom script that just reports any values > over a > > > certain amount, and the possibility to "trim" very large ones, but it > > > would be much better if something like a proper quota could be put on > (eg. > > > 30Mb). > > > > > > Any ideas? > > > > There is no build-in mechanism yet. > > Mmm... then how on earth are those "Cpanels" and others doing it? Never seen one, so I'm not sure. I've been toying with the idea of writing a simple mysqlquotad that would monitor space and revoke users's INSERT privileges until they pruned their tables (after sufficient notificaiton, of course). Wouldn't be too hard to do, I just haven't found the time yet... Jeremy -- Jeremy D. Zawodny | Perl, Web, MySQL, Linux Magazine, Yahoo! <[EMAIL PROTECTED]> | http://jeremy.zawodny.com/ -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
Re: Limit MySQL database sizes
On Thu, Jan 23, 2003 at 06:02:21AM +0800, Jason Lim wrote: > Hi all, > > How can a "quota" be put on MySQL sizes? That is... in a similar fashion > to the "commercial" control panels like Cpanel and such? > > Normal filesystem quotas don't work, since the database is owned by user > "MySQL" and not the user him/herself. You can chown the data files and make sure they're group-writable. > Right now we're using a custom script that just reports any values over a > certain amount, and the possibility to "trim" very large ones, but it > would be much better if something like a proper quota could be put on (eg. > 30Mb). > > Any ideas? There is no build-in mechanism yet. -- Jeremy D. Zawodny | Perl, Web, MySQL, Linux Magazine, Yahoo! <[EMAIL PROTECTED]> | http://jeremy.zawodny.com/ -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
Re: experience with mysql 4.x
On Fri, Nov 29, 2002 at 12:38:29PM +0100, von Boehn, Gunnar wrote: > > Hi folks, > > I tested mysql 4.x for some time now and I'm very happy with it. > Besides having more features and being faster than the 3.23 line, > it gave me I very stable impression. We've been using various builds of 4.0.x in production at work for a few months now. It has worked very well. It is quite stable. -- Jeremy D. Zawodny | Perl, Web, MySQL, Linux Magazine, Yahoo! <[EMAIL PROTECTED]> | http://jeremy.zawodny.com/ -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
Re: SCSI or IDE
On Thu, Nov 28, 2002 at 08:16:51AM +0100, Thomas Lamy wrote: > Thomas Kirk [mailto:[EMAIL PROTECTED]] wrote: > > > > Hep > > > > On Mon, Nov 25, 2002 at 11:57:33AM +1300, Jones, Steven wrote: > > > > > u can get hot swap ide > > > > > > promise do one (hot swap ide), dunno how good it is mind. > > > > If you are thinking on this one -> > > http://www.promise.com/product/product_detail_eng.asp?productI > > d=90&familyId=6 > > > > Dont buy it! It as simple as that. 1 year ago i bought one of those > > bastards from promise and its slooow. Im running it as filer on a > > debian 3.0 system filesystem xfs and i havent been able to push it to > > a sustain throughput on more than 3MB/sec. This is with 8 > > 60GB IBM deskstar > > 7200rpm disks in raid5. > > [...] > > Next time i have to buy ideraid ill try 3ware for sure. > > I have one ofe those thingies running our local samba server, raid 5 w/ 3+1 > 80 Gig 7200 IBM HDDs. Works flawlessly and fast. hdparm shows the following > throughput: > > Timing buffer-cache reads: 128 MB in 0.87 seconds =147.13 MB/sec > Timing buffered disk reads: 64 MB in 1.31 seconds = 48.85 MB/sec > > This is on a dual PIII/500 w/ 256 MB. > > Not the cheapest one, but it's actually worth it. By "one of those thingies" you mean 3ware? -- Jeremy D. Zawodny | Perl, Web, MySQL, Linux Magazine, Yahoo! <[EMAIL PROTECTED]> | http://jeremy.zawodny.com/ -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
Re: Backup Web Server
On Mon, Nov 25, 2002 at 02:17:22PM -0500, Steve Mickeler wrote: > > Theres a couple of ways you can do this. > > 1) round robin dns : 2 servers with their own IP's, each serving up the > website. If one goes down, you still get a 50% success rate. > > 2) VRRP via keepalived - http://www.keepalived.org/ : 2 servers, 1 real > floating IP that is bound to the active server. If the active server dies, > the IP's are picked up by the standby server and keeps on going. > > 3) LVS ( Linux Virtual Server ) http://www.linuxvirtualserver.org/ : This > is the most involved setup but will also give you the most scalability and > availabilty by creating farms of local servers that the inbound requests > are balanced across. It can also do enhanced checks on the local servers > to make sure that only healthy nodes are answering requests. You make it sound as if #2 and #3 are disconnected. But reading the web site for #2 makes it sound as if it only works *with* LVS. Is that not true? Jeremy -- Jeremy D. Zawodny | Perl, Web, MySQL, Linux Magazine, Yahoo! <[EMAIL PROTECTED]> | http://jeremy.zawodny.com/ -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
Re: SCSI or IDE
On Sun, Nov 24, 2002 at 06:56:34PM +0100, ? ? wrote: > > About performance - IDE still uses a lot of the CPU IMHO that argument made a lot more sense when we had 300MHz CPUs. But now that most servers are far faster than that, we're talking about what, 1% or maybe 2% of the CPU? It's probably more than worth the cost savings on the SCSI premium. Jeremy -- Jeremy D. Zawodny | Perl, Web, MySQL, Linux Magazine, Yahoo! <[EMAIL PROTECTED]> | http://jeremy.zawodny.com/ -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
Re: mysqlsnapshot and InnoDB tables
On Fri, Oct 25, 2002 at 02:33:54PM +0200, Amaya wrote: > Dear friends, > > I have successfully setup MySQL replication enviroment in several > clusters at work. The thing is that it is a little cumbersome > proccess as I have to make a snapshot of the databases in the master > server everytime and I have to stop the service in order to do it. > > I have just come across mysqlsnapshot [1] and it claims [2] that it can > generate an initial snapshot and consistent bin-log for MySQL > replication (on the master server) without taking the master off-line. > The only catch is that the binary log must already be enabled. So far, so good. > The problem is that I use InnoDB and it is supposed only to work for > the MyISAM kind. Correct. > Questions come to my mind: > Would it be very hard to support both kind of databases? That depends. I don't know if it's "safe" to backup the InnoDB tablespaces without shutting the server down. I suspect that it's not because there is no way to force InnoDB to commit all logged transactions. In practice it may not be a problem, but it could be. I'll have to ask the InnoDB developer about that. If the answer is "yes", then adding support to mysqlsnapshot should be quite easy. Jeremy -- Jeremy D. Zawodny | Perl, Web, MySQL, Linux Magazine, Yahoo! <[EMAIL PROTECTED]> | http://jeremy.zawodny.com/
Re: mysqlsnapshot and InnoDB tables
On Fri, Oct 25, 2002 at 02:33:54PM +0200, Amaya wrote: > Dear friends, > > I have successfully setup MySQL replication enviroment in several > clusters at work. The thing is that it is a little cumbersome > proccess as I have to make a snapshot of the databases in the master > server everytime and I have to stop the service in order to do it. > > I have just come across mysqlsnapshot [1] and it claims [2] that it can > generate an initial snapshot and consistent bin-log for MySQL > replication (on the master server) without taking the master off-line. > The only catch is that the binary log must already be enabled. So far, so good. > The problem is that I use InnoDB and it is supposed only to work for > the MyISAM kind. Correct. > Questions come to my mind: > Would it be very hard to support both kind of databases? That depends. I don't know if it's "safe" to backup the InnoDB tablespaces without shutting the server down. I suspect that it's not because there is no way to force InnoDB to commit all logged transactions. In practice it may not be a problem, but it could be. I'll have to ask the InnoDB developer about that. If the answer is "yes", then adding support to mysqlsnapshot should be quite easy. Jeremy -- Jeremy D. Zawodny | Perl, Web, MySQL, Linux Magazine, Yahoo! <[EMAIL PROTECTED]> | http://jeremy.zawodny.com/ -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
POP-before-SMTP w/Exim and Courier IMAP/POP?
I've looked at the "drac" package, but the documentation leaves a bit to be desired. Has anyone found a good tool for doing POP (or IMAP) before SMTP to allow relaying in Exim? I'd rather not roll my own, but I guess I could... Jeremy -- Jeremy D. Zawodny | Perl, Web, MySQL, Linux Magazine, Yahoo! <[EMAIL PROTECTED]> | http://jeremy.zawodny.com/
POP-before-SMTP w/Exim and Courier IMAP/POP?
I've looked at the "drac" package, but the documentation leaves a bit to be desired. Has anyone found a good tool for doing POP (or IMAP) before SMTP to allow relaying in Exim? I'd rather not roll my own, but I guess I could... Jeremy -- Jeremy D. Zawodny | Perl, Web, MySQL, Linux Magazine, Yahoo! <[EMAIL PROTECTED]> | http://jeremy.zawodny.com/ -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
Re: Bandwidth... compression... saving $$?
On Tue, Sep 03, 2002 at 10:15:55AM +1000, Joel Michael wrote: > > However, the biggest problem I found was that when ssh disconnects, it > doesn't automatically reconnect. I guess some magic scripting would get > around that easily enough, but that's when I dropped the whole idea over > a year ago. By using keychain and a cron job to restart the tunnel every 60 seconds or so, you can minimize outages due to SSH disconnects pretty effectively. Works quite well for me in a different situation. Jeremy -- Jeremy D. Zawodny | Perl, Web, MySQL, Linux Magazine, Yahoo! <[EMAIL PROTECTED]> | http://jeremy.zawodny.com/
Re: OT: Server side scripting languages comparison
On Mon, Aug 19, 2002 at 09:55:38AM +0300, [EMAIL PROTECTED] wrote:
>
> In perl I would type "if ($debug) {", move a few lines down and type }.
> In python I would type "if debug:", press C-space, move a few lines
> down and type C-c >.
>
> I do not consider this a problem because a) emacs has a nice python
> editing mode (propably vi has one as well), b) C-space and C-c are
> easier to type on my keyboard than (){}$-characters, c) the whitespace
> has to be there anyway for readability.
You need to try cperl-mode in Emacs. It makes writing Perl code a LOT
easier.
Jeremy
--
Jeremy D. Zawodny | Perl, Web, MySQL, Linux Magazine, Yahoo!
<[EMAIL PROTECTED]> | http://jeremy.zawodny.com/
Re: Admin for E-MAIL users only
On Sun, Jul 07, 2002 at 12:19:25PM +1000, Craig Sanders wrote: > > 1. use a decent database like postgres rather than a toy like mysql You're trolling, right? -- Jeremy D. Zawodny | Perl, Web, MySQL, Linux Magazine, Yahoo! <[EMAIL PROTECTED]> | http://jeremy.zawodny.com/ -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
Re: Admin for E-MAIL users only
On Sun, Jul 07, 2002 at 12:19:25PM +1000, Craig Sanders wrote: > > 1. use a decent database like postgres rather than a toy like mysql You're trolling, right? -- Jeremy D. Zawodny | Perl, Web, MySQL, Linux Magazine, Yahoo! <[EMAIL PROTECTED]> | http://jeremy.zawodny.com/ -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
Re: how to design mysql clusters with 30,000 clients?
On Fri, May 24, 2002 at 08:01:35PM +0200, Nicolas Bougues wrote: > On Fri, May 24, 2002 at 01:42:12PM -0400, Jeff S Wheeler wrote: > > > > While he may still need a large amount of DB muscle for other things, > > using PHP/MySQL sessions for a site that really expects to have 30,000 > > different HTTP clients at peak instants is not very bright. We have > > cookies for this. Server-side sessions are a great fallback for > > paranoid end-users who disable cookies in their browser, but it is my > > understanding that PHP relies on a cookie-based session ID anyway? > > What's not very bright is rather using MySQL in a somewhat audacious > configuration, for which support is quite recent (and thus, probably > not bugfree). In a high load / high availability environnement. What's the recent stuff you speak of? Replication has been in MySQL for about 1.5 years now. > An Oracle would probably be better here. At least, it has proven > replication mechanisms. I wonder what the license costs would be in that situation? Jeremy -- Jeremy D. Zawodny | Perl, Web, MySQL, Linux Magazine, Yahoo! <[EMAIL PROTECTED]> | http://jeremy.zawodny.com/ -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
Re: how to design mysql clusters with 30,000 clients?
On Fri, May 24, 2002 at 08:01:35PM +0200, Nicolas Bougues wrote: > On Fri, May 24, 2002 at 01:42:12PM -0400, Jeff S Wheeler wrote: > > > > While he may still need a large amount of DB muscle for other things, > > using PHP/MySQL sessions for a site that really expects to have 30,000 > > different HTTP clients at peak instants is not very bright. We have > > cookies for this. Server-side sessions are a great fallback for > > paranoid end-users who disable cookies in their browser, but it is my > > understanding that PHP relies on a cookie-based session ID anyway? > > What's not very bright is rather using MySQL in a somewhat audacious > configuration, for which support is quite recent (and thus, probably > not bugfree). In a high load / high availability environnement. What's the recent stuff you speak of? Replication has been in MySQL for about 1.5 years now. > An Oracle would probably be better here. At least, it has proven > replication mechanisms. I wonder what the license costs would be in that situation? Jeremy -- Jeremy D. Zawodny | Perl, Web, MySQL, Linux Magazine, Yahoo! <[EMAIL PROTECTED]> | http://jeremy.zawodny.com/ -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
Re: MySQL on iSCSI or IPSAN?
On Wed, May 22, 2002 at 03:52:33PM +0800, Patrick Hsieh wrote: > Hello Dan Nelson <[EMAIL PROTECTED]>, > > Is there any lock problem on iSCSI or SAN environment? > Say, mutliple mysql server mount the backend iSCSI or SAN storage device. > Is it safe? It is safe if you use MySQL's external (file) locking. Jeremy -- Jeremy D. Zawodny, <[EMAIL PROTECTED]> Technical Yahoo - Yahoo Finance Desk: (408) 349-7878 Fax: (408) 349-5454 Cell: (408) 685-5936 MySQL 3.23.47-max: up 0 days, processed 976,330 queries (174/sec. avg) -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
Re: MySQL on iSCSI or IPSAN?
On Wed, May 22, 2002 at 03:52:33PM +0800, Patrick Hsieh wrote: > Hello Dan Nelson <[EMAIL PROTECTED]>, > > Is there any lock problem on iSCSI or SAN environment? > Say, mutliple mysql server mount the backend iSCSI or SAN storage device. > Is it safe? It is safe if you use MySQL's external (file) locking. Jeremy -- Jeremy D. Zawodny, <[EMAIL PROTECTED]> Technical Yahoo - Yahoo Finance Desk: (408) 349-7878 Fax: (408) 349-5454 Cell: (408) 685-5936 MySQL 3.23.47-max: up 0 days, processed 976,330 queries (174/sec. avg) -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
Re: Mail Servers
On Mon, Mar 18, 2002 at 02:28:12AM -0500, Chris Jenks wrote: > I hate asking this, but I thought that this would be the fastest > way to get the answer. > > I may be setting up a mail server for a factory. From what little > I know so far, it will be for all a mail server for all five hundred > employees. (one in each location) so they can check work > related email. I was thinking about using woody, but have > the following 2 questions. > > 1 What is the max user limit that woody + exim will support It's WAY above 500. :-) > 2 Could someone point me to a good pointer / how-to for this. If you "apt-get install exim", the configuration process will ask you enough questions to set up the basics. Then I'd hit the Exim docs. Jeremy -- Jeremy D. Zawodny | Perl, Web, MySQL, Linux Magazine, Yahoo! <[EMAIL PROTECTED]> | http://jeremy.zawodny.com/ -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
Re: Quata Support with MySQL
On Fri, Nov 02, 2001 at 02:10:38AM -0500, Keith Elder wrote: > Greetings, > > I was wondering if anyone had any type of hints as howto setup > virtual mysql accounts with quota support. There's no really good way to do it yet. MySQL itself has no quota system. And if you use OS quotas, you risk table corruption when a user goes over quota. You could have a cron jobs to compute each users usage once a day and let them know if they're over. Jeremy -- Jeremy D. Zawodny | Perl, Web, MySQL, Linux Magazine, WCNet, Yahoo! <[EMAIL PROTECTED]> | http://jeremy.zawodny.com/
Re: Quata Support with MySQL
On Fri, Nov 02, 2001 at 02:10:38AM -0500, Keith Elder wrote: > Greetings, > > I was wondering if anyone had any type of hints as howto setup > virtual mysql accounts with quota support. There's no really good way to do it yet. MySQL itself has no quota system. And if you use OS quotas, you risk table corruption when a user goes over quota. You could have a cron jobs to compute each users usage once a day and let them know if they're over. Jeremy -- Jeremy D. Zawodny | Perl, Web, MySQL, Linux Magazine, WCNet, Yahoo! <[EMAIL PROTECTED]> | http://jeremy.zawodny.com/ -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
Re: max_connections in mysql
On Fri, Aug 31, 2001 at 02:54:26PM -0700, Robert Bulletproof Bogdon wrote: > > Does anyone know why I can't seem to increase the max_connections > variable for mysql on debian? I'm running version 3.23.40-1 of all > of the mysql packages. [snip] > set-variable= max_connections=2048 > > I've looked through the included documentation and tried to dig around on > deja and google and can't come up with a reason. What error messgae do you get? How many connections can you make? -- Jeremy D. Zawodny | Perl, Web, MySQL, Linux Magazine, Yahoo! <[EMAIL PROTECTED]> | http://jeremy.zawodny.com/ -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
Re: Cyrus or Courier?
On Wed, May 16, 2001 at 01:18:23PM +0200, Russell Coker wrote: > > I am using LDAP not a database. LDAP allows replication and > OpenLDAP is free. Free databases don't do replication, and Oracle > Parallel Server costs huge amounts of money. MySQL does replication. -- Jeremy D. ZawodnyWeb Geek, Perl Hacker, Yahoo! http://www.zawodny.com/jzawodn/ [EMAIL PROTECTED]
Re: Cyrus or Courier?
On Wed, May 16, 2001 at 01:18:23PM +0200, Russell Coker wrote: > > I am using LDAP not a database. LDAP allows replication and > OpenLDAP is free. Free databases don't do replication, and Oracle > Parallel Server costs huge amounts of money. MySQL does replication. -- Jeremy D. ZawodnyWeb Geek, Perl Hacker, Yahoo! http://www.zawodny.com/jzawodn/ [EMAIL PROTECTED] -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
Re: Mysqld dying together with safe_mysql
On Tue, Jul 03, 2001 at 12:49:32PM +0200, jens-ingo brodesser wrote: > hello, > > i'm experiencing a strange problem with mysqld under debian potato. > it dies almost allways together with the safe_mysql script which is > intended to restart a dead mysql server. > > has anybody an explanation for this strange behavior of the > safe_mysql script ? What does your MySQL error log say? -- Jeremy D. ZawodnyWeb Geek, Perl Hacker, Yahoo! http://www.zawodny.com/jzawodn/ [EMAIL PROTECTED]
Re: Mysqld dying together with safe_mysql
On Tue, Jul 03, 2001 at 12:49:32PM +0200, jens-ingo brodesser wrote: > hello, > > i'm experiencing a strange problem with mysqld under debian potato. > it dies almost allways together with the safe_mysql script which is > intended to restart a dead mysql server. > > has anybody an explanation for this strange behavior of the > safe_mysql script ? What does your MySQL error log say? -- Jeremy D. ZawodnyWeb Geek, Perl Hacker, Yahoo! http://www.zawodny.com/jzawodn/ [EMAIL PROTECTED] -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
