Using Network Block Device on Linux to build HUGE/cheap memory-base MySQL boxes.
I was talking to a friend tonight about how they use NBD to run a single system image in memory. NBD (Network Block Device) allows one Linux box to export a block device and for you to mount it on another filesystem. For the memory component they just use a ram disk. More info here: http://www.ussg.iu.edu/hypermail/linux/kernel/9704.3/0492.html Basically they just buy cheap 1U boxes with 4-8 gig and then mount them... this way they allow the process to allocate as much memory as it wants and it will them start swapping but instead of uses disk it starts using the remote memory. Since gigabit ethernet is now FASTER than most disk installs in terms of throughput this would seem like a win/win. Here's the idea I had though. MySQL (except for MySQL cluster) doesn't scale if you need to run an image across 2 boxes. For example you can't currently take two boxes and run your dataset on BOTH boxes at the same time for double scalability. What if you booted a MySQL install and told it to use NBD mounted memory? Theoretically you could build MUCH cheaper and MUCH faster clusters. Your DB writes would still back to the local (RAID) filesystem but your innodb buffer pool and other buffers would be running out of swap and into your network memory subsystem. This would allow you to have a HUGE buffer for MySQL. Buffer your whole damn database in MEMORY. The main downside I can see is fault tolerance if the ethernet port was pulled. The box would fail. Of course at this point its a bit like pulling a SCSI cable out. If this turns out to be a good way to scale MySQL someone could just pay to have NBD enhanced to support fault tolerance with mirror nodes. Thoughts? Kevin Kevin A. Burton, Location - San Francisco, CA AIM/YIM - sfburtonator, Web - http://www.feedblog.org/ GPG fingerprint: 5FB2 F3E2 760E 70A8 6174 D393 E84D 8D04 -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Permissions for /var/run/mysqld
A couple of days ago, I decided to be brave (or crazy :-) and upgrade my Ubuntu Breezy install to Dapper. It was really remarkably uneventful, I've just got a couple of rough edges to sort out. One is that dspam (3.4.9 built by me some months ago) can no longer connect to mysql when I reboot the machine. The problem appears to be permissions related. On boot, /var/run/mysqld is owned by mysql and in the root group with 770 permissions. That means that dspam can't open /var/run/mysqld/mysqld.sock to connect to the database. I've been fixing the problem with chgrp mysql /var/run/mysqld chmod 775 /var/run/mysqld but (1) is that the safe and correct thing to do and (2) if it is, how can I get mysql to do that by default when it starts? Be seeing you, norm -- Norman Walsh [EMAIL PROTECTED] | We have fewer friends than we imagine, http://nwalsh.com/| but more than we know.--Hugo Von | Hofmannsthal pgprffLtlBS4k.pgp Description: PGP signature
MySQL and OpenOffice - JDBC
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 I don't really think this is the right place to ask this question, so please forgive this post. I've tried asking the question over on the OpenOffice list, but can't get an answer. I'll try to give all the information to ease things. One of the guru's here has to have done this already: I'm running OOo on Ubuntu Gnu/Linux and trying to setup a data source - so far with no success. Following the instructions in OOo2's Help (which seem to be outdated as of 2.0), I've downloaded mm.mysql-2.0.4-bin.jar. I went to Tools-Options-OpenOffice.Org-Java and (1) Selected the Free Software Foundation JRE (2) Went to Class Path and added archive mm.mysql-2.0.4-bin.jar to the list After restarting OOo, I then went to the File-Wizards-Address Data Source. The only option available is other external data source (Is this ~ to be expected?). I select that and at Next press Settings and select MySQL (JDBC). At next, I enter the database as mysql://localhost:3306/Magicians. I check password required, enter the user and test connection. After entering the password, I get the error driver could not be loaded. OK, I don't think I left anything out. Would someone be so kind as to help me get past this? I'd appreciate it greatly. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.1 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org iD8DBQFD+Np1jeziQOokQnARAq8/AKCqNByrqBdIvXM0XSJHRSD3su0vfwCffI2A nr4xi+9GDU8/+Uhjm65e/8s= =dIta -END PGP SIGNATURE- -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: MySQL and OpenOffice - JDBC
Michael, can you connect using the command line client? sounds to me like it may be the old_password problem. http://dev.mysql.com/doc/refman/5.0/en/old-client.html -- George - Original Message - From: Michael Satterwhite [EMAIL PROTECTED] To: MySQL List mysql@lists.mysql.com Sent: Sunday, February 19, 2006 3:52 PM Subject: MySQL and OpenOffice - JDBC -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 I don't really think this is the right place to ask this question, so please forgive this post. I've tried asking the question over on the OpenOffice list, but can't get an answer. I'll try to give all the information to ease things. One of the guru's here has to have done this already: I'm running OOo on Ubuntu Gnu/Linux and trying to setup a data source - so far with no success. Following the instructions in OOo2's Help (which seem to be outdated as of 2.0), I've downloaded mm.mysql-2.0.4-bin.jar. I went to Tools-Options-OpenOffice.Org-Java and (1) Selected the Free Software Foundation JRE (2) Went to Class Path and added archive mm.mysql-2.0.4-bin.jar to the list After restarting OOo, I then went to the File-Wizards-Address Data Source. The only option available is other external data source (Is this ~ to be expected?). I select that and at Next press Settings and select MySQL (JDBC). At next, I enter the database as mysql://localhost:3306/Magicians. I check password required, enter the user and test connection. After entering the password, I get the error driver could not be loaded. OK, I don't think I left anything out. Would someone be so kind as to help me get past this? I'd appreciate it greatly. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.1 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org iD8DBQFD+Np1jeziQOokQnARAq8/AKCqNByrqBdIvXM0XSJHRSD3su0vfwCffI2A nr4xi+9GDU8/+Uhjm65e/8s= =dIta -END PGP SIGNATURE- -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED] -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Table grows much faster than others.
Hi, I have one table which grows at a much faster rate than the rest. It has 80 times more entries than the second largest table, which has 10k rows. What are the steps I can take to slow down the growth? Can I partition the table? Will the size of the table affect the perfomance of queries? I am running mysql 4.018 on win2k. Please CC replies to me as I'm not subscribed to the list. Thanks. -- [EMAIL PROTECTED] -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: Table grows much faster than others.
In the last episode (Feb 20), Song Ken Vern-E11804 said: I have one table which grows at a much faster rate than the rest. It has 80 times more entries than the second largest table, which has 10k rows. What are the steps I can take to slow down the growth? The only thing you can do is to insert less records :) 800k rows is a pretty small table, though, and shouldn't cause you any problems. Can I partition the table? Partitioning will be available in mysql 5.1. In older mysqls, you can use VIEWs or MERGE tables and manually migrate older records. Will the size of the table affect the perfomance of queries? It all depends on your queries, of course. Simple 1-record queries will slow down at a rate of O(log n), where n=your table size, assuming you have indexes on everything. -- Dan Nelson [EMAIL PROTECTED] -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
