Re: mysqldump on slave.
You havent mentioned which version of mysql your are on. If on an older version i would recommend the option --opt. Also if you are running a dump using single-transaction option on a loaded system with writes, things might slow down significantly due to different versions of rows which the server needs to maintain due to the dump. Thanks Alex On 7/6/07, Ananda Kumar <[EMAIL PROTECTED]> wrote: Hi All, I am planning to take mysqldump on slave running innodb engine. I going to use the below command /usr/bin/mysqldump --user=root --password= --flush-logs --all-databases --master-data=2 --single-transaction > alldbdump.sql Before doing the mysqldump, should i stop the slave or the above command is enough, please let know, also please let me know if any other option i can use to speed up mysqldump. regards anandkl
Re: Performance problem MySQL 4.0.20
On 7/6/07, [EMAIL PROTECTED] <[EMAIL PROTECTED]> wrote: How does the cpu power influence the speed of a query? Sort is a cpu intensive process. *Check if you are suffering from locks on the tables you look up.* Also, was the table in the system where the queries are running faster rebuilt recently. You can try rebuilding the tables. How is the overrall system load on both machines. Is one overloaded than the other ? The machine which takes longer to excute the query might be busy serving some other process other than MySQL. Thanks Alex
Re: bin-log position.
On 7/6/07, Ananda Kumar <[EMAIL PROTECTED]> wrote: -- CHANGE MASTER TO MASTER_LOG_FILE='mysql-bin.03', MASTER_LOG_POS=311; As see in the mysqldump is saying to start recovery from bin-log file "' mysql-bin.03'" and position="MASTER_LOG_POS=311", You need to use the positions specified in the mysqldump since when u restore using the data, you will get data only till the snapshot specified in the dump. Thanks Alex
Re: Performance problem MySQL 4.0.20
On 7/6/07, [EMAIL PROTECTED] <[EMAIL PROTECTED]> wrote: How does the cpu power influence the speed of a query? Sort is a cpu intensive process. *Check if you are suffering from locks on the tables you look up.* Also, was the table in the system where the queries are running faster rebuilt recently. You can try rebuilding the tables. How is the overrall system load on both machines. Is one overloaded than the other ? The machine which takes longer to excute the query might be busy serving some other process other than MySQL. Thanks Alex
Re: Full Text Search, Storage Engine Types
David T. Ashley wrote: I'm sending this again, because the server seems to have been down for several hours, and I'm not sure if it went out. Yes, I've been getting messages from yesterday, too. But I did get both of your messages. I don't know what's up. I'd like to do full text search on some fields of some tables, but I'm a bit confused by the documentation. Questions: a)How do I set that up (i.e. do I need to use a specific storage engine for a table)? Yes, MyISAM only. b)What storage engine(s) are required? c)Are there any restrictions on "mixing and matching" tables that use different storage engines in the same database? d)Do table locking and transactions work the same (for example, some of the storage engines are described as "not transaction safe"--unclear what this means)? Since it only applies to MyISAM, you have no transactions, and you get table-level locks. See http://dev.mysql.com/doc/refman/5.0/en/fulltext-search.html for more details. cheers Baron -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: Full Text Search, Storage Engines
Good Evening David- Have you considered using Lucene ? http://lucene.apache.org/java/docs/ M-- This email message and any files transmitted with it contain confidential information intended only for the person(s) to whom this email message is addressed. If you have received this email message in error, please notify the sender immediately by telephone or email and destroy the original message without making a copy. Thank you. - Original Message - From: "David T. Ashley" <[EMAIL PROTECTED]> To: Sent: Friday, July 06, 2007 9:19 PM Subject: Full Text Search, Storage Engines I'd like to do full text search on some fields of some tables, but I'm a bit confused by the documentation. Questions: a)How do I set that up? b)What storage engines are required? c)Are there any restrictions on "mixing and matching" tables? d)Do table locking and transactions work the same? Thanks. -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: LOW_PRIORITY_UPDATES
At 10:09 PM +0200 7/7/07, Ian Collins wrote: Hi, I am seeing a large lock contention on a production database (A large table_locks_waited against table_locks_immediate). I want to set low priority updates, but I don't want to shut the database down to do it. Is, set global LOW_PRIORITY_UPDATES=1; the same as starting mysql with --low_priority_updates? I think it is but want confirmation. It's the same. -- Paul DuBois, MySQL Documentation Team Madison, Wisconsin, USA MySQL AB, www.mysql.com -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: join between databases
Miguel, it's possible, but it's not normal procedure in most systems I've worked with. Separate databases are generally used for separate "systems". Reasons include more work/steps to grant privileges to users, more difficulty establishing a test system (you need a whole separate MySQL instance in your setup vs. a single database with a different name, ease of creating/restoring one database in one step vs. potentially multiple steps. You might consider prefixing table names with something to help categorize them, like mgmt_ fin_ prod_ You can join tables from different databases like so (assuming you have privileges): SELECT * FROM database1.table1 , database2.table2 WHERE ... HTH, Dan On 7/7/07, Miguel Vaz <[EMAIL PROTECTED]> wrote: Hi, I am building a new system for the place i work and i was thinking about organizing my tables in several databases, like "management", "financial", "production_line" to make things more tidy. I will have tons of tables, so is it a usual procedure in organizing tables? The other problem is about doing a join between tables that are on different databases, is that possible? For example: database: people table: users fields: id, name, email database: production table: machines fields: id, machine_job_num, id_user, etc I want to do a select on table machines that gets the user names from the table users, which is on a different databse. How can i do it? Is it even remotely possible? Sorry if the question is basic, but i searched the net all over the place and i couldnt get any answer to this. Thanks. -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
join between databases
Hi, I am building a new system for the place i work and i was thinking about organizing my tables in several databases, like "management", "financial", "production_line" to make things more tidy. I will have tons of tables, so is it a usual procedure in organizing tables? The other problem is about doing a join between tables that are on different databases, is that possible? For example: database: people table: users fields: id, name, email database: production table: machines fields: id, machine_job_num, id_user, etc I want to do a select on table machines that gets the user names from the table users, which is on a different databse. How can i do it? Is it even remotely possible? Sorry if the question is basic, but i searched the net all over the place and i couldnt get any answer to this. Thanks. -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Full Text Search, Storage Engine Types
I'm sending this again, because the server seems to have been down for several hours, and I'm not sure if it went out. - I'd like to do full text search on some fields of some tables, but I'm a bit confused by the documentation. Questions: a)How do I set that up (i.e. do I need to use a specific storage engine for a table)? b)What storage engine(s) are required? c)Are there any restrictions on "mixing and matching" tables that use different storage engines in the same database? d)Do table locking and transactions work the same (for example, some of the storage engines are described as "not transaction safe"--unclear what this means)? Thanks.
RE: moving database to new server
mysqlhotcopy is a perl script that came with your disto of mysql. If you have mysql installed on another machine then you probably already have it (I've never installed it without it being there). -Chris From: Michael Higgins [mailto:[EMAIL PROTECTED] Sent: Fri 7/6/2007 6:27 PM To: mysql@lists.mysql.com Subject: moving database to new server Hello, list -- Quick (and simple?) question: I've been backing my databases up with a perl tool mysqlhotcopy. It seems to leave me a bunch of files in a folder I specified. What is the best way to move this database function to a different machine? There are no constraints. I can take it all down, whatever. Copy the files from the database, or use the 'hot' copies? Any takers? Cheers, -- Michael Higgins <[EMAIL PROTECTED]> -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
LOW_PRIORITY_UPDATES
Hi, I am seeing a large lock contention on a production database (A large table_locks_waited against table_locks_immediate). I want to set low priority updates, but I don't want to shut the database down to do it. Is, set global LOW_PRIORITY_UPDATES=1; the same as starting mysql with --low_priority_updates? I think it is but want confirmation. Cheers, Ian. -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: off-topic unsubscribe concern
There are just spam messages. The spam robots probably found some messages from the list somewhere and our addresses, and it put all the addresses in its database. Then, as usually, it sends spam messages to all addresses, using another address from the same message as the source address. This way it sent an email to the address for unsubscribing from the list using our addresses as a source address. So we receive a confirmation for unsubscribing. So it is no problem. Octavian - Original Message - From: "B. Keith Murphy" <[EMAIL PROTECTED]> To: "Michael Dykman" <[EMAIL PROTECTED]> Cc: "mysql" Sent: Friday, July 06, 2007 10:48 PM Subject: Re: off-topic unsubscribe concern I have been having the same problems. Have no idea what is up. - Original Message - From: "Michael Dykman" <[EMAIL PROTECTED]> To: "MySQL General" Sent: Friday, July 6, 2007 11:55:41 AM (GMT-0500) America/New_York Subject: off-topic unsubscribe concern Hi everyone. I have been on this list for a pretty long time but in the last few months I have started to receive random 'confirm unsubscribe' messages.. They always seem to originate from a Roadrunner IP (I have not thoroughly tested that hypothesis). I have no accounts on or near roadrunner, so I doubt I am inadvertantly kicking these off, which was my first theory. Is anyone else suffering from this or is it just me? -- - michael dykman - [EMAIL PROTECTED] - All models are wrong. Some models are useful. -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe: http://lists.mysql.com/[EMAIL PROTECTED] -- B. Keith Murphy Database Administrator iContact 2635 Meridian Parkway, 2nd Floor Durham, North Carolina 27713 (o) 919-433-0786 (c) 850-637-3877 -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: off-topic unsubscribe concern
Same here, although they have been a little less frequent lately. From: "B. Keith Murphy" <[EMAIL PROTECTED]> Sent: Friday, July 06, 2007 3:50 PM To: Michael Dykman <[EMAIL PROTECTED]> Subject: Re: off-topic unsubscribe concern I have been having the same problems. Have no idea what is up. - Original Message - From: "Michael Dykman" To: "MySQL General" Sent: Friday, July 6, 2007 11:55:41 AM (GMT-0500) America/New_York Subject: off-topic unsubscribe concern Hi everyone. I have been on this list for a pretty long time but in the last few months I have started to receive random 'confirm unsubscribe' messages.. They always seem to originate from a Roadrunner IP (I have not thoroughly tested that hypothesis). I have no accounts on or near roadrunner, so I doubt I am inadvertantly kicking these off, which was my first theory. Is anyone else suffering from this or is it just me? -- - michael dykman - [EMAIL PROTECTED] - All models are wrong. Some models are useful. -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe: http://lists.mysql.com/[EMAIL PROTECTED] -- B. Keith Murphy Database Administrator iContact 2635 Meridian Parkway, 2nd Floor Durham, North Carolina 27713 (o) 919-433-0786 (c) 850-637-3877
Re: Import a text file
In python
-
import re
file = open("path/to/file","r")
for line in file:
line = line.replace("\n","")# this is not always needed
columns = re.split("\s+",line)
print columns#is now a list
print columns[0]
sql = "insert into ..."
-
If the file is large use
for line in fileinput.input("path/to/file"):
instead
Olaf
On 7/6/07 12:04 PM, "Scott Swaim" <[EMAIL PROTECTED]> wrote:
> I have a text file that is in the Panasonic DBS format. It is a log file
> that comes from my phone system. I have a program that monitors the serial
> port and write the input to a file. I have no control over the format of
> the file. I would like to on a nightly basis shut down the logging program
> and then upload this file to Mysql. What I don't know how to do is to have
> the file split into the correct fields.
>
>
> Here is a sample of the file
>
>
> MO 07/03 13:58:00 00:00:34 103 1817295978204
> MO 07/03 13:58:00 00:00:24 103 8175177982 05
> MO 07/03 13:59:00 00:00:23 103 8175177982 04
> MO 07/03 13:53:00 00:07:25 105 18004445445000 06
> MI 07/03 14:00:00 00:01:55 100 8177740741 01
>
>
>
> It is a fixed format so I could probably just write a script that parses the
> program
> Or write a script that adds a comma to the correct location.
>
> Does anyone have any suggestions or already have something that does this?
>
>
> Thanks in Advanced
> Scott Swaim
>
>
--
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: off-topic unsubscribe concern
Check out your signature after posting. It has the unsubscribe link added. cheers, boro Ananda Kumar schreef: Me too, every once in two days i keep getting this "UNSUBSRIBE" emails. regards anandkl On 7/7/07, B. Keith Murphy <[EMAIL PROTECTED]> wrote: I have been having the same problems. Have no idea what is up. - Original Message - From: "Michael Dykman" <[EMAIL PROTECTED]> To: "MySQL General" Sent: Friday, July 6, 2007 11:55:41 AM (GMT-0500) America/New_York Subject: off-topic unsubscribe concern Hi everyone. I have been on this list for a pretty long time but in the last few months I have started to receive random 'confirm unsubscribe' messages.. They always seem to originate from a Roadrunner IP (I have not thoroughly tested that hypothesis). I have no accounts on or near roadrunner, so I doubt I am inadvertantly kicking these off, which was my first theory. Is anyone else suffering from this or is it just me? -- - michael dykman - [EMAIL PROTECTED] - All models are wrong. Some models are useful. -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe: http://lists.mysql.com/[EMAIL PROTECTED] -- B. Keith Murphy Database Administrator iContact 2635 Meridian Parkway, 2nd Floor Durham, North Carolina 27713 (o) 919-433-0786 (c) 850-637-3877 -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: off-topic unsubscribe concern
Me too, every once in two days i keep getting this "UNSUBSRIBE" emails. regards anandkl On 7/7/07, B. Keith Murphy <[EMAIL PROTECTED]> wrote: I have been having the same problems. Have no idea what is up. - Original Message - From: "Michael Dykman" <[EMAIL PROTECTED]> To: "MySQL General" Sent: Friday, July 6, 2007 11:55:41 AM (GMT-0500) America/New_York Subject: off-topic unsubscribe concern Hi everyone. I have been on this list for a pretty long time but in the last few months I have started to receive random 'confirm unsubscribe' messages.. They always seem to originate from a Roadrunner IP (I have not thoroughly tested that hypothesis). I have no accounts on or near roadrunner, so I doubt I am inadvertantly kicking these off, which was my first theory. Is anyone else suffering from this or is it just me? -- - michael dykman - [EMAIL PROTECTED] - All models are wrong. Some models are useful. -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe: http://lists.mysql.com/[EMAIL PROTECTED] -- B. Keith Murphy Database Administrator iContact 2635 Meridian Parkway, 2nd Floor Durham, North Carolina 27713 (o) 919-433-0786 (c) 850-637-3877
moving database to new server
Hello, list -- Quick (and simple?) question: I've been backing my databases up with a perl tool mysqlhotcopy. It seems to leave me a bunch of files in a folder I specified. What is the best way to move this database function to a different machine? There are no constraints. I can take it all down, whatever. Copy the files from the database, or use the 'hot' copies? Any takers? Cheers, -- Michael Higgins <[EMAIL PROTECTED]> -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Full Text Search, Storage Engines
I'd like to do full text search on some fields of some tables, but I'm a bit confused by the documentation. Questions: a)How do I set that up? b)What storage engines are required? c)Are there any restrictions on "mixing and matching" tables? d)Do table locking and transactions work the same? Thanks.
