Re: Big innodb tables, how can I work with them?

2014-05-19 Thread Manuel Arostegui
2014-05-15 14:26 GMT+02:00 Antonio Fernández Pérez antoniofernan...@fabergroup.es: ​ ​ ​Hi, I have in my server database some tables that are too much big and produce some slow query, even with correct indexes created. For my application, it's necessary to have all the data because we

Re: Big innodb tables, how can I work with them?

2014-05-19 Thread Manuel Arostegui
2014-05-19 11:49 GMT+02:00 Johan De Meersman vegiv...@tuxera.be: - Original Message - From: Manuel Arostegui man...@tuenti.com Subject: Re: Big innodb tables, how can I work with them? noSQL/table sharding/partitioning/archiving. I keep wondering how people believe that NoSQL

Re: mysql Access denied error

2014-05-05 Thread Manuel Arostegui
2014-05-05 4:17 GMT+02:00 EdwardKing zhan...@neusoft.com: I use mysql to create a database and grant rights to a user hadooptest,then I use hadooptest to login mysql and use the database,but it failed. Why raise error after I grant rights? How to solve it? Thanks. My operation is follows:

Re: mysql Access denied error

2014-05-05 Thread Manuel Arostegui
2014-05-05 10:00 GMT+02:00 Reindl Harald h.rei...@thelounge.net: Am 05.05.2014 08:34, schrieb Manuel Arostegui: % doesn't match localhost so if you don't specify it you will be attempting to connect via Unix Socket. If you don't want to specify -hlocalhost all the time, just do the grant

Re: mysql Access denied error

2014-05-05 Thread Manuel Arostegui
2014-05-05 10:57 GMT+02:00 Reindl Harald h.rei...@thelounge.net: Am 05.05.2014 10:19, schrieb Manuel Arostegui: 2014-05-05 10:00 GMT+02:00 Reindl Harald h.rei...@thelounge.netmailto: h.rei...@thelounge.net: Am 05.05.2014 08:34, schrieb Manuel Arostegui: % doesn't match

Re: Difference between log-buffer flushing and log-buffer syncing?

2014-04-17 Thread Manuel Arostegui
2014-04-17 11:11 GMT+02:00 Ajay Garg ajaygargn...@gmail.com: On Thu, Apr 17, 2014 at 2:28 PM, Reindl Harald h.rei...@thelounge.net wrote: Am 17.04.2014 10:55, schrieb Ajay Garg: I do understand the meaning of Unix sync function. So, you mean to say that flushing and syncing are

Re: Data masking for mysql

2014-04-15 Thread Manuel Arostegui
2014-04-15 8:52 GMT+02:00 reena.kam...@jktech.com: Hi, I need to do data masking to sensitive data exists in mysql db. is there any data masking tool available for mysql with linux platform. if yes... please provide the links. else... please suggest other alternatives for this requirement.

Re: Things to be considered before/after the OS patch or upgrade

2014-04-15 Thread Manuel Arostegui
2014-04-15 12:05 GMT+02:00 Radoulov, Dimitre cichomit...@gmail.com: Hi Reindl, On 15/04/2014 11:32, Reindl Harald wrote: Am 15.04.2014 11:22, schrieb Radoulov, Dimitre: we're going to patch our MySQL servers. Most of them are RHEL/OEL 5.x and are going to be upgraded to 5.x+n (for

Re: Locking a Database (not tables) x

2014-03-22 Thread Manuel Arostegui
2014-03-21 18:42 GMT+01:00 David Lerer dle...@univision.net: Frequently, we import a production dump that contains only 1 or 2 databases into one of our QA instances that contains many more databases. (i.e. database being a schema or a catalogue). At the beginning of the import script, we

Re: DBA: please review my.cnf [for Java Hibernate application] and give suggestions

2014-02-12 Thread Manuel Arostegui
2014-02-12 12:32 GMT+01:00 Lukas Lehner webleh...@gmail.com: Hi Antonio all tables use InnoDB. The size is 27 GB (not yet in prod). I guess in prod it will be fast 80GB. Depending on how your application is going to use MySQL resources you will need to tweak some things (and not only

Re: replication question replacing the master

2014-01-18 Thread Manuel Arostegui
2014/1/17 Richard Reina gatorre...@gmail.com I have 3 relay MySQL database servers on my small office LAN backing up a master and 3 more machines backing up each relay (1 each). They are all replicating all databases and all tables. The master although running fine is almost eight years old.

Re: ERROR 2013 (HY000): Lost connection to MySQL server during query

2014-01-08 Thread Manuel Arostegui
2014/1/7 h...@tbbs.net 2014/01/06 17:07 +0100, Reindl Harald what about look in the servers logfiles most likely max_allowed_packet laughable low Is this then, too, likly when the server and the client are the same machine? I left this out, that it only then happens when the client has

Re: InnoDB error 5

2013-11-21 Thread Manuel Arostegui
2013/11/21 Reindl Harald h.rei...@thelounge.net Am 21.11.2013 13:51, schrieb Paul Halliday: Had a system crash this morning and I can't seem to get mysql back up and running. This is the error: InnoDB: Progress in percent: 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

Re: Archive Engine Question

2013-09-18 Thread Manuel Arostegui
2013/9/17 Wayne Leutwyler wleut...@columbus.rr.com Hello List, I have a customer who is wanting to use the Archive Engine. I have no experience with this engine, other than what I am been reading. Why would I want to use Archive over InnoDB. They are only going to be placing audit

Re: Performance hiccoughs..

2013-08-14 Thread Manuel Arostegui
2013/8/14 Andy Wallace awall...@ihouseweb.com Hey all - We have been focusing on performance in our systems a lot lately, and have made some pretty good progress. Upgrading the mySQL engine from 5.1 to 5.5 was eye-opening. But there are still issues, and one in particular is vexing. It

Re: hypothetical question about data storage

2013-07-30 Thread Manuel Arostegui
2013/7/30 Rick James rja...@yahoo-inc.com Elevator... If the RAID _controller_ does the Elevator stuff, any OS optimizations are wasted. And there have been benchmarks backing that up. (Sorry, don't have any links handy.) RAID 5/10 ... The testing I have done shows very little

Re: InnoDB problem.

2013-07-23 Thread Manuel Arostegui
2013/7/23 Rick James rja...@yahoo-inc.com Did you change innodb_log_file_size? innodb_log_file_size error always appears in the logs...he only posted a few lines of his log...but I guess (or I want to believe) he's gone through the whole log before starting the thread :-) Manuel

Re: mysql on zfs

2013-06-28 Thread Manuel Arostegui
Hello, Do you have trim enabled? Maybe those stalls could happen when the disks are getting trimmed. Just a random thought. Manuel 2013/6/28, nixofortune nixofort...@gmail.com: Hi guys, Did you have any experience running MyLSQ or in my case MariaDB 5.5.31 on FreeBSD on top of zfs? We are

Re: help: innodb database cannot recover

2013-06-20 Thread Manuel Arostegui
2013/6/20 Peter one2001...@yahoo.com Hello, I copied innodb database (ib_logfile0 ib_logfile1 ibdata1 and the whole database directory) from one crashed machine to another. I find that I cannot start database to get the database data any more. How did you copy the database? Manuel

Re: help: innodb database cannot recover

2013-06-20 Thread Manuel Arostegui
2013/6/20 Peter one2001...@yahoo.com 2013/6/20 Peter one2001...@yahoo.com Hello, I copied innodb database (ib_logfile0 ib_logfile1 ibdata1 and the whole database directory) from one crashed machine to another. I find that I cannot start database to get the database data any more. How

Re: open files in mysqld 5.1.53

2013-06-12 Thread Manuel Arostegui
2013/6/12 walter harms wha...@bfs.de Hi list, i am trying to understand the incredible use of filepointers in our mysql server (5.1.53). under normal condition the server reports 10k-15k open files pointer. I run a 'flush tables' every 2h to avoid problems, the number of users/connections

Re: Stopping mysql does not always stop it?

2013-06-06 Thread Manuel Arostegui
2013/6/6 Mike Franon kongfra...@gmail.com I am running mysql 5.0 for now, and I have a script that I wrote at 12 am, that stops mysql server, unmounts the disk that has mysql, and takes a different snapshot from amazon as the new disk. Long story short, 50% of the time the command

Re: Stopping mysql does not always stop it?

2013-06-06 Thread Manuel Arostegui
2013/6/6 Reindl Harald h.rei...@thelounge.net Am 06.06.2013 15:39, schrieb Manuel Arostegui: Once that problem has been found...you can use either /etc/init.d/mysql stop or mysqladmin. Both should work in the same way You should never use kill and why? what do you think does any stop

Re: Mysql server - which filesystem to choose? Is it really that important nowadays?

2013-05-23 Thread Manuel Arostegui
2013/5/22 Tim Callaghan tmcallag...@gmail.com Rafal, I don't believe TRIM is supported for XFS. I tried this two weeks ago and worked pretty well: http://xfs.org/index.php/FITRIM/discard Manuel.

Re: Mysql server - which filesystem to choose? Is it really that important nowadays?

2013-05-22 Thread Manuel Arostegui
2013/5/22 Rafał Radecki radecki.ra...@gmail.com Hi All. I use mysql/perconna/maria on my production CentOS 6 Linux servers. I currently try to choose the default filesystem for partitions with mysql data. Some time ago (previous dba) reiserfs was the choice but now it is not in the kernel

Re: Chain Replication QUestion

2013-04-30 Thread Manuel Arostegui
2013/4/30 Richard Reina gatorre...@gmail.com I have a few slaves set up on my local network that get updates from my main mysql database master. I was hoping to turn one into a master while keeping it a slave so that I can set up a chain. Does anyone know where I can find a how to or other

Re: Determing number of queries

2013-04-04 Thread Manuel Arostegui
2013/4/4 Richard Reina gatorre...@gmail.com I am looking to spec out hardware for a new database server. I figured a good starting point would be to find out how much usage my current server is getting. It just a local machine that runs mysql and is queried by a few users here in the office.

Re: Determing number of queries

2013-04-04 Thread Manuel Arostegui
2013/4/4 h...@tbbs.net 2013/04/04 22:40 +0200, Manuel Arostegui You can start with show innodb status; It is now show engine innodb status Yep, sorry, not used to it just yet :-) -- Manuel Aróstegui Systems Team tuenti.com

Re: Importing SQL dumps into MySQL through Command line

2013-03-31 Thread Manuel Arostegui
2013/3/31 Norah Jones nh.jone...@gmail.com Hi, To source sqldump i can use the source command, but if I need to do the same stuff using command line without going to the sqlpromt, can I achieve that. Hello, You mean cat sqldump.sql | mysql -uwhatever -pwhatever whatever_database ?

Re: Defragmentation of MySQL tables, how many times have I to do it?

2013-03-28 Thread Manuel Arostegui
Hello Antonio, As Reindl said, it is recommended but it shouldnt be done just everyday if your tables are quite big and you use query cache. If you do have lot of writes and deletes (depending on what you consider a lot), your table will indeed have lot of 'blank rows' which eat disk space.

Re: How to change max simultaneous connection parameter in mysql.

2013-03-24 Thread Manuel Arostegui
2013/3/24 Reindl Harald h.rei...@thelounge.net Am 24.03.2013 05:20, schrieb spameden: 2013/3/19 Rick James rja...@yahoo-inc.com: you never have hosted a large site Check my email address before saying that. :D as said, big company does not have only geniusses 20 may be low, but

Re: Promoting MySQL 5.5 slave to master

2013-03-21 Thread Manuel Arostegui
2013/3/21 Miguel González Castaños miguel_3_gonza...@yahoo.es Dear all, I have a pretty simple setup. A LAMP server in production and a failover LAMP server in case the main server is down. I have been searching around to find out a clear answer of how to proceed when you need to

Re: Promoting MySQL 5.5 slave to master

2013-03-21 Thread Manuel Arostegui
2013/3/21 Miguel Gonzalez miguel_3_gonza...@yahoo.es Can you elaborate about this? I thought that once you fixed the issues in the master server you needed to set it as slave of the new promoted master server, and do the other way round. That's why you might want to have master-master

Re: How to change max simultaneous connection parameter in mysql.

2013-03-16 Thread Manuel Arostegui
2013/3/16 Kevin Peterson qh.res...@gmail.com I am using PHP along with mysql. Mysql default configuration allows to have 100 simultaneous connection which I want to chane to 200. Please help. If you're reaching too many connections quite often, this change can imply memory problems in your

Re: Multi-Master Replication Manager - monitor works but mmm_control show executes very long and sometimes returns no output.

2013-03-11 Thread Manuel Arostegui
2013/3/11 Rafał Radecki radecki.ra...@gmail.com Hi All. I use: cat /etc/redhat-release CentOS release 6.3 (Final) uname -a Linux prod1.local 2.6.32-279.14.1.el6.x86_64 #1 SMP Tue Nov 6 23:43:09 UTC 2012 x86_64 x86_64 x86_64 GNU/Linux on db host: rpm -qa | grep mmm

Re: Upgrading form mysql 5.0.90 to 5.5 or 5.6

2013-02-16 Thread Manuel Arostegui
2013/2/15 Reindl Harald h.rei...@thelounge.net our database is 400 GB, mysqldump is 600MB was not a typo and you honestly believed that you can import this dump to somewhat? WTF - as admin you should be able to see if the things in front of you are theoretically possible before your start

Re: slave replication with lots of 'duplicate entry' errors

2013-02-15 Thread Manuel Arostegui
2013/2/14 Robert Citek robert.ci...@gmail.com According to the client, nothing is writing to the slave and everything is being logged at the master. I have not had the opportunity to independently verified any of this, yet. I do know that the slave is not in read-only mode, but rather we

Re: Upgrading form mysql 5.0.90 to 5.5 or 5.6

2013-02-14 Thread Manuel Arostegui
2013/2/14 Mike Franon kongfra...@gmail.com Great thanks for the info, I guess the best way to do this is take a spare server, set it up with our standard setup, and then start the upgrade as you said 5.0 - 5.1 - 5.5, test and then upgrade to 5.6 and test. Do not forget to leave that spare

Re: slave replication with lots of 'duplicate entry' errors

2013-02-14 Thread Manuel Arostegui
2013/2/13 Robert Citek robert.ci...@gmail.com On Wed, Feb 13, 2013 at 8:59 AM, Robert Citek robert.ci...@gmail.com wrote: Any other possibilities? Do other scenarios become likely if there are two or more tables? Of those, which are the most likely? [from off-list responder]: Other

Re: log sequence number InnoDB: is in the future!?

2013-02-04 Thread Manuel Arostegui
2013/2/3 Larry Martell larry.mart...@gmail.com We also ended up dropping the database and restoring from dumps. However all recent dumps ended up having a similar corruption and we were still getting the same errors. We had to go back to an October dump before it would come up cleanly. And

Re: log sequence number InnoDB: is in the future!?

2013-01-28 Thread Manuel Arostegui
2013/1/28 walter harms wha...@bfs.de hi list, i am using mysql 5.1.53. after a crash i have the follwing error in my log: 130128 10:45:25 InnoDB: Error: page 61 log sequence number 0 2871649158 InnoDB: is in the future! Current system log sequence number 0 2494349480. InnoDB: Your

Re: Handlersockets - mutex_delay contention

2012-12-12 Thread Manuel Arostegui
disabling the transactions limit. Manuel. 2012/12/7 Manuel Arostegui man...@tuenti.com Hello all, I am testing handlersockets performance in a 5.5.28-29.1-log (Percona) server. These are the enabled options: loose_handlersocket_port = 9998 loose_handlersocket_port_wr =

Handlersockets - mutex_delay contention

2012-12-07 Thread Manuel Arostegui
Hello all, I am testing handlersockets performance in a 5.5.28-29.1-log (Percona) server. These are the enabled options: loose_handlersocket_port = 9998 loose_handlersocket_port_wr = loose_handlersocket_threads = 48 loose_handlersocket_threads_wr = 1 innodb_spin_wait_delay=0 The machine

Re: MySQL Replication Error

2012-12-05 Thread Manuel Arostegui
2012/11/30 Néstor rot...@gmail.com I am trying to set up mysql replication on 2 systems but Once I get it going, I get the following an error 1062, skip I have re-installed the database on the slave also to see if this fixes the problem but after a few minutes I get the same error. I

Re: Innodb, MySQL 5.5.28 - Would an incorrect setting in my.cnf cause mysqld to randomly crash on high load?

2012-11-26 Thread Manuel Arostegui
Hi Tom, I am assuming nothing relevant shows up in dmesg, right? I have experienced random crashes like that and most of them turned to be HW issues - hard disk and memory banks related. Is it a HW RAID? Have you tried looking at the controller logs? (Megacli). And yes, corrupted tables would

Re: Replication between different versions

2012-11-15 Thread Manuel Arostegui
2012/11/15 Lorenzo Milesi max...@ufficyo.com Hi. Is it possible to have a master/master replication between servers of different versions? Now I've two 5.0.51 syncing themselves. I'm installing a new server with 5.5.28 and I'd like if I can upgrade but still mantaining compatibility.

Re: Assistance with replication

2012-11-12 Thread Manuel Arostegui
2012/11/12 Machiel Richards - Gmail machiel.richa...@gmail.com Hi Guys We need some assistance with a master slave setup we are experiencing some issues with. We have one master with 2 slaves replicating from it. Both the slaves stopped working this morning in the

Re: Assistance with replication

2012-11-12 Thread Manuel Arostegui
2012/11/12 Machiel Richards - Gmail machiel.richa...@gmail.com Hi Manuel Please take careful note of what I have stated in the original mail. 1. the fact that the slaves say seconds behind master = 0 does not neccesarily mean that repliication is working as I have found

Re: How to verify mysqldump files

2012-11-07 Thread Manuel Arostegui
2012/11/7 Ananda Kumar anan...@gmail.com you can use checksum to make sure there are not corruption in the file That would work for the file integrity itself not for the data integrity _in_ the file. As Claudio suggested, probably going thru the whole recovery process from time to time is

Re: Mysql backup for large databases

2012-11-02 Thread Manuel Arostegui
Hello, Just one more suggestion to do full backups in large databases: - Dedicated slave (either physical machine, a disk cabinet using iscsi connections from a machine just with a bunch of RAM etc) - Get the slave delayed a certain time (ie: 1 hour, 2 hours...depends on your workload) using

Re: Replication Question

2012-10-26 Thread Manuel Arostegui
2012/10/25 Sabika M sabika.makhd...@gmail.com I have replication setup in the following way: A - B -C I am making updates to server A. I want to stop all my updates and point them to server C. After I start writing to server C, can I use the change master statement to make the C the master

Re: monitoring tool

2012-10-10 Thread Manuel Arostegui
2012/10/10 Aastha aast...@gmail.com Hi, Are there any open source MYSQL rela time monitoring tools available in the market. Aastha Hello Aastha, You should try to be more specific when asking for stuff. What do you want to monitor? reads/writes? QPS? threads? etc Thanks Manuel.

Re: monitoring tool

2012-10-10 Thread Manuel Arostegui
2012/10/10 Aastha aast...@gmail.com it should do the following: 1. give the status of the health of the nodes -Primary concern What do you mean with health of the nodes? mysqld running? master-slaves up and sync'ed? replication not broken? you using NDB?. Still a very vague explanation.

Re: InnoDB corrupt after power failure

2012-10-04 Thread Manuel Arostegui
2012/10/4 Andrew Miklas and...@pagerduty.com Hi guys, I recently had a data corruption issue with InnoDB. MySQL was shut down improperly (power failure), and when the system came back up, MySQL refused to start. On inspection of the logs (see below), it looks like the tablespace became

Re: InnoDB vs. other storage engines

2012-09-19 Thread Manuel Arostegui
2012/9/19 Mark Haney ma...@abemblem.com I hope this doesn't end in some kind of flame war. I'm looking to optimize my tables (and performance in general) of the DB my web app is using. I'm tweaking things a little at a time, but I'm curious as to what the rest of the MySQL list thinks about

Re: Temporary table creation fails

2012-09-10 Thread Manuel Arostegui
2012/9/10 Machiel Richards - Gmail machiel.richa...@gmail.com Hi, permissions are confirmed as being correct. Other applications and users are currently writing files to this directory yes. Have you tried su - mysql and touch /tmp/test? (if your mysql user has shell...) Good luck!

Re: Understanding Slow Query Log

2012-09-05 Thread Manuel Arostegui
2012/9/5 Adarsh Sharma eddy.ada...@gmail.com Actually that query is not my concern : i have a query that is taking so much time : Slow Log Output : # Overall: 195 total, 16 unique, 0.00 QPS, 0.31x concurrency _ # Time range: 2012-09-01 14:30:01 to 2012-09-04 14:13:46 #