Re: tcmalloc mysql 5.7.14
Hi Shawn Thank you for the response. I have in fact in the meantime installed jemmalloc libraries on a few servers and the issue with the memory is definitely gone when using jemmalloc library. I do still feel this is a bug though , as I am only able to produce this issue when using mysql 5.7 on ubuntu using the system memory libraries. Using other libraries like jemmalloc now seems to work 100% again, and in previous versions of mysql on same OS , using system libraries also works 100%. This issue I have is only present when using mysql 5.7. I have logged this as a bug, however simply got a reply that it is not a bug. but all the other tests as well as the new jemmalloc was all tested on the same machine and OS. Thank you for all the assistance though... Regards On Sat, May 13, 2017 9:41 pm, shawn l.green wrote: > (yes, I recognize how late this reply is) > > > On 5/8/2017 7:56 AM, Reindl Harald wrote: > >> >> >> Am 08.05.2017 um 13:51 schrieb Machiel Richards: >> >>> We are having an issue with memory allocations on mysql 5.7.14 >>> whereby mysql is not releasing the memory that is being allocated >>> during mysqldump processes. >>> >>> This has been logged as a bug with mysql dev team however they do >>> not see this as a bug and suggested we test using another malloc >>> library such as tcmalloc. >>> >>> However from what I can see, this is no longer included in mysql 5.7 >>> and thus I am trying to find out if anyone can tell me how to enable / >>> install this and how to tell mysql to use this library. >> >> does the oracle stuff not support "jemalloc" like MariaDB >> >> MariaDB even suppports "-DWITH_JEMALLOC=system" because it's not the >> job of random software ship and build random library sources in their >> tarballs which usually don't get much attention in case of updates >> (others than system packages) >> >> > > Yes, if your system has the jemalloc library on it, MySQL can use it. > One way to activate it is with this option to mysqld_safe. > > > https://dev.mysql.com/doc/refman/5.7/en/mysqld-safe.html#option_mysqld_sa > fe_malloc-lib > > And, you can control whether the InnoDB engine uses it's own memory > management routines or those provided by the operating system: > https://dev.mysql.com/doc/refman/5.7/en/innodb-performance-use_sys_malloc > .html > > > > > Just because we don't bundle a library with our software does not mean > that our end users cannot download one for their operating system from > other reputable sources (like the Google devs for tcmalloc, for example) > > -- > Shawn Green > MySQL Senior Principal Technical Support Engineer > Oracle USA, Inc. - Integrated Cloud Applications & Platform Services > Office: Blountville, TN > > > Become certified in MySQL! Visit https://www.mysql.com/certification/ > for details. > > -- > MySQL General Mailing List > For list archives: http://lists.mysql.com/mysql > To unsubscribe:http://lists.mysql.com/mysql > > > -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/mysql
Re: tcmalloc mysql 5.7.14
(yes, I recognize how late this reply is) On 5/8/2017 7:56 AM, Reindl Harald wrote: Am 08.05.2017 um 13:51 schrieb Machiel Richards: We are having an issue with memory allocations on mysql 5.7.14 whereby mysql is not releasing the memory that is being allocated during mysqldump processes. This has been logged as a bug with mysql dev team however they do not see this as a bug and suggested we test using another malloc library such as tcmalloc. However from what I can see, this is no longer included in mysql 5.7 and thus I am trying to find out if anyone can tell me how to enable / install this and how to tell mysql to use this library. does the oracle stuff not support "jemalloc" like MariaDB MariaDB even suppports "-DWITH_JEMALLOC=system" because it's not the job of random software ship and build random library sources in their tarballs which usually don't get much attention in case of updates (others than system packages) Yes, if your system has the jemalloc library on it, MySQL can use it. One way to activate it is with this option to mysqld_safe. https://dev.mysql.com/doc/refman/5.7/en/mysqld-safe.html#option_mysqld_safe_malloc-lib And, you can control whether the InnoDB engine uses it's own memory management routines or those provided by the operating system: https://dev.mysql.com/doc/refman/5.7/en/innodb-performance-use_sys_malloc.html Just because we don't bundle a library with our software does not mean that our end users cannot download one for their operating system from other reputable sources (like the Google devs for tcmalloc, for example) -- Shawn Green MySQL Senior Principal Technical Support Engineer Oracle USA, Inc. - Integrated Cloud Applications & Platform Services Office: Blountville, TN Become certified in MySQL! Visit https://www.mysql.com/certification/ for details. -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/mysql
Re: tcmalloc mysql 5.7.14
I upgraded my mysql on my laptop to the MariaDB which is using the jemmalloc as you stated and that seems to work well. However on the servers it is running the Percona mysql 5.7.14 and there are no specific malloc libraries configured. >From what I understood , this then uses the normal OS malloc libraries , but this has proven to be problematic. So even if I can setup jemmalloc as a test to see if it makes a difference, that would help, however I am not sure how to enable / install it on percona mysql 5.7.14 though so this is where I need some help. I would really appreciate any help here. Regards On Mon, May 8, 2017 1:56 pm, Reindl Harald wrote: > > > Am 08.05.2017 um 13:51 schrieb Machiel Richards: > >> We are having an issue with memory allocations on mysql 5.7.14 whereby >> mysql is not releasing the memory that is being allocated during >> mysqldump processes. >> >> This has been logged as a bug with mysql dev team however they do not >> see this as a bug and suggested we test using another malloc library such >> as tcmalloc. >> >> However from what I can see, this is no longer included in mysql 5.7 >> and thus I am trying to find out if anyone can tell me how to enable / >> install this and how to tell mysql to use this library. > > does the oracle stuff not support "jemalloc" like MariaDB > > MariaDB even suppports "-DWITH_JEMALLOC=system" because it's not the job > of random software ship and build random library sources in their tarballs > which usually don't get much attention in case of updates (others than > system packages) > > -- > MySQL General Mailing List > For list archives: http://lists.mysql.com/mysql > To unsubscribe:http://lists.mysql.com/mysql > > > -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/mysql
Re: tcmalloc mysql 5.7.14
Am 08.05.2017 um 13:51 schrieb Machiel Richards: We are having an issue with memory allocations on mysql 5.7.14 whereby mysql is not releasing the memory that is being allocated during mysqldump processes. This has been logged as a bug with mysql dev team however they do not see this as a bug and suggested we test using another malloc library such as tcmalloc. However from what I can see, this is no longer included in mysql 5.7 and thus I am trying to find out if anyone can tell me how to enable / install this and how to tell mysql to use this library. does the oracle stuff not support "jemalloc" like MariaDB MariaDB even suppports "-DWITH_JEMALLOC=system" because it's not the job of random software ship and build random library sources in their tarballs which usually don't get much attention in case of updates (others than system packages) -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/mysql
tcmalloc mysql 5.7.14
Hi Guys I hope this mail finds everyone well. We are having an issue with memory allocations on mysql 5.7.14 whereby mysql is not releasing the memory that is being allocated during mysqldump processes. This has been logged as a bug with mysql dev team however they do not see this as a bug and suggested we test using another malloc library such as tcmalloc. However from what I can see, this is no longer included in mysql 5.7 and thus I am trying to find out if anyone can tell me how to enable / install this and how to tell mysql to use this library. I need to do some tests in order to see if this will resolve the memory issues. Regards -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/mysql
