Here's all the buffer variables:

mysql> show variables like '%buffer%'\G
*************************** 1. row ***************************
Variable_name: bulk_insert_buffer_size
        Value: 8388608
*************************** 2. row ***************************
Variable_name: innodb_buffer_pool_awe_mem_mb
        Value: 0
*************************** 3. row ***************************
Variable_name: innodb_buffer_pool_size
        Value: 8388608
*************************** 4. row ***************************
Variable_name: innodb_log_buffer_size
        Value: 1048576
*************************** 5. row ***************************
Variable_name: join_buffer_size
        Value: 131072
*************************** 6. row ***************************
Variable_name: key_buffer_size
        Value: 402653184
*************************** 7. row ***************************
Variable_name: myisam_sort_buffer_size
        Value: 67108864
*************************** 8. row ***************************
Variable_name: net_buffer_length
        Value: 16384
*************************** 9. row ***************************
Variable_name: preload_buffer_size
        Value: 32768
*************************** 10. row ***************************
Variable_name: read_buffer_size
        Value: 67104768
*************************** 11. row ***************************
Variable_name: read_rnd_buffer_size
        Value: 67104768
*************************** 12. row ***************************
Variable_name: sort_buffer_size
        Value: 67108856
12 rows in set (0.00 sec)

I'll bump innodb_buffer_pool_size to 2G and see how that goes. Thanks for the tips, if there's additional innodb tuning parameters folks tend to hit first I'd be glad to try them as well.
--
Ryan Schwartz


On Sep 4, 2008, at 8:16 AM, Johnny Withers wrote:

If you do have a fair about of innodb tables you can increase performance by increasing the size of innodb_buffer_pool_size. According to your status output, you are currently using the entire buffer pool:

*************************** 137. row ***************************
Variable_name: Innodb_buffer_pool_pages_free
      Value: 0

It seems to be set small anyway:

Variable_name: Innodb_buffer_pool_pages_data
      Value: 501

It also seems that you do have alot of innodb data:

*************************** 151. row ***************************
Variable_name: Innodb_data_read
      Value: 27743085907968


Again, i don't know what you have innodb_buffer_pool_size set to, but you have plenty of RAM, I'd set it to about 4.5GB and see if that helps. I also don't know mucha bout OS X and your hardware.. is it 64bit? If it is not 64bit, you probably can't use 4.5GB as the size of your buffer pool.

-johnny

On 9/3/08, Ryan Schwartz <[EMAIL PROTECTED]> wrote: All,

We're seeing a huge surge in our qps and I'd like to make sure we're tuned as well as we can be. I'm wondering if I've got some variables maybe set too large (is that even possible?) ? We do have a fair bit of innodb, so perhaps I should add some non-defaults there, but I'm not so sure where to start with that.

Hardware is an Apple Xserve, 2x Quad-Core Intel @ 3Ghz, 32GB RAM, 3x 280 GB SAS drives in Raid-5 config, OS is Mac OS X 10.5.4 and here's my my.cnf:

[billie:~] admin$ egrep -v '^$|^#' /etc/my.cnf
[client]
port            = 3306
socket          = /var/mysql/mysql.sock
[mysqld]
port            = 3306
socket          = /var/mysql/mysql.sock
skip-locking
key_buffer = 384M
max_allowed_packet = 50M
table_cache = 2048
sort_buffer_size = 64M
read_buffer_size = 64M
read_rnd_buffer_size = 64M
myisam_sort_buffer_size = 64M
thread_cache_size = 100
query_cache_size = 64M
thread_concurrency = 16
skip-thread-priority
max_connections = 750
old-passwords
innodb_file_per_table
innodb_flush_log_at_trx_commit=1
sync_binlog=1
log-slow-queries
long_query_time=2
log_queries_not_using_indexes
log-bin=mysql-bin
server-id       = 4
[mysqldump]
quick
max_allowed_packet = 16M
[mysql]
no-auto-rehash
[isamchk]
key_buffer = 256M
sort_buffer_size = 256M
read_buffer = 2M
write_buffer = 2M
[myisamchk]
key_buffer = 256M
sort_buffer_size = 256M
read_buffer = 2M
write_buffer = 2M
[mysqlhotcopy]
interactive-timeout

SHOW STATUS\G output follows my sig below...

My devs are adding indexes where the slow query log is pointing them, but any suggestions on how better to tune things up would be much appreciated. I'm not sure what else to tune here but we're getting bursts of 1200+ queries per second regularly and seeing things slow down significantly.

Best,
--
Ryan Schwartz

mysql> SHOW STATUS\G
*************************** 1. row ***************************
Variable_name: Aborted_clients
      Value: 1656
*************************** 2. row ***************************
Variable_name: Aborted_connects
      Value: 3
*************************** 3. row ***************************
Variable_name: Binlog_cache_disk_use
      Value: 276
*************************** 4. row ***************************
Variable_name: Binlog_cache_use
      Value: 6416113
*************************** 5. row ***************************
Variable_name: Bytes_received
      Value: 134
*************************** 6. row ***************************
Variable_name: Bytes_sent
      Value: 70104
*************************** 7. row ***************************
Variable_name: Com_admin_commands
      Value: 0
*************************** 8. row ***************************
Variable_name: Com_alter_db
      Value: 0
*************************** 9. row ***************************
Variable_name: Com_alter_table
      Value: 0
*************************** 10. row ***************************
Variable_name: Com_analyze
      Value: 0
*************************** 11. row ***************************
Variable_name: Com_backup_table
      Value: 0
*************************** 12. row ***************************
Variable_name: Com_begin
      Value: 0
*************************** 13. row ***************************
Variable_name: Com_call_procedure
      Value: 0
*************************** 14. row ***************************
Variable_name: Com_change_db
      Value: 0
*************************** 15. row ***************************
Variable_name: Com_change_master
      Value: 0
*************************** 16. row ***************************
Variable_name: Com_check
      Value: 0
*************************** 17. row ***************************
Variable_name: Com_checksum
      Value: 0
*************************** 18. row ***************************
Variable_name: Com_commit
      Value: 0
*************************** 19. row ***************************
Variable_name: Com_create_db
      Value: 0
*************************** 20. row ***************************
Variable_name: Com_create_function
      Value: 0
*************************** 21. row ***************************
Variable_name: Com_create_index
      Value: 0
*************************** 22. row ***************************
Variable_name: Com_create_table
      Value: 0
*************************** 23. row ***************************
Variable_name: Com_create_user
      Value: 0
*************************** 24. row ***************************
Variable_name: Com_dealloc_sql
      Value: 0
*************************** 25. row ***************************
Variable_name: Com_delete
      Value: 0
*************************** 26. row ***************************
Variable_name: Com_delete_multi
      Value: 0
*************************** 27. row ***************************
Variable_name: Com_do
      Value: 0
*************************** 28. row ***************************
Variable_name: Com_drop_db
      Value: 0
*************************** 29. row ***************************
Variable_name: Com_drop_function
      Value: 0
*************************** 30. row ***************************
Variable_name: Com_drop_index
      Value: 0
*************************** 31. row ***************************
Variable_name: Com_drop_table
      Value: 0
*************************** 32. row ***************************
Variable_name: Com_drop_user
      Value: 0
*************************** 33. row ***************************
Variable_name: Com_execute_sql
      Value: 0
*************************** 34. row ***************************
Variable_name: Com_flush
      Value: 0
*************************** 35. row ***************************
Variable_name: Com_grant
      Value: 0
*************************** 36. row ***************************
Variable_name: Com_ha_close
      Value: 0
*************************** 37. row ***************************
Variable_name: Com_ha_open
      Value: 0
*************************** 38. row ***************************
Variable_name: Com_ha_read
      Value: 0
*************************** 39. row ***************************
Variable_name: Com_help
      Value: 0
*************************** 40. row ***************************
Variable_name: Com_insert
      Value: 0
*************************** 41. row ***************************
Variable_name: Com_insert_select
      Value: 0
*************************** 42. row ***************************
Variable_name: Com_kill
      Value: 0
*************************** 43. row ***************************
Variable_name: Com_load
      Value: 0
*************************** 44. row ***************************
Variable_name: Com_load_master_data
      Value: 0
*************************** 45. row ***************************
Variable_name: Com_load_master_table
      Value: 0
*************************** 46. row ***************************
Variable_name: Com_lock_tables
      Value: 0
*************************** 47. row ***************************
Variable_name: Com_optimize
      Value: 0
*************************** 48. row ***************************
Variable_name: Com_preload_keys
      Value: 0
*************************** 49. row ***************************
Variable_name: Com_prepare_sql
      Value: 0
*************************** 50. row ***************************
Variable_name: Com_purge
      Value: 0
*************************** 51. row ***************************
Variable_name: Com_purge_before_date
      Value: 0
*************************** 52. row ***************************
Variable_name: Com_rename_table
      Value: 0
*************************** 53. row ***************************
Variable_name: Com_repair
      Value: 0
*************************** 54. row ***************************
Variable_name: Com_replace
      Value: 0
*************************** 55. row ***************************
Variable_name: Com_replace_select
      Value: 0
*************************** 56. row ***************************
Variable_name: Com_reset
      Value: 0
*************************** 57. row ***************************
Variable_name: Com_restore_table
      Value: 0
*************************** 58. row ***************************
Variable_name: Com_revoke
      Value: 0
*************************** 59. row ***************************
Variable_name: Com_revoke_all
      Value: 0
*************************** 60. row ***************************
Variable_name: Com_rollback
      Value: 0
*************************** 61. row ***************************
Variable_name: Com_savepoint
      Value: 0
*************************** 62. row ***************************
Variable_name: Com_select
      Value: 1
*************************** 63. row ***************************
Variable_name: Com_set_option
      Value: 0
*************************** 64. row ***************************
Variable_name: Com_show_binlog_events
      Value: 0
*************************** 65. row ***************************
Variable_name: Com_show_binlogs
      Value: 0
*************************** 66. row ***************************
Variable_name: Com_show_charsets
      Value: 0
*************************** 67. row ***************************
Variable_name: Com_show_collations
      Value: 0
*************************** 68. row ***************************
Variable_name: Com_show_column_types
      Value: 0
*************************** 69. row ***************************
Variable_name: Com_show_create_db
      Value: 0
*************************** 70. row ***************************
Variable_name: Com_show_create_table
      Value: 0
*************************** 71. row ***************************
Variable_name: Com_show_databases
      Value: 0
*************************** 72. row ***************************
Variable_name: Com_show_errors
      Value: 0
*************************** 73. row ***************************
Variable_name: Com_show_fields
      Value: 0
*************************** 74. row ***************************
Variable_name: Com_show_grants
      Value: 0
*************************** 75. row ***************************
Variable_name: Com_show_innodb_status
      Value: 1
*************************** 76. row ***************************
Variable_name: Com_show_keys
      Value: 0
*************************** 77. row ***************************
Variable_name: Com_show_logs
      Value: 0
*************************** 78. row ***************************
Variable_name: Com_show_master_status
      Value: 0
*************************** 79. row ***************************
Variable_name: Com_show_ndb_status
      Value: 0
*************************** 80. row ***************************
Variable_name: Com_show_new_master
      Value: 0
*************************** 81. row ***************************
Variable_name: Com_show_open_tables
      Value: 0
*************************** 82. row ***************************
Variable_name: Com_show_privileges
      Value: 0
*************************** 83. row ***************************
Variable_name: Com_show_processlist
      Value: 0
*************************** 84. row ***************************
Variable_name: Com_show_slave_hosts
      Value: 0
*************************** 85. row ***************************
Variable_name: Com_show_slave_status
      Value: 0
*************************** 86. row ***************************
Variable_name: Com_show_status
      Value: 2
*************************** 87. row ***************************
Variable_name: Com_show_storage_engines
      Value: 0
*************************** 88. row ***************************
Variable_name: Com_show_tables
      Value: 0
*************************** 89. row ***************************
Variable_name: Com_show_triggers
      Value: 0
*************************** 90. row ***************************
Variable_name: Com_show_variables
      Value: 0
*************************** 91. row ***************************
Variable_name: Com_show_warnings
      Value: 0
*************************** 92. row ***************************
Variable_name: Com_slave_start
      Value: 0
*************************** 93. row ***************************
Variable_name: Com_slave_stop
      Value: 0
*************************** 94. row ***************************
Variable_name: Com_stmt_close
      Value: 0
*************************** 95. row ***************************
Variable_name: Com_stmt_execute
      Value: 0
*************************** 96. row ***************************
Variable_name: Com_stmt_fetch
      Value: 0
*************************** 97. row ***************************
Variable_name: Com_stmt_prepare
      Value: 0
*************************** 98. row ***************************
Variable_name: Com_stmt_reset
      Value: 0
*************************** 99. row ***************************
Variable_name: Com_stmt_send_long_data
      Value: 0
*************************** 100. row ***************************
Variable_name: Com_truncate
      Value: 0
*************************** 101. row ***************************
Variable_name: Com_unlock_tables
      Value: 0
*************************** 102. row ***************************
Variable_name: Com_update
      Value: 0
*************************** 103. row ***************************
Variable_name: Com_update_multi
      Value: 0
*************************** 104. row ***************************
Variable_name: Com_xa_commit
      Value: 0
*************************** 105. row ***************************
Variable_name: Com_xa_end
      Value: 0
*************************** 106. row ***************************
Variable_name: Com_xa_prepare
      Value: 0
*************************** 107. row ***************************
Variable_name: Com_xa_recover
      Value: 0
*************************** 108. row ***************************
Variable_name: Com_xa_rollback
      Value: 0
*************************** 109. row ***************************
Variable_name: Com_xa_start
      Value: 0
*************************** 110. row ***************************
Variable_name: Compression
      Value: OFF
*************************** 111. row ***************************
Variable_name: Connections
      Value: 275608
*************************** 112. row ***************************
Variable_name: Created_tmp_disk_tables
      Value: 0
*************************** 113. row ***************************
Variable_name: Created_tmp_files
      Value: 160
*************************** 114. row ***************************
Variable_name: Created_tmp_tables
      Value: 2
*************************** 115. row ***************************
Variable_name: Delayed_errors
      Value: 0
*************************** 116. row ***************************
Variable_name: Delayed_insert_threads
      Value: 0
*************************** 117. row ***************************
Variable_name: Delayed_writes
      Value: 0
*************************** 118. row ***************************
Variable_name: Flush_commands
      Value: 1
*************************** 119. row ***************************
Variable_name: Handler_commit
      Value: 0
*************************** 120. row ***************************
Variable_name: Handler_delete
      Value: 0
*************************** 121. row ***************************
Variable_name: Handler_discover
      Value: 0
*************************** 122. row ***************************
Variable_name: Handler_prepare
      Value: 0
*************************** 123. row ***************************
Variable_name: Handler_read_first
      Value: 0
*************************** 124. row ***************************
Variable_name: Handler_read_key
      Value: 0
*************************** 125. row ***************************
Variable_name: Handler_read_next
      Value: 0
*************************** 126. row ***************************
Variable_name: Handler_read_prev
      Value: 0
*************************** 127. row ***************************
Variable_name: Handler_read_rnd
      Value: 0
*************************** 128. row ***************************
Variable_name: Handler_read_rnd_next
      Value: 227
*************************** 129. row ***************************
Variable_name: Handler_rollback
      Value: 0
*************************** 130. row ***************************
Variable_name: Handler_savepoint
      Value: 0
*************************** 131. row ***************************
Variable_name: Handler_savepoint_rollback
      Value: 0
*************************** 132. row ***************************
Variable_name: Handler_update
      Value: 0
*************************** 133. row ***************************
Variable_name: Handler_write
      Value: 358
*************************** 134. row ***************************
Variable_name: Innodb_buffer_pool_pages_data
      Value: 501
*************************** 135. row ***************************
Variable_name: Innodb_buffer_pool_pages_dirty
      Value: 5
*************************** 136. row ***************************
Variable_name: Innodb_buffer_pool_pages_flushed
      Value: 8038482
*************************** 137. row ***************************
Variable_name: Innodb_buffer_pool_pages_free
      Value: 0
*************************** 138. row ***************************
Variable_name: Innodb_buffer_pool_pages_latched
      Value: 7
*************************** 139. row ***************************
Variable_name: Innodb_buffer_pool_pages_misc
      Value: 11
*************************** 140. row ***************************
Variable_name: Innodb_buffer_pool_pages_total
      Value: 512
*************************** 141. row ***************************
Variable_name: Innodb_buffer_pool_read_ahead_rnd
      Value: 23210107
*************************** 142. row ***************************
Variable_name: Innodb_buffer_pool_read_ahead_seq
      Value: 63905948
*************************** 143. row ***************************
Variable_name: Innodb_buffer_pool_read_requests
      Value: 43197939155
*************************** 144. row ***************************
Variable_name: Innodb_buffer_pool_reads
      Value: 499689385
*************************** 145. row ***************************
Variable_name: Innodb_buffer_pool_wait_free
      Value: 0
*************************** 146. row ***************************
Variable_name: Innodb_buffer_pool_write_requests
      Value: 60487082
*************************** 147. row ***************************
Variable_name: Innodb_data_fsyncs
      Value: 11785833
*************************** 148. row ***************************
Variable_name: Innodb_data_pending_fsyncs
      Value: 0
*************************** 149. row ***************************
Variable_name: Innodb_data_pending_reads
      Value: 0
*************************** 150. row ***************************
Variable_name: Innodb_data_pending_writes
      Value: 0
*************************** 151. row ***************************
Variable_name: Innodb_data_read
      Value: 27743085907968
*************************** 152. row ***************************
Variable_name: Innodb_data_reads
      Value: 624111101
*************************** 153. row ***************************
Variable_name: Innodb_data_writes
      Value: 17135371
*************************** 154. row ***************************
Variable_name: Innodb_data_written
      Value: 272150367744
*************************** 155. row ***************************
Variable_name: Innodb_dblwr_pages_written
      Value: 8038482
*************************** 156. row ***************************
Variable_name: Innodb_dblwr_writes
      Value: 297489
*************************** 157. row ***************************
Variable_name: Innodb_log_waits
      Value: 0
*************************** 158. row ***************************
Variable_name: Innodb_log_write_requests
      Value: 8761455
*************************** 159. row ***************************
Variable_name: Innodb_log_writes
      Value: 9854707
*************************** 160. row ***************************
Variable_name: Innodb_os_log_fsyncs
      Value: 9915308
*************************** 161. row ***************************
Variable_name: Innodb_os_log_pending_fsyncs
      Value: 0
*************************** 162. row ***************************
Variable_name: Innodb_os_log_pending_writes
      Value: 0
*************************** 163. row ***************************
Variable_name: Innodb_os_log_written
      Value: 8713881088
*************************** 164. row ***************************
Variable_name: Innodb_page_size
      Value: 16384
*************************** 165. row ***************************
Variable_name: Innodb_pages_created
      Value: 127040
*************************** 166. row ***************************
Variable_name: Innodb_pages_read
      Value: 1693305750
*************************** 167. row ***************************
Variable_name: Innodb_pages_written
      Value: 8038482
*************************** 168. row ***************************
Variable_name: Innodb_row_lock_current_waits
      Value: 0
*************************** 169. row ***************************
Variable_name: Innodb_row_lock_time
      Value: 1652073
*************************** 170. row ***************************
Variable_name: Innodb_row_lock_time_avg
      Value: 188
*************************** 171. row ***************************
Variable_name: Innodb_row_lock_time_max
      Value: 51016
*************************** 172. row ***************************
Variable_name: Innodb_row_lock_waits
      Value: 8765
*************************** 173. row ***************************
Variable_name: Innodb_rows_deleted
      Value: 388078
*************************** 174. row ***************************
Variable_name: Innodb_rows_inserted
      Value: 3360570
*************************** 175. row ***************************
Variable_name: Innodb_rows_read
      Value: 68002285940
*************************** 176. row ***************************
Variable_name: Innodb_rows_updated
      Value: 1553227
*************************** 177. row ***************************
Variable_name: Key_blocks_not_flushed
      Value: 0
*************************** 178. row ***************************
Variable_name: Key_blocks_unused
      Value: 322999
*************************** 179. row ***************************
Variable_name: Key_blocks_used
      Value: 6288
*************************** 180. row ***************************
Variable_name: Key_read_requests
      Value: 7290692
*************************** 181. row ***************************
Variable_name: Key_reads
      Value: 926308
*************************** 182. row ***************************
Variable_name: Key_write_requests
      Value: 1318656
*************************** 183. row ***************************
Variable_name: Key_writes
      Value: 692107
*************************** 184. row ***************************
Variable_name: Last_query_cost
      Value: 0.000000
*************************** 185. row ***************************
Variable_name: Max_used_connections
      Value: 459
*************************** 186. row ***************************
Variable_name: Not_flushed_delayed_rows
      Value: 0
*************************** 187. row ***************************
Variable_name: Open_files
      Value: 2400
*************************** 188. row ***************************
Variable_name: Open_streams
      Value: 0
*************************** 189. row ***************************
Variable_name: Open_tables
      Value: 1931
*************************** 190. row ***************************
Variable_name: Opened_tables
      Value: 0
*************************** 191. row ***************************
Variable_name: Prepared_stmt_count
      Value: 0
*************************** 192. row ***************************
Variable_name: Qcache_free_blocks
      Value: 5997
*************************** 193. row ***************************
Variable_name: Qcache_free_memory
      Value: 45175024
*************************** 194. row ***************************
Variable_name: Qcache_hits
      Value: 48939926
*************************** 195. row ***************************
Variable_name: Qcache_inserts
      Value: 28589030
*************************** 196. row ***************************
Variable_name: Qcache_lowmem_prunes
      Value: 1368595
*************************** 197. row ***************************
Variable_name: Qcache_not_cached
      Value: 2718220
*************************** 198. row ***************************
Variable_name: Qcache_queries_in_cache
      Value: 9254
*************************** 199. row ***************************
Variable_name: Qcache_total_blocks
      Value: 24834
*************************** 200. row ***************************
Variable_name: Questions
      Value: 94454573
*************************** 201. row ***************************
Variable_name: Rpl_status
      Value: NULL
*************************** 202. row ***************************
Variable_name: Select_full_join
      Value: 0
*************************** 203. row ***************************
Variable_name: Select_full_range_join
      Value: 0
*************************** 204. row ***************************
Variable_name: Select_range
      Value: 0
*************************** 205. row ***************************
Variable_name: Select_range_check
      Value: 0
*************************** 206. row ***************************
Variable_name: Select_scan
      Value: 2
*************************** 207. row ***************************
Variable_name: Slave_open_temp_tables
      Value: 0
*************************** 208. row ***************************
Variable_name: Slave_retried_transactions
      Value: 0
*************************** 209. row ***************************
Variable_name: Slave_running
      Value: OFF
*************************** 210. row ***************************
Variable_name: Slow_launch_threads
      Value: 0
*************************** 211. row ***************************
Variable_name: Slow_queries
      Value: 0
*************************** 212. row ***************************
Variable_name: Sort_merge_passes
      Value: 0
*************************** 213. row ***************************
Variable_name: Sort_range
      Value: 0
*************************** 214. row ***************************
Variable_name: Sort_rows
      Value: 0
*************************** 215. row ***************************
Variable_name: Sort_scan
      Value: 0
*************************** 216. row ***************************
Variable_name: Table_locks_immediate
      Value: 43499188
*************************** 217. row ***************************
Variable_name: Table_locks_waited
      Value: 43
*************************** 218. row ***************************
Variable_name: Tc_log_max_pages_used
      Value: 0
*************************** 219. row ***************************
Variable_name: Tc_log_page_size
      Value: 0
*************************** 220. row ***************************
Variable_name: Tc_log_page_waits
      Value: 0
*************************** 221. row ***************************
Variable_name: Threads_cached
      Value: 43
*************************** 222. row ***************************
Variable_name: Threads_connected
      Value: 416
*************************** 223. row ***************************
Variable_name: Threads_created
      Value: 651
*************************** 224. row ***************************
Variable_name: Threads_running
      Value: 4
*************************** 225. row ***************************
Variable_name: Uptime
      Value: 615425
*************************** 226. row ***************************
Variable_name: Uptime_since_flush_status
      Value: 615425
226 rows in set (0.00 sec)


--
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe:    http://lists.mysql.com/[EMAIL PROTECTED]




--
-----------------------------
Johnny Withers
601.209.4985
[EMAIL PROTECTED]


--
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe:    http://lists.mysql.com/[EMAIL PROTECTED]

Reply via email to