Wei Zhou created CLOUDSTACK-2707: ------------------------------------ Summary: Usage server creates entries very slow for mysql performance degradation Key: CLOUDSTACK-2707 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-2707 Project: CloudStack Issue Type: Improvement Security Level: Public (Anyone can view this level - this is the default.) Reporter: Wei Zhou Assignee: Wei Zhou
As we know, the insert performance into a mysql table degrades when the records of table reaches 1,000,000. It takes more time and more CPU utilization. Here is log in usage.log 2013-05-27 09:13:24,827 INFO [cloud.usage.UsageManagerImpl] (Usage-Job-1:null) starting usage job... 2013-05-27 09:13:24,829 INFO [cloud.usage.UsageManagerImpl] (Usage-Job-1:null) Parsing usage records between Mon May 27 11:10:05 CEST 2013 and Mon May 27 11:13:24 CEST 2013 2013-05-27 09:13:25,534 DEBUG [cloud.usage.UsageManagerImpl] (Usage-Job-1:null) getting current accounted bytes for... accountId: 2 in zone: 1; abr: 1252; abs: 847 2013-05-27 09:13:25,534 DEBUG [cloud.usage.UsageManagerImpl] (Usage-Job-1:null) creating networkHelperEntry... accountId: 2 in zone: 1; abr: 1252; abs: 847; curABS: 847; curABR: 1252; ubs: 0; ubr: 0 2013-05-27 09:13:26,467 DEBUG [cloud.usage.UsageManagerImpl] (Usage-Job-1:null) getting current accounted bytes for... accountId: 2 in zone: 1; abr: 16112; abs: 16112 2013-05-27 09:13:26,468 DEBUG [cloud.usage.UsageManagerImpl] (Usage-Job-1:null) creating networkHelperEntry... accountId: 2 in zone: 1; abr: 16112; abs: 16112; curABS: 16112; curABR: 16112; ubs: 0; ubr: 0 2013-05-27 09:13:28,220 DEBUG [cloud.usage.UsageManagerImpl] (Usage-Job-1:null) getting current accounted bytes for... accountId: 2 in zone: 1; abr: 0; abs: 0 2013-05-27 09:13:28,220 DEBUG [cloud.usage.UsageManagerImpl] (Usage-Job-1:null) creating networkHelperEntry... accountId: 2 in zone: 1; abr: 0; abs: 0; curABS: 0; curABR: 0; ubs: 0; ubr: 0 2013-05-27 09:13:29,266 DEBUG [cloud.usage.UsageManagerImpl] (Usage-Job-1:null) getting current accounted bytes for... accountId: 2 in zone: 1; abr: 3648; abs: 3648 2013-05-27 09:13:29,266 DEBUG [cloud.usage.UsageManagerImpl] (Usage-Job-1:null) creating networkHelperEntry... accountId: 2 in zone: 1; abr: 3648; abs: 3648; curABS: 3648; curABR: 3648; ubs: 0; ubr: 0 2013-05-27 09:13:30,339 DEBUG [cloud.usage.UsageManagerImpl] (Usage-Job-1:null) getting current accounted bytes for... accountId: 2 in zone: 1; abr: 32984; abs: 32984 2013-05-27 09:13:30,339 DEBUG [cloud.usage.UsageManagerImpl] (Usage-Job-1:null) creating networkHelperEntry... accountId: 2 in zone: 1; abr: 32984; abs: 32984; curABS: 32984; curABR: 32984; ubs: 0; ubr: 0 2013-05-27 09:13:31,830 DEBUG [cloud.usage.UsageManagerImpl] (Usage-Job-1:null) getting current accounted bytes for... accountId: 2 in zone: 1; abr: 118636; abs: 118940 ...... 2013-05-27 09:16:08,285 DEBUG [cloud.usage.UsageManagerImpl] (Usage-Job-1:null) getting current accounted bytes for... accountId: 2 in zone: 1; abr: 0; abs: 0 2013-05-27 09:16:08,285 DEBUG [cloud.usage.UsageManagerImpl] (Usage-Job-1:null) creating networkHelperEntry... accountId: 2 in zone: 1; abr: 0; abs: 0; curABS: 0; curABR: 0; ubs: 0; ubr: 0 2013-05-27 09:16:09,308 DEBUG [cloud.usage.UsageManagerImpl] (Usage-Job-1:null) created network stats helper entries for 134 accts -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira