[ https://issues.apache.org/jira/browse/CLOUDSTACK-2707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13679483#comment-13679483 ]
ASF subversion and git services commented on CLOUDSTACK-2707: ------------------------------------------------------------- Commit 76ce304411259dc4a29e0e070de829b79b46efe2 in branch refs/heads/master from [~weizhou] [ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=76ce304 ] CLOUDSTACK-2707: use executeBatch instead of persist in Usage Server > Usage server creates entries very slow for mysql performance degradation > ------------------------------------------------------------------------ > > Key: CLOUDSTACK-2707 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-2707 > Project: CloudStack > Issue Type: Improvement > Security Level: Public(Anyone can view this level - this is the > default.) > Reporter: Wei Zhou > Assignee: Wei Zhou > > As we know, the insert performance into a mysql table degrades when the > records of table reaches 1,000,000. It takes more time and more CPU > utilization. > Here is log in usage.log > 2013-05-27 09:13:24,827 INFO [cloud.usage.UsageManagerImpl] > (Usage-Job-1:null) starting usage job... > 2013-05-27 09:13:24,829 INFO [cloud.usage.UsageManagerImpl] > (Usage-Job-1:null) Parsing usage records between Mon May 27 11:10:05 CEST > 2013 and Mon May 27 11:13:24 CEST 2013 > 2013-05-27 09:13:25,534 DEBUG [cloud.usage.UsageManagerImpl] > (Usage-Job-1:null) getting current accounted bytes for... accountId: 2 in > zone: 1; abr: 1252; abs: 847 > 2013-05-27 09:13:25,534 DEBUG [cloud.usage.UsageManagerImpl] > (Usage-Job-1:null) creating networkHelperEntry... accountId: 2 in zone: 1; > abr: 1252; abs: 847; curABS: 847; curABR: 1252; ubs: 0; ubr: 0 > 2013-05-27 09:13:26,467 DEBUG [cloud.usage.UsageManagerImpl] > (Usage-Job-1:null) getting current accounted bytes for... accountId: 2 in > zone: 1; abr: 16112; abs: 16112 > 2013-05-27 09:13:26,468 DEBUG [cloud.usage.UsageManagerImpl] > (Usage-Job-1:null) creating networkHelperEntry... accountId: 2 in zone: 1; > abr: 16112; abs: 16112; curABS: 16112; curABR: 16112; ubs: 0; ubr: 0 > 2013-05-27 09:13:28,220 DEBUG [cloud.usage.UsageManagerImpl] > (Usage-Job-1:null) getting current accounted bytes for... accountId: 2 in > zone: 1; abr: 0; abs: 0 > 2013-05-27 09:13:28,220 DEBUG [cloud.usage.UsageManagerImpl] > (Usage-Job-1:null) creating networkHelperEntry... accountId: 2 in zone: 1; > abr: 0; abs: 0; curABS: 0; curABR: 0; ubs: 0; ubr: 0 > 2013-05-27 09:13:29,266 DEBUG [cloud.usage.UsageManagerImpl] > (Usage-Job-1:null) getting current accounted bytes for... accountId: 2 in > zone: 1; abr: 3648; abs: 3648 > 2013-05-27 09:13:29,266 DEBUG [cloud.usage.UsageManagerImpl] > (Usage-Job-1:null) creating networkHelperEntry... accountId: 2 in zone: 1; > abr: 3648; abs: 3648; curABS: 3648; curABR: 3648; ubs: 0; ubr: 0 > 2013-05-27 09:13:30,339 DEBUG [cloud.usage.UsageManagerImpl] > (Usage-Job-1:null) getting current accounted bytes for... accountId: 2 in > zone: 1; abr: 32984; abs: 32984 > 2013-05-27 09:13:30,339 DEBUG [cloud.usage.UsageManagerImpl] > (Usage-Job-1:null) creating networkHelperEntry... accountId: 2 in zone: 1; > abr: 32984; abs: 32984; curABS: 32984; curABR: 32984; ubs: 0; ubr: 0 > 2013-05-27 09:13:31,830 DEBUG [cloud.usage.UsageManagerImpl] > (Usage-Job-1:null) getting current accounted bytes for... accountId: 2 in > zone: 1; abr: 118636; abs: 118940 > ...... > 2013-05-27 09:16:08,285 DEBUG [cloud.usage.UsageManagerImpl] > (Usage-Job-1:null) getting current accounted bytes for... accountId: 2 in > zone: 1; abr: 0; abs: 0 > 2013-05-27 09:16:08,285 DEBUG [cloud.usage.UsageManagerImpl] > (Usage-Job-1:null) creating networkHelperEntry... accountId: 2 in zone: 1; > abr: 0; abs: 0; curABS: 0; curABR: 0; ubs: 0; ubr: 0 > 2013-05-27 09:16:09,308 DEBUG [cloud.usage.UsageManagerImpl] > (Usage-Job-1:null) created network stats helper entries for 134 accts -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira