[jira] [Commented] (CLOUDSTACK-7472) Change cloudstack agent.properties file for rhel 7 to include kvmclock.disable=true
[ https://issues.apache.org/jira/browse/CLOUDSTACK-7472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14612886#comment-14612886 ] ASF GitHub Bot commented on CLOUDSTACK-7472: Github user koushik-das commented on the pull request: https://github.com/apache/cloudstack/pull/557#issuecomment-118248923 LGTM Change cloudstack agent.properties file for rhel 7 to include kvmclock.disable=true --- Key: CLOUDSTACK-7472 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-7472 Project: CloudStack Issue Type: Bug Security Level: Public(Anyone can view this level - this is the default.) Components: KVM Affects Versions: 4.5.0 Reporter: shweta agarwal Assignee: Kishan Kavala Priority: Critical Fix For: 4.5.2 We need to minimize manual steps that needs to be done after agent installation so change cloudstack agent.properties file for rhel 7 to include kvmclock.disable=true -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (CLOUDSTACK-8483) Private template not visible in project
[ https://issues.apache.org/jira/browse/CLOUDSTACK-8483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14612884#comment-14612884 ] ASF GitHub Bot commented on CLOUDSTACK-8483: Github user kishankavala commented on the pull request: https://github.com/apache/cloudstack/pull/334#issuecomment-118248786 There is an API change. Should this go into master only? Private template not visible in project --- Key: CLOUDSTACK-8483 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-8483 Project: CloudStack Issue Type: Bug Security Level: Public(Anyone can view this level - this is the default.) Components: Projects Affects Versions: 4.5.0 Reporter: Sudhansu Sahu Assignee: Sudhansu Sahu Private template get created outside the project context. These templates are not visible in project view. STEPS TO REPRODUCE: 1 Select a project view, and go into volumes view 2 Create a template from a Volume and wait until the process is complete 3 The template cannot be found in the project 4 Navigate back to the Default view The template can be found in the templates screen in this view -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (CLOUDSTACK-8177) Fix kvmclock for libvirt update
[ https://issues.apache.org/jira/browse/CLOUDSTACK-8177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14613073#comment-14613073 ] ASF subversion and git services commented on CLOUDSTACK-8177: - Commit 3a19a8916eb7840302882cddd8465ac56150d32d in cloudstack's branch refs/heads/master from [~kishan] [ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=3a19a89 ] BUG-ID:CLOUDSTACK-7472: kvmclock fix for LXC is not required after fixing CLOUDSTACK-8177 Signed-off-by: Rohit Yadav rohit.ya...@shapeblue.com This closes #557 Fix kvmclock for libvirt update --- Key: CLOUDSTACK-8177 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-8177 Project: CloudStack Issue Type: Bug Security Level: Public(Anyone can view this level - this is the default.) Components: KVM Affects Versions: 4.5.0 Reporter: Marcus Sorensen Assignee: Marcus Sorensen Fix For: 4.5.0 Newer libvirt builds disallow a tickpolicy parameter with the kvmclock timer. Previously it was allowed but apparently didn't do anything. We need to remove tickpolicy for kvmclock timer to be compatible with libvirt change. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (CLOUDSTACK-7472) Change cloudstack agent.properties file for rhel 7 to include kvmclock.disable=true
[ https://issues.apache.org/jira/browse/CLOUDSTACK-7472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14613072#comment-14613072 ] ASF subversion and git services commented on CLOUDSTACK-7472: - Commit 3a19a8916eb7840302882cddd8465ac56150d32d in cloudstack's branch refs/heads/master from [~kishan] [ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=3a19a89 ] BUG-ID:CLOUDSTACK-7472: kvmclock fix for LXC is not required after fixing CLOUDSTACK-8177 Signed-off-by: Rohit Yadav rohit.ya...@shapeblue.com This closes #557 Change cloudstack agent.properties file for rhel 7 to include kvmclock.disable=true --- Key: CLOUDSTACK-7472 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-7472 Project: CloudStack Issue Type: Bug Security Level: Public(Anyone can view this level - this is the default.) Components: KVM Affects Versions: 4.5.0 Reporter: shweta agarwal Assignee: Kishan Kavala Priority: Critical Fix For: 4.5.2 We need to minimize manual steps that needs to be done after agent installation so change cloudstack agent.properties file for rhel 7 to include kvmclock.disable=true -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (CLOUDSTACK-7472) Change cloudstack agent.properties file for rhel 7 to include kvmclock.disable=true
[ https://issues.apache.org/jira/browse/CLOUDSTACK-7472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14613074#comment-14613074 ] ASF GitHub Bot commented on CLOUDSTACK-7472: Github user asfgit closed the pull request at: https://github.com/apache/cloudstack/pull/557 Change cloudstack agent.properties file for rhel 7 to include kvmclock.disable=true --- Key: CLOUDSTACK-7472 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-7472 Project: CloudStack Issue Type: Bug Security Level: Public(Anyone can view this level - this is the default.) Components: KVM Affects Versions: 4.5.0 Reporter: shweta agarwal Assignee: Kishan Kavala Priority: Critical Fix For: 4.5.2 We need to minimize manual steps that needs to be done after agent installation so change cloudstack agent.properties file for rhel 7 to include kvmclock.disable=true -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (CLOUDSTACK-7472) Change cloudstack agent.properties file for rhel 7 to include kvmclock.disable=true
[ https://issues.apache.org/jira/browse/CLOUDSTACK-7472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14613071#comment-14613071 ] ASF GitHub Bot commented on CLOUDSTACK-7472: Github user bhaisaab commented on the pull request: https://github.com/apache/cloudstack/pull/557#issuecomment-118302519 LGTM, merging Change cloudstack agent.properties file for rhel 7 to include kvmclock.disable=true --- Key: CLOUDSTACK-7472 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-7472 Project: CloudStack Issue Type: Bug Security Level: Public(Anyone can view this level - this is the default.) Components: KVM Affects Versions: 4.5.0 Reporter: shweta agarwal Assignee: Kishan Kavala Priority: Critical Fix For: 4.5.2 We need to minimize manual steps that needs to be done after agent installation so change cloudstack agent.properties file for rhel 7 to include kvmclock.disable=true -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (CLOUDSTACK-8603) Random list VM failures at scale (more than 1000 VMs) when VM has resource tags
[ https://issues.apache.org/jira/browse/CLOUDSTACK-8603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14613080#comment-14613080 ] ASF subversion and git services commented on CLOUDSTACK-8603: - Commit 7eac6310bc1f67e8c61980d43cd31586032503ee in cloudstack's branch refs/heads/4.5 from [~koushikd] [ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=7eac631 ] CLOUDSTACK-8603: Random list VM failures at scale (more than 1000 VMs) when VM has resource tags There is no 'removed' field on the resource_tags table. So 'id' based search may return a record or null in case record is deleted. Added a check for null or empty in search resource tags based on 'id'. Signed-off-by: Rohit Yadav rohit.ya...@shapeblue.com This closes #551 (cherry picked from commit 5d9f851deb1a12e4a07297353ea715f9cf13e677) Signed-off-by: Rohit Yadav rohit.ya...@shapeblue.com Random list VM failures at scale (more than 1000 VMs) when VM has resource tags --- Key: CLOUDSTACK-8603 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-8603 Project: CloudStack Issue Type: Bug Security Level: Public(Anyone can view this level - this is the default.) Components: Management Server Affects Versions: 4.5.0, 4.5.1 Reporter: Koushik Das Assignee: Koushik Das Fix For: 4.6.0 Random failures seen in list VM API call (VMs having resource tag) with the following exception. As can be seen from the stack trace, exception is thrown while creating the list response. The test scenario involved doing VM creation/deletion/list operations concurrently over a period of time. 2015-05-27 00:16:54,239 ERROR [c.c.a.ApiServer] (catalina-exec-24:ctx-c122d00c ctx-fcdc0d00 ctx-3df89f23) (logid:6004902e) unhandled exception executing api command: [Ljava.lang.String;@76642f16 java.lang.IndexOutOfBoundsException: Index: 0, Size: 0 at java.util.ArrayList.rangeCheck(ArrayList.java:635) at java.util.ArrayList.get(ArrayList.java:411) at com.cloud.api.query.dao.ResourceTagJoinDaoImpl.searchById(ResourceTagJoinDaoImpl.java:154) at sun.reflect.GeneratedMethodAccessor138.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150) at com.cloud.utils.db.TransactionContextInterceptor.invoke(TransactionContextInterceptor.java:34) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204) at com.sun.proxy.$Proxy86.searchById(Unknown Source) at com.cloud.api.ApiDBUtils.findResourceTagViewById(ApiDBUtils.java:1636) at com.cloud.api.query.dao.UserVmJoinDaoImpl.newUserVmResponse(UserVmJoinDaoImpl.java:266) at sun.reflect.GeneratedMethodAccessor126.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150) at com.cloud.utils.db.TransactionContextInterceptor.invoke(TransactionContextInterceptor.java:34) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204) at com.sun.proxy.$Proxy176.newUserVmResponse(Unknown Source) at com.cloud.api.ApiDBUtils.newUserVmResponse(ApiDBUtils.java:1600) at com.cloud.api.query.ViewResponseHelper.createUserVmResponse(ViewResponseHelper.java:140) at
[jira] [Commented] (CLOUDSTACK-8603) Random list VM failures at scale (more than 1000 VMs) when VM has resource tags
[ https://issues.apache.org/jira/browse/CLOUDSTACK-8603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14613077#comment-14613077 ] ASF subversion and git services commented on CLOUDSTACK-8603: - Commit 5d9f851deb1a12e4a07297353ea715f9cf13e677 in cloudstack's branch refs/heads/master from [~koushikd] [ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=5d9f851 ] CLOUDSTACK-8603: Random list VM failures at scale (more than 1000 VMs) when VM has resource tags There is no 'removed' field on the resource_tags table. So 'id' based search may return a record or null in case record is deleted. Added a check for null or empty in search resource tags based on 'id'. Signed-off-by: Rohit Yadav rohit.ya...@shapeblue.com This closes #551 Random list VM failures at scale (more than 1000 VMs) when VM has resource tags --- Key: CLOUDSTACK-8603 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-8603 Project: CloudStack Issue Type: Bug Security Level: Public(Anyone can view this level - this is the default.) Components: Management Server Affects Versions: 4.5.0, 4.5.1 Reporter: Koushik Das Assignee: Koushik Das Fix For: 4.6.0 Random failures seen in list VM API call (VMs having resource tag) with the following exception. As can be seen from the stack trace, exception is thrown while creating the list response. The test scenario involved doing VM creation/deletion/list operations concurrently over a period of time. 2015-05-27 00:16:54,239 ERROR [c.c.a.ApiServer] (catalina-exec-24:ctx-c122d00c ctx-fcdc0d00 ctx-3df89f23) (logid:6004902e) unhandled exception executing api command: [Ljava.lang.String;@76642f16 java.lang.IndexOutOfBoundsException: Index: 0, Size: 0 at java.util.ArrayList.rangeCheck(ArrayList.java:635) at java.util.ArrayList.get(ArrayList.java:411) at com.cloud.api.query.dao.ResourceTagJoinDaoImpl.searchById(ResourceTagJoinDaoImpl.java:154) at sun.reflect.GeneratedMethodAccessor138.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150) at com.cloud.utils.db.TransactionContextInterceptor.invoke(TransactionContextInterceptor.java:34) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204) at com.sun.proxy.$Proxy86.searchById(Unknown Source) at com.cloud.api.ApiDBUtils.findResourceTagViewById(ApiDBUtils.java:1636) at com.cloud.api.query.dao.UserVmJoinDaoImpl.newUserVmResponse(UserVmJoinDaoImpl.java:266) at sun.reflect.GeneratedMethodAccessor126.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150) at com.cloud.utils.db.TransactionContextInterceptor.invoke(TransactionContextInterceptor.java:34) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204) at com.sun.proxy.$Proxy176.newUserVmResponse(Unknown Source) at com.cloud.api.ApiDBUtils.newUserVmResponse(ApiDBUtils.java:1600) at com.cloud.api.query.ViewResponseHelper.createUserVmResponse(ViewResponseHelper.java:140) at com.cloud.api.query.QueryManagerImpl.searchForUserVMs(QueryManagerImpl.java:762) at org.apache.cloudstack.api.command.user.vm.ListVMsCmd.execute(ListVMsCmd.java:227) at
[jira] [Commented] (CLOUDSTACK-8603) Random list VM failures at scale (more than 1000 VMs) when VM has resource tags
[ https://issues.apache.org/jira/browse/CLOUDSTACK-8603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14613076#comment-14613076 ] ASF GitHub Bot commented on CLOUDSTACK-8603: Github user bhaisaab commented on the pull request: https://github.com/apache/cloudstack/pull/551#issuecomment-118303081 LGTM, merging. Random list VM failures at scale (more than 1000 VMs) when VM has resource tags --- Key: CLOUDSTACK-8603 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-8603 Project: CloudStack Issue Type: Bug Security Level: Public(Anyone can view this level - this is the default.) Components: Management Server Affects Versions: 4.5.0, 4.5.1 Reporter: Koushik Das Assignee: Koushik Das Fix For: 4.6.0 Random failures seen in list VM API call (VMs having resource tag) with the following exception. As can be seen from the stack trace, exception is thrown while creating the list response. The test scenario involved doing VM creation/deletion/list operations concurrently over a period of time. 2015-05-27 00:16:54,239 ERROR [c.c.a.ApiServer] (catalina-exec-24:ctx-c122d00c ctx-fcdc0d00 ctx-3df89f23) (logid:6004902e) unhandled exception executing api command: [Ljava.lang.String;@76642f16 java.lang.IndexOutOfBoundsException: Index: 0, Size: 0 at java.util.ArrayList.rangeCheck(ArrayList.java:635) at java.util.ArrayList.get(ArrayList.java:411) at com.cloud.api.query.dao.ResourceTagJoinDaoImpl.searchById(ResourceTagJoinDaoImpl.java:154) at sun.reflect.GeneratedMethodAccessor138.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150) at com.cloud.utils.db.TransactionContextInterceptor.invoke(TransactionContextInterceptor.java:34) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204) at com.sun.proxy.$Proxy86.searchById(Unknown Source) at com.cloud.api.ApiDBUtils.findResourceTagViewById(ApiDBUtils.java:1636) at com.cloud.api.query.dao.UserVmJoinDaoImpl.newUserVmResponse(UserVmJoinDaoImpl.java:266) at sun.reflect.GeneratedMethodAccessor126.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150) at com.cloud.utils.db.TransactionContextInterceptor.invoke(TransactionContextInterceptor.java:34) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204) at com.sun.proxy.$Proxy176.newUserVmResponse(Unknown Source) at com.cloud.api.ApiDBUtils.newUserVmResponse(ApiDBUtils.java:1600) at com.cloud.api.query.ViewResponseHelper.createUserVmResponse(ViewResponseHelper.java:140) at com.cloud.api.query.QueryManagerImpl.searchForUserVMs(QueryManagerImpl.java:762) at org.apache.cloudstack.api.command.user.vm.ListVMsCmd.execute(ListVMsCmd.java:227) at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:150) at com.cloud.api.ApiServer.queueCommand(ApiServer.java:700) at com.cloud.api.ApiServer.handleRequest(ApiServer.java:525) at com.cloud.api.ApiServlet.processRequestInContext(ApiServlet.java:282) There are 2 part to list VM API: a. Get a list of VMs based on search criteria from the user_vm_view view in DB. b. Create the response records corresponding to each VM obtained as part of
[jira] [Commented] (CLOUDSTACK-8603) Random list VM failures at scale (more than 1000 VMs) when VM has resource tags
[ https://issues.apache.org/jira/browse/CLOUDSTACK-8603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14613078#comment-14613078 ] ASF GitHub Bot commented on CLOUDSTACK-8603: Github user asfgit closed the pull request at: https://github.com/apache/cloudstack/pull/551 Random list VM failures at scale (more than 1000 VMs) when VM has resource tags --- Key: CLOUDSTACK-8603 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-8603 Project: CloudStack Issue Type: Bug Security Level: Public(Anyone can view this level - this is the default.) Components: Management Server Affects Versions: 4.5.0, 4.5.1 Reporter: Koushik Das Assignee: Koushik Das Fix For: 4.6.0 Random failures seen in list VM API call (VMs having resource tag) with the following exception. As can be seen from the stack trace, exception is thrown while creating the list response. The test scenario involved doing VM creation/deletion/list operations concurrently over a period of time. 2015-05-27 00:16:54,239 ERROR [c.c.a.ApiServer] (catalina-exec-24:ctx-c122d00c ctx-fcdc0d00 ctx-3df89f23) (logid:6004902e) unhandled exception executing api command: [Ljava.lang.String;@76642f16 java.lang.IndexOutOfBoundsException: Index: 0, Size: 0 at java.util.ArrayList.rangeCheck(ArrayList.java:635) at java.util.ArrayList.get(ArrayList.java:411) at com.cloud.api.query.dao.ResourceTagJoinDaoImpl.searchById(ResourceTagJoinDaoImpl.java:154) at sun.reflect.GeneratedMethodAccessor138.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150) at com.cloud.utils.db.TransactionContextInterceptor.invoke(TransactionContextInterceptor.java:34) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204) at com.sun.proxy.$Proxy86.searchById(Unknown Source) at com.cloud.api.ApiDBUtils.findResourceTagViewById(ApiDBUtils.java:1636) at com.cloud.api.query.dao.UserVmJoinDaoImpl.newUserVmResponse(UserVmJoinDaoImpl.java:266) at sun.reflect.GeneratedMethodAccessor126.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150) at com.cloud.utils.db.TransactionContextInterceptor.invoke(TransactionContextInterceptor.java:34) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204) at com.sun.proxy.$Proxy176.newUserVmResponse(Unknown Source) at com.cloud.api.ApiDBUtils.newUserVmResponse(ApiDBUtils.java:1600) at com.cloud.api.query.ViewResponseHelper.createUserVmResponse(ViewResponseHelper.java:140) at com.cloud.api.query.QueryManagerImpl.searchForUserVMs(QueryManagerImpl.java:762) at org.apache.cloudstack.api.command.user.vm.ListVMsCmd.execute(ListVMsCmd.java:227) at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:150) at com.cloud.api.ApiServer.queueCommand(ApiServer.java:700) at com.cloud.api.ApiServer.handleRequest(ApiServer.java:525) at com.cloud.api.ApiServlet.processRequestInContext(ApiServlet.java:282) There are 2 part to list VM API: a. Get a list of VMs based on search criteria from the user_vm_view view in DB. b. Create the response records corresponding to each VM obtained as part of (a). This record creation involves fetching
[jira] [Resolved] (CLOUDSTACK-8603) Random list VM failures at scale (more than 1000 VMs) when VM has resource tags
[ https://issues.apache.org/jira/browse/CLOUDSTACK-8603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koushik Das resolved CLOUDSTACK-8603. - Resolution: Fixed Random list VM failures at scale (more than 1000 VMs) when VM has resource tags --- Key: CLOUDSTACK-8603 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-8603 Project: CloudStack Issue Type: Bug Security Level: Public(Anyone can view this level - this is the default.) Components: Management Server Affects Versions: 4.5.0, 4.5.1 Reporter: Koushik Das Assignee: Koushik Das Fix For: 4.6.0 Random failures seen in list VM API call (VMs having resource tag) with the following exception. As can be seen from the stack trace, exception is thrown while creating the list response. The test scenario involved doing VM creation/deletion/list operations concurrently over a period of time. 2015-05-27 00:16:54,239 ERROR [c.c.a.ApiServer] (catalina-exec-24:ctx-c122d00c ctx-fcdc0d00 ctx-3df89f23) (logid:6004902e) unhandled exception executing api command: [Ljava.lang.String;@76642f16 java.lang.IndexOutOfBoundsException: Index: 0, Size: 0 at java.util.ArrayList.rangeCheck(ArrayList.java:635) at java.util.ArrayList.get(ArrayList.java:411) at com.cloud.api.query.dao.ResourceTagJoinDaoImpl.searchById(ResourceTagJoinDaoImpl.java:154) at sun.reflect.GeneratedMethodAccessor138.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150) at com.cloud.utils.db.TransactionContextInterceptor.invoke(TransactionContextInterceptor.java:34) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204) at com.sun.proxy.$Proxy86.searchById(Unknown Source) at com.cloud.api.ApiDBUtils.findResourceTagViewById(ApiDBUtils.java:1636) at com.cloud.api.query.dao.UserVmJoinDaoImpl.newUserVmResponse(UserVmJoinDaoImpl.java:266) at sun.reflect.GeneratedMethodAccessor126.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150) at com.cloud.utils.db.TransactionContextInterceptor.invoke(TransactionContextInterceptor.java:34) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204) at com.sun.proxy.$Proxy176.newUserVmResponse(Unknown Source) at com.cloud.api.ApiDBUtils.newUserVmResponse(ApiDBUtils.java:1600) at com.cloud.api.query.ViewResponseHelper.createUserVmResponse(ViewResponseHelper.java:140) at com.cloud.api.query.QueryManagerImpl.searchForUserVMs(QueryManagerImpl.java:762) at org.apache.cloudstack.api.command.user.vm.ListVMsCmd.execute(ListVMsCmd.java:227) at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:150) at com.cloud.api.ApiServer.queueCommand(ApiServer.java:700) at com.cloud.api.ApiServer.handleRequest(ApiServer.java:525) at com.cloud.api.ApiServlet.processRequestInContext(ApiServlet.java:282) There are 2 part to list VM API: a. Get a list of VMs based on search criteria from the user_vm_view view in DB. b. Create the response records corresponding to each VM obtained as part of (a). This record creation involves fetching additional data from other views/tables in the DB. One such view is resource_tag_view. Now consider the following sequence of events that
[jira] [Commented] (CLOUDSTACK-8484) Hosts without tag are not listed while listing the hosts for migration for instance with tag
[
https://issues.apache.org/jira/browse/CLOUDSTACK-8484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14613156#comment-14613156
]
ASF GitHub Bot commented on CLOUDSTACK-8484:
Github user sudhansu7 commented on the pull request:
https://github.com/apache/cloudstack/pull/335#issuecomment-118331438
@remibergsma @karuturi
I have added marvin test for this issue.
Test result from local setup:
Sudhansus-MAC:cloudstack sudhansu$ nosetests --with-marvin
--marvin-config=setup/dev/advanced.cfg
./test/integration/smoke/find_hosts_for_migration.py
Marvin Init Started
=== Marvin Parse Config Successful ===
=== Marvin Setting TestData Successful===
Log Folder Path: /tmp//MarvinLogs//Jul_03_2015_17_38_01_JVMT7H. All
logs will be available here
=== Marvin Init Logging Successful===
Marvin Init Successful
===final results are now copied to:
/tmp//MarvinLogs/find_hosts_for_migration_FKMWAR===
Sudhansus-MAC:cloudstack sudhansu$ cat
/tmp//MarvinLogs/find_hosts_for_migration_FKMWAR/results.txt
Test find suitable and not-suitable list of hosts for migration ... ===
TestName: test_01_find_hosts_for_migration | Status : SUCCESS ===
ok
--
Ran 1 test in 27.003s
OK
Sudhansus-MAC:cloudstack sudhansu$ cat
/tmp//MarvinLogs/find_hosts_for_migration_FKMWAR/failed_plus_exceptions.txt
Sudhansus-MAC:cloudstack sudhansu$ cat
/tmp//MarvinLogs/find_hosts_for_migration_FKMWAR/runinfo.txt | grep -i
'Suitable Hosts'
2015-07-03 17:38:18,171 - DEBUG - Suitable Hosts: set([])
2015-07-03 17:38:18,171 - DEBUG - Not suitable Hosts:
set([{cpuwithoverprovisioning : u'32000.0', version : u'4.5.2-SNAPSHOT',
memorytotal : 8589934592, jobstatus : 0, zoneid :
u'7a83176c-4ae7-49cc-88ff-a794716e74f9', cpunumber : 4, managementserverid :
4278190080, cpuallocated : u'0%', memoryused : 0, id :
u'b1b25f17-18f7-4b4d-a8e1-a353ebf33660', cpuused : u'0%', suitableformigration
: False, clusterid : u'c138587b-c149-4819-9d30-d4fa9d6d5da4', capabilities :
u'hvm', state : u'Up', memoryallocated : 1879048192, networkkbswrite : 16384,
cpuspeed : 8000, type : u'Routing', events : u'Ping; StartAgentRebalance;
ShutdownRequested; ManagementServerDown; HostDown; AgentDisconnected;
PingTimeout; Remove; AgentConnected', zonename : u'Sandbox-simulator', podid :
u'b0b72cfb-db0a-4e9c-a9da-84854d8c4a1f', clustertype : u'CloudManaged', hahost
: False, lastpinged : u'1970-01-17T11:01:01+0530', ipaddress : u'172.16.15.21',
disconnected : u'2015-07-03T14:32:16+0530', name :
u'SimulatedAgent.3481871b-7626-450a-b2c1-ab4e6a2e5965', networkkbsread : 32768,
created : u'2015-07-03T13:39:27+0530', clustername : u'C0', hypervisor :
u'Simulator', islocalstorageactive : False, resourcestate : u'Enabled',
requiresStorageMotion : False, podname : u'POD0'}])
Hosts without tag are not listed while listing the hosts for migration for
instance with tag
Key: CLOUDSTACK-8484
URL: https://issues.apache.org/jira/browse/CLOUDSTACK-8484
Project: CloudStack
Issue Type: Bug
Security Level: Public(Anyone can view this level - this is the
default.)
Components: Management Server
Affects Versions: 4.5.0
Reporter: Sudhansu Sahu
Assignee: Sudhansu Sahu
Hosts without tag are not listed while listing the hosts for migration for
instance with tag.
Ideally system should list all available hosts with not suitable suffix.
Steps to reproduce:
1) Create a compute offering with a host tag eg: 'tag-1'
2) Tag a host in your cluster as 'tag-1'
3) Deploy an instance using this offering.
4) Instance will get deployed to the tagged host
5) Try listing the hosts for migration,it would return no host is available
for migration.
6) Tag other hosts with 'tag-1' and they would start appearing in the list.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
