[jira] [Updated] (CLOUDSTACK-2537) [Object_Store_Refactor] System vms failed to come up with S3 as storage provider

2013-10-21 Thread Animesh Chaturvedi (JIRA) 

 [ 
https://issues.apache.org/jira/browse/CLOUDSTACK-2537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Animesh Chaturvedi updated CLOUDSTACK-2537:
---


ACS 4.3,0 feature freeze is Nov 8th. I will cut the 4.3 branch from master on 
that day. Please provide an update on your issue as a comment. 

> [Object_Store_Refactor] System vms failed to come up with S3 as storage 
> provider
> 
>
> Key: CLOUDSTACK-2537
> URL: https://issues.apache.org/jira/browse/CLOUDSTACK-2537
> Project: CloudStack
>  Issue Type: Bug
>  Security Level: Public(Anyone can view this level - this is the 
> default.) 
>  Components: Management Server
>Affects Versions: 4.2.0
> Environment: Build from object_store branch
>Reporter: Sanjeev N
>Assignee: Min Chen
>Priority: Blocker
> Fix For: 4.2.0
>
> Attachments: management-server.rar
>
>
> System vms failed to come up with S3 as storage provider
> Repro steps:
> ==
> 1.Bring CS in advanced zone with S3 as secondary storage provider
> 2.Enable the zone
> Expected Result:
> =
> As and when S3 gets added to CS, it should download system template to S3 and 
> bring up system vms.
> Actual Result:
> ===
> System template was successfuly downloaded to S3 but failed to bring up 
> system vms.
> Observations:
> 
> 1.After step 1 system template was successfully downloaded to s3 bucket.
> 2013-05-16 10:40:49,434 INFO  [storage.template.S3TemplateDownloader] 
> (pool-2-thread-1:null) No credentials configured for host=10.147.28.7:80
> 2013-05-16 10:40:49,620 INFO  [storage.template.S3TemplateDownloader] 
> (pool-1-thread-1:null) Starting download from 
> http://10.147.28.7/templates/acton/acton-systemvm-02062012.vhd.bz2 to s3 
> bucket imagestore remoteSize=140616708 , max size=53687091200
> 2013-05-16 10:40:49,638 DEBUG [cloud.utils.S3Utils] (pool-1-thread-1:null) 
> Creating S3 client with configuration: [protocol: http, connectionTimeOut: 
> 100, maxErrorRetry: 3, socketTimeout: 100]
> 2013-05-16 10:40:49,995 DEBUG [cloud.utils.S3Utils] (pool-1-thread-1:null) 
> Setting the end point for S3 client 
> com.amazonaws.services.s3.AmazonS3Client@470edb99 to 10.147.29.56:8080.
> 2013-05-16 10:40:58,970 DEBUG [cloud.server.StatsCollector] 
> (StatsCollector-2:null) HostStatsCollector is running...
> 2013-05-16 10:40:58,972 DEBUG [cloud.server.StatsCollector] 
> (StatsCollector-3:null) VmStatsCollector is running...
> 2013-05-16 10:40:58,974 DEBUG [cloud.server.StatsCollector] 
> (StatsCollector-1:null) StorageCollector is running...
> 2013-05-16 10:40:59,036 DEBUG [agent.manager.DirectAgentAttache] 
> (DirectAgent-4:null) Seq 1-1911750666: Executing request
> 2013-05-16 10:40:59,045 DEBUG [agent.manager.DirectAgentAttache] 
> (DirectAgent-5:null) Seq 1-1911750667: Executing request
> 2013-05-16 10:40:59,271 DEBUG [agent.manager.DirectAgentAttache] 
> (DirectAgent-4:null) Seq 1-1911750666: Response Received:
> 2013-05-16 10:40:59,272 DEBUG [agent.transport.Request] 
> (StatsCollector-2:null) Seq 1-1911750666: Received:  { Ans: , MgmtId: 
> 7332683579487, via: 1, Ver: v1, Flags: 10, { GetHostStatsAnswer } }
> 2013-05-16 10:40:59,356 DEBUG [agent.manager.DirectAgentAttache] 
> (DirectAgent-5:null) Seq 1-1911750667: Response Received:
> 2013-05-16 10:40:59,357 DEBUG [agent.transport.Request] 
> (StatsCollector-1:null) Seq 1-1911750667: Received:  { Ans: , MgmtId: 
> 7332683579487, via: 1, Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
> 2013-05-16 10:41:01,014 INFO  [storage.template.S3TemplateDownloader] 
> (pool-1-thread-1:null) download completed
> 2013-05-16 10:41:01,016 INFO  [storage.template.DownloadManagerImpl] 
> (pool-1-thread-1:null) Download Completion for jobId: 
> 46e0c43d-a743-461f-8b88-16a57ac4bbb8, status=DOWNLOAD_FINISHED
> 2013-05-16 10:41:01,016 INFO  [storage.template.DownloadManagerImpl] 
> (pool-1-thread-1:null) local: 
> template/tmpl/1/1/routing-1/acton-systemvm-02062012.vhd.bz2, bytes=140616708, 
> error= , pct=100
> 2.After step2 CS tried to bring up the system vms. But failed to create 
> volumes with following exceptions:
> 2013-05-16 10:43:44,843 DEBUG [cloud.storage.VolumeManagerImpl] 
> (secstorage-1:null) Checking if we need to prepare 1 volumes for 
> VM[SecondaryStorageVm|s-1-VM]
> 2013-05-16 10:43:45,016 ERROR [storage.resource.NfsSecondaryStorageResource] 
> (secstorage-1:null) Unable to create directory download directory 1 for 
> download from S3.
> 2013-05-16 10:43:45,025 DEBUG [cloud.storage.VolumeManagerImpl] 
> (secstorage-1:null) Unable to create 
> Vol[1|vm=1|ROOT]:java.lang.NullPointerException
> 2013-05-16 10:43:45,026 INFO  [cloud.vm.VirtualMachineManagerImpl] 
> (secstorage-1:null) Unable to contact resource.
> com.cloud.exception.StorageUn

[jira] [Updated] (CLOUDSTACK-2537) [Object_Store_Refactor] System vms failed to come up with S3 as storage provider

2013-05-16 Thread Sanjeev N (JIRA) 

 [ 
https://issues.apache.org/jira/browse/CLOUDSTACK-2537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sanjeev N updated CLOUDSTACK-2537:
--

Attachment: management-server.rar

Attached mgmt server log file

> [Object_Store_Refactor] System vms failed to come up with S3 as storage 
> provider
> 
>
> Key: CLOUDSTACK-2537
> URL: https://issues.apache.org/jira/browse/CLOUDSTACK-2537
> Project: CloudStack
>  Issue Type: Bug
>  Security Level: Public(Anyone can view this level - this is the 
> default.) 
>  Components: Management Server
>Affects Versions: 4.2.0
> Environment: Build from object_store branch
>Reporter: Sanjeev N
>Priority: Blocker
> Fix For: 4.2.0
>
> Attachments: management-server.rar
>
>
> System vms failed to come up with S3 as storage provider
> Repro steps:
> ==
> 1.Bring CS in advanced zone with S3 as secondary storage provider
> 2.Enable the zone
> Expected Result:
> =
> As and when S3 gets added to CS, it should download system template to S3 and 
> bring up system vms.
> Actual Result:
> ===
> System template was successfuly downloaded to S3 but failed to bring up 
> system vms.
> Observations:
> 
> 1.After step 1 system template was successfully downloaded to s3 bucket.
> 2013-05-16 10:40:49,434 INFO  [storage.template.S3TemplateDownloader] 
> (pool-2-thread-1:null) No credentials configured for host=10.147.28.7:80
> 2013-05-16 10:40:49,620 INFO  [storage.template.S3TemplateDownloader] 
> (pool-1-thread-1:null) Starting download from 
> http://10.147.28.7/templates/acton/acton-systemvm-02062012.vhd.bz2 to s3 
> bucket imagestore remoteSize=140616708 , max size=53687091200
> 2013-05-16 10:40:49,638 DEBUG [cloud.utils.S3Utils] (pool-1-thread-1:null) 
> Creating S3 client with configuration: [protocol: http, connectionTimeOut: 
> 100, maxErrorRetry: 3, socketTimeout: 100]
> 2013-05-16 10:40:49,995 DEBUG [cloud.utils.S3Utils] (pool-1-thread-1:null) 
> Setting the end point for S3 client 
> com.amazonaws.services.s3.AmazonS3Client@470edb99 to 10.147.29.56:8080.
> 2013-05-16 10:40:58,970 DEBUG [cloud.server.StatsCollector] 
> (StatsCollector-2:null) HostStatsCollector is running...
> 2013-05-16 10:40:58,972 DEBUG [cloud.server.StatsCollector] 
> (StatsCollector-3:null) VmStatsCollector is running...
> 2013-05-16 10:40:58,974 DEBUG [cloud.server.StatsCollector] 
> (StatsCollector-1:null) StorageCollector is running...
> 2013-05-16 10:40:59,036 DEBUG [agent.manager.DirectAgentAttache] 
> (DirectAgent-4:null) Seq 1-1911750666: Executing request
> 2013-05-16 10:40:59,045 DEBUG [agent.manager.DirectAgentAttache] 
> (DirectAgent-5:null) Seq 1-1911750667: Executing request
> 2013-05-16 10:40:59,271 DEBUG [agent.manager.DirectAgentAttache] 
> (DirectAgent-4:null) Seq 1-1911750666: Response Received:
> 2013-05-16 10:40:59,272 DEBUG [agent.transport.Request] 
> (StatsCollector-2:null) Seq 1-1911750666: Received:  { Ans: , MgmtId: 
> 7332683579487, via: 1, Ver: v1, Flags: 10, { GetHostStatsAnswer } }
> 2013-05-16 10:40:59,356 DEBUG [agent.manager.DirectAgentAttache] 
> (DirectAgent-5:null) Seq 1-1911750667: Response Received:
> 2013-05-16 10:40:59,357 DEBUG [agent.transport.Request] 
> (StatsCollector-1:null) Seq 1-1911750667: Received:  { Ans: , MgmtId: 
> 7332683579487, via: 1, Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
> 2013-05-16 10:41:01,014 INFO  [storage.template.S3TemplateDownloader] 
> (pool-1-thread-1:null) download completed
> 2013-05-16 10:41:01,016 INFO  [storage.template.DownloadManagerImpl] 
> (pool-1-thread-1:null) Download Completion for jobId: 
> 46e0c43d-a743-461f-8b88-16a57ac4bbb8, status=DOWNLOAD_FINISHED
> 2013-05-16 10:41:01,016 INFO  [storage.template.DownloadManagerImpl] 
> (pool-1-thread-1:null) local: 
> template/tmpl/1/1/routing-1/acton-systemvm-02062012.vhd.bz2, bytes=140616708, 
> error= , pct=100
> 2.After step2 CS tried to bring up the system vms. But failed to create 
> volumes with following exceptions:
> 2013-05-16 10:43:44,843 DEBUG [cloud.storage.VolumeManagerImpl] 
> (secstorage-1:null) Checking if we need to prepare 1 volumes for 
> VM[SecondaryStorageVm|s-1-VM]
> 2013-05-16 10:43:45,016 ERROR [storage.resource.NfsSecondaryStorageResource] 
> (secstorage-1:null) Unable to create directory download directory 1 for 
> download from S3.
> 2013-05-16 10:43:45,025 DEBUG [cloud.storage.VolumeManagerImpl] 
> (secstorage-1:null) Unable to create 
> Vol[1|vm=1|ROOT]:java.lang.NullPointerException
> 2013-05-16 10:43:45,026 INFO  [cloud.vm.VirtualMachineManagerImpl] 
> (secstorage-1:null) Unable to contact resource.
> com.cloud.exception.StorageUnavailableException: Resource [StoragePool:1] is 
> unreachable: Unable to create Vol[1|vm=1|ROOT]:java.lang.N