Re: [openstack-dev] [glance] multi threads with swift backend

2017-09-29 Thread Erno Kuvaja
On Fri, Sep 29, 2017 at 6:35 AM, Arnaud MORIN wrote: > My objective is to be able to download and upload from glance/computes to > swift in a faster way. > I was thinking that if glance could parallelizes the connections to swift > for a single image (with chunks), it would be faster. > Am I wrong

Re: [openstack-dev] [glance] multi threads with swift backend

2017-09-29 Thread Erno Kuvaja
On Fri, Sep 29, 2017 at 6:35 AM, Arnaud MORIN wrote: > My objective is to be able to download and upload from glance/computes to > swift in a faster way. > I was thinking that if glance could parallelizes the connections to swift > for a single image (with chunks), it would be faster. > Am I wrong

Re: [openstack-dev] [glance] multi threads with swift backend

2017-09-28 Thread Arnaud MORIN
My objective is to be able to download and upload from glance/computes to swift in a faster way. I was thinking that if glance could parallelizes the connections to swift for a single image (with chunks), it would be faster. Am I wrong ? Is there any other way I am not thinking of? Arnaud. Le 28

Re: [openstack-dev] [glance] multi threads with swift backend

2017-09-28 Thread Erno Kuvaja
On Thu, Sep 28, 2017 at 4:27 PM, Arnaud MORIN wrote: > Hey all, > So I finally tested your pull requests, it does not work. > 1 - For uploads, swiftclient is not using threads when source is given by > glance: > https://github.com/openstack/python-swiftclient/blob/master/swiftclient/service.py#L18

Re: [openstack-dev] [glance] multi threads with swift backend

2017-09-28 Thread Arnaud MORIN
Hey all, So I finally tested your pull requests, it does not work. 1 - For uploads, swiftclient is not using threads when source is given by glance: https://github.com/openstack/python-swiftclient/blob/master/swiftclient/service.py#L1847 2 - For downloads, when requesting the file from swift, it i

Re: [openstack-dev] [glance] multi threads with swift backend

2017-09-06 Thread Arnaud MORIN
Hey, I would love to see that reviving! Cheers, Arnaud On 6 September 2017 at 21:00, Mikhail Fedosin wrote: > Hey! As you said it's not possible now. > > I implemented the support several years ago, bit unfortunately no one > wanted to review it: https://review.openstack.org/#/c/218993 > If you

Re: [openstack-dev] [glance] multi threads with swift backend

2017-09-06 Thread Mikhail Fedosin
Hey! As you said it's not possible now. I implemented the support several years ago, bit unfortunately no one wanted to review it: https://review.openstack.org/#/c/218993 If you want, we can revive it. Best, Mike On Wed, Sep 6, 2017 at 9:05 PM, Clay Gerrard wrote: > I'm pretty sure that would

Re: [openstack-dev] [glance] multi threads with swift backend

2017-09-06 Thread Clay Gerrard
I'm pretty sure that would only be possible with a code change in glance to move the consumption of the swiftclient abstraction up a layer from the client/connection objects to swiftclient's service objects [1]. I'm not sure if that'd be something that would make a lot of sense to the Image Servic

[openstack-dev] [glance] multi threads with swift backend

2017-09-06 Thread Arnaud MORIN
Hi all, Is there any chance that glance can use the multiprocessing from swiftclient library (equivalent of xxx-threads options from cli)? If yes, how to enable it? I did not find anything useful in the glance configuration options. And looking at glance_store code make me think that it's not poss