Re: [Openstack] [Swift] Delete handling with md5 collisions

On 8/26/15 1:37 PM, Shrinand Javadekar wrote: Hi, I have a question about how object deletes are handled with md5 collisions. I looked at the code and here's my understanding of how things will work. If I have two objects that have the same md5 hash, they will go to the same hash directory. Say

Re: [Openstack] Swift - Adding S3 Glacier like interface in Swift & Swift3 Object Storage

On 5/6/15 2:34 AM, Bala wrote: I am new to this list so please excuse me if I posted it in wrong list. We have a tape library which we would like to integrate with OpenStack Swift & Swift3 object storage service to provide S3 interface. The current file system we have for the library has been i

Re: [Openstack] [Swift] tmp directory causing Swift slowdown

On 5/1/15 12:37 PM, Christian Schwede wrote: On 01.05.15 20:33, Samuel Merritt wrote: On 5/1/15 7:55 AM, Uwe Sauter wrote: Am 01.05.2015 um 02:21 schrieb Samuel Merritt: It seems like 1430268763.41931.data would be in the same allocation group as objects/757/a94

Re: [Openstack] [Swift] tmp directory causing Swift slowdown

On 5/1/15 7:55 AM, Uwe Sauter wrote: Am 01.05.2015 um 02:21 schrieb Samuel Merritt: It seems like 1430268763.41931.data would be in the same allocation group as objects/757/a94/bd77129a1cae9e32381776e322efca94, and bd77129a1cae9e32381776e322efca94 would be in the same allocation group as

Re: [Openstack] [Swift] tmp directory causing Swift slowdown

On 4/29/15 4:08 PM, Shrinand Javadekar wrote: Hi, I have been investigating a pretty serious Swift performance problem for a while now. I have a single node Swift instance with 16 cores, 64GB memory and 8 MDs of 3TB each. I only write 256KB objects into this Swift instance with high concurrency;

Re: [Openstack] Openstack swift charset problem

On 4/3/15 1:42 AM, mehmet hacısalihoğlu wrote: Hi All, When I request send to create pseudo folder with turkish characters in windows, I get error message "Invalid UTF8 or contains NULL". curl -i -X PUT http://1X.XX.XXX.XX/v1/AUTH_test/test/çöçö

Re: [Openstack] [Swift] XFS extended attribute performance

On 3/24/15 2:52 PM, Shrinand Javadekar wrote: Hi, I wrote a small microbenchmark for measuring the performance of extended attributes in XFS. In the experiment, I wrote 100K files, each with extended attributes. In one experiment, XFS was formatted with the default inode size of 256 bytes. In th

Re: [Openstack] Swift with Ceilometer

Swift can be configured to emit lots of telemetry in StatsD format. Among the numerous metrics are such things as GETs/sec, PUTs/sec, and total bytes transferred per second. See http://docs.openstack.org/developer/swift/admin_guide.html#reporting-metrics-to-statsd for more details. On 11/8/

Re: [Openstack] Remove storage from the rings and then re-add..

On 10/19/14, 11:24 PM, Shyam Prasad N wrote: Hi, I've written a few scripts to make adding of storage to swift cluster easier: remakerings: removes existing ring files and builds new empty rings. addtorings: adds new IP:DISK pair to existing rings. removefromrings: removes an IP:DISK pair from e

[Openstack] [Swift] Does anyone deploy Swift with non-Eventlet WSGI servers?

As far as I know, most Swift deployments use eventlet.wsgi as their WSGI server. Are there any out there that use Apache/mod_wsgi or anything else? I ask because I'm looking at making better use of the 100 Continue response inside Swift (proxy ---> object server requests, nothing client-facing

Re: [Openstack] Swift And Custom HTTP Reponse Headers

On 8/7/14, 9:25 AM, Brent Troge wrote: Hello. I am considering building out a Swift cluster to act as an origin to some edge cache servers. Are there any readily available API extensions(preferably OSS) which allow for setting max-age and expires headers? There's https://github.com/dpgoetz/so

Re: [Openstack] [Swift] Geo replication vs Storage policies

On 7/30/14, 10:18 AM, Shrinand Javadekar wrote: Hi, Swift v1 allowed for geo replication using read and write affinity rules. Now, Swift v2 allows setting storage policies (which can affect replication) per container. I wanted to know if/how these two intersect. Some of the following are straigh

Re: [Openstack] Swift downloading only manifest of static large object (SLO)

On 3/12/14 9:14 PM, Ben McCann wrote: Hi, I'm attempting to download a large file which I have uploaded to SoftLayer Object Storage using the swift tool. It's downloading only the manifest and is not downloading the segments. Any tips on figuring out what is going wrong? It's entirely possible

Re: [Openstack] [SWIFT] swift 'generator' object not callable

On 2/20/14 10:41 AM, Stephen Wood wrote: Can someone provide more details about this error that I'm seeing periodically? Feb 20 18:31:58 swiftproxy swift 'generator' object is not callable: #012Traceback (most recent call last):#012 File "/usr/local/lib/python2.7/dist-packages/swift3-1.7.0-py2.

Re: [Openstack] [Swift]Support reading from archives

I have several reasons for not wanting that functionality in Swift; I'll try to enumerate them here. First, this represents a significant scope expansion. As of today, Swift deals only in opaque byte streams, and any operation applies equally to all byte streams. This change would, for the fi

Re: [Openstack] openstack swift storage provisioning

On 2/3/14 12:16 AM, Heiko Krämer wrote: Hi Pragya, you can set account and container quotas with a ResellerAdmin user. http://docs.openstack.org/developer/swift/middleware.html?highlight=quota#module-swift.common.middleware.account_quotas to find out how much a user have in use you need ceilom

Re: [Openstack] openstack swift storage provisioning

On 1/31/14 8:22 PM, pragya jain wrote: hello all, please somebody help me to know: in openstack swift, how does a user come to know whether there is a free space available to store the data or there is a need to add more storage capacity? One simply tries the object PUT request and sees if it

Re: [Openstack] Keep X versions of an object where X depends of the container

Swift does not support limiting the number of object versions kept. You just get all of them. One could manually delete objects from the versions container* to achieve this, but there's no support for that in Swift. * that's the container where the old object versions are stored, not the cont

Re: [Openstack] [Swift] Container DB update after object PUT

On 11/27/13 9:24 PM, Shao, Minglong wrote: Thanks for your reply! I understand the three PUTs by the proxy server and how the replicator works. What I don’t understand is the update of the container DB. The update is sent by individual object servers which don’t know whether a PUT (from the clie

Re: [Openstack] Swift stat Account HEAD failed

On 10/24/13 7:13 AM, Therese Persson wrote: Hello, I have encountered a problem regarding Swift in my one node installation of OpenStack on Ubuntu 12.04. When I try to run the command “swift stat” I get the following error: Account HEAD failed: http://XXX.XXX.XXX.XXX:/v1/AUTH_519c6e2d26304

Re: [Openstack] Assets down

On 10/11/13 1:43 AM, Emre Sokullu wrote: Hi everyone, We're having a serious problem with our OpenStack installation. Most assets that we've been serving from http://assets00.grou.ps such as http://assets.grou.ps/0F2E3C/avatars/28346976/80.png are broken, but some stil

Re: [Openstack] [Swift] Object expiration vs DELETE

On 10/10/13 11:12 AM, Shrinand Javadekar wrote: Thanks for the detailed reply Samuel. The architecture overview of Openstack Swift at [1] mentions: "A deletion is also treated as a version of the file (a 0 byte file ending with ”.ts”, which stands for tombstone)". That led me to think that an ob

Re: [Openstack] [Swift] Object expiration vs DELETE

On 10/9/13 8:28 PM, Shrinand Javadekar wrote: Hi, Objects in a swift container can be deleted by either explicitly deleting them or by setting a expiry timestamp on them. Is there a performance difference between the two? For example, when I want to delete an object, instead of deleting it, can

Re: [Openstack] Remounting drives

On 8/15/13 12:50 AM, Morten Møller Riis wrote: After an apt-get upgrade on one of the object/account/container servers Ubuntu decided to rename the devices. I've been running with the following structure: /srv/node/sda1 /srv/node/sdb1 /srv/node/sdc1 /srv/node/sdd1 sde and sdf are system disks