Re: [Openstack] [Swift] Where can I get the libshss library ?

On Thu, 13 Oct 2016 11:58:58 +0900 Yu Watanabe wrote: > Oct 12 19:44:45 opstack-objstorage1 swift-account-server[27793]: Error: > [swift-hash]: both swift_hash_path_suffix and swift_hash_path_prefix are > m...ft.conf Leaving libshss aside, Swift being unable to read /etc/swift/swift.conf is typi

Re: [Openstack] [Swift] 404 re-reading just created container

On Fri, 3 Jun 2016 16:09:06 +1200 Mark Kirkwood wrote: > This is a Swift 2.7.0.1 system with 2 proxies and 3 storage nodes (each > the latter with 6 devices). What is your replica count? > The proxies are load balanced behind Haproxy (which I'm guessing is > causing the 404 - see below) HApr

Re: [Openstack] Using swift-client in C with cURL to access a swift store

On Fri, 20 May 2016 10:24:38 -0700 Clay Gerrard wrote: > > Look at cf_xxx functions here: > > https://git.fedorahosted.org/cgit/iwhd.git/tree/backend.c > > Clone > > git://git.fedorahosted.org/iwhd.git > > > ^ should *also* go on the associated projects list! Naah, iwhd is completely dead. O

Re: [Openstack] Using swift-client in C with cURL to access a swift store

On Wed, 18 May 2016 11:21:29 -0700 Clay Gerrard wrote: > I haven't heard much about folks using Swift bindings for C - there's no C > bindings listed on the associated projects page [1]. I'm sure just using The so-called "Image Warehouse" of the Aeolus project has a minimal handler for CF in C.

Re: [Openstack] [swift] Object replication failure counts confusing in 2.7.0

On Wed, 18 May 2016 16:46:05 +1200 Mark Kirkwood wrote: > May 18 04:31:17 markir-dev-ostor002 object-server: object replication > failure 4, detail Traceback (most recent call last):#012 File > "/opt/cat/openstack/swift/local/lib/python2.7/site-packages/swift/obj/replicator.py", > > line 622

Re: [Openstack] Swift accounts and container replication

On Mon, 04 Apr 2016 18:13:17 +0100 Carlos Rodrigues wrote: > I have two regions nodes of swift, geographically dispersed, and i have > storage policies for both regions.  > > How can i do to replicate the accounts and containers between two > regions? Policies do not apply to accounts and conta

Re: [Openstack] swift ringbuilder and disk size/capacity relationship

On Wed, 16 Mar 2016 13:23:31 +1300 Mark Kirkwood wrote: > So integrating swift-recon into regular monitoring/alerting > (collectd/nagios or whatever) is one approach (mind you most folk > already monitor disk usage data... and there is nothing overly special > about ensuring you don't run of s

Re: [Openstack] Using swift with a single replica on software-defined storage

On Wed, 27 May 2015 10:28:53 +0200 Vincenzo Pii wrote: > My question is the following: when performance doesn't matter and > reliability is taken care of "below" swift (so swift will always manage to > read/write an object as devices will always be consistent and available), > are there other asp

Re: [Openstack] [Swift] Using unevenly sized disks in a cluster

On Thu, 26 Feb 2015 12:40:32 -0800 Shrinand Javadekar wrote: > Let's say I start with two disks of 10GB each [...] > At a later point, I increase the capacity of the cluster by adding one > 500GB disk. [...] > How does Swift place data such that it the "as unique as possible" > policy is maintai

Re: [Openstack] [Openstack-operators] [swift] How to encrypt account/container/object data that travels through storage nodes?

On Wed, 17 Sep 2014 15:16:22 -0300 Gui Maluf wrote: > Replicas are copied between storage nodes and swift presume all storage > nodes are running in a secure network. Taking any scenario of a Globally > Distributed OpenStack Swift Cluster >

Re: [Openstack] Implement "swift service-list" in python-swiftclient

On Tue, 9 Sep 2014 15:36:03 +0530 Ashish Chandra wrote: > 1) Do we have plans to include "swift service-list" in swiftclient ? > If yes then I would be filing a blueprint in python-swiftclient to > implement the same coz I require it to populate under the Admin -> System > Info -> Object Storage

Re: [Openstack] [Swift] IP address of Swift nodes : need help

On Tue, 19 Aug 2014 00:12:43 +0530 Jyoti Ranjan wrote: > In other words, is it necessary to use static IP for Swift nodes? It is, but you can assign them with DHCP. In ISC DHCP the syntax is host r21s05 { fixed-address r21s05; hardware ethernet 68:9c:70:95:8e:51; } -- Pete ___

Re: [Openstack] [Swift] Running out of ports or fds?

On Fri, 11 Jul 2014 20:48:54 + "Luse, Paul E" wrote: > So Stephen (presented the perf work at the last hackathon) had an idea > about maybe saving on some connections via batching up groups of > container updates before making the connection to the container server > in async_update(). I don

Re: [Openstack] [Swift] Running out of ports or fds?

On Tue, 8 Jul 2014 16:26:10 -0700 Shrinand Javadekar wrote: > I see that these servers do not use a persistent http connection > between them. So every blob get/put/delete request will create a new > connection, use it and tear it down. In a highly concurrent > environment with thousands of such

Re: [Openstack] Swift generating thousands of rsyncs per second on a small cluster

On Tue, 1 Jul 2014 10:50:15 +0100 Diogo Vieira wrote: > Can you tell me if this is normal behaviour? If so, how will > this scale when I add more objects? Will it keep getting more > and more CPU usage? Dunno if it's normal or not, but clusters installed with default parameters do that. My nodes

Re: [Openstack] Swift and Keystone behind NAT Firewall

On Thu, 12 Jun 2014 09:52:59 +0100 Diogo Vieira wrote: > Ok, I guess that might work, but I have one problem with that approach. > For a service I'm developing I have to know the public URL for an object > in the store. For that I use Keystone to find the endpoint of Swift and > I get the interna

Re: [Openstack] Swift and Keystone behind NAT Firewall

On Wed, 11 Jun 2014 18:52:43 +0100 Diogo Vieira wrote: > I have one Proxy Node in the same machine as the Keystone service is as > well as a Storage Node. On the other machine I have only a Storage Node. > What should be the approach used to make this publicly available? What > ports should be o

Re: [Openstack] [Trove] [Swift] Devstack broken pipe getting backup out of swift

On Thu, 05 Jun 2014 17:14:43 +1200 Mark Kirkwood wrote: > The swift logs on the storage don't show anything odd (200 responses to > the request to GET the backup). Any ideas? You aren't using nginx as your LB in front of Swift by any chance? It almost looks like the LB can't handle the GET size

Re: [Openstack] swift don't start with ceilometer

On Wed, 04 Jun 2014 17:28:54 +0800 Yugang LIU wrote: > pkg_resources.VersionConflict: (happybase 0.7 > (/usr/lib/python2.7/dist-packages), > Requirement.parse('happybase>=0.5,!=0.7')) > > it need happybase 0.5, but my system version is 0.7? You either need to go down on happybase or find a ceil

Re: [Openstack] [SWIFT] What happens when the shard count on available disk is less than the total shard count?

On Fri, 28 Feb 2014 16:01:26 -0800 Stephen Wood wrote: > When originally running swift-ring-builder container.builder create, I set > the partitions at 15 to give a total of 32768 partitions to split across 23 > hosts with 12 disks each. Now I am replacing the container service on these > 23 host

Re: [Openstack] [SWIFT] What happens when the shard count on available disk is less than the total shard count?

On Fri, 28 Feb 2014 09:10:06 -0800 Stephen Wood wrote: > However I realize that the shard count is completely different now. What is a "shard count"? Do you have a document that uses such terminology? > I > originally used a partition value of 15 but this now seems much to high for > 4 servers

Re: [Openstack] Capturing performance penalities Physical versus VM [Swift]

On Fri, 21 Feb 2014 13:47:31 -0800 Adam Lawson wrote: > So, are there benchmarks already published somewhere that demonstrate > how/why a virtual infrastructure is such a bad idea with Swift? We all know > Swift is designed to be a storage provider - not a storage consumer and > that running Swif

Re: [Openstack] Building Swift cluster wiuth Ubuntu VM's

On Sun, 2 Feb 2014 20:08:02 -0800 Adam Lawson wrote: > (http://docs.openstack.org/developer/swift/howto_installmultinode.html) > > I'm running into issues where the instructions start to get really > hazy/unclear after step #4 in Configure Proxy Server. Woops, there was a bug in numbering of st

Re: [Openstack] [SWIFT] Memcached timeouts?

On Fri, 24 Jan 2014 12:51:45 -0800 Stephen Wood wrote: > My memcached settings are basically stock. Any idea what could be causing > these errors? I don't have a good idea, but I would start by backing up these commits: https://github.com/openstack/swift/commit/0b370269111957fec7521d284fcbd742f

Re: [Openstack] [swift] Is anyone using cloudfuse successfully?

On Wed, 22 Jan 2014 22:40:13 -0700 Joel Cooklin wrote: > > Also have you looked the gluster-swift project to see what they are doing? > > I have not. I wasn't aware that they included a client or fusedriver > like this. I'll look into it. Well, theirs is upside-down: the data is in Gluster a

Re: [Openstack] [Swift] Object use cases

On Mon, 20 Jan 2014 15:56:40 -0800 (PST) Mark Brown wrote: > 2. Is anyone deploying Swift within the data center for a private cloud > object solution, and if yes, what are the use cases for that as compared to > say, using a NAS solution within the data center? I am looking for concrete > inf

Re: [Openstack] [Swift] Proxy server bottleneck

On Fri, 10 Jan 2014 15:25:02 -0800 Shrinand Javadekar wrote: > I see that the proxy-server already has a "workers" config option. However, > looks like that is the # of threads in one proxy-server process. Not so. Workers are separate Linux processes. Look at os.fork() in run_sever(). Perhaps yo

Re: [Openstack] [SWIFT] 404 error during uploads

On Mon, 23 Dec 2013 12:13:13 -0800 Stephen Wood wrote: > During any given 100 uploads, I'll usually see between 1 to 4% of the > calls give a 404. In my practice, all such cases were related to custer health. However, since your 404 occurs when Object controler in proxy checks if container exist

Re: [Openstack] [Swift] Swift on RHEL

On Tue, 10 Dec 2013 23:23:01 + "Kotwani, Mukul" wrote: > As an example, for a specific test: > PUT for Ubuntu, default parameters: ~140 ops/sec > PUT for Ubuntu, disable_fallocate=true: ~100 ops/sec > PUT for Redhat 5.8, default parameters: ~15 ops/sec I suppose it should be trackable, altho

Re: [Openstack] [Swift] Swift on RHEL

On Thu, 5 Dec 2013 21:19:49 + "Kotwani, Mukul" wrote: > Has anyone used and/or deployed RHEL (5.8) with Swift? > I was also looking for a "Supported platforms" for Swift, and > I could not find it. I don't think an RDO for RHEL 5.x ever existed. First packages were built a year after RHEL 6

Re: [Openstack] [SWIFT] Unable to delete containers?

On Thu, 5 Dec 2013 10:06:14 -0800 Stephen Wood wrote: > $ swift list > ssbench_46 > > $ swift delete ssbench_46 > Container 'ssbench_46' not found > > $ swift list ssbench_46 > Container 'ssbench_46' not found > > How does one go about actually removing these phantom contai

Re: [Openstack] [Swift] Container DB update after object PUT

On Thu, 28 Nov 2013 05:24:35 + "Shao, Minglong" wrote: > 1. Proxy server sends three requests to three object servers. > 2. One object server writes the object successfully, sends an update to > the container DB and an “OK” reply to the proxy server. But the other two > fail, so they

Re: [Openstack] [Swift] Changing local logging destinations?

On Wed, 27 Nov 2013 15:33:52 -0800 John Dickinson wrote: > > Can someone give me advice on how to redirect logs from /var/log/syslog to > > /var/log/swift/{object|account|container}.logs? > While a Swift-All-In-One certainly isn't something your should run in > production, the SAIO document do

Re: [Openstack] Swift deployment in production

On Mon, 25 Nov 2013 10:26:51 +0530 Pravar Jawalekar wrote: > How object/container/auth servers made communicate to actual underlying > storage infrastructure? There's NO "underlying storage architecture", typically. Although you could configure Swift that way, nobody sane does it for production.

Re: [Openstack] [swift] Frequent OperationalError (database locked) in 1.10.0 (Havana)

On Thu, 14 Nov 2013 14:18:37 + "Juan J. Martinez" wrote: > I've managed to isolate the change that introduced the problem: > > https://github.com/openstack/swift/commit/0fdad0d9d9e68b00f61171bb2a0dfd840ef5345f > > As this change is just for PyPy support I've reverted it and the problem > is

Re: [Openstack] WORM support

On Wed, 13 Nov 2013 16:47:29 + "Perez, Daniel - ES" wrote: > I am wondering if I can circumvent the use of tombstone files? Not without writing some code, but you can write your own Pluggable Back-end like Gluster does. In that case you're free to implement any delete mechanism you like. Not

Re: [Openstack] Swift stat Account HEAD failed

On Thu, 24 Oct 2013 14:13:23 + Therese Persson wrote: > Oct 24 15:45:37 kds-openstack-01 account-server 10.10.10.51 - - > [24/Oct/2013:13:45:37 +] "HEAD > /cciss/c0d2p1/182082/AUTH_519c6e2d263049adba404441f18aab60" 400 72 > "tx6dd78c64bf6b4ceca3a568c04628fad3" "-" "-" 0.0002 "" > /dev

Re: [Openstack] [Swift] Problems during initial configuration

On Fri, 16 Aug 2013 13:11:26 -0700 Steve Carter wrote: > swift-ring-builder object.builder create 18 3 1 > swift-ring-builder object.builder add z2-10.30.177.41:6200/sdb 100 > swift-ring-builder object.builder add z3-10.30.177.41:6201/sdc 100 > swift-ring-builder object.builder add z4-10.30.177.4

Re: [Openstack] [swift] permission denied errors during swift-init start main

On Thu, 15 Aug 2013 01:59:03 + "Snider, Tim" wrote: > IOError: [Errno 13] Permission denied: '/etc/swift/account-server.conf' Bet you made /etc/swift a signing_dir. I don't know who came up with this destructive idea first, but it even made its way into upstream Puppet modules and it always