Re: [Openstack] swift proxys and dedecated ceilometer

2013-07-24 Thread Julien Danjou
On Wed, Jul 24 2013, Axel Christiansen wrote: > To be sure, the ceilometer-agent-central and ceilometer-collector do > go on the proxys. And just the ceilometer-api ist for the dedecated > ceilometer-host? No, they all can go to your dedicated host. Ceilometer agent central access Swift via its A

Re: [Openstack] swift proxys and dedecated ceilometer

2013-07-24 Thread Axel Christiansen
Hi Julien, thx a lot for the real quick help. Yes, only swift. These meters: storage.objects storage.objects.size storage.objects.containers storage.objects.incoming.bytes storage.objects.outgoing.bytes To be sure, the ceilometer-agent-central and ceilometer-collector do go on the proxys. And

Re: [Openstack] swift proxys and dedecated ceilometer

2013-07-24 Thread Julien Danjou
On Wed, Jul 24 2013, Axel Christiansen wrote: Hi Axel, If you want to only meter Swift, you just need: > ceilometer-agent-central > ceilometer-collector And to retrieve your data: > ceilometer-api -- Julien Danjou /* Free Software hacker * freelance consultant http://julien.danjou.info */

[Openstack] swift proxys and dedecated ceilometer

2013-07-24 Thread Axel Christiansen
Dear List, i am trying to figure out what ceilometer components nedds to bo installed an what nodes. I have 2 swift-proxy-hosts and 1 ceiloemeter-host These are the packages debian7 respectively the grizzly repo offers: ceilometer-agent-central - OpenStack efficient metering counters system

Re: [Openstack] Issue in debugging OpenStack Swift

2013-07-24 Thread Muhammad Kazim
hammad Kazim > *Sent:* Tuesday, July 23, 2013 12:33 AM > *To:* Gareth > *Cc:* openstack@lists.launchpad.net > > *Subject:* Re: [Openstack] Issue in debugging OpenStack Swift > > ** ** > > Worked perfectly in the first attempt. Thanks a lot for the help. :) > > On Tu

Re: [Openstack] Issue in debugging OpenStack Swift

2013-07-23 Thread Luse, Paul E
-bounces+paul.e.luse=intel@lists.launchpad.net] On Behalf Of Muhammad Kazim Sent: Tuesday, July 23, 2013 12:33 AM To: Gareth Cc: openstack@lists.launchpad.net Subject: Re: [Openstack] Issue in debugging OpenStack Swift Worked perfectly in the first attempt. Thanks a lot for the help. :) On Tue, Jul

Re: [Openstack] Issue in debugging OpenStack Swift

2013-07-23 Thread Muhammad Kazim
Worked perfectly in the first attempt. Thanks a lot for the help. :) On Tue, Jul 23, 2013 at 10:41 AM, Gareth wrote: > the key reason it here: > https://github.com/openstack/swift/blob/master/swift/common/utils.py#L1047 > > you have many ways to stop flush IO; I prefer add a line

Re: [Openstack] Issue in debugging OpenStack Swift

2013-07-22 Thread Gareth
the key reason it here: https://github.com/openstack/swift/blob/master/swift/common/utils.py#L1047 you have many ways to stop flush IO; I prefer add a line "stdio_files = []" after line 1037 On Sun, Jul 21, 2013 at 1:58 AM, Muhammad Kazim wrote: > Hi all, > > I wanted to

[Openstack] Issue in debugging OpenStack Swift

2013-07-20 Thread Muhammad Kazim
Hi all, I wanted to debug Swift source code. I have a Devstack setup running on my machine that i have configured to only run keystone, mysql and swift. I have used pdb to debug source code. I was able to debug python-swiftclient, middleware (common), and proxy-server code. However, when i try to

Re: [Openstack] [ANN] Caimito 0.11 - WebDAV frontend for OpenStack Swift Cloud Storage

2013-07-17 Thread Chmouel Boudjnah
gt; https://wiki.openstack.org/wiki/RelatedProjects, but got no response. > Regards This is a document inside openstack swift : https://github.com/openstack/swift/blob/master/doc/source/associated_projects.rst you just need to submit a review updating the document in the source tree and this will get

Re: [Openstack] [ANN] Caimito 0.11 - WebDAV frontend for OpenStack Swift Cloud Storage

2013-07-17 Thread Gabe Wong
al Message- From: "Chmouel Boudjnah" Sent: Tuesday, July 16, 2013 2:45am To: "Gabe Wong" Cc: openstack@lists.launchpad.net Subject: Re: [Openstack] [ANN] Caimito 0.11 - WebDAV frontend for OpenStack Swift Cloud Storage On Wed, Jul 10, 2013 at 4:14 PM, Gabe Wong wrote: &

Re: [Openstack] [Swift] Is it possible to use tempauth and tempurl together?

2013-07-17 Thread Clay Gerrard
Yes tempurl and and tempauth are tessted together, your pipeline looks good. "allow_overrides = false" in the tempauth section could cause this, but it's default is true. Are you creating the tempurl's with "bin/swift-temp-url" ??? clayg@swift:~$ swift post -m temp-url-key:asdf clayg@swift:~$ s

[Openstack] [Swift] Is it possible to use tempauth and tempurl together?

2013-07-17 Thread Jonathan Lu
Hi, all stackers, Can I use the tempauth and tempurl at the same time? I will set a long tempauth timeout time for internal service and a short tempurl timeout for the ohters? My proxy-server.conf is quite easy: [pipeline:main] pipeline = healthcheck cache tempurl tempauth pro

Re: [Openstack] Swift proxy logs

2013-07-16 Thread CHABANI Mohamed El Hadi
Yes, i followed the instructions in the SAIO, and i've either proxy.log, proxy.error or /message !! except the /syslog in which there is logs but no signs for proxy activities (even i do authentication, or upload/download) !! 2013/7/16 Chuck Thier > Hello, > > If you followed the rsyslog instru

Re: [Openstack] Swift proxy logs

2013-07-16 Thread Chuck Thier
Hello, If you followed the rsyslog instructions in the SAIO, then the proxy logs will be in /var/log/swift/proxy.log and proxy.error. If not, then it will be either in /var/log/syslog or /var/log/messages, depending on your server distro. -- Chuck On Tue, Jul 16, 2013 at 4:57 AM, CHABANI Moham

[Openstack] Swift proxy logs

2013-07-16 Thread CHABANI Mohamed El Hadi
Hi guys, I've a problem with The Swift proxy log, i can't find it in /var/log/syslog (only for replicators, updaters...) neither in /var/log/upstart. and in the proxy-server.conf also there is no parameter to specify the log path (i took the one by default in http://docs.openstack.org/developer/sw

Re: [Openstack] [ANN] Caimito 0.11 - WebDAV frontend for OpenStack Swift Cloud Storage

2013-07-15 Thread Chmouel Boudjnah
On Wed, Jul 10, 2013 at 4:14 PM, Gabe Wong wrote: > Lots of work has been done to Caimito. In addition to bug fixes: > - Faster request handling. > - Better handling of files with spaces and other characters. > > Thanks to everyone who have contributed. Of course the community's valuable > feedbac

Re: [Openstack] [SWIFT] Account reaping - gradually

2013-07-15 Thread Samuel Merritt
On 7/15/13 6:52 AM, Leandro Reox wrote: Hi guys, I was wondering if there any plans or maybe already exist a feature or a flag for the account reaping process to make it gradually. We had one case with an account with millions of files, that was plain deleted, an that triggers the deletion of ev

[Openstack] [SWIFT] Account reaping - gradually

2013-07-15 Thread Leandro Reox
Hi guys, I was wondering if there any plans or maybe already exist a feature or a flag for the account reaping process to make it gradually. We had one case with an account with millions of files, that was plain deleted, an that triggers the deletion of every object, then containers to finally del

Re: [Openstack] [Swift] Try to get the final status of PUT and timeout

2013-07-12 Thread Peter Portante
Can you use the transaction ID in the object server log that is in error to correlate with the proxy server logs to see how the proxy server responded for that REST API request? On Fri, Jul 12, 2013 at 12:46 PM, Samuel Merritt wrote: > On 7/12/13 12:34 AM, Jonathan Lu wrote: > >> Hi, all stacke

Re: [Openstack] [Swift] Try to get the final status of PUT and timeout

2013-07-12 Thread Samuel Merritt
On 7/12/13 12:34 AM, Jonathan Lu wrote: Hi, all stackers, I test the cluster and get such error msg: Jul 12 11:23:57 ubuntu-12 proxy-server ERROR with Object server 192.168.1.161:60 00/xvdb1 re: Trying to get final status of PUT to /v1/AUTH_test/test_8/e9a243cb0

Re: [Openstack] swift storage, getting it working

2013-07-12 Thread Axel Christiansen
Hi Hugo, as i mentioned, my ring was wrong. At least i beleve using the wrong ports for the ring services(account, container, object) breaks the ring, right? Thats what broke my setup, i beleve. Axel Am 12.07.13 14:09, schrieb Kuo Hugo: > Hi Alex , > > Did you re-check the drives informati

Re: [Openstack] swift storage, getting it working

2013-07-12 Thread Kuo Hugo
Hi Alex , Did you re-check the drives information in the ring? Would you like to show it? +Hugo Kuo+ h...@swiftstack.com tonyt...@gmail.com +886 935004793 2013/7/12 Axel Christiansen > Hello. > > > my issue is solved. What did i do wrong, got wrong from google ;) > > I mixed up the default po

Re: [Openstack] swift storage, getting it working

2013-07-12 Thread Axel Christiansen
Hello. my issue is solved. What did i do wrong, got wrong from google ;) I mixed up the default ports for the ring building. The proxy-server option "allow_account_management = true" and "account_autocreate = true" where set to false. All the best. Axel Am 12.07.13 12:50, schrieb Axel Chri

Re: [Openstack] swift storage, getting it working

2013-07-12 Thread Axel Christiansen
Thank you. That looks all right. Switching to user swift on a storage node, cd-ing to a mountpoint (/srv/node/sdb1/) and creating a file works. I checked the mount points and rights twice. Here is a little larger snippet from the log server: http://paste.openstack.org/show/40222/ someone with

Re: [Openstack] swift storage, getting it working

2013-07-12 Thread Kuo Hugo
Agree with Jonathan +1 Change the owner of disk mount point to the relevant user which you set in /etc/swift/*. +Hugo Kuo+ h...@swiftstack.com tonyt...@gmail.com +886 935004793 2013/7/12 Jonathan Lu > Hi, > I once met such problem because I forget to change the own of the > directory of t

Re: [Openstack] swift storage, getting it working

2013-07-12 Thread Jonathan Lu
Hi, I once met such problem because I forget to change the own of the directory of the mounted device to swift:swift. On 2013/7/12 16:44, Axel Christiansen wrote: Hello List, i got stock getting a swift store running. the base components, a proxy some storage nodes are prepared. The keys

[Openstack] swift storage, getting it working

2013-07-12 Thread Axel Christiansen
Hello List, i got stock getting a swift store running. the base components, a proxy some storage nodes are prepared. The keystone service is up and seems working ok. Authentication works. wehn trying to create a container this happens: swift -v -s -V 2.0 -A http://10.42.44.206:5000/v2.0 -U dem

[Openstack] [Swift] Try to get the final status of PUT and timeout

2013-07-12 Thread Jonathan Lu
Hi, all stackers, I test the cluster and get such error msg: Jul 12 11:23:57 ubuntu-12 proxy-server ERROR with Object server 192.168.1.161:60 00/xvdb1 re: Trying to get final status of PUT to /v1/AUTH_test/test_8/e9a243cb0 462406a9ca10b590ed42a5f: Timeout (10s) (t

Re: [Openstack] [Swift] Breakpoint resume with tempurl

2013-07-11 Thread John Dickinson
Swift supports Range requests, so you are able to make a GET request with the Range header starting with the first byte you didn't fetch the first time. --John On Jul 10, 2013, at 8:10 PM, Jonathan Lu wrote: > Hi, all stackers, > > I have realized downloading large object with tempurl mi

[Openstack] [Swift] Breakpoint resume with tempurl

2013-07-10 Thread Jonathan Lu
Hi, all stackers, I have realized downloading large object with tempurl middle-wareand want to support break-point resume. Has anyone got the experience of fulfilling break-point resume with tempurl in Swift? Thanks, Jonathan Lu ___ Mailing list

Re: [Openstack] Swift tempurl

2013-07-10 Thread Morten Møller Riis
This turned out to be a known issue with swath. I upgraded to a newer version and the problem was resolved :) Mvh / Best regards Morten Møller Riis Gigahost ApS m...@gigahost.dk On Jul 11, 2013, at 10:52 AM, Morten Møller Riis wrote: > I use swauth, and thus authtoken is not present in my p

Re: [Openstack] Swift tempurl

2013-07-10 Thread Morten Møller Riis
I use swauth, and thus authtoken is not present in my pipeline. This might be why I'm seeing the problem actually. Mvh / Best regards Morten Møller Riis Gigahost ApS m...@gigahost.dk On Jul 11, 2013, at 4:04 AM, Shrinand Javadekar wrote: > I had a similar problem. See [1]. The fix was to ad

Re: [Openstack] Swift tempurl

2013-07-10 Thread Shrinand Javadekar
I had a similar problem. See [1]. The fix was to add delay_auth_decision = 1 in the proxy-server.conf [filter:authtoken] ... delay_auth_decision = 1 -Shri [1] https://answers.launchpad.net/swift/+question/225614 On Wed, Jul 10, 2013 at 4:43 AM, Morten Møller Riis wrote: > I've been looking at

[Openstack] [ANN] Caimito 0.11 - WebDAV frontend for OpenStack Swift Cloud Storage

2013-07-10 Thread Gabe Wong
Re: Caimito 0.11 - WebDAV frontend for OpenStack Swift Cloud Storage Hi all, Lots of work has been done to Caimito. In addition to bug fixes: - Faster request handling. - Better handling of files with spaces and other characters. Thanks to everyone who have contributed. Of course the

Re: [Openstack] Swift tempurl

2013-07-10 Thread Morten Møller Riis
I've been looking at tempurl.py and found that the problem occurs here: def _get_key(self, env, account): """ Returns the X-Account-Meta-Temp-URL-Key header value for the account, or None if none is set. :param env: The WSGI environment for the request.

[Openstack] Swift tempurl

2013-07-10 Thread Morten Møller Riis
I'm having trouble getting tempurl to work. I set the "X-Account-Meta-Temp-Url-Key" metadata on the account. And a GET request shows it's set correctly. I've enabled it on the proxy server in /etc/swift/proxy-server.conf: [DEFAULT] bind_port = 8080 workers = 8 user = swift [pipeline:main] pipe

Re: [Openstack] [SWIFT] raising network traffic on the storage node

2013-07-09 Thread Klaus Schürmann
Nachricht- Von: Openstack [mailto:openstack-bounces+klaus.schuermann=mediabeam@lists.launchpad.net] Im Auftrag von Robert van Leeuwen Gesendet: Dienstag, 9. Juli 2013 09:09 An: openstack@lists.launchpad.net Betreff: Re: [Openstack] [SWIFT] raising network traffic on the storage node > If

Re: [Openstack] [SWIFT] raising network traffic on the storage node

2013-07-09 Thread Robert van Leeuwen
> If the replication traffic is responsible for this raising network traffic > for only 1.200.000 objects, how much traffic I can > expect if I have 100.000.000 objects stored? > The average size of my mailobjects are 120 kB. > It's planned to use all 12 hard drive slots of my DELL R720xd with 4

Re: [Openstack] [SWIFT] raising network traffic on the storage node

2013-07-08 Thread Klaus Schürmann
Juli 2013 19:22 An: Klaus Schürmann Cc: openstack@lists.launchpad.net Betreff: Re: [Openstack] [SWIFT] raising network traffic o the storage node On Mon, 8 Jul 2013 13:50:38 + Klaus Schürmann wrote: > I use a swift storage as a mail-store. Now I have about 1.000.000 objects > st

Re: [Openstack] [SWIFT] raising network traffic o the storage node

2013-07-08 Thread Pete Zaitcev
On Mon, 8 Jul 2013 13:50:38 + Klaus Schürmann wrote: > I use a swift storage as a mail-store. Now I have about 1.000.000 objects > stored in the cluster. > Traffic Storagenode: http://www.schuermann.net/temp/storagenode.png > Traffic Proxyserver: http://www.schuermann.net/temp/proxyserver.

Re: [Openstack] swift

2013-07-08 Thread Pete Zaitcev
On Mon, 8 Jul 2013 23:59:40 +0800 Peter Cheung wrote: > Hi AllHow you guy admin swift? by command line or by www.swiftstack.com > admin portal? Sounds like a great question for the ops list http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators -- P

[Openstack] swift

2013-07-08 Thread Peter Cheung
Hi AllHow you guy admin swift? by command line or by www.swiftstack.com admin portal? Thanksfrom Peter ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscrib

Re: [Openstack] [SWIFT] raising network traffic o the storage node

2013-07-08 Thread Kuo Hugo
:04 > An: Klaus Schürmann > Cc: openstack@lists.launchpad.net > Betreff: Re: [Openstack] [SWIFT] raising network traffic o the storage node > > Can you zoom in past the spike, most recent 2 or three weeks and see > how it looks? > > My guess is that the proxy traffic is also risin

Re: [Openstack] [SWIFT] raising network traffic o the storage node

2013-07-08 Thread Klaus Schürmann
Portante [mailto:peter.a.porta...@gmail.com] Gesendet: Montag, 8. Juli 2013 16:04 An: Klaus Schürmann Cc: openstack@lists.launchpad.net Betreff: Re: [Openstack] [SWIFT] raising network traffic o the storage node Can you zoom in past the spike, most recent 2 or three weeks and see how it looks? My

Re: [Openstack] [SWIFT] raising network traffic o the storage node

2013-07-08 Thread Peter Portante
Can you zoom in past the spike, most recent 2 or three weeks and see how it looks? My guess is that the proxy traffic is also rising. On Mon, Jul 8, 2013 at 9:50 AM, Klaus Schürmann wrote: > Hi, > > I use a swift storage as a mail-store. Now I have about 1.000.000 objects > stored in the cluste

[Openstack] [SWIFT] raising network traffic o the storage node

2013-07-08 Thread Klaus Schürmann
Hi, I use a swift storage as a mail-store. Now I have about 1.000.000 objects stored in the cluster. I'm wondering about the raising network traffic on my storage nodes. The traffic from the proxy-server has a normal characteristic

Re: [Openstack] Swift Client

2013-07-05 Thread CHABANI Mohamed El Hadi
Okey thank's, i will check this approach. ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp

Re: [Openstack] Swift Client

2013-07-05 Thread Jonathan Lu
Hi, Maybe you need the latest snapshot build, which you can download on the Cyberduck website , "Connect without SSL" section. If that still not work, you can check the config file. If the url of auth is /auth/v1.0, then you sho

Re: [Openstack] Swift Client

2013-07-05 Thread CHABANI Mohamed El Hadi
To use Cyberduck of course. I thing i should also use a different middleware instead of Tempauth, how can i replace it by devauth or swauth ? 2013/7/5 CHABANI Mohamed El Hadi > Hi Hugo, > > I didn't use Owncloud, i tried before Cyberduck and had a problem such > 'unrecongnized SSL message' ! >

Re: [Openstack] Swift Client

2013-07-05 Thread CHABANI Mohamed El Hadi
Hi Hugo, I didn't use Owncloud, i tried before Cyberduck and had a problem such 'unrecongnized SSL message' ! My purpose is just to test ! i'm using a SAIO installation, with an Ubuntu 12.04, with tempauth middleware exactly according to : http://docs.openstack.org/developer/swift/development_sai

Re: [Openstack] Swift Client

2013-07-04 Thread Kuo Hugo
--- I ever used --- 1) CyberDuck 2) Owncloud (What's the problem in your test?) 3) Gladinet client 4) SwiftStack Web Console 5) Most of AWS S3 client tools, but you need to enable Swift3 middleware support 6) OpenStack DashBoard 7) Maldivica gateway -- I never use but should work -- 8) SME Hope

[Openstack] Swift Client

2013-07-04 Thread CHABANI Mohamed El Hadi
Hi people, I want to use my Swift all in One with a graphical client, to put / retrieve objects. i heard that we can use Cyberduck (but there is problem of port) or Owncloud as Swift client but didn't find good references. If any person could help me or suggest other clients, it would be really g

Re: [Openstack] [Swift] Updating best practices for XFS inode size

2013-07-04 Thread Chmouel Boudjnah
On Mon, Jul 1, 2013 at 9:02 AM, Robert van Leeuwen wrote: >> I would like to thank the XFS folks at Redhat for letting us know about the >> improvements in XFS, >> and the XFS team in general for the great work they have done. > Thanks for the heads up. > Do you, or any of the Redhat people, kno

[Openstack] OpenStack Swift Functional Testing (API Compatibility)

2013-07-03 Thread Shailendra Singh (Product Engineering Services - Mumbai)
We are trying to verify the compatibility of API for a Openstack Swift (swift-1.8.0-1; python-swiftclient-1.2.0-1) Implementation Using Swift functional tests suite. Looking for information how to configure & execute; What are benchmarks; and how to pass swift functional tests to c

Re: [Openstack] Swift objects permissions

2013-07-01 Thread CHABANI Mohamed El Hadi
El Hadi El Hadi ---2013-07-01 下午 05:39:04---CHABANI Mohamed El Hadi < > chabani.mohamed.h...@gmail.com> > > >*CHABANI Mohamed El Hadi * >Sent by: "Openstack" cn.ibm@lists.launchpad.net> > >2013-07-01 下午 05:39 > > > To > > >

Re: [Openstack] Swift objects permissions

2013-07-01 Thread Hua ZZ Zhang
currently Swift R/W ACL is for container level. make sure that you set ACL on the container "test". if you also want to authorize listing that container, add ACL like " .r:*,.rlistings". see detailed doc here: http://docs.openstack.org/developer/swift/misc.html#id5 -Edward Zhang

[Openstack] Swift objects permissions

2013-07-01 Thread CHABANI Mohamed El Hadi
Hi people, I'm trying to show a picture in my browser from a swift cluser (SAIO), when i do '*http://myadressip:8080/v1/AUTH_test/test/myfiles/test.jpeg*' i get *"This server could not verify that you are authorized to access the document you requested."* I set also the Read ACL = ".r:*" Shoul

Re: [Openstack] [Swift] Updating best practices for XFS inode size

2013-07-01 Thread Robert van Leeuwen
> If you are using recent Linux Kernels, using the default inode size no longer > has any impact to write (PUT) performance through swift. > > I would like to thank the XFS folks at Redhat for letting us know about the > improvements in XFS, > and the XFS team in general for the great work they

[Openstack] [Swift] Updating best practices for XFS inode size

2013-06-28 Thread Chuck Thier
Swift stores object metadata in the xattrs of the file on disk and XFS stores xattrs in the inodes. When swift was first developed, there were performance issues with using the default inode size in XFS, and led to us recommending to change the inode size when creating XFS filesystems. In the pas

Re: [Openstack] Swift / Keystone authentication

2013-06-27 Thread CHABANI Mohamed El Hadi
ify --ready > > # or a module with notify() method: > > # onready = keystone.common.systemd > > ** ** > > ** ** > > *From:* CHABANI Mohamed El Hadi [mailto:chabani.mohamed.h...@gmail.com] > *Sent:* Wednesday, June 26, 2013 6:25 AM > *To:* Jamie Lennox

Re: [Openstack] Swift / Keystone authentication

2013-06-26 Thread CHABANI Mohamed El Hadi
ing into a problem and cannot start. Check > > the /var/log/syslog file. > > > > > > > > From: CHABANI Mohamed El Hadi > > [mailto:chabani.mohamed.h...@gmail.com] > > Sent: Tuesday, June 25, 2013 8:46 AM > > To:

Re: [Openstack] Swift / Keystone authentication

2013-06-25 Thread Jamie Lennox
gt; Cc: Виль Суркин; openstack@lists.launchpad.net > > > Subject: Re: [Openstack] Swift / Keystone authentication > > > Yes you are right :) ! > > When trying 'service keystone status' i get : keyst

Re: [Openstack] Swift / Keystone authentication

2013-06-25 Thread tudor
chabani.mohamed.h...@gmail.com [7]] >> SENT: Tuesday, June 25, 2013 8:46 AM >> TO: Miller, Mark M (EB SW Cloud - R&D - Corvallis) >> CC: Виль Суркин; openstack@lists.launchpad.net [8] >> >> SUBJECT: Re: [Openstack] Swift / Keystone authentication >> >

Re: [Openstack] [Swift] Load Average node storage

2013-06-25 Thread Brent Roskos
I wouldn't think 3 replica's across 1 zone is a viable configuration. Given you are starting with 4 servers, you should really have 4 zones. Then all 3 copies of an object can still go somewhere even when aone server is down. When you add more servers, just add them in groups of 4 to keep it sim

Re: [Openstack] Swift / Keystone authentication

2013-06-25 Thread CHABANI Mohamed El Hadi
c:* Виль Суркин; openstack@lists.launchpad.net > > *Subject:* Re: [Openstack] Swift / Keystone authentication > > ** ** > > Yes you are right :) ! > > When trying *'service keystone status'* i get : *keystone > stop/waiting*..however > when i do *ser

Re: [Openstack] Swift / Keystone authentication

2013-06-25 Thread Miller, Mark M (EB SW Cloud - R&D - Corvallis)
@lists.launchpad.net Subject: Re: [Openstack] Swift / Keystone authentication When i tried with port : 5000 and even 35357 i got : Authorization Failed: [Errno 111] Connection refused These 2 ports are not open i guess, should i open them manually ? (the keystone service is start/running) 2013/6/25

Re: [Openstack] Swift / Keystone authentication

2013-06-25 Thread CHABANI Mohamed El Hadi
k-bounces+mark.m.miller= > hp@lists.launchpad.net] *On Behalf Of *CHABANI Mohamed El Hadi > *Sent:* Tuesday, June 25, 2013 7:48 AM > *To:* Виль Суркин > > *Cc:* openstack@lists.launchpad.net > *Subject:* Re: [Openstack] Swift / Keystone authentication > > ** ** > &

Re: [Openstack] Swift / Keystone authentication

2013-06-25 Thread Miller, Mark M (EB SW Cloud - R&D - Corvallis)
Subject: Re: [Openstack] Swift / Keystone authentication Remo Mattei : wich log file ? because in keystone.log there is nothing ! 2013/6/25 Remo Mattei mailto:r...@mattei.org>> Hi, can you do a netstat -ant and see what it says? Also I would check the logs, /var/log and look for any erro

Re: [Openstack] Swift / Keystone authentication

2013-06-25 Thread Miller, Mark M (EB SW Cloud - R&D - Corvallis)
Mattei Cc: openstack@lists.launchpad.net Subject: Re: [Openstack] Swift / Keystone authentication Remo Mattei : wich log file ? because in keystone.log there is nothing ! 2013/6/25 Remo Mattei mailto:r...@mattei.org>> Hi, can you do a netstat -ant and see what it says? Also I would check th

Re: [Openstack] Swift / Keystone authentication

2013-06-25 Thread CHABANI Mohamed El Hadi
*Remo Mattei* : wich log file ? because in keystone.log there is nothing ! 2013/6/25 Remo Mattei > Hi, > can you do a netstat -ant and see what it says? Also I would check the > logs, /var/log and look for any errors? If you are using Redhat base > (Fedora, CentOS etc, you may have to open up

Re: [Openstack] Swift / Keystone authentication

2013-06-25 Thread CHABANI Mohamed El Hadi
*Remo Mattei* : when i cheched with netstat -an : the port 5000 is not open either the port 35357, i don't know why ! and no i'm on Ubuntu 12.04, they are supposed to be open when the keystone run no ?! *Виль Суркин :* No i didn't add any additional configurations, i'm looking now how to add the

Re: [Openstack] Swift / Keystone authentication

2013-06-25 Thread Виль Суркин
Did you create services and endpoints in keystone? If yes, how you can do this? =) -- Виль Суркин вторник, 25 июня 2013 г. в 18:48, CHABANI Mohamed El Hadi написал: > When i tried with port : 5000 and even 35357 i got : Authorization Failed: > [Errno 111] Connection refused > > These 2 po

Re: [Openstack] Swift / Keystone authentication

2013-06-25 Thread Remo Mattei
Hi, can you do a netstat -ant and see what it says? Also I would check the logs, /var/log and look for any errors? If you are using Redhat base (Fedora, CentOS etc, you may have to open up the iptables since by default it does not have those ports open). My 2 cents. Remo On Jun 25, 2013, a

Re: [Openstack] Swift / Keystone authentication

2013-06-25 Thread CHABANI Mohamed El Hadi
When i tried with port : 5000 and even 35357 i got : *Authorization Failed: [Errno 111] Connection refused* These 2 ports are not open i guess, should i open them manually ? (the keystone service is start/running) 2013/6/25 Виль Суркин > You should authenticate in keystone service, not in swi

Re: [Openstack] Swift / Keystone authentication

2013-06-25 Thread Виль Суркин
You should authenticate in keystone service, not in swift-proxy. Keystone's Public API usually binds to TCP port 5000. -- Виль Суркин вторник, 25 июня 2013 г. в 18:38, CHABANI Mohamed El Hadi написал: > Hi, > > I'm trying to install Swift from this Guide > (http://docs.openstack.org/trun

[Openstack] Swift / Keystone authentication

2013-06-25 Thread CHABANI Mohamed El Hadi
Hi, I'm trying to install Swift from this Guide, and for the authentication service (Keystone) i'm a bit lost, should i install Keystone as a full-fledged service with the MySql dat

[Openstack] [OpenStack][Swift][Keystone] Authentication Fails

2013-06-24 Thread Trevor Roberts Jr
Hello Team, I am unable to login to Swift using the Keystone integration. Here is sample output when I try to get swift status: vagrant@swift:~$ swift -A http://172.16.0.201:5000/v2.0 -U service:swift -K swift stat Auth GET failed: http://172.16.0.201:5000/v2.0 200 OK I tried adding TempAuth

Re: [Openstack] [Swift] Load Average node storage

2013-06-23 Thread Robert van Leeuwen
> load average: 24.06, 24.02, 24.00 > There is something, can i do to reduce the load? > is it normal? I guess it depends on what is causing the load. (are there processes eating all cpu cycles?) What we see is that the object-auditor and object-replicator can cause quite a bit of load because

[Openstack] [Swift] Load Average node storage

2013-06-20 Thread Jose Augusto de Sousa
Dears, i finished installation and configuration of my swift cluster. After all, i used a region with 1 zone and 4 node storage. each node-storage with 24 disks and 32GB ram, in 10Gb network. i notice the load always in 3 of 4 hosts. load average: 24.06, 24.02, 24.00 top - 20:24:29 up 8 days

Re: [Openstack] Swift cleaning tenant after deletion on Keystone

2013-06-20 Thread Brent Roskos
The account-reaper generally takes care of this. Have you seen this? http://docs.openstack.org/developer/swift/overview_reaper.html Regards, Brent On Thu, Jun 20, 2013 at 6:06 AM, Heiko Krämer wrote: > Hey Hugo, > > ok, thx for your quick answer! > > Greetings > Heiko > > > On 20.06.2013 1

Re: [Openstack] Swift cleaning tenant after deletion on Keystone

2013-06-20 Thread Heiko Krämer
Hey Hugo, ok, thx for your quick answer! Greetings Heiko On 20.06.2013 11:56, Kuo Hugo wrote: > Hi Heiko, > > All objects won't be deleted if the tenant been deleted in Keystone. > > Hugo > > +Hugo Kuo+ > h...@swiftstack.com > tonyt...@gmail.com >

Re: [Openstack] Swift cleaning tenant after deletion on Keystone

2013-06-20 Thread Kuo Hugo
Hi Heiko, All objects won't be deleted if the tenant been deleted in Keystone. Hugo +Hugo Kuo+ h...@swiftstack.com tonyt...@gmail.com +886 935004793 2013/6/20 Heiko Krämer > Heyho guys, > > I've a short question because I can't find anything in the docs. > > Will Swift cleanup himself if I d

[Openstack] Swift cleaning tenant after deletion on Keystone

2013-06-20 Thread Heiko Krämer
Heyho guys, I've a short question because I can't find anything in the docs. Will Swift cleanup himself if I delete a tenant on Keystone ? Or do I need to ensure that all files and all buckets/containers are deleted on Swift before the tenant will be deleted on Keystone? Greetings and thx Heiko

Re: [Openstack] Swift Object Storage authentication

2013-06-19 Thread CHABANI Mohamed El Hadi
During the installation of Swift, i didn't touch any Keystone configuration, so do you think that i should install Keystone separately according to : http://docs.openstack.org/grizzly/openstack-compute/install/apt/content/install-keystone.html? and configure Swift to work with it ? 2013/6/19 Kuo

Re: [Openstack] Swift Object Storage authentication

2013-06-19 Thread CHABANI Mohamed El Hadi
Hi Hugo, Here is my proxy-sever.conf http://paste.openstack.org/show/38944/ (i've already attached a pic in the first mail :) ) Thanks 2013/6/19 Kuo Hugo > Hi CHABANI , > > Would you please show me the proxy-server.conf ? > > You can paste on http://paste.openstack.org/ or gist. > > Cheer

Re: [Openstack] Swift Object Storage authentication

2013-06-19 Thread Kuo Hugo
Hi CHABANI , Would you please show me the proxy-server.conf ? You can paste on http://paste.openstack.org/ or gist. Cheers +Hugo Kuo+ h...@swiftstack.com tonyt...@gmail.com +886 935004793 2013/6/19 CHABANI Mohamed El Hadi > Hi all, > > I'm trying to install Swift Object Storage accordin

Re: [Openstack] [Swift] Cache pressure tuning

2013-06-18 Thread ZHOU Yuan
Jonathan, Yes we have 10,000 containers and we're using COSBench to do the tests. Sincerely, Yuan On Wed, Jun 19, 2013 at 9:24 AM, Jonathan Lu wrote: > Hi, Zhou, > BTW, in test case 2, the number of container is 10,000 or just 10? > > > Jonathan Lu > > On 2013/6/18 19:18, ZHOU Yuan wrot

Re: [Openstack] [Swift] Cache pressure tuning

2013-06-18 Thread ZHOU Yuan
Jonathan, we happen to use SN similar with yours and I could share you some performance testing data here: 1. 100 container with 1 objects(base) The performance is quite good and can hit HW bottleneck 2. 10kcontainer with 100M objects The performance is not so good, which dropped 80% compared

Re: [Openstack] [Swift] Cache pressure tuning

2013-06-17 Thread Jonathan Lu
Hi, Huang Thanks a lot. I will try this test. One more question: In the 3 following situation, will the base line performance be quite different? 1. only 1 sontaienr with 10m objects; 2. 100,000 objects per container at 100 containers 3. 1,000 objects per con

Re: [Openstack] [Swift] Cache pressure tuning

2013-06-17 Thread Huang Zhiteng
On Tue, Jun 18, 2013 at 12:35 PM, Jonathan Lu wrote: > Hi, Huang > Thanks for you explanation. Does it mean that the storage cluster of > specific processing ability will be slower and slower with more and more > objects? Is there any test about the rate of the decline or is there any > lowe

Re: [Openstack] [Swift] Cache pressure tuning

2013-06-17 Thread Jonathan Lu
Hi, Huang Thanks for you explanation. Does it mean that the storage cluster of specific processing ability will be slower and slower with more and more objects? Is there any test about the rate of the decline or is there any lower limit? For example, my environment is: Swift

Re: [Openstack] [Swift] Cache pressure tuning

2013-06-17 Thread Kuo Hugo
Hi Huang, Storage nodes will run out of memory for caching inode eventually right? Have you ever measure the upper limit of caching capability of your storage nodes? Hi Jonathan, The default reclaiming time is 7 days. Did you wait for 7 days or just change the setting to 1 min in conf file ?

Re: [Openstack] [Swift] Cache pressure tuning

2013-06-17 Thread Jonathan Lu
Hi Hugo, I know the tombstone mechanism. In my opinion after the reclaim time, the object of xxx.tombstone will be deleted at all. Is that right? Maybe I misunderstand the doc :( ... We try to "colddown" the swift system ( just wait for the reclaiming) and test, but the result is not sa

Re: [Openstack] [Swift] Cache pressure tuning

2013-06-17 Thread Kuo Hugo
Hi Jonathan , How did you perform "delete all the objects in the storage" ? Those deleted objects still consume inodes in tombstone status until the reclaim time. Would you mind to compare the result of $> sudo cat /proc/slabinfo | grep xfs , before/after set the vfs_cache_pressure spongebob@

Re: [Openstack] [Swift] Cache pressure tuning

2013-06-17 Thread Huang Zhiteng
On Tue, Jun 18, 2013 at 10:42 AM, Jonathan Lu wrote: > On 2013/6/17 18:59, Robert van Leeuwen wrote: > >> I'm facing the issue about the performance degradation, and once I >>> glanced that changing the value in /proc/sys >>> /vm/vfs_cache_pressure will do a favour. >>> Can anyone explain to me w

Re: [Openstack] [Swift] Cache pressure tuning

2013-06-17 Thread Jonathan Lu
On 2013/6/17 18:59, Robert van Leeuwen wrote: I'm facing the issue about the performance degradation, and once I glanced that changing the value in /proc/sys /vm/vfs_cache_pressure will do a favour. Can anyone explain to me whether and why it is useful? Hi, When this is set to a lower value th

Re: [Openstack] [Swift] Cache pressure tuning

2013-06-17 Thread Robert van Leeuwen
> I'm facing the issue about the performance degradation, and once I glanced > that changing the value in /proc/sys > /vm/vfs_cache_pressure will do a favour. > Can anyone explain to me whether and why it is useful? Hi, When this is set to a lower value the kernel will try to keep the inode/den

Re: [Openstack] [Swift] Cache pressure tuning

2013-06-17 Thread Peter Portante
that changing the value in /proc/sys/vm/vfs_cache_pressure will do a > favour. > > Can anyone explain to me whether and why it is useful? I have scanned > the Deployment Guide of OpenStack Swift but cannot find anything about such > tuni

Re: [Openstack] [Swift] Cache pressure tuning

2013-06-17 Thread Hugo
sure will do a > favour. > > Can anyone explain to me whether and why it is useful? I have scanned the > Deployment Guide of OpenStack Swift but cannot find anything about such > tuning. > > Thanks, > Jonathan Lu >

  1   2   3   4   5   6   7   8   9   10   >