Re: [ceph-users] docker distribution
looks like it only works if an nginx is in front of radosgw, it translates absolute URIs and maybe fix other issues: https://github.com/docker/distribution/pull/808#issuecomment-135286314 https://github.com/docker/distribution/pull/902 On Mon, Aug 17, 2015 at 1:37 PM, Lorieri lori...@gmail.com wrote: Hi, Docker changed the old docker-registry project to docker-distribution and its API to v2. It now uses librados instead of radosgw to save data. In some ceph installations it is easier to get access to radosgw than to the cluster, so I've made a pull request to add radosgw support, it would be great if you test it. https://hub.docker.com/r/lorieri/docker-distribution-generic-s3/ Note: if you already use the old docker-registry you must create another bucket and push the images again, the API changed to v2. There is a shellscript to help https://github.com/docker/migrator How I tested it: docker run -d -p 5000:5000 -e REGISTRY_STORAGE=s3 \ -e REGISTRY_STORAGE_S3_REGION=generic \ -e REGISTRY_STORAGE_S3_REGIONENDPOINT=http://myradosgw.mydomain.com; \ -e REGISTRY_STORAGE_S3_BUCKET=registry \ -e REGISTRY_STORAGE_S3_ACCESSKEY=XXX \ -e REGISTRY_STORAGE_S3_SECRETKEY=XXX \ -e REGISTRY_STORAGE_S3_SECURE=false \ -e REGISTRY_STORAGE_S3_ENCRYPT=false \ -e REGISTRY_STORAGE_S3_REGIONSUPPORTSHEAD=false \ lorieri/docker-distribution-generic-s3 thanks, -lorieri ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] docker distribution
Hi, Docker changed the old docker-registry project to docker-distribution and its API to v2. It now uses librados instead of radosgw to save data. In some ceph installations it is easier to get access to radosgw than to the cluster, so I've made a pull request to add radosgw support, it would be great if you test it. https://hub.docker.com/r/lorieri/docker-distribution-generic-s3/ Note: if you already use the old docker-registry you must create another bucket and push the images again, the API changed to v2. There is a shellscript to help https://github.com/docker/migrator How I tested it: docker run -d -p 5000:5000 -e REGISTRY_STORAGE=s3 \ -e REGISTRY_STORAGE_S3_REGION=generic \ -e REGISTRY_STORAGE_S3_REGIONENDPOINT=http://myradosgw.mydomain.com; \ -e REGISTRY_STORAGE_S3_BUCKET=registry \ -e REGISTRY_STORAGE_S3_ACCESSKEY=XXX \ -e REGISTRY_STORAGE_S3_SECRETKEY=XXX \ -e REGISTRY_STORAGE_S3_SECURE=false \ -e REGISTRY_STORAGE_S3_ENCRYPT=false \ -e REGISTRY_STORAGE_S3_REGIONSUPPORTSHEAD=false \ lorieri/docker-distribution-generic-s3 thanks, -lorieri ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] cephfs modification time
Hi, I have a program that tails a file and this file is create on another machine some tail programs does not work because the modification time is not updated in the remote machines I've find this old thread http://permalink.gmane.org/gmane.comp.file-systems.ceph.devel/11001 it mentions the problem and suggest ntp sync I tried to re-sync ntp and restart the ceph cluster, but the issue persists do you know if it is possible to avoid this behavior ? thanks -lorieri ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] cephfs survey results
Hi, if I have a situation when each node in a cluster writes their own files in cephfs, is it safe to use multiple MDS ? I mean, is the problem using multiple MDS related to nodes writing same files ? thanks, -lorieri On Tue, Nov 4, 2014 at 9:47 PM, Shain Miley smi...@npr.org wrote: +1 for fsck and snapshots, being able to have snapshot backups and protect against accidental deletion, etc is something we are really looking forward to. Thanks, Shain On 11/04/2014 04:02 AM, Sage Weil wrote: On Tue, 4 Nov 2014, Blair Bethwaite wrote: On 4 November 2014 01:50, Sage Weil s...@newdream.net wrote: In the Ceph session at the OpenStack summit someone asked what the CephFS survey results looked like. Thanks Sage, that was me! Here's the link: https://www.surveymonkey.com/results/SM-L5JV7WXL/ In short, people want fsck multimds snapshots quotas TBH I'm a bit surprised by a couple of these and hope maybe you guys will apply a certain amount of filtering on this... fsck and quotas were there for me, but multimds and snapshots are what I'd consider icing features - they're nice to have but not on the critical path to using cephfs instead of e.g. nfs in a production setting. I'd have thought stuff like small file performance and gateway support was much more relevant to uptake and positive/pain-free UX. Interested to hear others rationale here. Yeah, I agree, and am taking the results with a grain of salt. I think the results are heavily influenced by the order they were originally listed (I whish surveymonkey would randomize is for each person or something). fsck is a clear #1. Everybody wants multimds, but I think very few actually need it at this point. We'll be merging a soft quota patch shortly, and things like performance (adding the inline data support to the kernel client, for instance) will probably compete with getting snapshots working (as part of a larger subvolume infrastructure). That's my guess at least; for now, we're really focused on fsck and hard usability edges and haven't set priorities beyond that. We're definitely interested in hearing feedback on this strategy, and on peoples' experiences with giant so far... sage ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- Shain Miley | Manager of Systems and Infrastructure, Digital Media | smi...@npr.org | 202.513.3649 ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] docker + coreos + ceph
Hi, Btw, it was not me who added it to the official release. Em 03/09/2014 07:14, Sebastien Han sebastien@enovance.com escreveu: Well done! Gonna test this :) On 03 Sep 2014, at 11:24, Marco Garcês ma...@garces.cc wrote: Amazing work, will test it as soon as I can! Thanks Marco Garcês #sysadmin Maputo - Mozambique [Phone] +258 84 4105579 [Skype] marcogarces On Wed, Sep 3, 2014 at 3:20 AM, David Moreau Simard dmsim...@iweb.com wrote: Oh nasty typo in those release notes. RDB module :) Good thing nonetheless ! -- David Moreau Simard Le 2014-09-02, 8:57 PM, « Lorieri » lori...@gmail.com a écrit : it is added officially now https://coreos.com/releases/#423.0.0 cheers, -lorieri On Mon, Aug 11, 2014 at 12:28 AM, Lorieri lori...@gmail.com wrote: Hi, I've playing with CoreOS and got it (dirty) running with Ceph. No big deal, but it can save some time. 1 - An image of docker-registry that stores on radosgw: https://registry.hub.docker.com/u/lorieri/registry-ceph/ 2 - Steps to get the rbd running in the host machine: - find out in which kernel version your coreos runs - run a docker container (or the toolbox https://coreos.com/docs/cluster-management/debugging/install-debugging-to ols/) - clone the coreos kernel: https://github.com/coreos/linux - checkout to the branch of your kernel's version (https://github.com/coreos/linux/branches/active) - compile the ceph modules and copy to the coreos machine ( ceph.ko libceph.ko libcrc32c.ko rbd.ko ) - load the modules - run the coreos toolbox (/usr/bin/toolbox), it is a fedora machine - run: yum ceph install - run: ldd /usr/bin/rbd - copy the libraries to the coreos machine in a directory (scp?) - copy the /usr/bin/rbd binary to the coreos machine - run it like this: LD_LIBRARY_PATH=/root/libs/ ./rbd map dockertest --keyfile key --id coreos -m ceph1 the libraries I've put in /root/libs/ : libboost_system.so.1.54.0 libboost_thread.so.1.54.0 libcryptopp.so.6 libgcc_s.so.1 libleveldb.so.1 liblzma.so.5 librados.so.2 librbd.so.1 libselinux.so.1 libsnappy.so.1 libstdc++.so.6 cheers, -lorieri ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com Cheers. Sébastien Han Cloud Architect Always give 100%. Unless you're giving blood. Phone: +33 (0)1 49 70 99 72 Mail: sebastien@enovance.com Address : 11 bis, rue Roquépine - 75008 Paris Web : www.enovance.com - Twitter : @enovance ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] docker + coreos + ceph
Hi, I've playing with CoreOS and got it (dirty) running with Ceph. No big deal, but it can save some time. 1 - An image of docker-registry that stores on radosgw: https://registry.hub.docker.com/u/lorieri/registry-ceph/ 2 - Steps to get the rbd running in the host machine: - find out in which kernel version your coreos runs - run a docker container (or the toolbox https://coreos.com/docs/cluster-management/debugging/install-debugging-tools/) - clone the coreos kernel: https://github.com/coreos/linux - checkout to the branch of your kernel's version (https://github.com/coreos/linux/branches/active) - compile the ceph modules and copy to the coreos machine ( ceph.ko libceph.ko libcrc32c.ko rbd.ko ) - load the modules - run the coreos toolbox (/usr/bin/toolbox), it is a fedora machine - run: yum ceph install - run: ldd /usr/bin/rbd - copy the libraries to the coreos machine in a directory (scp?) - copy the /usr/bin/rbd binary to the coreos machine - run it like this: LD_LIBRARY_PATH=/root/libs/ ./rbd map dockertest --keyfile key --id coreos -m ceph1 the libraries I've put in /root/libs/ : libboost_system.so.1.54.0 libboost_thread.so.1.54.0 libcryptopp.so.6 libgcc_s.so.1 libleveldb.so.1 liblzma.so.5 librados.so.2 librbd.so.1 libselinux.so.1 libsnappy.so.1 libstdc++.so.6 cheers, -lorieri ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Fw: single node installation
http://ceph.com/docs/dumpling/start/quick-ceph-deploy/ ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] neither POSIX nor REST
Hi, I saw radosgw-admin doesn't require radosgw daemon. I was wondering if by adding creation of buckets and manipulation of objects to radosgw-admin (or a library similar to it) ceph would have a great tool between the low and high levels of rados and radosgw, and simpler than cephfs. Of course those features, and object listing by prefix are not there for good reason that I don't know, but maybe it worths to be implemented and could make it easier for us (users) to innovate using ceph. ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] RadosGW and S3-compatible clients for PC and OSX
I've made some tests again with s3cmd
you need to have a valid and accessible host_bucket key in the .s3cfg
for example:
host_bucket = %(bucket)s.myhostname.com
if you dont have it, it does not allow you to use lowercase buckets
I believe it checks if the bucket name is a valid dns name, etc
for osx:
brew install s3cmd
[]s
-lorieri
On Tue, Apr 23, 2013 at 4:00 PM, Igor Laskovy igor.lask...@gmail.comwrote:
So, I totally lost in this, but I did it, and now CrossFTP report:
[R1] Connect to osd01.ceph.labspace.studiogrizzly.com
[R1] Current path: /
[R1] Current path: /
[R1] LIST /
[R1] Request Error [!DOCTYPE HTML PUBLIC -//IETF//DTD HTML 2.0//EN
htmlhead
title404 Not Found/title
/headbody
h1Not Found/h1
pThe requested URL / was not found on this server./p
/body/html
].
On Tue, Apr 23, 2013 at 9:39 PM, Yehuda Sadeh yeh...@inktank.com wrote:
On Tue, Apr 23, 2013 at 11:33 AM, Igor Laskovy igor.lask...@gmail.com
wrote:
In /etc/apache2/httpd.conf I have :
ServerName osd01.ceph.labspace.studiogrizzly.com
In /etc/apache2/sites-available/rgw.conf :
FastCgiExternalServer /var/www/s3gw.fcgi -socket /tmp/radosgw.sock
VirtualHost *:80
ServerName osd01.ceph.labspace.studiogrizzly.com
ServerAdmin igor.lask...@gmail.com
DocumentRoot /var/www
/VirtualHost
remove this line ^^^
RewriteEngine On
RewriteRule ^/([a-zA-Z0-9-_.]*)([/]?.*)
/s3gw.fcgi?page=$1params=$2%{QUERY_STRING}
[E=HTTP_AUTHORIZATION:%{HTTP:Authorization},L]
VirtualHost *:80
remove this line ^^^
IfModule mod_fastcgi.c
Directory /var/www
Options +ExecCGI
AllowOverride All
SetHandler fastcgi-script
Order allow,deny
Allow from all
AuthBasicAuthoritative Off
/Directory
/IfModule
AllowEncodedSlashes On
ErrorLog /var/log/apache2/error.log
CustomLog /var/log/apache2/access.log combined
ServerSignature Off
/VirtualHost
On Tue, Apr 23, 2013 at 5:57 PM, Yehuda Sadeh yeh...@inktank.com
wrote:
On Tue, Apr 23, 2013 at 7:51 AM, Igor Laskovy igor.lask...@gmail.com
wrote:
Sorry for delayed reply,
I am not good familiar with apache.
For RGW I use one of the OSD nodes. This is clear minimum
installation of
Ubunut 12.04 and ceph deployment on it, no another services.
I must to say that I use default apache2 package from Ubuntu
repository and
have rgw print continue = false in ceph.conf .
Again, all configuration made as shown at here
http://ceph.com/docs/master/radosgw/manual-install/ and here
http://ceph.com/docs/master/radosgw/config/ nothing more.
As {fqdn} I have used FQDN for this node.
try listing whatever under /etc/apache2/sites-enabled, see if there's
anything else there.
Looks like apache works.
Which exactly log files can I show for you?
I think that your apache site config is the more interesting thing to
look at it right now. The docs might be a bit unclear, we've seen some
error there recently, can you make sure that there's only a single
VirtualHost section in it?
On Sun, Apr 21, 2013 at 11:49 PM, Yehuda Sadeh yeh...@inktank.com
wrote:
On Sun, Apr 21, 2013 at 10:05 AM, Igor Laskovy
igor.lask...@gmail.com
wrote:
Just initial connect to rgw server, nothing further.
Please see below behavior for CrossFTP and S3Browser cases.
On CrossFTP side:
[R1] Connect to rgw.labspace
[R1] Current path: /
[R1] Current path: /
[R1] LIST /
[R1] Expected XML document response from S3 but received content
type
text/html
[R1] Disconnected
On rgw side:
root@osd01:~# ps aux |grep rados
root 1785 0.4 0.1 2045404 6068 ?Ssl 19:47 0:00
/usr/bin/radosgw -n client.radosgw.a
root@osd01:~# tail -f /var/log/apache2/error.log
[Sun Apr 21 19:43:56 2013] [notice] FastCGI: process manager
initialized
(pid 1433)
[Sun Apr 21 19:43:56 2013] [notice] Apache/2.2.22 (Ubuntu)
mod_fastcgi/mod_fastcgi-SNAP-0910052141 mod_ssl/2.2.22
OpenSSL/1.0.1
configured -- resuming normal operations
[Sun Apr 21 19:50:19 2013] [error] [client 192.168.1.51] File does
not
exist: /var/www/favicon.ico
Doesn't seem that your apache is configured right. How does your site
config file look like? Do you have any other sites configured (e.g.,
the default one)? try listing whatever under
/etc/apache2/sites-enabled, see if there's anything else there.
tail -f /var/log/apache2/access.log
nothing
On S3browser side:
[4/21/2013 7:56 PM] Getting buckets list... TaskID: 2
[4/21/2013 7:56 PM] System.Net.WebException:The underlying
connection
was closed: An unexpected error occurred on a send. TaskID: 2
TaskID: 2
[4/21/2013 7:56 PM] Error occurred during Getting buckets list
