Re: [ceph-users] Ceph repo - RSYNC?

[Matt Taylor]

Australian/Oceanic users can also rsync from here:

rsync://ceph.mirror.digitalpacific.com.au/ceph

As Wido mentioned before, you can also obtain packages from here too:

http://ceph.mirror.digitalpacific.com.au/

Mirror is located in Sydney, Australia and syncs directly from eu.ceph.com

Cheers,
Matt.

On 16/04/2015 22:26, Wido den Hollander wrote:



On 16-04-15 15:11, Paul Mansfield wrote:

On 16/04/15 09:55, Wido den Hollander wrote:

It's on my radar to come up with a proper mirror system for Ceph. A
simple Bash script which is in the Git repo which you can use to sync
all Ceph packages and downloads.


I've now set up a mirror of ceph/rpm-hammer/rhel7 for our internal use
and a simple snapshotting script copies the mirror to a date-stamped
directory using hard links so as not to eat up lots of disk space.



Yes, that works, but I also want to make sure all docs are copied.

Anyway, thanks for sharing!

Wido



the key bits of the script look somewhat like this (I'm copying/pasting
and editing without testing the results, and missing out various error
checks and information messages, so please don't just copy this into a
script blindly ;-)


#!/bin/bash

DDD=`date +%Y%m%d`

MIRRDIR=/fileserver/rhel/ceph
SNAPDIR=/fileserver/rhel/ceph-snapshots/ceph-$DDD
RSYNCSRC=rsync://eu.ceph.com/ceph


mkdir -p $SNAPDIR

# copy flags: a = archive, l = hard links, r = recursive,
# u = updated/newer files, v = verbose

# trailing slash style otherwise we end up with ceph-yymmdd/ceph/
nice cp -alruv $MIRRDIR/* $SNAPDIR/

if [ $? != 0] ; then
echo "error"
exit
fi


# add other versions here:
for SRC in rpm-hammer/rhel7
 rsync --bwlimit=1024 -aiH --no-perms --numeric-ids \
--delete --delete-after --delay-updates \
--exclude="*.i686.rpm" \
 $RSYNCSRC/$SRC/ $MIRRDIR/$SRC/



___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com


___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com


___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Ceph repo - RSYNC?

[Wido den Hollander]

On 16-04-15 15:11, Paul Mansfield wrote:
> On 16/04/15 09:55, Wido den Hollander wrote:
>> It's on my radar to come up with a proper mirror system for Ceph. A
>> simple Bash script which is in the Git repo which you can use to sync
>> all Ceph packages and downloads.
> 
> I've now set up a mirror of ceph/rpm-hammer/rhel7 for our internal use
> and a simple snapshotting script copies the mirror to a date-stamped
> directory using hard links so as not to eat up lots of disk space.
> 

Yes, that works, but I also want to make sure all docs are copied.

Anyway, thanks for sharing!

Wido

> 
> the key bits of the script look somewhat like this (I'm copying/pasting
> and editing without testing the results, and missing out various error
> checks and information messages, so please don't just copy this into a
> script blindly ;-)
> 
> 
> #!/bin/bash
> 
> DDD=`date +%Y%m%d`
> 
> MIRRDIR=/fileserver/rhel/ceph
> SNAPDIR=/fileserver/rhel/ceph-snapshots/ceph-$DDD
> RSYNCSRC=rsync://eu.ceph.com/ceph
> 
> 
> mkdir -p $SNAPDIR
> 
> # copy flags: a = archive, l = hard links, r = recursive,
> # u = updated/newer files, v = verbose
> 
> # trailing slash style otherwise we end up with ceph-yymmdd/ceph/
> nice cp -alruv $MIRRDIR/* $SNAPDIR/
> 
> if [ $? != 0] ; then
>   echo "error"
>   exit
> fi
> 
> 
> # add other versions here:
> for SRC in rpm-hammer/rhel7
> rsync --bwlimit=1024 -aiH --no-perms --numeric-ids \
>   --delete --delete-after --delay-updates \
>   --exclude="*.i686.rpm" \
>$RSYNCSRC/$SRC/ $MIRRDIR/$SRC/
> 
> 
> 
> ___
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
> 
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Ceph repo - RSYNC?

[Paul Mansfield]

On 16/04/15 09:55, Wido den Hollander wrote:
> It's on my radar to come up with a proper mirror system for Ceph. A
> simple Bash script which is in the Git repo which you can use to sync
> all Ceph packages and downloads.

I've now set up a mirror of ceph/rpm-hammer/rhel7 for our internal use
and a simple snapshotting script copies the mirror to a date-stamped
directory using hard links so as not to eat up lots of disk space.


the key bits of the script look somewhat like this (I'm copying/pasting
and editing without testing the results, and missing out various error
checks and information messages, so please don't just copy this into a
script blindly ;-)


#!/bin/bash

DDD=`date +%Y%m%d`

MIRRDIR=/fileserver/rhel/ceph
SNAPDIR=/fileserver/rhel/ceph-snapshots/ceph-$DDD
RSYNCSRC=rsync://eu.ceph.com/ceph


mkdir -p $SNAPDIR

# copy flags: a = archive, l = hard links, r = recursive,
# u = updated/newer files, v = verbose

# trailing slash style otherwise we end up with ceph-yymmdd/ceph/
nice cp -alruv $MIRRDIR/* $SNAPDIR/

if [ $? != 0] ; then
echo "error"
exit
fi


# add other versions here:
for SRC in rpm-hammer/rhel7
rsync --bwlimit=1024 -aiH --no-perms --numeric-ids \
--delete --delete-after --delay-updates \
--exclude="*.i686.rpm" \
 $RSYNCSRC/$SRC/ $MIRRDIR/$SRC/



___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Ceph repo - RSYNC?

[Wido den Hollander]

On 15-04-15 18:17, Paul Mansfield wrote:
> 
> Sorry for starting a new thread, I've only just subscribed to the list
> and the archive on the mail listserv is far from complete at the moment.
> 

No problem!

It's on my radar to come up with a proper mirror system for Ceph. A
simple Bash script which is in the Git repo which you can use to sync
all Ceph packages and downloads.

Didn't get to it yet.

> on 8th March David Moreau Simard said
>   http://www.spinics.net/lists/ceph-users/msg16334.html
> that there was a rsync'able mirror of the ceph repo at
> http://ceph.mirror.iweb.ca/
> 
> 
> My problem is that the repo doesn't include Hammer. Is there someone who
> can get that added to the mirror?
> 
> thanks very much
> Paul
> ___
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
> 


-- 
Wido den Hollander
42on B.V.

Phone: +31 (0)20 700 9902
Skype: contact42on
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Ceph repo - RSYNC?

[David Moreau Simard]

Hey, you're right.

Thanks for bringing that to my attention, it's syncing now :)

Should be available soon.

David Moreau Simard

On 2015-04-15 12:17 PM, Paul Mansfield wrote:
> Sorry for starting a new thread, I've only just subscribed to the list
> and the archive on the mail listserv is far from complete at the moment.
>
> on 8th March David Moreau Simard said
>http://www.spinics.net/lists/ceph-users/msg16334.html
> that there was a rsync'able mirror of the ceph repo at
> http://ceph.mirror.iweb.ca/
>
>
> My problem is that the repo doesn't include Hammer. Is there someone who
> can get that added to the mirror?
>
> thanks very much
> Paul
> ___
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Ceph repo - RSYNC?

[Robert LeBlanc]

http://eu.ceph.com/ has rsync and Hammer.

On Wed, Apr 15, 2015 at 10:17 AM, Paul Mansfield <
paul.mansfi...@alcatel-lucent.com> wrote:

>
> Sorry for starting a new thread, I've only just subscribed to the list
> and the archive on the mail listserv is far from complete at the moment.
>
> on 8th March David Moreau Simard said
>   http://www.spinics.net/lists/ceph-users/msg16334.html
> that there was a rsync'able mirror of the ceph repo at
> http://ceph.mirror.iweb.ca/
>
>
> My problem is that the repo doesn't include Hammer. Is there someone who
> can get that added to the mirror?
>
> thanks very much
> Paul
> ___
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[ceph-users] Ceph repo - RSYNC?

[Paul Mansfield]

Sorry for starting a new thread, I've only just subscribed to the list
and the archive on the mail listserv is far from complete at the moment.

on 8th March David Moreau Simard said
  http://www.spinics.net/lists/ceph-users/msg16334.html
that there was a rsync'able mirror of the ceph repo at
http://ceph.mirror.iweb.ca/


My problem is that the repo doesn't include Hammer. Is there someone who
can get that added to the mirror?

thanks very much
Paul
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Ceph repo - RSYNC?

[Jesus Chavez (jeschave)]

Hi David also for the Calamari or gui monitoring interface is there any way to 
get user account and passwd of inktank since the repo to install Calamari seems 
to be only for people inside of inktank



Jesus Chavez
SYSTEMS ENGINEER-C.SALES

jesch...@cisco.com
Phone: +52 55 5267 3146
Mobile: +51 1 5538883255

CCIE - 44433

On Mar 8, 2015, at 10:38 AM, David Moreau Simard 
mailto:dmsim...@iweb.com>> wrote:

Hi,

With the help of Inktank we have been providing a Ceph mirror at
ceph.mirror.iweb.ca.
Quick facts:
- Located on the east coast of Canada (Montreal, Quebec)
- Syncs every four hours directly off of the official repositories
- Available over http (http://ceph.mirror.iweb.ca/) and rsync
(rsync://mirror.iweb.ca/ceph)

We're working on a brand new, faster and improved infrastructure for all
of our mirrors and it will be backed by Ceph.. So the Ceph mirror will
soon be stored on a Ceph cluster :)

Feel free to use it !
--
David Moreau Simard


On 2015-03-05, 1:14 PM, "Brian Rak" 
mailto:b...@gameservers.com>> wrote:

Do any of the Ceph repositories run rsync?  We generally mirror the
repository locally so we don't encounter any unexpected upgrades.

eu.ceph.com used to run this, but it seems to be down now.

# rsync rsync://eu.ceph.com
rsync: failed to connect to eu.ceph.com: Connection refused 
(111)
rsync error: error in socket IO (code 10) at clientserver.c(124)
[receiver=3.0.6]

___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Ceph repo - RSYNC?

[David Moreau Simard]

Hi,

With the help of Inktank we have been providing a Ceph mirror at
ceph.mirror.iweb.ca.
Quick facts:
- Located on the east coast of Canada (Montreal, Quebec)
- Syncs every four hours directly off of the official repositories
- Available over http (http://ceph.mirror.iweb.ca/) and rsync
(rsync://mirror.iweb.ca/ceph)

We're working on a brand new, faster and improved infrastructure for all
of our mirrors and it will be backed by Ceph.. So the Ceph mirror will
soon be stored on a Ceph cluster :)

Feel free to use it !
--
David Moreau Simard


On 2015-03-05, 1:14 PM, "Brian Rak"  wrote:

>Do any of the Ceph repositories run rsync?  We generally mirror the
>repository locally so we don't encounter any unexpected upgrades.
>
>eu.ceph.com used to run this, but it seems to be down now.
>
># rsync rsync://eu.ceph.com
>rsync: failed to connect to eu.ceph.com: Connection refused (111)
>rsync error: error in socket IO (code 10) at clientserver.c(124)
>[receiver=3.0.6]
>
>___
>ceph-users mailing list
>ceph-users@lists.ceph.com
>http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Ceph repo - RSYNC?

[Wido den Hollander]

On 03/05/2015 07:14 PM, Brian Rak wrote:
> Do any of the Ceph repositories run rsync?  We generally mirror the
> repository locally so we don't encounter any unexpected upgrades.
> 
> eu.ceph.com used to run this, but it seems to be down now.
> 
> # rsync rsync://eu.ceph.com
> rsync: failed to connect to eu.ceph.com: Connection refused (111)
> rsync error: error in socket IO (code 10) at clientserver.c(124)
> [receiver=3.0.6]
> 

Argh! That rsync daemon somehow sometimes dies and I don't notice.

I'll see if I can fix this.

> ___
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com


-- 
Wido den Hollander
42on B.V.
Ceph trainer and consultant

Phone: +31 (0)20 700 9902
Skype: contact42on
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Ceph repo - RSYNC?

[Michael Kuriger]

I use reposync to keep mine updated when needed.


Something like:
cd ~ /ceph/repos
reposync -r Ceph -c /etc/yum.repos.d/ceph.repo
reposync -r Ceph-noarch -c /etc/yum.repos.d/ceph.repo
reposync -r elrepo-kernel -c /etc/yum.repos.d/elrepo.repo



 
Michael Kuriger
Sr. Unix Systems Engineer
S mk7...@yp.com |  818-649-7235


-Original Message-
From: ceph-users [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of Brian 
Rak
Sent: Thursday, March 05, 2015 10:14 AM
To: ceph-users@lists.ceph.com
Subject: [ceph-users] Ceph repo - RSYNC?

Do any of the Ceph repositories run rsync?  We generally mirror the repository 
locally so we don't encounter any unexpected upgrades.

eu.ceph.com used to run this, but it seems to be down now.

# rsync rsync://eu.ceph.com
rsync: failed to connect to eu.ceph.com: Connection refused (111) rsync error: 
error in socket IO (code 10) at clientserver.c(124) [receiver=3.0.6]

___
ceph-users mailing list
ceph-users@lists.ceph.com
https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.ceph.com_listinfo.cgi_ceph-2Dusers-2Dceph.com&d=AwICAg&c=lXkdEK1PC7UK9oKA-BBSI8p1AamzLOSncm6Vfn0C_UQ&r=CSYA9OS6Qd7fQySI2LDvlQ&m=5oPk_opCf1eJ_BZLqS3mzFHka3r1-lGm_ya8mvkaIh8&s=sYjohrI39G9Owm-E92bzgsL53AYrmkFJJEzt-fEC7aw&e=
 
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[ceph-users] Ceph repo - RSYNC?

[Brian Rak]

Do any of the Ceph repositories run rsync?  We generally mirror the 
repository locally so we don't encounter any unexpected upgrades.


eu.ceph.com used to run this, but it seems to be down now.

# rsync rsync://eu.ceph.com
rsync: failed to connect to eu.ceph.com: Connection refused (111)
rsync error: error in socket IO (code 10) at clientserver.c(124) 
[receiver=3.0.6]


___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com