Re: [ceph-users] How can we repair OSD leveldb?

2016-08-17 Thread Christian Balzer
Hello, On Wed, 17 Aug 2016 16:54:41 -0500 Dan Jakubiec wrote: > Hi Wido, > > Thank you for the response: > > > On Aug 17, 2016, at 16:25, Wido den Hollander wrote: > > > > > >> Op 17 augustus 2016 om 17:44 schreef Dan Jakubiec : > >> > >> > >>

Re: [ceph-users] Fwd: Ceph Storage Migration from SAN storage to Local Disks

2016-08-17 Thread Gaurav Goyal
As it is a lab environment, can i install the setup in a way to achieve less redundancy (replication factor) and more capacity? How can i achieve that? On Wed, Aug 17, 2016 at 7:47 PM, Gaurav Goyal wrote: > Hello, > > Awaiting any suggestion please! > > > > >

Re: [ceph-users] Fwd: Ceph Storage Migration from SAN storage to Local Disks

2016-08-17 Thread Gaurav Goyal
Hello, Awaiting any suggestion please! Regards On Wed, Aug 17, 2016 at 9:59 AM, Gaurav Goyal wrote: > Hello Brian, > > Thanks for your response! > > Can you please elaborate on this. > > Do you mean i must use > > 4 x 1TB HDD on each nodes rather than 2 x 2TB? > >

Re: [ceph-users] Designing ceph cluster

2016-08-17 Thread Gaurav Goyal
Dear Ceph Users, Awaiting some suggestion please! On Wed, Aug 17, 2016 at 11:15 AM, Gaurav Goyal wrote: > Hello Mart, > > Thanks a lot for the detailed information! > Please find my response inline and help me to get more knowledge on it > > > Ceph works best with

Re: [ceph-users] build and Compile ceph in development mode takes an hour

2016-08-17 Thread Brad Hubbard
On Thu, Aug 18, 2016 at 1:12 AM, agung Laksono wrote: > Hi Ceph User, > > When I make change inside ceph codes in the development mode, > I found that recompiling takes around an hour because I have to remove > a build folder and all the contest and then reproduce it. > >

Re: [ceph-users] How can we repair OSD leveldb?

2016-08-17 Thread Dan Jakubiec
Hi Wido, Thank you for the response: > On Aug 17, 2016, at 16:25, Wido den Hollander wrote: > > >> Op 17 augustus 2016 om 17:44 schreef Dan Jakubiec : >> >> >> Hello, we have a Ceph cluster with 8 OSD that recently lost power to all 8 >> machines.

Re: [ceph-users] How can we repair OSD leveldb?

2016-08-17 Thread Wido den Hollander
> Op 17 augustus 2016 om 17:44 schreef Dan Jakubiec : > > > Hello, we have a Ceph cluster with 8 OSD that recently lost power to all 8 > machines. We've managed to recover the XFS filesystems on 7 of the machines, > but the OSD service is only starting on 1 of them. >

[ceph-users] Reading payload from rados_watchcb2_t callback

2016-08-17 Thread Nick Fisk
Hi All, I'm writing a small piece of code to call fsfreeze/unfreeze that can be invoked by a RADOS notify. I have the basic watch/notify functionality working but I need to be able to determine if the notify message is to freeze or unfreeze, or maybe something completely unrelated. I'm looking

[ceph-users] Ceph Tech Talk - Next Week

2016-08-17 Thread Patrick McGarry
Hey cephers, Just a reminder that the August Ceph Tech Talk is on for next Thursday @ 1p EDT. http://ceph.com/ceph-tech-talks/ Alfredo Deza will be talking about ‘Unified CI: transitioning away from gitbuilders’ and a special guest moderator will be recording the event while I’m running around

Re: [ceph-users] openATTIC 2.0.13 beta has been released

2016-08-17 Thread Lenz Grimmer
Hi, On 08/16/2016 02:16 PM, Lenz Grimmer wrote: > I blogged about the state of Ceph support a few months ago [1], a > followup posting is currently in the works. > > [1] > https://blog.openattic.org/posts/update-the-state-of-ceph-support-in-openattic/ FWIW, the update has been published now:

[ceph-users] How can we repair OSD leveldb?

2016-08-17 Thread Dan Jakubiec
Hello, we have a Ceph cluster with 8 OSD that recently lost power to all 8 machines. We've managed to recover the XFS filesystems on 7 of the machines, but the OSD service is only starting on 1 of them. The other 5 machines all have complaints similar to the following: 2016-08-17

Re: [ceph-users] Designing ceph cluster

2016-08-17 Thread Gaurav Goyal
Hello Mart, Thanks a lot for the detailed information! Please find my response inline and help me to get more knowledge on it Ceph works best with more hardware. It is not really designed for small scale setups. Of course small setups can work for a PoC or testing, but I would not advise this

[ceph-users] build and Compile ceph in development mode takes an hour

2016-08-17 Thread agung Laksono
Hi Ceph User, When I make change inside ceph codes in the development mode, I found that recompiling takes around an hour because I have to remove a build folder and all the contest and then reproduce it. Is there a way to make the compiling process be faster? something like only compile a

Re: [ceph-users] Fwd: Ceph Storage Migration from SAN storage to Local Disks

2016-08-17 Thread Gaurav Goyal
Hello Brian, Thanks for your response! Can you please elaborate on this. Do you mean i must use 4 x 1TB HDD on each nodes rather than 2 x 2TB? This is going to be a lab environment. Can you please suggest to have best possible design for my lab environment. On Wed, Aug 17, 2016 at 9:54 AM,

Re: [ceph-users] Fwd: Ceph Storage Migration from SAN storage to Local Disks

2016-08-17 Thread Brian ::
You're going to see pretty slow performance on a cluster this size with spinning disks... Ceph scales very very well but at this type of size cluster it can be challenging to get nice throughput and iops.. for something small like this either use all ssd osds or consider having more spinning

Re: [ceph-users] Designing ceph cluster

2016-08-17 Thread Mart van Santen
Dear Gaurav, Ceph works best with more hardware. It is not really designed for small scale setups. Of course small setups can work for a PoC or testing, but I would not advise this for production. If you want to proceed however, have a good look the manuals or this mailinglist archive and do

[ceph-users] Designing ceph cluster

2016-08-17 Thread Gaurav Goyal
Dear Ceph Users, I need your help to redesign my ceph storage network. As suggested in earlier discussions, i must not use SAN storage. So we have decided to removed it. Now we are ordering Local HDDs. My Network would be Host1 --> Controller + Compute1 Host 2--> Compute2 Host 3 --> Compute3

Re: [ceph-users] Fwd: Re: (no subject)

2016-08-17 Thread Gaurav Goyal
Dear Ceph Users, I need your help to redesign my ceph storage network. As suggested in earlier discussions, i must not use SAN storage. So we have decided to removed it. Now we are ordering Local HDDs. My Network would be Host1 --> Controller + Compute1 Host 2--> Compute2 Host 3 --> Compute3

Re: [ceph-users] Fwd: Ceph Storage Migration from SAN storage to Local Disks

2016-08-17 Thread Gaurav Goyal
Dear Ceph Users, Can you please address my scenario and suggest me a solution. Regards Gaurav Goyal On Tue, Aug 16, 2016 at 11:13 AM, Gaurav Goyal wrote: > Hello > > > I need your help to redesign my ceph storage network. > > As suggested in earlier discussions, i

Re: [ceph-users] ceph admin socket from non root

2016-08-17 Thread Alexandre DERUMIER
Hi Stefan, I have same problem than you, trying to monitor ceph through the socket with a non-root user. Do you have find a clean way to add write permissions to ceph group to the socket ? - Mail original - De: "Stefan Priebe, Profihost AG" À: "Gregory Farnum"

[ceph-users] ceph cluster not reposnd

2016-08-17 Thread Niv Azriel
sorry guys, I solved the problem. The issue because high io wait on the local disk of the monitor servers. I migrate the local disks from raid1 to raid5 to get more io . (The leveldb stores on the local disks of the monitor servers and each change in the map requires update of the database)

[ceph-users] is it possible to get and set zonegroup , zone through admin rest api?

2016-08-17 Thread Leo Yu
hi,cepher is it possible to set zonegroup and zone through admin rest api? i can get and set the zonegroup and zone through radosgw-admin command like the following : [root@ceph04 src]# ./radosgw-admin zone get --rgw-zone=us-east-2 #dump those to an file and inject after modify 2016-08-17