Rbd map failure in 3.16.0-55

2015-12-12 Thread Varada Kari
Hi all, We are working on jewel branch on a test cluster to validate some of the fixes. But landed up in the following error when mapping an image using krbd on Ubuntu 14.04.2 with 3.16.0-55 kernel version. $ sudo rbd map -p pool1 rbd1 rbd: sysfs write failed rbd: map failed: (5) Input/output

RE: Rbd map failure in 3.16.0-55

2015-12-12 Thread Varada Kari
: Ilya Dryomov [mailto:idryo...@gmail.com] > Sent: Saturday, December 12, 2015 4:42 PM > To: Varada Kari <varada.k...@sandisk.com> > Cc: ceph-devel@vger.kernel.org > Subject: Re: Rbd map failure in 3.16.0-55 > > On Sat, Dec 12, 2015 at 7:56 AM, Varada Kari <varada.k...

RE: newstore direction

2015-10-19 Thread Varada Kari
bably still an XFS > partition) vs the block storage. Maybe we do this anyway (put metadata on > SSD!) so it won't matter. But what happens when we are storing gobs of rgw > index data or cephfs metadata? Suddenly we are pulling storage out of a > different pool and those aren't curren

RE: newstore direction

2015-10-19 Thread Varada Kari
Hi James, Are you mentioning SCSI OSD (http://www.t10.org/drafts.htm#OSD_Family) ? If SCSI OSD is what you are mentioning, drive has to support all osd functionality mentioned by T10. If not, we have to implement the same functionality in kernel or have a wrapper in user space to convert them

RE: loadable objectstore

2015-09-29 Thread Varada Kari
.*' +#libceph_filestore_la_LDFLAGS += -export-symbols-regex '.*__ceph_plugin_.*' endif lib_LTLIBRARIES += libceph_filestore.la Thanks, Varada > -Original Message- > From: James (Fei) Liu-SSI [mailto:james@ssi.samsung.com] > Sent: Tuesday, September 29, 2015 10:08 PM > To: Varada Ka

RE: loadable objectstore

2015-09-29 Thread Varada Kari
if there is any problem. And yes, I have not made any changes to cmake yet, once I have all the changes for automake, will make cmake changes. Varada > -Original Message- > From: James (Fei) Liu-SSI [mailto:james@ssi.samsung.com] > Sent: Tuesday, September 29, 2015 11:02 PM > To:

RE: loadable objectstore

2015-09-28 Thread Varada Kari
ada, > Have you rebased the pull request to master already? > > Thanks, > James > > -Original Message- > From: ceph-devel-ow...@vger.kernel.org [mailto:ceph-devel- > ow...@vger.kernel.org] On Behalf Of Varada Kari > Sent: Friday, September 11, 2015 3:28 AM > To: Sage

RE: loadable objectstore

2015-09-12 Thread Varada Kari
3, 2015 2:05 AM > To: Varada Kari <varada.k...@sandisk.com>; James (Fei) Liu-SSI > <james@ssi.samsung.com>; Sage Weil <s...@newdream.net>; Matt W. > Benjamin <m...@cohortfs.com>; Loic Dachary <l...@dachary.org> > Cc: ceph-devel <ceph-deve

RE: loadable objectstore

2015-09-11 Thread Varada Kari
and let me know your comments. Will submit a rebased PR soon with new store integration. Thanks, Varada -Original Message- From: ceph-devel-ow...@vger.kernel.org [mailto:ceph-devel-ow...@vger.kernel.org] On Behalf Of Varada Kari Sent: Friday, July 03, 2015 7:31 PM To: Sage Weil &l

RE: Generalizing ceph-disk for various osd backends

2015-08-21 Thread Varada Kari
Something like erasure code plugins would suffice here? Each plugin has a default parameters, which can be overridden with ceph.conf options. Varada -Original Message- From: Sage Weil [mailto:s...@newdream.net] Sent: Friday, August 21, 2015 8:37 PM To: Varada Kari varada.k

Generalizing ceph-disk for various osd backends

2015-08-19 Thread Varada Kari
Hi all, This is regarding generalizing the ceph-disk to work with different osd backends like FileStore, KeyValueStore and NewStore etc... All these object store implementations has different needs on the disk being used for holding data and Meta data. Sage suggest in the one of the pull

Package issue in hammer branch on ubuntu

2015-08-17 Thread Varada Kari
Hi all, When I tried to build and install the packages on hammer branch. Facing the issue mentioned below. $dpkg -i ceph-common_0.94.2-1_amd64.deb Selecting previously unselected package ceph-common. (Reading database ... 57855 files and directories currently installed.) Preparing to unpack

RE: Package issue in hammer branch on ubuntu

2015-08-17 Thread Varada Kari
Thanks. There are no changes from my end, just tried building the packages to test internally with the latest code base. 0. 94-2.2 is intentional? Varada -Original Message- From: Ken Dreyer [mailto:kdre...@redhat.com] Sent: Tuesday, August 18, 2015 3:42 AM To: Varada Kari varada.k

RE: [ceph-users] Enclosure power failure pausing client IO till all connected hosts up

2015-07-23 Thread Varada Kari
(Adding devel list to the CC) Hi Eric, To add more context to the problem: Min_size was set to 1 and replication size is 2. There was a flaky power connection to one of the enclosures. With min_size 1, we were able to continue the IO's, and recovery was active once the power comes back. But

RE: Patches for review on keyvaluestore

2015-07-11 Thread Varada Kari
Sure. Will break them into multiple patches for easy review and merge. Varada -Original Message- From: Haomai Wang [mailto:haomaiw...@gmail.com] Sent: Friday, July 10, 2015 1:57 PM To: Varada Kari Cc: Sage Weil; Samuel Just; ceph-devel Subject: Re: Patches for review on keyvaluestore I

Patches for review on keyvaluestore

2015-07-09 Thread Varada Kari
Hi Sage/Sam/Haomai, Sent pull requests for two enhancement for key value store. Can you please review the changes? https://github.com/ceph/ceph/pull/5136 Contains changes for short circuiting op_wq and osr in key value store. We have observed good performance gains with the above pull

RE: loadable objectstore

2015-07-03 Thread Varada Kari
(0x7f5e49c12000) Edited the above output just show the dependencies. Did anyone face this issue before? Any help would be much appreciated. Thanks, Varada -Original Message- From: ceph-devel-ow...@vger.kernel.org [mailto:ceph-devel-ow...@vger.kernel.org] On Behalf Of Varada Kari Sent

RE: loadable objectstore

2015-06-26 Thread Varada Kari
-devel-ow...@vger.kernel.org [mailto:ceph-devel-ow...@vger.kernel.org] On Behalf Of Varada Kari Sent: Monday, June 22, 2015 8:57 PM To: Matt W. Benjamin Cc: Loic Dachary; ceph-devel; Sage Weil Subject: RE: loadable objectstore Hi Matt, Majority of the changes are segregating the files

RE: loadable objectstore

2015-06-22 Thread Varada Kari
, and I think we are in the way of making them on-demand (if possible) loadable modules. Varada -Original Message- From: Matt W. Benjamin [mailto:m...@cohortfs.com] Sent: Monday, June 22, 2015 8:37 PM To: Varada Kari Cc: Loic Dachary; ceph-devel; Sage Weil Subject: Re: loadable objectstore Hi

RE: loadable objectstore

2015-06-22 Thread Varada Kari
implementation? We can extend this implementation to messenger and different backend of the OSD. Will make those incremental once the base framework is approved. Thanks, Varada -Original Message- From: Sage Weil [mailto:s...@newdream.net] Sent: Tuesday, May 12, 2015 5:11 AM To: Varada Kari

CEPH on RHEL 7.1

2015-06-10 Thread Varada Kari
Hi, We are trying to build CEPH on RHEL7.1. But facing some issues with the build with Giant branch. Enabled the redhat server rpms and redhat ceph storage rpm channels along with optional, extras and supplementary. But we are not able to find gperftools, leveldb and yasm rpms in the channels.

RE: loadable objectstore

2015-04-11 Thread Varada Kari
Thanks Sage and Loic. Will add the missing pieces and integrate the object factory and plugin changes. Varada -Original Message- From: Sage Weil [mailto:s...@newdream.net] Sent: Saturday, April 11, 2015 9:19 PM To: Loic Dachary Cc: Varada Kari; Matt W. Benjamin; ceph-devel Subject: Re

RE: loadable objectstore

2015-04-10 Thread Varada Kari
: Varada Kari; ceph-devel Subject: Re: loadable objectstore On Fri, 10 Apr 2015, Matt W. Benjamin wrote: Hi Varada, I pushed branch hammer-osfactory to https://github.com/linuxbox2/ceph.git It can at least provide a starting point for discussion, if not a jumping off point; I do think it's

RE: Adding a proprietary key value store to CEPH

2015-03-23 Thread Varada Kari
Kari Cc: Ceph Development Subject: Re: Adding a proprietary key value store to CEPH Hi Varada, On Tue, 24 Feb 2015, Varada Kari wrote: Hi Sage, We are trying to integrate a new proprietary key value store to CEPH. To integrate this KV-store, which is a closed source shared library, we propose

RE: Adding a proprietary key value store to CEPH

2015-03-09 Thread Varada Kari
Hi Matt, Can you please upstream the implementation you are mentioning? Varada -Original Message- From: Matt W. Benjamin [mailto:m...@cohortfs.com] Sent: Thursday, February 26, 2015 5:26 AM To: Somnath Roy Cc: Varada Kari; Ceph Development; Sage Weil Subject: Re: Adding a proprietary

RE: generic plugin support

2015-02-25 Thread Varada Kari
Sure Loic. Will attend the CDS next week. Thanks, Varada -Original Message- From: Loic Dachary [mailto:l...@dachary.org] Sent: Wednesday, February 25, 2015 2:49 AM To: Varada Kari; Miyamae, Takeshi Cc: Ceph Development Subject: generic plugin support Hi, I proposed a blueprint to add

RE: Adding a proprietary key value store to CEPH

2015-02-25 Thread Varada Kari
Hi Sage, Thanks. Will wait for your reply. Meanwhile, Can I submit a blue print for this for next release? Thanks, Varada -Original Message- From: Sage Weil [mailto:s...@newdream.net] Sent: Tuesday, February 24, 2015 10:21 PM To: Varada Kari Cc: Ceph Development Subject: Re: Adding

Adding a proprietary key value store to CEPH

2015-02-24 Thread Varada Kari
Hi Sage, We are trying to integrate a new proprietary key value store to CEPH. To integrate this KV-store, which is a closed source shared library, we propose a new class to CEPH called PropDBStore which does a dlopen and imports the required symbols. This framework will help in integrating

RE: Adding a proprietary key value store to CEPH

2015-02-24 Thread Varada Kari
Hi Loic, Yes, db is designed to optimize the workloads on flash backends and uses only standard interfaces and system calls to achieve that. Varada -Original Message- From: Loic Dachary [mailto:l...@dachary.org] Sent: Tuesday, February 24, 2015 9:57 PM To: Somnath Roy; Varada Kari

Debug messages of osd_ping and ping_reply

2014-10-30 Thread Varada Kari
Hi all, We have a test cluster with ~500 OSD's. This cluster has multiple rbd images mapped to multiple client machines. But from past two days, only one rbd image was serving the IO's rest of the images were not used. We are running the cluster with debug 1/1 for most of the sub modules. But

RE: Regarding key/value interface

2014-10-03 Thread Varada Kari
I am not sure, if Rocksdb/LevelDB can work on a raw device. When I looked at code they were doing write to mount point/directory. Varada -Original Message- From: ceph-devel-ow...@vger.kernel.org [mailto:ceph-devel-ow...@vger.kernel.org] On Behalf Of Haomai Wang Sent: Friday, October

RE: Regarding key/value interface

2014-10-03 Thread Varada Kari
I am not sure, if Rocksdb/LevelDB can work on a raw device. When I looked at code they were doing write to mount point/directory. Varada -Original Message- From: ceph-devel-ow...@vger.kernel.org [mailto:ceph-devel-ow...@vger.kernel.org] On Behalf Of Haomai Wang Sent: Friday, October

RE: pools with latest master

2014-08-18 Thread Varada Kari
Yes, these are recent changes from John. Because of these changes: commit 90e6daec9f3fe2a3ba051301ee50940278ade18b Author: John Spray john.sp...@inktank.com Date: Tue Apr 29 15:39:45 2014 +0100 osdmap: Don't create FS pools by default Because many Ceph users don't use the