Re: ceph-deploy: too many argument: --setgroup 10

2015-09-03 Thread Noah Watkins
ership on /var/lib/ceph ? > > ceph-deploy should only be trying to use --setgroup if /var/lib/ceph is > owned by non-root. > > On a fresh install of Hammer, this should be root:root. > > The --setgroup flag was added to ceph-deploy in 1.5.26. > > - Travis > > On

ceph-deploy: too many argument: --setgroup 10

2015-09-02 Thread Noah Watkins
I'm getting the following error using ceph-deploy to setup a cluster. It's Centos6.6 and I'm using Hammer and the latest ceph-deploy. It looks like setgroup wasn't an option in Hammer, but ceph-deploy adds it. Is there a trick or older version of ceph-deploy I should try? - Noah [cn67][INFO ]

newstore OSD magic error

2015-08-27 Thread Noah Watkins
I've deployed a cluster with one monitor and one OSD using ceph-deploy. The OSD is spinning up, and there are some errors in the log after `ceph-deploy create osd osd0:/dev/sdb`. 2015-08-27 14:23:28.061297 7f46d6811980 -1 OSD magic @??7?V != my ceph osd volume v026 ceph.conf: [global] fsid =

Re: Ceph bindings for go docker

2015-02-09 Thread Noah Watkins
Dachary l...@dachary.org To: Noah Watkins noah.watk...@inktank.com Cc: Ceph Development ceph-devel@vger.kernel.org, Vincent Batts vba...@redhat.com, Johan Euphrosine pro...@google.com Sent: Monday, February 9, 2015 9:15:02 AM Subject: Ceph bindings for go docker Hi, I discovered https://github.com

Re: arm7 gitbuilder ?

2014-10-10 Thread Noah Watkins
On Fri, Oct 10, 2014 at 10:14 AM, Sage Weil sw...@redhat.com wrote: On Fri, 10 Oct 2014, Loic Dachary wrote: On 10/10/2014 17:11, Sage Weil wrote: On Fri, 10 Oct 2014, Loic Dachary wrote: Hi Sandon, Would it be possible to resurect / create an arm7 gitbuilder for whatever distribution

Re: arm7 gitbuilder ?

2014-10-10 Thread Noah Watkins
On Fri, Oct 10, 2014 at 12:16 PM, Loic Dachary l...@dachary.org wrote: Hi Noah, My focus is to create centos7 and ubuntu-14.04 packages at this point. I think a newish Ubuntu should work just fine for us. Are the builds using a cross compile? If so it'd be great if there was one build for

Re: arm7 gitbuilder ?

2014-10-10 Thread Noah Watkins
On Fri, Oct 10, 2014 at 2:54 PM, Loic Dachary l...@dachary.org wrote: I would be surprised if it could easily be setup for cross compilation. Although it would be nice to have an ARMv8 I don't need it right now. Do you ? Potentially. I'll poke around a bit and see. Maybe we can run 32-bit

Re: arm7 gitbuilder ?

2014-10-10 Thread Noah Watkins
On Fri, Oct 10, 2014 at 3:21 PM, Loic Dachary l...@dachary.org wrote: You are lucky to have access to ARMv8 boxes :-) Would you be willing to run a few tests on my behalf ? That might be a challenge since we (our reserach group) don't own them--we just have remote access for a specific

Re: why index (collectionIndex) need a lock?

2014-10-01 Thread Noah Watkins
I didn't know about mutrace, thanks for that reference! On Tue, Sep 30, 2014 at 8:13 PM, Milosz Tanski mil...@adfin.com wrote: On Tue, Sep 30, 2014 at 7:36 PM, Noah Watkins noah.watk...@inktank.com wrote: On Tue, Sep 30, 2014 at 10:42 AM, Somnath Roy somnath@sandisk.com wrote: Also, I

Re: why index (collectionIndex) need a lock?

2014-09-30 Thread Noah Watkins
On Tue, Sep 30, 2014 at 10:42 AM, Somnath Roy somnath@sandisk.com wrote: Also, I don't think this lock has big impact to performance since it is already sharded to index level. I tried with reader/writer implementation of this lock (logic will be somewhat similar to your state concept)

Re: LTTng unfriendly with mixed static/dynamic linking

2014-08-12 Thread Noah Watkins
The Mutex tracepoints were just a driving example, so definitely feel free to remove them. But libcommon is pretty big, so I suspect that that if tracing is merged that someone will eventually want tracepoints in libcommon. On Tue, Aug 12, 2014 at 12:41 PM, Adam Crume adamcr...@gmail.com wrote:

Packaging RFC for cephfs-java

2014-05-21 Thread Noah Watkins
Hey ceph-devel, In its current form deploying any software that depends on `cephfs-java` can be a real pain! Users need to make sure they have one of each of the following installed: * platform-indep: libcephfs.jar * platform-dep: libcephfs_jni.[so,dylib,...] - osx/linux * x86/x86-64 *

ceph-osd seg-fault with small writes

2014-03-03 Thread Noah Watkins
Running rados bench with the default 4MB object size works fine, but when I shrink the write size to 4K (i.e. running `rados -p data -b 4096 bench 30 write`), ceph-osd will segfault almost immediately. Here is the segfault, and a link to the full debug uploaded using ceph-post-file.

librados::ObjectIterator segfault

2014-03-02 Thread Noah Watkins
This is a segfault occuring in the latest master listing objects with `rados -p data ls` Full trace: http://pastebin.com/3JG9cX0Z nwatkins@kyoto:~/ceph2/src$ CEPH_CONF=ceph.conf ./rados lspools data metadata rbd nwatkins@kyoto:~/ceph2/src$ CEPH_CONF=ceph.conf ./rados -p data ls *** Caught signal

Re: librados::ObjectIterator segfault

2014-03-02 Thread Noah Watkins
Oh great. I'll pull in that patch. Thanks On Sun, Mar 2, 2014 at 11:12 AM, Ilya Dryomov ilya.dryo...@inktank.com wrote: On Sun, Mar 2, 2014 at 8:38 PM, Noah Watkins noah.watk...@inktank.com wrote: This is a segfault occuring in the latest master listing objects with `rados -p data ls` Full

Re: Assertion error in librados

2014-02-25 Thread Noah Watkins
Perhaps using gtest-style asserts (ASSERT_EQ(r, 0)) in Ceph would be useful so we can see parameter values to the assertion in the log. In this case, the return value from pthread_mutex_lock is almost certainly EINVAL, but it'd be informative to know for sure. On Tue, Feb 25, 2014 at 7:58 AM,

Re: Assertion error in librados

2014-02-25 Thread Noah Watkins
On Tue, Feb 25, 2014 at 9:51 AM, Josh Durgin josh.dur...@inktank.com wrote: That's a good idea. This particular assert in a Mutex is almost always a use-after-free of the Mutex or structure containing it though. I think that a use-after-free will also throw an EINVAL (assuming it isn't a

Re: doxygen help

2014-02-23 Thread Noah Watkins
I don't think Asphyxiate handles 'class' http://marc.info/?l=ceph-develm=135130277326664w=2 On Sun, Feb 23, 2014 at 12:38 PM, Sage Weil s...@inktank.com wrote: A while back I added some doxygen comments/docs to librados.hpp and tried to have sphinx slurp it up into the generated docs on

Re: [ceph-users] ceph hadoop using ambari

2014-02-17 Thread Noah Watkins
Hi Kesten, It's a little difficult to tell what the source of the problem is, but looking at the gist you referenced, I don't see anything that would indicate that Ceph is causing the issue. For instance, hadoop-mapred-tasktracker-xxx-yyy-hdfs01.log looks like Hadoop daemons are having problems

Re: feedback on supporting libc++

2014-01-09 Thread Noah Watkins
, 2013 at 11:59 AM, Josh Durgin josh.dur...@inktank.com wrote: On 12/31/2013 08:59 AM, Noah Watkins wrote: Thanks for testing that Josh. Before cleaning up this patch set, I have a few questions. I'm still not clear on how to handle the std::tr1::shared_ptr ObjListCtx ctx; in librados.hpp

Re: [ceph-users] how to use the function ceph_open_layout

2014-01-03 Thread Noah Watkins
You'll need to register the new pool with the MDS: ceph mds add_data_pool pool id On Thu, Jan 2, 2014 at 9:48 PM, 鹏 wkp4...@126.com wrote: Hi all; today, I want to use the fuction of ceph_open_layout() in libcephFs.h I creat a new pool success, # rados mkpool data1 and then I edit

Re: feedback on supporting libc++

2013-12-31 Thread Noah Watkins
at 5:19 PM, Josh Durgin josh.dur...@inktank.com wrote: On 12/27/2013 03:34 PM, Noah Watkins wrote: On Wed, Oct 30, 2013 at 2:02 PM, Josh Durgin josh.dur...@inktank.com wrote: On 10/29/2013 03:51 PM, Noah Watkins wrote: unsafe to me. Could you check whether you can run 'rados ls' compiled

Shared library symbol visibility

2013-12-30 Thread Noah Watkins
It looks like we may be outgrowing the use of export-symbols-regex and friends to control symbol visibility for published shared libraries. On Linux, ld seems to be quite content linking against hidden symbols, but at least on OSX with Clang it seems the visibility is strictly enforced. For

Re: feedback on supporting libc++

2013-12-27 Thread Noah Watkins
On Wed, Oct 30, 2013 at 2:02 PM, Josh Durgin josh.dur...@inktank.com wrote: On 10/29/2013 03:51 PM, Noah Watkins wrote: unsafe to me. Could you check whether you can run 'rados ls' compiled against an old librados, but dynamically loading librados from this branch compiled in c++98 mode? I'm

Re: Building Ceph using CMake

2013-12-20 Thread Noah Watkins
On Tue, Dec 17, 2013 at 2:09 PM, Ali Maredia a...@linuxbox.com wrote: Most of the speedup can be attributed to the fact that libtool is compiling both PIC and non-PIC versions of every source file. CMake just builds everything with -fPIC. We don't have an opinion on the matter, but you may

Re: /usr/bin/ld: cannot find -lboost_program_options

2013-12-01 Thread Noah Watkins
Hi Charles, Out of curiousity, do you have a config.log handy? A recent change to configure.ac should have caught the absense of the boost program options library before this step. On Sun, Dec 1, 2013 at 7:08 PM, charles L charlesboy...@hotmail.com wrote: i reinstalled

Re: [May be a bug?]Cannot umount cephfs after all mons is stopped

2013-11-29 Thread Noah Watkins
Did you try `umount -f`? I wouldn't say that is 'clean', but might avoid a reboot. It would seem there isn't much else that can be done if there is dirty data and no cluster to flush it to. This also looks relevant: http://tracker.ceph.com/issues/206 On Thu, Nov 28, 2013 at 9:51 PM, Ketor D

Re: libuuid vs boost uuid

2013-11-26 Thread Noah Watkins
I put up a patch here for review https://github.com/ceph/ceph/pull/875/files It seems ok as long as boost doesn’t ever try to change their internal representation, which in this patch we reach in an grab for the 16 octet representation. Why not just grab a copy of libuuid from util-linux and

Re: Building Ceph using CMake

2013-11-26 Thread Noah Watkins
On Nov 26, 2013, at 2:06 PM, Ali Maredia a...@linuxbox.com wrote: Hi all, I'm a student working on a project to make ceph build faster and to help with efforts to port ceph to other platforms using cmake. CMake is awesome. Also, you might be interested in checking out the portability

RFC: object operation instruction set

2013-11-17 Thread Noah Watkins
The ObjectOperation interface in librados is great for performing compound atomic operations. However, it doesn’t seem to be capable of expressing more complex flows. Consider the following set of operations that I one might want to run atomically to optionally initialize an xattr: int ret

Re: libuuid vs boost uuid

2013-11-13 Thread Noah Watkins
Hi James, I just wanted to follow up on this thread. I’d like to bring this patch into the wip-port portability branch. Were you able to get the boost::uuid to work as a drop-in replacement? Thanks, Noah On Nov 9, 2013, at 9:22 PM, Sage Weil s...@inktank.com wrote: On Sun, 10 Nov 2013,

Re: libuuid vs boost uuid

2013-11-13 Thread Noah Watkins
Oh ok, no rush. Just wanted to know if you were still hacking on it. Thanks! On Nov 13, 2013, at 1:42 PM, James Harper james.har...@bendigoit.com.au wrote: Hi James, I just wanted to follow up on this thread. I'd like to bring this patch into the wip-port portability branch. Were you

Re: [ceph-users] how to use rados_exec

2013-11-12 Thread Noah Watkins
The cls_crypto.cc file in src/ hasn't been included in the Ceph compilation for a long time. Take a look at src/cls/* for a list of modules that are compiled. In particular, there is a Hello World example that is nice. These should work for you out-of-the-box. You could also try to compile

Re: portability issue with gmtime method in utime_t

2013-11-09 Thread Noah Watkins
Hi James, I think my vote would be to rename `ostream gmtime(ostream out) const` to something like `write_gmtime`, but the global namespace approach seems OK too. Maybe someone else has a strong opinion. --- sort of related: while we are on the subject of utime_t, `timegm` isn't portable. This

Re: libuuid vs boost uuid

2013-11-09 Thread Noah Watkins
Alan, would this fix the problem on FreeBSD? IIRC llibuuid is a terrible terrible headache, with the recommended approach, being to upstream changes to e2fsprogs-libuuid. On Fri, Nov 8, 2013 at 10:43 PM, Sage Weil s...@inktank.com wrote: On Sat, 9 Nov 2013, James Harper wrote: Just out of

Re: emperor leftovers

2013-11-07 Thread Noah Watkins
On Thu, Nov 7, 2013 at 5:15 PM, Sage Weil s...@inktank.com wrote: curious if the discussion on windows portability is relevant here or if it's better treated as a separate but related effort. The kernel space talk that's been tossed around probably isn't relevant, but I'd be nice to learn

Re: emperor leftovers

2013-11-07 Thread Noah Watkins
: Or, MSVC, frankly. - Matt W. Benjamin m...@linuxbox.com wrote: Yes. But you may wish to think about mingwXX porting rather than Cygwin, if you prefer native results. Matt - Noah Watkins noah.watk...@inktank.com wrote: On Thu, Nov 7, 2013 at 5:15 PM, Sage Weil s...@inktank.com

Re: emperor leftovers

2013-11-07 Thread Noah Watkins
/Source_tree_restructuring Matt - Noah Watkins noahwatk...@gmail.com wrote: Oh, my ignorance of Windows development is enormous :) So there are cygwin, mingw, and msvc. And mingw “more” native than cygwin, but doesn’t try to do posix, and msvc just the default/native windows development env

feedback on supporting libc++

2013-10-29 Thread Noah Watkins
Out of the box on OSX Mavericks libc++ [1] is being used as opposed to libstdc++. One of the issues is that stuff from tr1 isn't available (e.g. std::tr1::shared_ptr), as they have moved to std in c++11. I'm looking for any feedback on this patch set, or if there is a better way forward. A set

Re: Paxos vs Raft

2013-09-14 Thread Noah Watkins
I'm curious about what exactly the consensus requirement and assumptions are for the monitors. For instance, in the discussion between Loic and Joao, this statement: Joao: : the recovery logic in our implementation tries to aleviate the burden of recovering multiple versions at the same time.

Re: subdir-objects

2013-09-07 Thread Noah Watkins
think this is the most important difference between your and my approach, and I like to hear your arguments for recursive builds so we can agree on recursive vs non-recursive make. Then I think it would be great to combine work! Roald On Fri, Sep 6, 2013 at 7:27 PM, Noah Watkins noah.watk

Re: subdir-objects

2013-09-07 Thread Noah Watkins
. Is that possible with the include approach, or would a naked LDADD in an included Makefile fragment affect all the targets in the file including it? -Noah On Sat, Sep 7, 2013 at 10:38 AM, Noah Watkins noah.watk...@inktank.com wrote: The non-recursive approach is interesting. I just had a quick look

Re: subdir-objects

2013-09-07 Thread Noah Watkins
roaldvanl...@gmail.com wrote: On Sat, Sep 7, 2013 at 7:47 PM, Noah Watkins noah.watk...@inktank.com wrote: Oh, and one question about the non-recursive approach. If I stick a Makefile.am in the test/ directory I can do things like: LDADD = all-the-test-dependencies and then avoid redundant per

Re: subdir-objects

2013-09-06 Thread Noah Watkins
Hi Roald, Sage just pointed me at your wip-automake branch. I also just pushed up a branch, make-refactor, that I was hacking on a bit. Not sure how much overlap there is, or if my approach is bogus, but I thought I'd point it out to see if there is anything that can be combined :) -Noah On

Re: Need some help with the RBD Java bindings

2013-08-22 Thread Noah Watkins
On Wed, Aug 21, 2013 at 11:20 PM, Wido den Hollander w...@42on.com wrote: Yes, seems like a good thing to do. I wasn't sure myself when I was writing the bindings on how the packaging should be. I'm not entirely sure either. With JNI it's pretty simple, but JNA introduces all sorts of

Re: Need some help with the RBD Java bindings

2013-08-21 Thread Noah Watkins
of my snap listing fix: just create a copy of the SnapInfo into the public struct. it also means we can avoid exposing users to JNA structures. On Wed, Aug 21, 2013 at 5:11 AM, Wido den Hollander w...@42on.com wrote: On 08/20/2013 11:26 PM, Noah Watkins wrote: Wido, I pushed up a patch

Re: subdir-objects

2013-08-21 Thread Noah Watkins
On Wed, Aug 21, 2013 at 12:45 PM, Roald van Loon roaldvanl...@gmail.com wrote: from auto-registering the plugins in the RGW core. The only fix for this is making the RGW core aware of the subdirs/plugins, but I think that's nasty design. I'd like to have it in my make conf. This patch will

Re: Need some help with the RBD Java bindings

2013-08-20 Thread Noah Watkins
Wido, I pushed up a patch to https://github.com/ceph/rados-java/commit/ca16d82bc5b596620609880e429ec9f4eaa4d5ce That includes a fix for this problem. The fix is a bit hacky, but the tests pass now. I included more details about the hack in the code. On Thu, Aug 15, 2013 at 9:57 AM, Noah

Re: Need some help with the RBD Java bindings

2013-08-15 Thread Noah Watkins
On Thu, Aug 15, 2013 at 8:51 AM, Wido den Hollander w...@42on.com wrote: public ListRbdSnapInfo snapList() throws RbdException { IntByReference numSnaps = new IntByReference(16); PointerByReference snaps = new PointerByReference(); ListRbdSnapInfo list = new

blueprint follow-up: paper cuts

2013-08-12 Thread Noah Watkins
I couldn't find any info on ownership of items in the CDS 'paper cuts' session. Was that done / documented somewhere? Specifically: Quickstart for librados - cls_helloworld - helloworld_rados - Noah -- To unsubscribe from this list: send the line unsubscribe ceph-devel in the body of a

Re: blueprint: osd: ceph on zfs

2013-08-04 Thread Noah Watkins
, Yan, Zheng uker...@gmail.com wrote: On Mon, Aug 5, 2013 at 7:39 AM, Noah Watkins noah.watk...@inktank.com wrote: It seems to make sense that fiemap should be part of the `class BackingFileSystem` abstraction? FS_IOC_FIEMAP is a standard API, I think no need to implement it in `class

Re: Rados Protocoll

2013-08-04 Thread Noah Watkins
On Fri, Aug 2, 2013 at 1:58 AM, Niklas Goerke nik...@niklasgoerke.de wrote: As for the documentation you referenced: I didn't find a documentation of the RADOS Protocol which could be used to base an implementation of librados upon. Does anything like this exist, or would I need to translate

Re: Rados Protocoll

2013-08-01 Thread Noah Watkins
Hi Niklas, The RADOS reference implementation in C++ is quite large. Reproducing it all in another language would be interesting, but I'm curious if wrapping the C interface is not an option for you? There are Java bindings that are being worked on here: https://github.com/wido/rados-java. There

blueprint: ceph platform portability

2013-07-26 Thread Noah Watkins
http://wiki.ceph.com/01Planning/02Blueprints/Emperor/Increasing_Ceph_portability Recently I've managed to get Ceph built and running on OSX. There was a past effort to get Ceph working on non-Linux platforms, most notably FreeBSD, but that approach introduced a lot of ad-hoc macros that has made

__bitwise__ annotation in inttypes

2013-07-12 Thread Noah Watkins
The following is in include/inttypes.h #define __bitwise__ typedef __u16 __bitwise__ __le16; typedef __u16 __bitwise__ __be16; ... In linux, the same definition of __bitwise__ is used when not being run through Sparse. Is there any purpose in Ceph for _always_ removing those

Re: __bitwise__ annotation in inttypes

2013-07-12 Thread Noah Watkins
Nevermind :) I see that is for freebsd.. On Fri, Jul 12, 2013 at 7:32 PM, Noah Watkins noah.watk...@inktank.com wrote: The following is in include/inttypes.h #define __bitwise__ typedef __u16 __bitwise__ __le16; typedef __u16 __bitwise__ __be16; ... In linux, the same definition

assertion failure in update_from_paxos

2013-07-09 Thread Noah Watkins
I'm getting the following failure when running a vstart instance with 1 of each daemon. -- 0 2013-07-09 08:30:43.213345 7fdc289e97c0 -1 mon/OSDMonitor.cc: In function 'virtual void OSDMonitor::update_from_paxos(bool*)' thread 7fdc289e97c0 time 2013-07-09 08:30:43.207686 mon/OSDMonitor.cc: 129:

Re: assertion failure in update_from_paxos

2013-07-09 Thread Noah Watkins
It appears to be resolved in master now. On Tue, Jul 9, 2013 at 12:43 PM, Joao Eduardo Luis joao.l...@inktank.com wrote: On 07/09/2013 04:37 PM, Noah Watkins wrote: I'm getting the following failure when running a vstart instance with 1 of each daemon. I can confirm this happens

Re: Erasure encoding as a storage backend

2013-05-05 Thread Noah Watkins
On May 4, 2013, at 9:51 PM, Gregory Farnum g...@inktank.com wrote: I'm pretty sure we'd just want to use erasure-coded RADOS pools, rather than trying to do any CephFS magic erasure encoding. Doing it above the RADOS layers would introduce some very odd behaviors in terms of losing objects,

Re: Erasure encoding as a storage backend

2013-05-04 Thread Noah Watkins
On May 4, 2013, at 10:16 AM, Loic Dachary l...@dachary.org wrote: it would be great to get feedback before the ceph summit to address the most prominent issues. One thing that has been in the back of my mind is how this proposal is influenced (if at all) by a future that includes

Re: Erasure encoding as a storage backend

2013-05-04 Thread Noah Watkins
On May 4, 2013, at 11:36 AM, Loic Dachary l...@dachary.org wrote: On 05/04/2013 08:27 PM, Noah Watkins wrote: On May 4, 2013, at 10:16 AM, Loic Dachary l...@dachary.org wrote: it would be great to get feedback before the ceph summit to address the most prominent issues. One thing

Re: PG statechart

2013-04-26 Thread Noah Watkins
Boost Statechart Viewer generates GraphViz: http://rtime.felk.cvut.cz/statechart-viewer/ Having trouble with my LLVM environment on 12.04, so I haven't tested it. -Noah On Apr 26, 2013, at 8:20 AM, Loic Dachary l...@dachary.org wrote: Hi, I was considering drawing a statechart (

Re: PG statechart

2013-04-26 Thread Noah Watkins
Very cool! On Apr 26, 2013, at 9:21 PM, Loic Dachary l...@dachary.org wrote: Hi Noah, Nice tool :-) Here is the statechart generated from PG.h. Cheers On 04/26/2013 06:07 PM, Noah Watkins wrote: Boost Statechart Viewer generates GraphViz: http://rtime.felk.cvut.cz/statechart

Re: erasure coding (sorry)

2013-04-18 Thread Noah Watkins
On Apr 18, 2013, at 2:08 PM, Josh Durgin josh.dur...@inktank.com wrote: I talked to some folks interested in doing a more limited form of this yesterday. They started a blueprint [1]. One of their ideas was to have erasure coding done by a separate process (or thread perhaps). It would use

CephFS locality API RFC

2013-03-14 Thread Noah Watkins
The current CephFS API is used to extract locality information as follows: First we get a list of OSD IDs: ceph_get_file_extent_osds(offset) - [OSD ID]* Using the OSD IDs we can then query for the CRUSH bucket hierarchy: ceph_get_osd_crush_location(osd_id) - path The path includes

Re: CephFS locality API RFC

2013-03-14 Thread Noah Watkins
On Mar 14, 2013, at 11:29 AM, Greg Farnum g...@inktank.com wrote: On Thursday, March 14, 2013 at 11:14 AM, Noah Watkins wrote: The current CephFS API is used to extract locality information as follows: First we get a list of OSD IDs: ceph_get_file_extent_osds(offset) - [OSD ID]* Using

Re: CephFS locality API RFC

2013-03-14 Thread Noah Watkins
On Mar 14, 2013, at 12:39 PM, Sage Weil s...@inktank.com wrote: Unless those old bindings are already broken because of the preferred osd thing… Well, for preferred_pg EOPNOTSUPP will be ignored by the old bindings, so I guess it still works :)-- To unsubscribe from this list: send the line

Re: MDS running at 100% CPU, no clients

2013-03-07 Thread Noah Watkins
couldn't figure out if the thread was stuck in _sample or a level up. Anyhow, my gdb-foo isn't stellar and I managed to crash the mds. I'm gonna stick some log points in and try to reproduce it. -Greg On Wednesday, March 6, 2013 at 6:23 PM, Noah Watkins wrote: Which, looks to be in a tight

Re: Approaches to wrapping aio_exec

2013-03-06 Thread Noah Watkins
thoughts on dealing with this some how? -Noah On Mar 4, 2013, at 11:44 AM, Yehuda Sadeh yeh...@inktank.com wrote: On Mon, Mar 4, 2013 at 11:34 AM, Noah Watkins jayh...@cs.ucsc.edu wrote: On Mar 3, 2013, at 6:31 PM, Yehuda Sadeh yeh...@inktank.com wrote: I pushed the wip-librados-exec

Re: MDS running at 100% CPU, no clients

2013-03-06 Thread Noah Watkins
On Mar 6, 2013, at 5:57 PM, Noah Watkins jayh...@cs.ucsc.edu wrote: The MDS process in my cluster is running at 100% CPU. In fact I thought the cluster came down, but rather an ls was taking a minute. There aren't any clients active. I've left the process running in case there is any

Re: MDS running at 100% CPU, no clients

2013-03-06 Thread Noah Watkins
0x00794c65 in SafeTimer::timer_thread() () #8 0x007958ad in SafeTimerThread::entry() () #9 0x7f0270d7de9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0 On Mar 6, 2013, at 6:18 PM, Noah Watkins jayh...@cs.ucsc.edu wrote: On Mar 6, 2013, at 5:57 PM, Noah Watkins jayh

Re: Approaches to wrapping aio_exec

2013-03-04 Thread Noah Watkins
On Mar 3, 2013, at 6:31 PM, Yehuda Sadeh yeh...@inktank.com wrote: I pushed the wip-librados-exec branch last week that solves a similar issue. I added two more ObjectOperation::exec() api calls. The more interesting one added a callback context that is called with the output buffer of the

Approaches to wrapping aio_exec

2013-03-03 Thread Noah Watkins
I've built a custom protocol on top of Rados::exec that uses serialized versions of InputObject and OutputObject to implement the protocol. Here's simple pseudo-code that provides my_service::exec: void my_service::exec(oid, input_params, bufferlist out) { bufferlist inbl, outbl;

Re: [Ceph - Feature #4230] (New) librados: node.js bindings

2013-02-23 Thread Noah Watkins
On Feb 23, 2013, at 12:49 PM, Alexandre Marangone alexandre.marang...@inktank.com wrote: Of course, thoughts and suggestions are welcome. Oo, this is nice. A while back I built a cls_v8 object class to play with, but never got around to working on a front-end. The motivation was to be able

Re: Hadoop DNS/topology details

2013-02-20 Thread Noah Watkins
On Feb 20, 2013, at 9:31 AM, Sage Weil s...@inktank.com wrote: or something like this that replaces the current extent-to-sockaddr interface? The proposed interface about would do the host/ip mapping, as well as the topology mapping? Yeah. The ceph_offset_to_osds should probably also

Re: Hadoop DNS/topology details

2013-02-19 Thread Noah Watkins
On Feb 19, 2013, at 2:22 PM, Gregory Farnum g...@inktank.com wrote: On Tue, Feb 19, 2013 at 2:10 PM, Noah Watkins jayh...@cs.ucsc.edu wrote: That is just truly annoying. Is this described anywhere in their docs? Not really. It's just there in the code--I can figure out the metric if you're

Re: [PATCH] configure.ac: check for org.junit.rules.ExternalResource

2013-01-15 Thread Noah Watkins
On Tue, Jan 15, 2013 at 1:32 AM, Danny Al-Gaaf danny.al-g...@bisect.de wrote: Am 15.01.2013 10:04, schrieb James Page: On 12/01/13 16:36, Noah Watkins wrote: On Thu, Jan 10, 2013 at 9:13 PM, Gary Lowell gary.low...@inktank.com wrote: I would also prefer to not add another huge build

Re: Usage of CEPH FS versa HDFS for Hadoop: TeraSort benchmark performance comparison issue

2012-12-13 Thread Noah Watkins
The bindings use the default Hadoop settings (e.g. 64 or 128 MB chunks) when creating new files. The chunk size can also be specified on a per-file basis using the same interface as Hadoop. Additionally, while Hadoop doesn't provide an interface to configuration parameters beyond chunk size, we

Re: [ceph-commit] [ceph/ceph] e6a154: osx: compile on OSX

2012-12-09 Thread Noah Watkins
On Sun, Dec 9, 2012 at 10:05 AM, Gregory Farnum g...@inktank.com wrote: Oooh, very nice! Do you have a list of the dependencies that you actually needed to install? I can put that together. They were boost, gperf, fuse4x, cryptopp. I think that might have been it. Apart from breaking this up

Review request: wip-localized-read-tests

2012-11-30 Thread Noah Watkins
I've pushed up patches for the first phase of testing read from replica functionality, which looks only at objecter/client level ops: wip-localized-read-tests The major points are: 1. Run libcephfs tests w/ and w/o localized reads enabled 2. Add the performance counter in Objecter to

Client crash on getcwd with non-default root mount

2012-11-29 Thread Noah Watkins
I'm getting the assert failure below with the following test: ceph_mount(cmount, /otherdir); ceph_getcwd(cmount); -- client/Inode.h: In function 'Dentry* Inode::get_first_parent()' thread 7fded47c8780 time 2012-11-29 11:49:00.890184 client/Inode.h: 165: FAILED assert(!dn_set.empty()) ceph

Re: Client crash on getcwd with non-default root mount

2012-11-29 Thread Noah Watkins
Oh, let me clarify. /otherdir exists, and the mount succeeds. - Noah On Thu, Nov 29, 2012 at 11:58 AM, Sam Lang sam.l...@inktank.com wrote: On 11/29/2012 01:52 PM, Noah Watkins wrote: I'm getting the assert failure below with the following test: ceph_mount(cmount, /otherdir

Re: Client crash on getcwd with non-default root mount

2012-11-29 Thread Noah Watkins
(cmount), /); } On Thu, Nov 29, 2012 at 12:02 PM, Noah Watkins jayh...@cs.ucsc.edu wrote: Oh, let me clarify. /otherdir exists, and the mount succeeds. - Noah On Thu, Nov 29, 2012 at 11:58 AM, Sam Lang sam.l...@inktank.com wrote: On 11/29/2012 01:52 PM, Noah Watkins wrote: I'm getting

Re: Hadoop and Ceph client/mds view of modification time

2012-11-21 Thread Noah Watkins
at 12:20 PM, Sam Lang sam.l...@inktank.com wrote: On 11/20/2012 01:44 PM, Noah Watkins wrote: This is a description of the clock synchronization issue we are facing in Hadoop: Components of Hadoop use mtime as a versioning mechanism. Here is an example where Client B tests the expected 'version

Hadoop and Ceph client/mds view of modification time

2012-11-20 Thread Noah Watkins
This is a description of the clock synchronization issue we are facing in Hadoop: Components of Hadoop use mtime as a versioning mechanism. Here is an example where Client B tests the expected 'version' of a file created by Client A: Client A: create file, write data into file. Client A:

Re: libcephfs create file with layout and replication

2012-11-20 Thread Noah Watkins
On Mon, Nov 19, 2012 at 7:28 PM, Sage Weil s...@inktank.com wrote: We could avoid the whole issue by passing 4 arguments to the function... I pushed a new patch that takes each of the 4 new arguments. wip-client-open-layout Thanks, -Noah -- To unsubscribe from this list: send the line

Re: libcephfs create file with layout and replication

2012-11-19 Thread Noah Watkins
On Mon, Nov 19, 2012 at 5:04 PM, Gregory Farnum g...@inktank.com wrote: Just glanced over this, and I'm curious: 1) Why symlink another reference to your file_layout.h? I followed the same pattern as page.h in librados, but may have misunderstood its use. When libcephfs.h is installed, it

Re: libcephfs create file with layout and replication

2012-11-18 Thread Noah Watkins
Wanna have a look at a first pass on this patch? wip-client-open-layout Thanks, Noah On Sat, Nov 17, 2012 at 5:20 PM, Noah Watkins jayh...@cs.ucsc.edu wrote: On Sat, Nov 17, 2012 at 4:15 PM, Sage Weil s...@inktank.com wrote: We ignore that for the purposes of getting the libcephfs API

libcephfs create file with layout and replication

2012-11-17 Thread Noah Watkins
The Hadoop VFS layer assumes that block size and replication can be set on a per-file basis, which is important to users for file layout/workload optimizations. The libcephfs interface doesn't make this entirely easy. Here is one approach, but it isn't thread safe as the default values are global

Re: libcephfs create file with layout and replication

2012-11-17 Thread Noah Watkins
On Sat, Nov 17, 2012 at 4:15 PM, Sage Weil s...@inktank.com wrote: We ignore that for the purposes of getting the libcephfs API correct, though... Ok, make sense. Thanks. Noah -- To unsubscribe from this list: send the line unsubscribe ceph-devel in the body of a message to

[PATCH] vstart: allow minimum pool size of one

2012-11-08 Thread Noah Watkins
I needed this patch after some simple 1 OSD vstart environments refused to allow clients to connect. -- A minimum pool size of 2 was introduced by 13486857cf. This sets the minimum to one so that basic vstart environments work. Signed-off-by: Noah Watkins noahwatk...@gmail.com diff

Debugging lsetxattr / llistxattr

2012-11-06 Thread Noah Watkins
Hi all, I'm having some difficulty debugging a symlink xattr problem, though luckily it is reproducible. A basic test that adds an xattr to a symlink: ceph_lsetxattr(symlink path, ...); ceph_llistxattr(symlink path, ...); results in a return value of 0 from llistxattr (no xattrs found).

Re: Handle bad file descriptors with EBADF

2012-11-04 Thread Noah Watkins
On Sun, Nov 4, 2012 at 4:17 AM, Sage Weil s...@inktank.com wrote: but this is actually doing the lookup twice. A better pattern: mapfoo, bar::iterator p = container.find(key); if (p == container.end()) return NULL; return p-second; Cool, thanks for

Handle bad file descriptors with EBADF

2012-11-03 Thread Noah Watkins
The libcephfs interface asserts valid file descriptors, so clients are forced to manage this or risk crashes. Pushed to wip-bad-fd is changes that handle this case by returning -EBADF. Review welcome :) - Noah -- To unsubscribe from this list: send the line unsubscribe ceph-devel in the body of a

Re: Need CRYPTO_CXXFLAGS with latest master?

2012-11-02 Thread Noah Watkins
On Fri, Nov 2, 2012 at 6:04 PM, Gary Lowell gary.low...@inktank.com wrote: Looks like the complaints come from a small number of newish programs that are compiled only when the --with-debug flag is given. When building against cryptpp (--with-cryptpp) the pk11 headers are found implicitly

Assertion failure in ceph_readlink()

2012-11-01 Thread Noah Watkins
I'm getting the following assertion failure when running a test that creates a symlink and then tries to read it using ceph_readlink(). This is the failure, and the test is shown below (and is in wip-java-symlinks). Also note that if the test below is altered to use relative paths for both

Re: Assertion failure in ceph_readlink()

2012-11-01 Thread Noah Watkins
filepath path(relpath); Inode *in; - int r = path_walk(path, in); + int r = path_walk(path, in, false); if (r 0) return r; Fixes both cases. Thanks! -- To unsubscribe from this list: send the line unsubscribe ceph-devel in the body of a message to majord...@vger.kernel.org

Re: Need CRYPTO_CXXFLAGS with latest master?

2012-11-01 Thread Noah Watkins
On Oct 31, 2012, at 8:22 PM, Noah Watkins wrote: Whoops, here is the original error: CXXtest_idempotent_sequence.o In file included from ./os/LFNIndex.h:27:0, from ./os/HashIndex.h:20, from ./os/IndexManager.h:26, from ./os/ObjectMap.h:18

Re: bobtail timing

2012-10-31 Thread Noah Watkins
Which branch is the freeze taken against? master? On Wed, Oct 31, 2012 at 1:46 PM, Sage Weil s...@inktank.com wrote: I would like to freeze v0.55, the bobtail stable release, at the end of next week. If there is any functionality you are working on that should be included, we need to get it

Need CRYPTO_CXXFLAGS with latest master?

2012-10-31 Thread Noah Watkins
Pushed changes to Makefile.am in branch: wip-make-crypto-flags Several changes to Makefile.am that add CRYPTO_CXXFLAGS to various test targets. I needed these to build after updating to master this afternoon. Not sure if there is something else going on in my environment.. Thanks, Noah --

  1   2   3   >