Re: Issue with Ceph File System and LIO

get_tx_thread+0x1c0/0x1c0 [iscsi_target_mod] > [Thu Dec 17 03:29:55 2015] [] kthread+0xc9/0xe0 > [Thu Dec 17 03:29:55 2015] [] ? > kthread_create_on_node+0x180/0x180 > [Thu Dec 17 03:29:55 2015] [] ret_from_fork+0x3f/0x70 > [Thu Dec 17 03:29:55 2015] [] ? > kthread_create_on_node+0

Re: Issue with Ceph File System and LIO

On Fri, Dec 18, 2015 at 2:23 PM, Eric Eastman <eric.east...@keepertech.com> wrote: >> Hi Yan Zheng, Eric Eastman >> >> Similar bug was reported in f2fs, btrfs, it does affect 4.4-rc4, the fixing >> patch was merged into 4.4-rc5, dfd01f026058 ("sched/w

Re: Issue with Ceph File System and LIO

4:27:59 2015] [] ? > kthread_create_on_node+0x180/0x180 > [Thu Dec 17 14:27:59 2015] ---[ end trace 8346192e3f29ed5d ]--- > The page gets unlocked mystically. I still don't find any clue. Could you please try the new patch (not incremental patch). Besides, please enable CONFIG_DEBUG_VM when compiling the kernel. Thanks you very much Yan, Zheng cephfs_new.patch Description: Binary data

Re: Issue with Ceph File System and LIO

On Wed, Dec 16, 2015 at 12:51 AM, Eric Eastman <eric.east...@keepertech.com> wrote: > I have opened ticket: 14086 > > On Tue, Dec 15, 2015 at 5:05 AM, Yan, Zheng <uker...@gmail.com> wrote: >> On Tue, Dec 15, 2015 at 2:08 PM, Eric Eastman >>> [Tue Dec 15 0

Re: Issue with Ceph File System and LIO

-- > [Tue Dec 15 00:46:55 2015] WARNING: CPU: 0 PID: 1123421 at > /home/kernel/COD/linux/fs/ceph/addr.c:125 could you confirm that addr.c:125 is WARN_ON(!PageLocked(page)); Regards Yan, Zheng > ceph_set_page_dirty+0x230/0x240 [ceph]() > [Tue Dec 15 00:46:55 2015] Modules linked in: i

Re: 答复: how to see file object-mappings for cephfuse client

Wu Xiangwei > Tel : 0571-86760875 > 2014 UIS 2, TEAM BORE > > > -邮件原件- > 发件人: Yan, Zheng [mailto:uker...@gmail.com] > 发送时间: 2015年12月7日 11:22 > 收件人: wuxiangwei 09660 (RD) > 抄送: ceph-devel@vger.kernel.org; ceph-us...@lists.ceph.com > 主题: Re: how to see file objec

Re: how to see file object-mappings for cephfuse client

On Mon, Dec 7, 2015 at 10:51 AM, Wuxiangwei wrote: > Hi, Everyone > > Recently I'm trying to figure out how to use ceph-fuse. If we mount cephfs as > the kernel client, there is a 'cephfs' command tool (though it seems to be > 'deprecated') with 'map' and 'show_location'

Re: Compiling for FreeBSD

On Thu, Dec 3, 2015 at 4:52 AM, Willem Jan Withagen <w...@digiware.nl> wrote: > On 2-12-2015 15:13, Yan, Zheng wrote: >> see https://github.com/ceph/ceph/pull/6770. The code can be compiled >> on FreeBSD/OSX, most client programs can connect to ceph servers on >> Linux.

Re: Compiling for FreeBSD

see https://github.com/ceph/ceph/pull/6770. The code can be compiled on FreeBSD/OSX, most client programs can connect to ceph servers on Linux. Regards Yan. Zheng On Wed, Dec 2, 2015 at 2:43 AM, Willem Jan Withagen <w...@digiware.nl> wrote: > On 1-12-2015 19:36, Sage Weil wrote: >&g

Re: Compiling for FreeBSD

quot; --without-tcmalloc --without-libaio --without-libxfs gmake I don't know extact list of packages dependencies. But ./configure should tell you what is missing. Yan, Zheng > > > -- > To unsubscribe from this list: send the line "unsubscribe ceph-devel" in > the

Re: Ceph-fuse single read limitation?‏

gt; >> From the ceph client log, we found each read > request's size (ll_read) is limited to 128KB, which should be the limitation > of kernel fuse's FUSE_MAX_PAGES_PER_REQ = 32. We may try to increase this > value to see the performance difference, but are there other options we can

Re: Ceph-fuse single read limitation?‏

. We may try to increase this value to see the > performance difference, but are there other options we can try to increase > single read performance? > try setting client_readahead_max_bytes to 4M Yan, Zheng -- To unsubscribe from this list:

Re: [PATCH 2/2] fs/ceph: ceph_frag_contains_value can be boolean

atic inline bool ceph_frag_contains_value(__u32 f, __u32 v) > { > return (v & ceph_frag_mask(f)) == ceph_frag_value(f); > } > -- > 1.9.1 both applied Thanks Yan, Zheng > > > -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html

Re: [PATCH] ceph:Fix error handling in the function down_reply

pblob + > rinfo->snapblob_len, > + le32_to_cpu(head->op) == > CEPH_MDS_OP_RMSNAP, > + ); > downgrade_write(>snap_rwsem); > } else { > down_read(>snap_rwsem); > } > + > +

Re: [PATCH] ceph:Fix error handling in the function ceph_readddir_prepopulate

goto out; > + } > } > ceph_fill_dirfrag() failure is not fatal. I think it’s better to not skip later code when it happens. Regards Yan, Zheng > if (ceph_frag_is_leftmost(frag) && req->r_readdir_offset == 2) { > -- > 2.5

Re: Only client.admin can mount cephfs by ceph-fuse

On Mon, Nov 2, 2015 at 12:28 PM, Jaze Lee wrote: > Hello, >I find only ceph.client.admin can mount cephfs. > > [root@ceph-base-0 ceph]# ceph auth get client.cephfs_user > exported keyring for client.cephfs_user > [client.cephfs_user] > key =

Re: [PATCH 0/4] libceph: nocephx_sign_messages option + misc

- > net/ceph/ceph_common.c | 18 +- > net/ceph/messenger.c | 32 > net/ceph/osd_client.c | 14 ++++-- > 7 files changed, 53 insertions(+), 53 deletions(-) > Reviewed-by: Yan, Zheng <z...@redhat.com&g

Re: [PATCH] libceph: introduce ceph_x_authorizer_cleanup()

orizer_cleanup() to encapsulate > ceph_x_authorizer cleanup and switch to it. This fixes ceph_x_destroy(), > which currently always leaks key and ceph_x_build_authorizer() error > paths. > > Cc: Yan, Zheng <z...@redhat.com> > Signed-off-by: Ilya Dryo

Re: why package ceph-fuse needs packages ceph?

On Mon, Oct 26, 2015 at 6:31 PM, Jevon Qiao wrote: > Hi Sage, > > Here comes another question, does ceph-fuse support Unix OS(like HP-UNIX or > AIX)? It supports OSX and FreeBSD. (I tested it a few weeks ago. current development branch may require some minor modification) >

Re: a patch to improve cephfs direct io performance

= n; > +n = len; > +pages = dio_alloc_pagev(from, len, false, , > +_pages); > +if (IS_ERR(pages)) { > ceph_osdc_put_request(req); > +ret = PTR_ERR(pages); > break; > } > > -num_pages =

Re: [PATCH] ceph: fix message length computation

len = sizeof(*head) + > pathlen1 + pathlen2 + 2*(1 + sizeof(u32) + sizeof(u64)) + > - sizeof(struct timespec); > + sizeof(struct ceph_timespec); > > /* calculate (max) length for cap releases */ > len += sizeof(struct

Re: a patch to improve cephfs direct io performance

he iteration. They conflict with each other in the principle. why? I think it's easy to replace dio_alloc_pagev() by iov_iter_get_pages(). We just need to use dio_get_pagevlen() to calculate how many page to get each time. Regards Yan, Zheng > > The patch for the newest kernel branch is below

[BUG] commit "namei: d_is_negative() should be checked before ->d_seq validation" breaks ceph-fuse

multiple machines. Regards Yan, Zheng-- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html

Re: [PATCH] ceph: fix a comment typo

> uint16_t klen; > > - /* use ceph virtual inode (id + snaphot) */ > + /* use ceph virtual inode (id + snapshot) */ > klen = sizeof(ci->i_vino); > if (klen > maxbuf) > return 0; Applied, thank you. Yan, Zheng > -- > 1.9.

Re: a patch to improve cephfs direct io performance

_pages_for((ulong)data, pagevlen); > +pages = kmalloc(sizeof(*pages) * npages, GFP_NOFS); > +if (!pages) > +return ERR_PTR(-ENOMEM); > + for (n = 0; n < npages; n += m) { > +m = calc_pages_for((ulong)data, len); > +if (n + m > npages) > +

Re: [PATCH] libceph: don't access invalid memory in keepalive2 path

_ts); > + ceph_encode_timespec(>out_temp_keepalive2, ); > + con_out_kvec_add(con, sizeof(con->out_temp_keepalive2), > + >out_temp_keepalive2); > } else { > con_out_kvec_add(con, sizeof(tag_keepali

Re: [PATCH] libceph: advertise support for keepalive2

s fully support KEEPALIVE2 (it does not recognize CEPH_MSGR_TAG_KEEPALIVE2 tag). I think it's better to not advertise support for keepalive2. Regards Yan, Zheng > > Signed-off-by: Ilya Dryomov <idryo...@gmail.com> > --- > include/linux/ceph/ceph_features.h | 1 + > 1 file ch

Re: [PATCH] libceph: advertise support for keepalive2

On Wed, Sep 16, 2015 at 3:39 PM, Ilya Dryomov <idryo...@gmail.com> wrote: > On Wed, Sep 16, 2015 at 9:28 AM, Yan, Zheng <uker...@gmail.com> wrote: >> On Mon, Sep 14, 2015 at 9:51 PM, Ilya Dryomov <idryo...@gmail.com> wrote: >>> We are the client, but advertise

Re: [PATCH] libceph: use keepalive2 to verify the mon session is alive

> On Sep 2, 2015, at 17:12, Ilya Dryomov <idryo...@gmail.com> wrote: > > On Wed, Sep 2, 2015 at 5:22 AM, Yan, Zheng <z...@redhat.com> wrote: >> timespec_to_jiffies() does not work this way. it convert time delta in form >> of timespec to time delta in fo

[PATCH] libceph: use keepalive2 to verify the mon session is alive

Signed-off-by: Yan, Zheng <z...@redhat.com> --- include/linux/ceph/libceph.h | 2 ++ include/linux/ceph/messenger.h | 4 +++ include/linux/ceph/msgr.h | 4 ++- net/ceph/ceph_common.c | 18 - net/ceph/messenger.c

Re: [PATCH] fs/ceph: No need get inode of parent in ceph_open.

It seems all of your patches are malformed. please use 'git send-email’ to send patch. Regards Yan, Zheng On Aug 17, 2015, at 16:43, Ma, Jianpeng jianpeng...@intel.com wrote: For ceph_open, it already get the parent inode. So no need to get again. Signed-off-by: Jianpeng Ma jianpeng

Re: [PATCH] fs/ceph: No need get inode of parent in ceph_open.

patches) and added them to our testing branch Thanks Yan, Zheng 2.4.3 -- To unsubscribe from this list: send the line unsubscribe ceph-devel in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html

Re: [PATCH] ceph: Using file-f_flags rather than flags check O_CREAT.

) parent_inode = ceph_get_dentry_parent_inode(file-f_path.dentry); err = ceph_mdsc_do_request(mdsc, parent_inode, req); iput(parent_inode); In this case, we do not need parent_inode because file already exists. I'd like to remove the code that finds parent inode. Regards Yan

Re: [PATCH] ceph: Using file-f_flags rather than flags check O_CREAT.

On Thu, Aug 13, 2015 at 8:34 PM, Sage Weil s...@newdream.net wrote: On Thu, 13 Aug 2015, Yan, Zheng wrote: On Thu, Aug 13, 2015 at 5:01 PM, Ma, Jianpeng jianpeng...@intel.com wrote: Because flags removed the O_CREAT, so we should use file-f_flags. Signed-off-by: Jianpeng Ma jianpeng

Re: FileStore should not use syncfs(2)

On Thu, Aug 6, 2015 at 5:26 AM, Sage Weil sw...@redhat.com wrote: Today I learned that syncfs(2) does an O(n) search of the superblock's inode list searching for dirty items. I've always assumed that it was only traversing dirty inodes (e.g., a list of dirty inodes), but that appears not to

Re: CephFS and the next hammer release v0.94.3

Hi Loic. Yes, https://github.com/ceph/ceph/pull/5222 is problematic. Do you mean should we include these RPs in v0.94.3? These RPs fix a bug in rare configure, I think it’s not a big deal to not include it in v0.94.3 Regards Yan, Zheng On Aug 4, 2015, at 00:32, Loic Dachary l

Re: Client: what is supposed to protect racing readdirs and unlinks?

. Is there supposed to be something preventing this kind of race? If not I can work something out in the code but I've not done much work in that bit and there are enough pieces that I wonder if I'm missing some other issue. I think calling (*pd)-get() before release the client_lock should work. Regards Yan

Re: [ceph:for-linus 11/40] fs/ceph/mds_client.c:2865:1-10: second lock on line 2904

: TO: Yan, Zheng z...@redhat.com CC: Ilya Dryomov idryo...@gmail.com CC: ceph-devel@vger.kernel.org tree: git://git.kernel.org/pub/scm/linux/kernel/git/sage/ceph-client.git for-linus head: 5a60e87603c4c533492c515b7f62578189b03c9c commit: 745a8e3bccbc6adae69a98ddc525e529aa44636e [11/40] ceph

Re: Ceph hard lock Hammer 9.2

Could you please run echo 1 /proc/sys/kernel/sysrq; echo t /proc/sysrq-trigger when this warning happens again. then send the kernel message to us. Regards Yan, Zheng On Tue, Jun 23, 2015 at 10:25 PM, Barclay Jameson almightybe...@gmail.com wrote: Sure, I guess it's actually a soft kernel

Re: Slow file creating and deleting using bonnie ++ on Hammer

On Sat, May 23, 2015 at 1:34 AM, Barclay Jameson almightybe...@gmail.com wrote: Here are some more info : rados bench -p cephfs_data 100 write --no-cleanup Total time run: 100.096473 Total writes made: 21900 Write size: 4194304 Bandwidth (MB/sec): 875.156

Re: [PATCH 4/5] ceph: simplify two mount_timeout sites

) + err = -EIO; /* timed out */ + else + err = timeleft; /* killed */ } dout(do_request waited, got %d\n, err); mutex_lock(mdsc-mutex); -- 1.9.3 Reviewed-by: Yan, Zheng z...@redhat.com -- To unsubscribe from

[PATCH 3/3] ceph: check OSD caps before read/write

Signed-off-by: Yan, Zheng z...@redhat.com --- fs/ceph/addr.c | 203 +++ fs/ceph/caps.c | 4 + fs/ceph/inode.c | 3 + fs/ceph/mds_client.c | 4 + fs/ceph/mds_client.h | 9 +++ fs/ceph/super.c | 15 +++- fs/ceph/super.h

[PATCH 2/3] libceph: allow setting osd_req_op's flags

Signed-off-by: Yan, Zheng z...@redhat.com --- drivers/block/rbd.c | 4 ++-- fs/ceph/addr.c | 3 ++- fs/ceph/file.c | 2 +- include/linux/ceph/osd_client.h | 2 +- net/ceph/osd_client.c | 24 +++- 5 files changed, 21

Re: [ceph-users] CephFS Slow writes with 1MB files

code. Could you try the newest development version ceph (It includes the fix). Or apply the attached patch to source of giant release. Regards Yan, Zheng I may have found something. I did the build manually as such I did _NOT_ set up these config settings: filestore xattr use omap = false

Re: [ceph-users] CephFS Slow writes with 1MB files

ceph-fuse or kernel client, what's the mount options? Regards Yan, Zheng Beeij On Mon, Mar 30, 2015 at 10:59 PM, Yan, Zheng uker...@gmail.com wrote: On Sun, Mar 29, 2015 at 1:12 AM, Barclay Jameson almightybe...@gmail.com wrote: I redid my entire Ceph build going back to to CentOS 7 hoping

Re: [ceph-users] CephFS Slow writes with 1MB files

). and upload /var/log/ceph/mds.x.log to somewhere. Regards Yan, Zheng On Fri, Mar 27, 2015 at 4:50 PM, Gregory Farnum g...@gregs42.com wrote: On Fri, Mar 27, 2015 at 2:46 PM, Barclay Jameson almightybe...@gmail.com wrote: Yes it's the exact same hardware except for the MDS server (although I tried

Re: ceph-fuse remount issues

upcall. Does that sound right? what do you mean make that happen in the general case. In my option, there isn't much fuse kernel module can do about dentry. Maybe we can try adding a new callback which call d_prune_aliases(). Regards Yan, Zheng sage -- To unsubscribe from this list: send

Re: [PATCH] ceph: use msecs_to_jiffies for time conversion

-duration_ms) * HZ / 1000; + msecs_to_jiffies(le32_to_cpu(h-duration_ms)); di-lease_seq = seq; dentry-d_time = di-lease_renew_from + duration; -- 1.7.10.4 added to our testing branch Thanks Yan, Zheng

Re: [PATCH] ceph: match wait_for_completion_timeout return type

On Tue, Mar 10, 2015 at 11:18 PM, Nicholas Mc Guire hof...@osadl.org wrote: return type of wait_for_completion_timeout is unsigned long not int. An appropriately named unsigned long is added and the assignment fixed up. Signed-off-by: Nicholas Mc Guire hof...@osadl.org --- This was only

Re: [PATCH] ceph: match wait_for_completion_timeout return type

On Wed, Mar 11, 2015 at 7:04 PM, Nicholas Mc Guire der.h...@hofr.at wrote: On Wed, 11 Mar 2015, Yan, Zheng wrote: On Tue, Mar 10, 2015 at 11:18 PM, Nicholas Mc Guire hof...@osadl.org wrote: return type of wait_for_completion_timeout is unsigned long not int. An appropriately named unsigned

Re: workloads/rbd_fsx_cache_writethrough.yaml hangs on dumpling

On Mon, Feb 2, 2015 at 9:18 PM, Loic Dachary l...@dachary.org wrote: Hi, http://pulpito.ceph.com/loic-2015-01-29_15:39:38-rbd-dumpling-backports---basic-multi/730029/ hangs on dumpling and got killed after two days. Although workloads/rbd_fsx_cache_writethrough.yaml was running with the

Re: [RFC] several ceph dentry leaks

elegantly, because MDS may have done other operation, which moved the newly created file/directory to other place. For multiple dentries pointing to directory inode, maybe we can return an error (-ENOENT or -ESTALE). Regards Yan, Zheng -- To unsubscribe from this list: send the line unsubscribe

Re: [RFC] several ceph dentry leaks

On Mon, Feb 2, 2015 at 12:41 PM, Al Viro v...@zeniv.linux.org.uk wrote: On Mon, Feb 02, 2015 at 11:23:58AM +0800, Yan, Zheng wrote: we should _never_ create multiple dentries pointing to directory inode, so d_instantiate() in there isn't mitigating anything - it's actively breaking

Re: MDS has inconsistent performance

, unfortunately there still is a bug that prevent new directory from having I_COMPLETE flag Regards Yan, Zheng -Greg -- To unsubscribe from this list: send the line unsubscribe ceph-devel in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo

Re: [PATCH] ceph: acl: Remove unused function

On Sun, Jan 4, 2015 at 7:44 AM, Rickard Strandqvist rickard_strandqv...@spectrumdigital.se wrote: Remove the function ceph_get_cached_acl() that is not used anywhere. This was partially found by using a static code analysis program called cppcheck. Signed-off-by: Rickard Strandqvist

[PATCH] ceph: fix setting empty extended attribute

make sure 'value' is not null. otherwise __ceph_setxattr will remove the extended attribute. Signed-off-by: Yan, Zheng z...@redhat.com --- fs/ceph/xattr.c | 7 +-- 1 file changed, 5 insertions(+), 2 deletions(-) diff --git a/fs/ceph/xattr.c b/fs/ceph/xattr.c index 678b0d2..5a492ca 100644

Re: [GIT PULL] Ceph updates for 3.19-rc1

my commit ceph: add inline data to pagecache incidentally adds fs/ceph/super.j.rej. please remove it from your branch. sorry for the inconvenience Yan, Zheng On Thu, Dec 18, 2014 at 7:27 AM, Sage Weil sw...@redhat.com wrote: Hi Linus, Please pull the following Ceph updates from git

[PATCH] ceph: fix mksnap crash

mksnap reply only contain 'target', does not contain 'dentry'. So it's wrong to use req-r_reply_info.head-is_dentry to detect traceless reply. Signed-off-by: Yan, Zheng z...@redhat.com --- fs/ceph/dir.c | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-) diff --git a/fs/ceph/dir.c b/fs

[PATCH 01/12] libceph: add SETXATTR/CMPXATTR osd operations support

Signed-off-by: Yan, Zheng z...@redhat.com --- include/linux/ceph/osd_client.h | 10 ++ net/ceph/osd_client.c | 38 ++ 2 files changed, 48 insertions(+) diff --git a/include/linux/ceph/osd_client.h b/include/linux/ceph/osd_client.h index

[PATCH 05/12] ceph: add inline data to pagecache

Request reply and cap message can contain inline data. add inline data to the page cache if there is Fc cap. Signed-off-by: Yan, Zheng z...@redhat.com --- fs/ceph/addr.c | 42 ++ fs/ceph/caps.c | 11 +++ fs/ceph/inode.c

[PATCH 06/12] ceph: use getattr request to fetch inline data

Add a new parameter 'locked_page' to ceph_do_getattr(). If inline data in getattr reply will be copied to the page. Signed-off-by: Yan, Zheng z...@redhat.com --- fs/ceph/inode.c | 34 +- fs/ceph/mds_client.h | 1 + fs/ceph/super.h

[PATCH 0/12] ceph: read/modify inline data support

Hi, This patch series allows cephfs client kernel to read/modify inline data. When modifying a inode with inline data, inline data are always converted to normal object first. This patch series does not support storing new data as inline. Regards Yan, Zheng -- To unsubscribe from this list: send

[PATCH 04/12] ceph: parse inline data in MClientReply and MClientCaps

Signed-off-by: Yan, Zheng z...@redhat.com --- fs/ceph/caps.c | 34 +++--- fs/ceph/mds_client.c | 10 ++ fs/ceph/mds_client.h | 3 +++ 3 files changed, 36 insertions(+), 11 deletions(-) diff --git a/fs/ceph/caps.c b/fs/ceph/caps.c index eb1bf1f..b88ae60

[PATCH 07/12] ceph: fetch inline data while getting Fcr cap refs

cache for later IO. Signed-off-by: Yan, Zheng z...@redhat.com --- fs/ceph/addr.c | 9 +++-- fs/ceph/caps.c | 55 ++- fs/ceph/file.c | 12 +--- 3 files changed, 62 insertions(+), 14 deletions(-) diff --git a/fs/ceph/addr.c b/fs/ceph

[PATCH 12/12] ceph: support inline data feature

Signed-off-by: Yan, Zheng z...@redhat.com --- fs/ceph/super.c | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/fs/ceph/super.c b/fs/ceph/super.c index 2b5481f..c37f1b9 100644 --- a/fs/ceph/super.c +++ b/fs/ceph/super.c @@ -515,7 +515,8 @@ static struct ceph_fs_client

[PATCH 11/12] ceph: flush inline version

part is always zero. Signed-off-by: Yan, Zheng z...@redhat.com --- fs/ceph/caps.c | 24 fs/ceph/snap.c | 2 ++ fs/ceph/super.h | 1 + 3 files changed, 23 insertions(+), 4 deletions(-) diff --git a/fs/ceph/caps.c b/fs/ceph/caps.c index 3bc0908..77c4068 100644 --- a/fs

[PATCH 08/12] ceph: sync read inline data

we can't use getattr to fetch inline data while holding Fr cap, because it can cause deadlock. If we need to sync read inline data, drop cap refs first, then use getattr to fetch inline data. Signed-off-by: Yan, Zheng z...@redhat.com --- fs/ceph/addr.c | 7 ++- fs/ceph/file.c | 63

[PATCH 10/12] ceph: convert inline data for memory mapped read

We can't use getattr to fetch inline data while holding Fr caps, If there is no Fc cap, ceph_get_caps() does not bring inline data to page cache neither. To simplify this case, just convert inline data to normal data. Signed-off-by: Yan, Zheng z...@redhat.com --- fs/ceph/addr.c | 17

[PATCH] libceph: require cephx message signature by default

Signed-off-by: Yan, Zheng z...@redhat.com --- include/linux/ceph/libceph.h | 1 + net/ceph/ceph_common.c | 13 + 2 files changed, 14 insertions(+) diff --git a/include/linux/ceph/libceph.h b/include/linux/ceph/libceph.h index d293f7e..8b11a79 100644 --- a/include/linux/ceph

[PATCH] libceph: require cephx message signature by default

Signed-off-by: Yan, Zheng z...@redhat.com --- include/linux/ceph/libceph.h | 1 + net/ceph/ceph_common.c | 13 + 2 files changed, 14 insertions(+) diff --git a/include/linux/ceph/libceph.h b/include/linux/ceph/libceph.h index d293f7e..8b11a79 100644 --- a/include/linux/ceph

[PATCH 2/2] libceph: message signature support

Signed-off-by: Yan, Zheng z...@redhat.com --- fs/ceph/mds_client.c | 16 +++ include/linux/ceph/auth.h | 26 + include/linux/ceph/ceph_features.h | 1 + include/linux/ceph/messenger.h | 9 +- include/linux/ceph/msgr.h | 8

[PATCH 1/2] libceph: store session key in cephx authorizer

Session key is required when calculating message signature. Save the session key in authorizer, this avoid lookup ticket handler for each message Signed-off-by: Yan, Zheng z...@redhat.com --- net/ceph/auth_x.c | 18 +++--- net/ceph/auth_x.h | 1 + 2 files changed, 12 insertions

Re: design a rados-based distributed kv store support scan op

On Tue, Sep 30, 2014 at 5:23 PM, Plato Zhang sango...@gmail.com wrote: Hi all, We plan to develop a new distributed key-value storage engine, which would based on rados and supoort range-scan operation. Besides, it'll be open source. We know rados is already a kv storage engine, and can do

[PATCH] ceph: remove redundant io_iter_advance()

ceph_sync_read and generic_file_read_iter() have already advanced the IO iterator. Signed-off-by: Yan, Zheng z...@redhat.com --- fs/ceph/file.c | 1 - 1 file changed, 1 deletion(-) diff --git a/fs/ceph/file.c b/fs/ceph/file.c index 1c1df08..d7e0da8 100644 --- a/fs/ceph/file.c +++ b/fs/ceph

Re: [PATCH] ceph: remove redundant code for max file size verification

); return err; -out: - spin_unlock(ci-i_ceph_lock); out_put: ceph_mdsc_put_request(req); return err; -- 2.0.1.474.g72c7794 Reviewed-by: Yan, Zheng z...@redhat.com I added this to testing branch of client-client. Thanks Yan, Zheng -- To unsubscribe from this list

[PATCH] ceph: request xattrs if xattr_version is zero

is force sending a getattr request to MDS if xattrs_version is 0. The getattr mask is set to CEPH_STAT_CAP_XATTR, so MDS knows client does not have xattr. Signed-off-by: Yan, Zheng z...@redhat.com --- fs/ceph/file.c | 5 ++--- fs/ceph/inode.c | 8 fs/ceph/ioctl.c | 4 ++-- fs/ceph

[PATCH 1/3] libceph: reference counting pagelist

this allow pagelist to present data that may be sent multiple times. Signed-off-by: Yan, Zheng z...@redhat.com --- fs/ceph/mds_client.c | 1 - include/linux/ceph/pagelist.h | 5 - net/ceph/messenger.c | 4 +--- net/ceph/pagelist.c | 8 ++-- 4 files changed, 11

[PATCH 2/3] ceph: use pagelist to present MDS request data

. Pagelist is reference counted. Signed-off-by: Yan, Zheng z...@redhat.com --- fs/ceph/mds_client.c | 14 +- fs/ceph/mds_client.h | 4 +--- fs/ceph/xattr.c | 46 -- 3 files changed, 26 insertions(+), 38 deletions(-) diff --git a/fs/ceph

[PATCH 3/3] ceph: include the initial ACL in create/mkdir/mknod MDS requests

can handle creating file/directory and setting the initial ACL in one request. Signed-off-by: Yan, Zheng z...@redhat.com --- fs/ceph/acl.c | 125 fs/ceph/dir.c | 41 ++- fs/ceph/file.c | 27 +--- fs/ceph/super.h

[PATCH] ceph: move ceph_find_inode() outside the s_mutex

ceph_find_inode() may wait on freeing inode, using it inside the s_mutex may cause deadlock. (the freeing inode is waiting for OSD read reply, but dispatch thread is blocked by the s_mutex) Signed-off-by: Yan, Zheng z...@redhat.com --- fs/ceph/caps.c | 11 ++- fs/ceph/mds_client.c

[PATCH] ceph: include the initial ACL in create/mkdir/mknod MDS requests

can handle creating file/directory and setting the initial ACL in one request. Signed-off-by: Yan, Zheng z...@redhat.com --- fs/ceph/acl.c| 124 +-- fs/ceph/dir.c| 41 - fs/ceph/file.c | 27 --- fs/ceph

[PATCH 1/2] ceph: protect kick_requests() with mdsc-mutex

From: Yan, Zheng uker...@gmail.com Signed-off-by: Yan, Zheng z...@redhat.com --- fs/ceph/mds_client.c | 5 +++-- 1 file changed, 3 insertions(+), 2 deletions(-) diff --git a/fs/ceph/mds_client.c b/fs/ceph/mds_client.c index f751fea..267ba44 100644 --- a/fs/ceph/mds_client.c +++ b/fs/ceph

[PATCH 2/2] ceph: make sure request isn't in any waiting list when kicking request.

From: Yan, Zheng uker...@gmail.com we may corrupt waiting list if a request in the waiting list is kicked. Signed-off-by: Yan, Zheng z...@redhat.com --- fs/ceph/mds_client.c | 1 + 1 file changed, 1 insertion(+) diff --git a/fs/ceph/mds_client.c b/fs/ceph/mds_client.c index 267ba44..a17fc49

[PATCH] ceph: trim unused inodes before reconnecting to recovering MDS

So the recovering MDS does not need to fetch these ununsed inodes during cache rejoin. This may reduce MDS recovery time. Signed-off-by: Yan, Zheng z...@redhat.com --- fs/ceph/mds_client.c | 23 +-- 1 file changed, 13 insertions(+), 10 deletions(-) diff --git a/fs/ceph

Re: [PATCH] ceph: refactor readpage_nounlock() to make the logic clearer

branch of ceph-client Thanks Yan, Zheng 1.8.1.2 . -- To unsubscribe from this list: send the line unsubscribe ceph-devel in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html

Re: [ceph-users] Ceph mds laggy and failed assert in function replay mds/journal.cc

for the ceph-mds, and do you want me to send the ceph-mon log too? yes please. BTW, how to confirm that the mds has passed the beacon to mon or not? read monitor's log Regards Yan, Zheng Thank you so much Zheng! Bazli -Original Message- From: Yan, Zheng [mailto:uker

Re: [ceph-users] Ceph mds laggy and failed assert in function replay mds/journal.cc

On Sun, Apr 27, 2014 at 12:04 PM, Yan, Zheng uker...@gmail.com wrote: On Sat, Apr 26, 2014 at 9:56 AM, Jingyuan Luke jyl...@gmail.com wrote: Hi Greg, Actually our cluster is pretty empty, but we suspect we had a temporary network disconnection to one of our OSD, not sure if this caused

Re: [ceph-users] Ceph mds laggy and failed assert in function replay mds/journal.cc

the journal? Regards Yan, Zheng Regards, Luke On Tue, Apr 29, 2014 at 2:12 PM, Yan, Zheng uker...@gmail.com wrote: On Tue, Apr 29, 2014 at 11:24 AM, Jingyuan Luke jyl...@gmail.com wrote: Hi, We had applied the patch and recompile ceph as well as updated the ceph.conf as per suggested, when

Re: [ceph-users] Ceph mds laggy and failed assert in function replay mds/journal.cc

do that? compile ceph-mds with the attached patch. add a line mds wipe_sessions = 1 to the ceph.conf, Yan, Zheng Regards, Luke On Saturday, April 26, 2014, Gregory Farnum g...@inktank.com wrote: Hmm, it looks like your on-disk SessionMap is horrendously out of date. Did your cluster get

[PATCH 3/6] ceph: pre-allocate ceph_cap struct for ceph_add_cap()

So that ceph_add_cap() can be used while i_ceph_lock is locked. This simplifies the code that handle cap import/export. Signed-off-by: Yan, Zheng zheng.z@intel.com --- fs/ceph/caps.c | 81 +++-- fs/ceph/inode.c | 70

[PATCH 5/6] ceph: introduce ceph_fill_fragtree()

Move the code that update the i_fragtree into a separate function. Also add simple probabilistic test to decide whether the i_fragtree should be updated Signed-off-by: Yan, Zheng zheng.z@intel.com --- fs/ceph/inode.c | 129 1 file

[PATCH 4/6] ceph: handle cap import atomically

() release the lock after it finishes its job. Signed-off-by: Yan, Zheng zheng.z@intel.com --- fs/ceph/caps.c | 98 +++--- 1 file changed, 53 insertions(+), 45 deletions(-) diff --git a/fs/ceph/caps.c b/fs/ceph/caps.c index 73a42f5..318b50f 100644

[PATCH 1/6] ceph: avoid releasing caps that are being used

To avoid releasing caps that are being used, encode_inode_release() should send implemented caps to MDS. Signed-off-by: Yan, Zheng zheng.z@intel.com --- fs/ceph/caps.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/fs/ceph/caps.c b/fs/ceph/caps.c index 9946ce3..de39a03

[PATCH 6/6] ceph: remember subtree root dirfrag's auth MDS

remember dirfrag's auth MDS when it's different from its parent inode's auth MDS. Signed-off-by: Yan, Zheng zheng.z@intel.com --- fs/ceph/inode.c | 8 +++- 1 file changed, 7 insertions(+), 1 deletion(-) diff --git a/fs/ceph/inode.c b/fs/ceph/inode.c index 80528ff..7736097 100644

[PATCH 2/6] ceph: update inode fields according to issued caps

Cap message and request reply from non-auth MDS may carry stale information (corresponding locks are in LOCK states) even they have the newest inode version. So client should update inode fields according to issued caps. Signed-off-by: Yan, Zheng zheng.z@intel.com --- fs/ceph/caps.c

[PATCH] ceph: clear directory's completeness when creating file

/issues/8025 Signed-off-by: Yan, Zheng zheng.z@intel.com --- fs/ceph/dir.c | 9 fs/ceph/inode.c | 71 + fs/ceph/super.h | 1 - 3 files changed, 21 insertions(+), 60 deletions(-) diff --git a/fs/ceph/dir.c b/fs/ceph/dir.c index

Re: [PATCH] ceph: clear directory's completeness when creating file

On Mon, Apr 14, 2014 at 9:59 PM, Sage Weil s...@inktank.com wrote: On Mon, 14 Apr 2014, Yan, Zheng wrote: When creating a file, ceph_set_dentry_offset() puts the new dentry at the end of directory's d_subdirs, then set the dentry's offset based on directory's max offset. The offset does

Re: [PATCH] ceph: clear directory's completeness when creating file

On Mon, Apr 14, 2014 at 11:12 PM, Sage Weil s...@inktank.com wrote: On Mon, 14 Apr 2014, Yan, Zheng wrote: On Mon, Apr 14, 2014 at 9:59 PM, Sage Weil s...@inktank.com wrote: On Mon, 14 Apr 2014, Yan, Zheng wrote: When creating a file, ceph_set_dentry_offset() puts the new dentry at the end

Re: [PATCH] rbd: replace IS_ERR and PTR_ERR with PTR_ERR_OR_ZERO

-by: Yan, Zheng zheng.z@intel.com -- 1.8.3.1 -- To unsubscribe from this list: send the line unsubscribe ceph-devel in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html -- To unsubscribe from this list: send the line

Re: [PATCH] ceph: remove useless ACL check

= POSIX_ACL_XATTR_ACCESS; -- 1.8.5.5 aded to our testing branch. Thanks. Yan, Zheng -- To unsubscribe from this list: send the line unsubscribe ceph-devel in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html

  1   2   3   4   5   6   7   >