Can you paste the output of 'stat foo' and 'stat /cephfs/some_folder'?  
(Maybe also the same with 'stat -f'.)

Thanks!
sage


On Fri, 25 May 2018, Ric Wheeler wrote:
> That seems to be the issue - we need to understand why rename sees them as
> different.
> 
> Ric
> 
> 
> On Fri, May 25, 2018, 9:15 AM Oliver Freyermuth <
> freyerm...@physik.uni-bonn.de> wrote:
> 
> > Mhhhm... that's funny, I checked an mv with an strace now. I get:
> >
> > ---------------------------------------------------------------------------------
> > access("/cephfs/some_folder/file", W_OK) = 0
> > rename("foo", "/cephfs/some_folder/file") = -1 EXDEV (Invalid cross-device
> > link)
> > unlink("/cephfs/some_folder/file") = 0
> > lgetxattr("foo", "security.selinux", "system_u:object_r:fusefs_t:s0", 255)
> > = 30
> >
> > ---------------------------------------------------------------------------------
> > But I can assure it's only a single filesystem, and a single ceph-fuse
> > client running.
> >
> > Same happens when using absolute paths.
> >
> > Cheers,
> >         Oliver
> >
> > Am 25.05.2018 um 15:06 schrieb Ric Wheeler:
> > > We should look at what mv uses to see if it thinks the directories are
> > on different file systems.
> > >
> > > If the fstat or whatever it looks at is confused, that might explain it.
> > >
> > > Ric
> > >
> > >
> > > On Fri, May 25, 2018, 9:04 AM Oliver Freyermuth <
> > freyerm...@physik.uni-bonn.de <mailto:freyerm...@physik.uni-bonn.de>>
> > wrote:
> > >
> > >     Am 25.05.2018 um 14:57 schrieb Ric Wheeler:
> > >     > Is this move between directories on the same file system?
> > >
> > >     It is, we only have a single CephFS in use. There's also only a
> > single ceph-fuse client running.
> > >
> > >     What's different, though, are different ACLs set for source and
> > target directory, and owner / group,
> > >     but I hope that should not matter.
> > >
> > >     All the best,
> > >     Oliver
> > >
> > >     > Rename as a system call only works within a file system.
> > >     >
> > >     > The user space mv command becomes a copy when not the same file
> > system.
> > >     >
> > >     > Regards,
> > >     >
> > >     > Ric
> > >     >
> > >     >
> > >     > On Fri, May 25, 2018, 8:51 AM John Spray <jsp...@redhat.com
> > <mailto:jsp...@redhat.com> <mailto:jsp...@redhat.com <mailto:
> > jsp...@redhat.com>>> wrote:
> > >     >
> > >     >     On Fri, May 25, 2018 at 1:10 PM, Oliver Freyermuth
> > >     >     <freyerm...@physik.uni-bonn.de <mailto:
> > freyerm...@physik.uni-bonn.de> <mailto:freyerm...@physik.uni-bonn.de
> > <mailto:freyerm...@physik.uni-bonn.de>>> wrote:
> > >     >     > Dear Cephalopodians,
> > >     >     >
> > >     >     > I was wondering why a simple "mv" is taking extraordinarily
> > long on CephFS and must note that,
> > >     >     > at least with the fuse-client (12.2.5) and when moving a
> > file from one directory to another,
> > >     >     > the file appears to be copied first (byte by byte, traffic
> > going through the client?) before the initial file is deleted.
> > >     >     >
> > >     >     > Is this true, or am I missing something?
> > >     >
> > >     >     A mv should not involve copying a file through the client --
> > it's
> > >     >     implemented in the MDS as a rename from one location to
> > another.
> > >     >     What's the observation that's making it seem like the data is
> > going
> > >     >     through the client?
> > >     >
> > >     >     John
> > >     >
> > >     >     >
> > >     >     > For large files, this might be rather time consuming,
> > >     >     > and we should certainly advise all our users to not move
> > files around needlessly if this is the case.
> > >     >     >
> > >     >     > Cheers,
> > >     >     >         Oliver
> > >     >     >
> > >     >     >
> > >     >     > _______________________________________________
> > >     >     > ceph-users mailing list
> > >     >     > ceph-users@lists.ceph.com <mailto:ceph-users@lists.ceph.com>
> > <mailto:ceph-users@lists.ceph.com <mailto:ceph-users@lists.ceph.com>>
> > >     >     > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
> > >     >     >
> > >     >     _______________________________________________
> > >     >     ceph-users mailing list
> > >     >     ceph-users@lists.ceph.com <mailto:ceph-users@lists.ceph.com>
> > <mailto:ceph-users@lists.ceph.com <mailto:ceph-users@lists.ceph.com>>
> > >     >     http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
> > >     >
> > >
> >
> >
> >
> >
> 
_______________________________________________
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Reply via email to