Re: [ceph-users] XFS attempt to access beyond end of device

2017-08-27 Thread Brad Hubbard
On Fri, Aug 25, 2017 at 4:19 PM, Götz Reinicke - IT Koordinator wrote: > Hi, > > Am 28.07.17 um 04:06 schrieb Brad Hubbard: >> An update on this. >> >> The "attempt to access beyond end of device" messages are created due to a >> kernel bug which is rectified by

Re: [ceph-users] XFS attempt to access beyond end of device

2017-07-27 Thread Brad Hubbard
An update on this. The "attempt to access beyond end of device" messages are created due to a kernel bug which is rectified by the following patches. - 59d43914ed7b9625(vfs: make guard_bh_eod() more generic) - 4db96b71e3caea(vfs: guard end of device for mpage interface) An upgraded Red Hat

Re: [ceph-users] XFS attempt to access beyond end of device

2017-07-22 Thread Brad Hubbard
Blair, I should clarify that I am *now* aware of your support case =D For anyone willing to run a systemtap the following should give us more information about the problem. stap --all-modules -e 'probe kernel.function("handle_bad_sector"){ printf("handle_bad_sector(): ARGS is %s\n",$$parms$$);

Re: [ceph-users] XFS attempt to access beyond end of device

2017-07-21 Thread Brad Hubbard
On Sat, Jul 22, 2017 at 9:38 AM, Blair Bethwaite wrote: > Hi Brad, > > On 22 July 2017 at 09:04, Brad Hubbard wrote: >> Could you share what kernel/distro you are running and also please test >> whether >> the error message can be triggered by

Re: [ceph-users] XFS attempt to access beyond end of device

2017-07-21 Thread Blair Bethwaite
Hi Brad, On 22 July 2017 at 09:04, Brad Hubbard wrote: > Could you share what kernel/distro you are running and also please test > whether > the error message can be triggered by running the "blkid" command? I'm seeing it on RHEL7.3 (3.10.0-514.2.2.el7.x86_64). See Red Hat

Re: [ceph-users] XFS attempt to access beyond end of device

2017-07-21 Thread Brad Hubbard
On Sat, Jul 22, 2017 at 5:57 AM, Marcus Furlong wrote: > On 20 July 2017 at 18:48, Brad Hubbard wrote: >> On Fri, Jul 21, 2017 at 4:23 AM, Marcus Furlong wrote: >>> On 20 July 2017 at 12:49, Matthew Vernon wrote:

Re: [ceph-users] XFS attempt to access beyond end of device

2017-07-21 Thread Marcus Furlong
On 20 July 2017 at 18:48, Brad Hubbard wrote: > On Fri, Jul 21, 2017 at 4:23 AM, Marcus Furlong wrote: >> On 20 July 2017 at 12:49, Matthew Vernon wrote: >>> Hi, >>> >>> On 18/07/17 05:08, Marcus Furlong wrote: On 22 March

Re: [ceph-users] XFS attempt to access beyond end of device

2017-07-20 Thread Brad Hubbard
On Fri, Jul 21, 2017 at 4:23 AM, Marcus Furlong wrote: > On 20 July 2017 at 12:49, Matthew Vernon wrote: >> Hi, >> >> On 18/07/17 05:08, Marcus Furlong wrote: >>> >>> On 22 March 2017 at 05:51, Dan van der Ster >>

Re: [ceph-users] XFS attempt to access beyond end of device

2017-07-20 Thread Marcus Furlong
On 20 July 2017 at 12:49, Matthew Vernon wrote: > Hi, > > On 18/07/17 05:08, Marcus Furlong wrote: >> >> On 22 March 2017 at 05:51, Dan van der Ster > > wrote: > > >> Apologies for reviving an old thread, but I figured out what

Re: [ceph-users] XFS attempt to access beyond end of device

2017-07-20 Thread Matthew Vernon
Hi, On 18/07/17 05:08, Marcus Furlong wrote: On 22 March 2017 at 05:51, Dan van der Ster > wrote: Apologies for reviving an old thread, but I figured out what happened and never documented it, so I thought an update might be useful. [snip

Re: [ceph-users] XFS attempt to access beyond end of device

2017-07-18 Thread Dan van der Ster
On Tue, Jul 18, 2017 at 6:08 AM, Marcus Furlong wrote: > On 22 March 2017 at 05:51, Dan van der Ster wrote: >> On Wed, Mar 22, 2017 at 8:24 AM, Marcus Furlong >> wrote: >>> Hi, >>> >>> I'm experiencing the same issue as outlined in

Re: [ceph-users] XFS attempt to access beyond end of device

2017-07-17 Thread Blair Bethwaite
Brilliant, thanks Marcus. We have just (noticed we've) hit this too and looks like your script will fix this (will test and report back...). On 18 July 2017 at 14:08, Marcus Furlong wrote: > [ 92.938882] XFS (sdi1): Mounting V5 Filesystem > [ 93.065393] XFS (sdi1): Ending

Re: [ceph-users] XFS attempt to access beyond end of device

2017-07-17 Thread Marcus Furlong
On 22 March 2017 at 05:51, Dan van der Ster wrote: > On Wed, Mar 22, 2017 at 8:24 AM, Marcus Furlong wrote: >> Hi, >> >> I'm experiencing the same issue as outlined in this post: >> >>

Re: [ceph-users] XFS attempt to access beyond end of device

2017-03-28 Thread Brad Hubbard
On Tue, Mar 28, 2017 at 4:22 PM, Marcus Furlong wrote: > On 22 March 2017 at 19:36, Brad Hubbard wrote: >> On Wed, Mar 22, 2017 at 5:24 PM, Marcus Furlong wrote: > >>> [435339.965817] [ cut here ] >>>

Re: [ceph-users] XFS attempt to access beyond end of device

2017-03-28 Thread Marcus Furlong
On 22 March 2017 at 19:36, Brad Hubbard wrote: > On Wed, Mar 22, 2017 at 5:24 PM, Marcus Furlong wrote: >> [435339.965817] [ cut here ] >> [435339.965874] WARNING: at fs/xfs/xfs_aops.c:1244 >> xfs_vm_releasepage+0xcb/0x100 [xfs]()

Re: [ceph-users] XFS attempt to access beyond end of device

2017-03-22 Thread Marcus Furlong
On 22 March 2017 at 21:23, Martin Palma wrote: >> [429280.254400] attempt to access beyond end of device >> [429280.254412] sdi1: rw=0, want=19134412768, limit=19134412767 > > We are seeing the same for our OSDs which have the journal as a > separate partition always on the same

Re: [ceph-users] XFS attempt to access beyond end of device

2017-03-22 Thread Martin Palma
> [429280.254400] attempt to access beyond end of device > [429280.254412] sdi1: rw=0, want=19134412768, limit=19134412767 We are seeing the same for our OSDs which have the journal as a separate partition always on the same disk and only for OSDs which we added after our cluster was upgraded to

Re: [ceph-users] XFS attempt to access beyond end of device

2017-03-22 Thread Dan van der Ster
On Wed, Mar 22, 2017 at 8:24 AM, Marcus Furlong wrote: > Hi, > > I'm experiencing the same issue as outlined in this post: > > http://lists.ceph.com/pipermail/ceph-users-ceph.com/2016-September/013330.html > > I have also deployed this jewel cluster using ceph-deploy. > > This

Re: [ceph-users] XFS attempt to access beyond end of device

2017-03-22 Thread Brad Hubbard
On Wed, Mar 22, 2017 at 5:24 PM, Marcus Furlong wrote: > Hi, > > I'm experiencing the same issue as outlined in this post: > > http://lists.ceph.com/pipermail/ceph-users-ceph.com/2016-September/013330.html > > I have also deployed this jewel cluster using ceph-deploy. > > This

[ceph-users] XFS attempt to access beyond end of device

2017-03-22 Thread Marcus Furlong
Hi, I'm experiencing the same issue as outlined in this post: http://lists.ceph.com/pipermail/ceph-users-ceph.com/2016-September/013330.html I have also deployed this jewel cluster using ceph-deploy. This is the message I see at boot (happens for all drives, on all OSD nodes): [ 92.938882]