Re: ntfs mount problems (dfly 3.0.2 + ntfsprogs)

[Raimundo Santos]

Well,

this is the first hours of monday, and, as promised, I have some news:
after reinstalling my system with an internal NTFS partition, a panic
occured when trying to copy a lot of files, small and large test
random-content files (no dir structure, only files), with rsync.

The rsync command was: rsync -rltgoDuvh /mnt /var/dataholder/data_backup

And there was a panic!

The cpdup command was: cpdup -I /mnt/. /var/dataholder/data_backup

... and this just froze the system again, after coping 12GB of 69GB total.

Ah! That is in time to say that all thee tests were made with: mount_ntfs
-u raitech -g users /dev/source /dest. And the copy commands issued as a
normal user.

Tryied with:

rsync -rltgoDuvh /mnt/* /var/dataholder/data_backup AND mount_ntfs -u
raitech -g users /dev/source /dest
SAME PANIC

rsync -rltgoDuvh /mnt/* /var/dataholder/data_backup AND mount_ntfs
/dev/source /dest
SAME PANIC

Here is a partial copy of the PANIC on a core.txt file:

Mon Jun 25 02:47:09 BRT 2012

Version String: DragonFly v3.0.2.60.g00275d-RELEASE #0: Sun Jun 24 22:21:36
BRT 2012 root@:/usr/obj/usr/src/sys/X86_64_GENERIC

panic: bgetvp - overlapping buffer

GNU gdb (GDB) 7.3
Copyright (C) 2011 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later 
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.  Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-dragonfly".
For bug reporting instructions, please see:
...
Reading symbols from /boot/kernel/kernel...done.

Unread portion of the kernel message buffer:
bgetvp: overlapr 6000/4096 6800 bp
0xffe01b66d788 bx 0xffe01b061c90
panic: bgetvp - overlapping buffer
cpuid = 1
Trace beginning at frame 0xffe121cc6278
panic() at panic+0x1fb 0x8049a9cd
panic() at panic+0x1fb 0x8049a9cd
bgetvp() at bgetvp+0x16e 0x80506945
getblk() at getblk+0x3f9 0x804f3605
breadnx() at breadnx+0x3f 0x804f37de
ntfs_readntvattr_plain() at ntfs_readntvattr_plain+0x19e 0x83434844
ntfs_readattr_plain() at ntfs_readattr_plain+0x107 0x834357ea
ntfs_readattr() at ntfs_readattr+0x32e 0x83435ba0
ntfs_loadntnode() at ntfs_loadntnode+0x13d 0x834351b4
ntfs_findvattr() at ntfs_findvattr+0x3d 0x83435383
ntfs_ntvattrget() at ntfs_ntvattrget+0x82 0x834354cc
ntfs_ntreaddir() at ntfs_ntreaddir+0x7a 0x8343615a
ntfs_readdir() at ntfs_readdir+0x192 0x83433612
vop_readdir() at vop_readdir+0x6b 0x80517980
kern_getdirentries() at kern_getdirentries+0xfb 0x8050fdfc
sys_getdirentries() at sys_getdirentries+0x28 0x8050fed7
syscall2() at syscall2+0x370 0x8075af61
Xfast_syscall() at Xfast_syscall+0xcb 0x807448eb
Debugger("panic")
**
I had put it in the redmine, under the same bug.

cheers!
raitech

-- 

Raimundo A. P. Santos
Bacharelando em Informática
ICMC - USP

Re: ntfs mount problems (dfly 3.0.2 + ntfsprogs)

[Raimundo Santos]

On 20 June 2012 22:47, Raimundo Santos  wrote:

> Also which program are you using to do the copy? Have you tried
>> cpdup/rsync? Is there a consistency in the size of the files (ie. mp3s,
>> movies) or is it completely random?
>>
>
> It is all kind of files: pdfs, git repos, mp3, flac, avi (various codecs),
> and so on. All the tests with rsync installed with pkgin.
>

tested with cpdup: same issue. That same old frozen system. It will be
boring to do the internal hard disk test: need to backup my config and
reinstall everything, to be able to have a NTFS formatted partition. I
think till monday I will came with an answer.

cheers!
raitech

-- 

Raimundo A. P. Santos
Bacharelando em Informática
ICMC - USP

Re: ntfs mount problems (dfly 3.0.2 + ntfsprogs)

[Raimundo Santos]

On 20 June 2012 19:24, Antonio Huete Jiménez  wrote:

> Hi Raimundo,
>

Hi!


>
> Do you think it is possible to try the copy using an internal HDD? So that
> we can discard any USB issue.
>

Maybe... there is a way to format a NTFS partition under dfly? Could test
from the free space in my system disk, a old 160GB Samsung.


>
> Also which program are you using to do the copy? Have you tried
> cpdup/rsync? Is there a consistency in the size of the files (ie. mp3s,
> movies) or is it completely random?
>

It is all kind of files: pdfs, git repos, mp3, flac, avi (various codecs),
and so on. All the tests with rsync installed with pkgin.


>
> I would like to try to reproduce it myself to see if I can track it down.
> Otherwise, it would be quite hard to find it.
>

I do not think it is so hard:

. external disk with NTFS
. a HAMMER FS
. try to copy a very large number of files

But I will try to isolete a bit more the problem.

[]s
raitech


-- 

Raimundo A. P. Santos
Bacharelando em Informática
ICMC - USP

Re: ntfs mount problems (dfly 3.0.2 + ntfsprogs)

[Antonio Huete Jiménez]

Hi Raimundo,

Do you think it is possible to try the copy using an internal HDD? So that  
we can discard any USB issue.


Also which program are you using to do the copy? Have you tried  
cpdup/rsync? Is there a consistency in the size of the files (ie. mp3s,  
movies) or is it completely random?


I would like to try to reproduce it myself to see if I can track it down.  
Otherwise, it would be quite hard to find it.


Cheers,
Antonio Huete


On 20 June 2012 11:38, Sascha Wildner  wrote:


Does CTL-ALT-ESC work to drop to ddb? If it does and you are at the db>
prompt, please do 'call dumpsys' and see if it dumps (numbers counting  
and

hard disk activity). When it goes back to db>, you can 'reset'. The dump
will then be written to /var/crash (kern.xxx and vmcore.xxx) when the
system comes up again.



okey, noobing again... just replied to sascha, and now to all of us:

Trying to copy again. This may take a while. But the test now have  
another
purpose, too: test to see if iostat could be blamed. In the other two  
tries
I have used iostat to see the ratio of MB/s in the transfer and guess  
some

time to finish it. My calcs returned about 17h of transfer... just around
4MB/s and floating a lot.

Now, without iostat, I am able to see:

. if it do not crash, there is a good chance that iostat is doing some  
bad

(I may repeat the test again)
. else, test the CTL-ALT-ESC.

And now, waiting... :)



Done!

Again, the same issue: the system freezes. Tried to do the test without  
my

USB keyboard, used a PS/2 instead. Freezes into a state that neither the
keyboard works, so the debugger does not show up.

weird... 0_o

I must try it with the USB HDD mounted in another machine and transfer  
via

ssh. But it is not that simple maintain another computer conected in my
network for about 17h... all of them are notebooks, and just one is mine.

Waiting for some another idea... I am very amateur in terms of kernel and
drivers.

thanks!
raitech




--
Usando el novísimo cliente de correo de Opera: http://www.opera.com/mail/

Re: ntfs mount problems (dfly 3.0.2 + ntfsprogs)

[Raimundo Santos]

On 20 June 2012 11:38, Sascha Wildner  wrote:

> Does CTL-ALT-ESC work to drop to ddb? If it does and you are at the db>
> prompt, please do 'call dumpsys' and see if it dumps (numbers counting and
> hard disk activity). When it goes back to db>, you can 'reset'. The dump
> will then be written to /var/crash (kern.xxx and vmcore.xxx) when the
> system comes up again.


okey, noobing again... just replied to sascha, and now to all of us:

Trying to copy again. This may take a while. But the test now have another
purpose, too: test to see if iostat could be blamed. In the other two tries
I have used iostat to see the ratio of MB/s in the transfer and guess some
time to finish it. My calcs returned about 17h of transfer... just around
4MB/s and floating a lot.

Now, without iostat, I am able to see:

. if it do not crash, there is a good chance that iostat is doing some bad
(I may repeat the test again)
. else, test the CTL-ALT-ESC.

And now, waiting... :)



Done!

Again, the same issue: the system freezes. Tried to do the test without my
USB keyboard, used a PS/2 instead. Freezes into a state that neither the
keyboard works, so the debugger does not show up.

weird... 0_o

I must try it with the USB HDD mounted in another machine and transfer via
ssh. But it is not that simple maintain another computer conected in my
network for about 17h... all of them are notebooks, and just one is mine.

Waiting for some another idea... I am very amateur in terms of kernel and
drivers.

thanks!
raitech

-- 

Raimundo A. P. Santos
Bacharelando em Informática
ICMC - USP

Re: ntfs mount problems (dfly 3.0.2 + ntfsprogs)

[Sascha Wildner]

On Wed, 20 Jun 2012 16:22:30 +0200, Raimundo Santos   
wrote:



Okey,

Now, part II:

I was very happy copying my 234GB of data to the new and shiny PFS over  
my

only-data 1TB disk, when circa 9GB copied, the system just freeze. Yes
freeze in the normal sense: no interaction, no messages, no logs, just me
alone with the hope that my backup external disk continues to have their
data.


Does CTL-ALT-ESC work to drop to ddb? If it does and you are at the db>  
prompt, please do 'call dumpsys' and see if it dumps (numbers counting and  
hard disk activity). When it goes back to db>, you can 'reset'. The dump  
will then be written to /var/crash (kern.xxx and vmcore.xxx) when the  
system comes up again.


These files could help us figure out what the system was doing when it  
froze.


Regards,
Sascha

Re: ntfs mount problems (dfly 3.0.2 + ntfsprogs)

[Raimundo Santos]

Okey,

Now, part II:

I was very happy copying my 234GB of data to the new and shiny PFS over my
only-data 1TB disk, when circa 9GB copied, the system just freeze. Yes
freeze in the normal sense: no interaction, no messages, no logs, just me
alone with the hope that my backup external disk continues to have their
data.

Any clue about this? Listing the 'moving parts' of the situation:

- a 500GB Samsung (S2) external USB HDD with NTFS
- a DragonFly kernel 3.0.2 which is cherry-picked from commit
abe9d9ec9d654eb64bf9808c39d8658c61e34ca2
- a Seagate internal SATA HDD 1TB with HAMMER and a PFS, this is not a
system disk

My intention is, as noted in other message, to be able to HAMMERize the USB
HDD and turn it into a mirror of the PFS in the Seagate. The first of all
actions is failing: copy data to initialize my backup.

Thanks in advance!
raitech

-- 

Raimundo A. P. Santos
Bacharelando em Informática
ICMC - USP

Re: ntfs mount problems (dfly 3.0.2 + ntfsprogs)

[Raimundo Santos]

Hey Antonio,

Many thanks!

I really dunno why I did not do that!

Now I'm trying to figure out why I have citted ntfsprogs...

Thanks again, for reminding me of the redmine :)

-- 

Raimundo A. P. Santos
Bacharelando em Informática
ICMC - USP

Re: ntfs mount problems (dfly 3.0.2 + ntfsprogs)

[Antonio Huete Jiménez]

Hi Raimundo,

Thanks for the report, I've created a ticket in our tracker  
(http://bugs.dragonflybsd.org/issues/2388)


Regards,
Antonio Huete


Hi there!

Have some problem when trying to access a NTFS external hdd.

Mounted -> OK
a simple 'ls' -> OK
a 'ls -la' -> PANIC

panic: lockmgr: LK_RELEASE: no lock held
cpuid = 1
Trace beginning at frame 0xffe120ef06c8
panic() at panic+0x1fb 0x8049a9cd
panic() at panic+0x1fb 0x8049a9cd
lockmgr() at lockmgr+0x56d 0x8048bb16
vn_unlock() at vn_unlock+0x15 0x80515373
vop_compat_nresolve() at vop_compat_nresolve+0xdb 0x804fdb8d
vop_defaultop() at vop_defaultop+0x10 0x804fcd12
vop_nresolve() at vop_nresolve+0x5b 0x80516c85
cache_resolve() at cache_resolve+0x750 0x804f975a
nlookup() at nlookup+0x354 0x8050378b
kern_stat() at kern_stat+0x1c 0x80511e8d
sys_lstat() at sys_lstat+0x3e 0x80511ff2
syscall2() at syscall2+0x370 0x8075af61
Xfast_syscall() at Xfast_syscall+0xcb 0x807448eb
Debugger("panic")

After that, tryied the TAB key in my zsh just to complete a rsync  
command,

and panic again.

My intention is to do a backup solution with HAMMER both in the machine  
and
in the external hdd, and mirror the machine on to the ext. hdd. But by  
now,

the hdd is a NTFS partition.

uname -a :

DragonFly rtcprime.mondoextremoh 3.0-RELEASE DragonFly
v3.0.2.55.g27ab5-RELEASE #3: Sun Jun 17 18:38:48 BRT 2012
root@rtcprime.mondoextremoh:/usr/obj/usr/src/sys/X86_64_GENERIC  x86_64

(compiled yesterday)


some clue?
thanks!