Re: Problem with an external usb HD - slow usb

2010-08-03 Thread Luigi Castro Cardeles
News:

upgrade to fedora 13 and using ext4 filesystem = ~26MB/s

[]'s
Luigi Castro Cardeles


2010/4/29 Luigi Castro Cardeles luigi.carde...@gmail.com

 Hi list,

 just to update:

 since kernel 2.6.32.11-99.fc12.x86_64, the usb speed with that device has
 improved to 8~6,5MB/s...

 []'s
 Luigi Castro Cardeles



-- 
users mailing list
users@lists.fedoraproject.org
To unsubscribe or change subscription options:
https://admin.fedoraproject.org/mailman/listinfo/users
Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines


Re: Problem with an external usb HD - slow usb

2010-08-03 Thread JD
  On 08/03/2010 07:04 PM, Luigi Castro Cardeles wrote:
 News:

 upgrade to fedora 13 and using ext4 filesystem = ~26MB/s

 []'s
 Luigi Castro Cardeles


 2010/4/29 Luigi Castro Cardeles luigi.carde...@gmail.com 
 mailto:luigi.carde...@gmail.com

 Hi list,

 just to update:

 since kernel 2.6.32.11-99.fc12.x86_64, the usb speed with that
 device has improved to 8~6,5MB/s...

 []'s
 Luigi Castro Cardeles



If you want even better performance, reiserfs4 was benchmarked to
exceed ALL other
  Linux filesystems, including xfs, ext2/3/4
See  http://kerneltrap.org/node/6776
-- 
users mailing list
users@lists.fedoraproject.org
To unsubscribe or change subscription options:
https://admin.fedoraproject.org/mailman/listinfo/users
Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines


Re: Problem with an external usb HD - slow usb

2010-08-03 Thread Christofer C. Bell
On Tue, Aug 3, 2010 at 10:12 PM, JD jd1...@gmail.com wrote:
 If you want even better performance, reiserfs4 was benchmarked to
 exceed ALL other
  Linux filesystems, including xfs, ext2/3/4
 See  http://kerneltrap.org/node/6776

How do you get that from your link?  The article has nothing to do
with Reiser 4 and the post from Hans Resier containing the clams you
make is from 2006 (4 years ago, before he went to prison, where he
remains).  What does this have to do with Reiser 4 vs. ext4
performance *today*, 4 years later?

-- 
Chris
-- 
users mailing list
users@lists.fedoraproject.org
To unsubscribe or change subscription options:
https://admin.fedoraproject.org/mailman/listinfo/users
Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines


Re: Problem with an external usb HD - slow usb

2010-08-03 Thread JD

On 08/03/2010 09:31 PM, Christofer C. Bell wrote:
 On Tue, Aug 3, 2010 at 10:12 PM, JDjd1...@gmail.com  wrote:
 If you want even better performance, reiserfs4 was benchmarked to
 exceed ALL other
   Linux filesystems, including xfs, ext2/3/4
 See  http://kerneltrap.org/node/6776
 How do you get that from your link?  The article has nothing to do
 with Reiser 4 and the post from Hans Resier containing the clams you
 make is from 2006 (4 years ago, before he went to prison, where he
 remains).  What does this have to do with Reiser 4 vs. ext4
 performance *today*, 4 years later?

Here is the conclusion from 2009:

Conclusion: REISERFS and JFS are pretty close contenders for first 
place, followed by BTRFS and EXT4. Good old EXT3 would be my pick for 
fifth, leaving XFS and the still immature, but interesting log based 
filesystem NILFS2 in last place.

At URL:
http://agcbsm.blogspot.com/2009/12/linux-filesystem-benchmarks.html

Also, benchmarks in 2008:
Ext4 is great for /small/ files read, read+write, and delete.
But for /medium/ files, resiserfs outshines it by a very good margin.
Ditto for /large/ files read+write - resierfs shines the best.

See 
http://www.jejik.com/articles/2008/04/benchmarking_linux_filesystems_on_software_raid_1/

unfortunately, there is a dearth of /official/ benchmarks for linux 
filesystems that are very recent
(ca. 2009/2010).


-- 
users mailing list
users@lists.fedoraproject.org
To unsubscribe or change subscription options:
https://admin.fedoraproject.org/mailman/listinfo/users
Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines


Re: Problem with an external usb HD - slow usb

2010-04-29 Thread Luigi Castro Cardeles
Hi list,

just to update:

since kernel 2.6.32.11-99.fc12.x86_64, the usb speed with that device has
improved to 8~6,5MB/s...

[]'s
Luigi Castro Cardeles
-- 
users mailing list
users@lists.fedoraproject.org
To unsubscribe or change subscription options:
https://admin.fedoraproject.org/mailman/listinfo/users
Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines


Re: Problem with an external usb HD - slow usb

2010-03-12 Thread Patrick O'Callaghan
On Fri, 2010-03-12 at 03:36 -0800, Don Quixote de la Mancha wrote:
 On Thu, Mar 11, 2010 at 10:54 AM, Patrick O'Callaghan
 pocallag...@gmail.com wrote:
  It's likely that the disk came with a special driver for Windows,
  whereas the Linux version is using a generic driver. I'd guess the
  answer is probably in the Windows driver code, but of course it will be
  binary and proprietary so it's of no use to anyone.
 
 There are lots of I/O devices that claim to comply with some published
 protocol, but really don't.  Some operating systems deal with this by
 providing special-case code for particular devices that, while
 strictly speaking violate the protocols, at least get the device
 working for the user.  Many devices provide unique vendor and device
 IDs that can be used to know when such workarounds need to be
 activated.
 
 I know that Linux includes such code to support otherwise broken
 microprocessors.  I don't know whether it also provides support for
 broken USB storage devices.
 
 A specific example is that I can recall a post to one of the FreeBSD
 lists which mentioned the addition of a special workaround for the
 Kingston USB Flash drives.

Interesting. I have a couple of these. Do you have a more specific
reference? Google shows a bunch of stuff but nothing that indicates any
specific issue with Kingston versus other brands.

poc

-- 
users mailing list
users@lists.fedoraproject.org
To unsubscribe or change subscription options:
https://admin.fedoraproject.org/mailman/listinfo/users
Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines


Re: Problem with an external usb HD - slow usb

2010-03-11 Thread Patrick O'Callaghan
On Wed, 2010-03-10 at 10:28 -0300, Luigi Castro Cardeles wrote:
 2010/3/9 Roberto Ragusa m...@robertoragusa.it:
  Luigi Castro Cardeles wrote:
  2010/3/9 Mikkel mik...@infinity-ltd.com:
 
  slow speed
  high speed
  full speed
 
  so:
  low-speed - uhci
  full-speed - ohci
  high-speed - ehci
 
  When the USB group created the 2.0 specifications it made
  a good effort to confuse good speed (480Mbit/s) with
  awful speed (12Mbit/s) devices, so to manage to sell
  all the ancient stuff by putting a USB2.0 label on them.
 
  This thread clearly demonstrates how successful they were.
  :-(
 
  --
Roberto Ragusamail at robertoragusa.it
  --
  users mailing list
  users@lists.fedoraproject.org
  To unsubscribe or change subscription options:
  https://admin.fedoraproject.org/mailman/listinfo/users
  Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines
 
 
 but using the same external hd on windows is faster then on linux...
 at that point, i am trying to understand that :D
 the device is: philips case sde3275fc/97
 still struggling with that.

It's likely that the disk came with a special driver for Windows,
whereas the Linux version is using a generic driver. I'd guess the
answer is probably in the Windows driver code, but of course it will be
binary and proprietary so it's of no use to anyone.

poc

-- 
users mailing list
users@lists.fedoraproject.org
To unsubscribe or change subscription options:
https://admin.fedoraproject.org/mailman/listinfo/users
Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines


Re: Problem with an external usb HD - slow usb

2010-03-11 Thread Mike McCarty
Patrick O'Callaghan wrote:

[...]

 It's likely that the disk came with a special driver for Windows,
 whereas the Linux version is using a generic driver. I'd guess the
 answer is probably in the Windows driver code, but of course it will be
 binary and proprietary so it's of no use to anyone.

Clearly it's of _some_ use to _someone_. It just isn't of use to _you_.

Mike
-- 
p=p=%c%s%c;main(){printf(p,34,p,34);};main(){printf(p,34,p,34);}
Oppose globalization and One World Governments like the UN.
This message made from 100% recycled bits.
You have found the bank of Larn.
I speak only for myself, and I am unanimous in that!
-- 
users mailing list
users@lists.fedoraproject.org
To unsubscribe or change subscription options:
https://admin.fedoraproject.org/mailman/listinfo/users
Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines


Re: Problem with an external usb HD - slow usb

2010-03-11 Thread Patrick O'Callaghan
On Thu, 2010-03-11 at 18:13 -0600, Mike McCarty wrote:
 Patrick O'Callaghan wrote:
 
 [...]
 
  It's likely that the disk came with a special driver for Windows,
  whereas the Linux version is using a generic driver. I'd guess the
  answer is probably in the Windows driver code, but of course it will be
  binary and proprietary so it's of no use to anyone.
 
 Clearly it's of _some_ use to _someone_. It just isn't of use to _you_.

No, it's of no use to anyone using a non-Windows system. Isn't that what
we're talking about on this list?

poc

-- 
users mailing list
users@lists.fedoraproject.org
To unsubscribe or change subscription options:
https://admin.fedoraproject.org/mailman/listinfo/users
Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines


Re: Problem with an external usb HD - slow usb

2010-03-11 Thread Mike McCarty
Patrick O'Callaghan wrote:
 On Thu, 2010-03-11 at 18:13 -0600, Mike McCarty wrote:
 Clearly it's of _some_ use to _someone_. It just isn't of use to _you_.
 
 No, it's of no use to anyone using a non-Windows system. Isn't that what
 we're talking about on this list?

There are those who install Windows drivers on Linux systems.

Mike
-- 
p=p=%c%s%c;main(){printf(p,34,p,34);};main(){printf(p,34,p,34);}
Oppose globalization and One World Governments like the UN.
This message made from 100% recycled bits.
You have found the bank of Larn.
I speak only for myself, and I am unanimous in that!
-- 
users mailing list
users@lists.fedoraproject.org
To unsubscribe or change subscription options:
https://admin.fedoraproject.org/mailman/listinfo/users
Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines


Re: Problem with an external usb HD - slow usb

2010-03-11 Thread Mike McCarty
Patrick O'Callaghan wrote:
 On Thu, 2010-03-11 at 18:13 -0600, Mike McCarty wrote:
 Patrick O'Callaghan wrote:

 [...]

 It's likely that the disk came with a special driver for Windows,
 whereas the Linux version is using a generic driver. I'd guess the
 answer is probably in the Windows driver code, but of course it will be
 binary and proprietary so it's of no use to anyone.
 Clearly it's of _some_ use to _someone_. It just isn't of use to _you_.
 
 No, it's of no use to anyone using a non-Windows system. Isn't that what
 we're talking about on this list?

Actually, my other reply wasn't quite apropos to your question in
this exact context. This particular driver is not especially useful in
this particular context, except as a comparison of what can be
done using the exact same hardware. Also, people who use Fedora
use it on dual boot systems. This echo is Community support for
Fedora users, some of whom are also Windows (of various versions)
users.

Comparisons and contrasts between the performance of the identical
same hardware using different drivers is of definite benefit for
diagnostic purposes.

However, in a broader context, simply because a driver is closed
source and proprietary does not mean that it is of no use to anyone.
AIUI, nVidia provides some Linux drivers which are closed, and used
by people here, as an example.

Mike
-- 
p=p=%c%s%c;main(){printf(p,34,p,34);};main(){printf(p,34,p,34);}
Oppose globalization and One World Governments like the UN.
This message made from 100% recycled bits.
You have found the bank of Larn.
I speak only for myself, and I am unanimous in that!
-- 
users mailing list
users@lists.fedoraproject.org
To unsubscribe or change subscription options:
https://admin.fedoraproject.org/mailman/listinfo/users
Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines


Re: Problem with an external usb HD - slow usb

2010-03-11 Thread Patrick O'Callaghan
On Thu, 2010-03-11 at 19:24 -0600, Mike McCarty wrote:
 Patrick O'Callaghan wrote:
  On Thu, 2010-03-11 at 18:13 -0600, Mike McCarty wrote:
  Patrick O'Callaghan wrote:
 
  [...]
 
  It's likely that the disk came with a special driver for Windows,
  whereas the Linux version is using a generic driver. I'd guess the
  answer is probably in the Windows driver code, but of course it will be
  binary and proprietary so it's of no use to anyone.
  Clearly it's of _some_ use to _someone_. It just isn't of use to _you_.
  
  No, it's of no use to anyone using a non-Windows system. Isn't that what
  we're talking about on this list?
 
 Actually, my other reply wasn't quite apropos to your question in
 this exact context. This particular driver is not especially useful in
 this particular context, except as a comparison of what can be
 done using the exact same hardware. Also, people who use Fedora
 use it on dual boot systems. This echo is Community support for
 Fedora users, some of whom are also Windows (of various versions)
 users.
 
 Comparisons and contrasts between the performance of the identical
 same hardware using different drivers is of definite benefit for
 diagnostic purposes.

Of course. That's why I brought it up in the first place.

 However, in a broader context, simply because a driver is closed
 source and proprietary does not mean that it is of no use to anyone.
 AIUI, nVidia provides some Linux drivers which are closed, and used
 by people here, as an example.

I made no such generalization. You're taking a far too literal reading
of an off-the-cuff phrase, and missing the point I was trying to make,
to wit, that proprietary (and usually undocumented) drivers can do
anything at all and we aren't going to know about it without enormous
effort. IOW what can be done with the exact same hardware in practice
*cannot* be done except via the proprietary driver. The OP's question
about his disk system performance could well be unanswerable.

All this is of course completely hypothetical.

poc

-- 
users mailing list
users@lists.fedoraproject.org
To unsubscribe or change subscription options:
https://admin.fedoraproject.org/mailman/listinfo/users
Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines


Re: Problem with an external usb HD - slow usb

2010-03-09 Thread Luigi Castro Cardeles
2010/3/9 Mikkel mik...@infinity-ltd.com:
 On 03/08/2010 08:17 PM, Luigi Castro Cardeles wrote:

 Hi Mikkel,

 cat /var/log/messages

 usb 2-2: new high speed USB device using ehci_hcd

 That is another reason your drive is slow. You are connected at USB
 1.1 speeds, instead of USB 2.0 speeds.

 new full speed USB device using ohci_hcd

 It does not make a lot of sense, but the speeds go:

 slow speed
 high speed
 full speed

 Mikkel
 --

  Do not meddle in the affairs of dragons,
 for thou art crunchy and taste good with Ketchup!


 --
 users mailing list
 users@lists.fedoraproject.org
 To unsubscribe or change subscription options:
 https://admin.fedoraproject.org/mailman/listinfo/users
 Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines



Hi,

This is from tuxdera:
USB is running in Low-Speed (0.1875 MB/sec) or Full-Speed (maximum
1.5 MB/sec) mode instead of High-Speed mode (maximum 60 MB/sec).
from linux-usb:
http://www.linux-usb.org/FAQ.html#gs6;

so:
low-speed - uhci
full-speed - ohci
high-speed - ehci

no?
[]'s
Luigi Castro Cardeles
-- 
users mailing list
users@lists.fedoraproject.org
To unsubscribe or change subscription options:
https://admin.fedoraproject.org/mailman/listinfo/users
Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines


Re: Problem with an external usb HD - slow usb

2010-03-09 Thread Roberto Ragusa
Luigi Castro Cardeles wrote:
 2010/3/9 Mikkel mik...@infinity-ltd.com:

 slow speed
 high speed
 full speed

 so:
 low-speed - uhci
 full-speed - ohci
 high-speed - ehci

When the USB group created the 2.0 specifications it made
a good effort to confuse good speed (480Mbit/s) with
awful speed (12Mbit/s) devices, so to manage to sell
all the ancient stuff by putting a USB2.0 label on them.

This thread clearly demonstrates how successful they were.
:-(

-- 
   Roberto Ragusamail at robertoragusa.it
-- 
users mailing list
users@lists.fedoraproject.org
To unsubscribe or change subscription options:
https://admin.fedoraproject.org/mailman/listinfo/users
Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines


Re: Problem with an external usb HD - slow usb

2010-03-08 Thread Luigi Castro Cardeles
Hi list and Patrick,

the default max_sectors is 240. I change this to 1024 like you said but the
problem continue.

If i try the speed:

time dd if=/dev/sdc1 of=/dev/null bs=1M count=5
i get that speed: 972 MB/s

but if i run rsync, the upload transfer rate is very slow ( begins at 4MB/s
and goes below until 0.7KB/s)

[]'s
Luigi Castro Cardeles


2010/3/6 Patrick O'Callaghan pocallag...@gmail.com

 On Sat, 2010-03-06 at 11:05 -0300, Luigi Castro Cardeles wrote:
  Hi list,
 
 
  I use fedora 12 on a dell inspiron 1545 laptop.
  (2.6.31.12-174.2.22.fc12.x86_64).
  i have a external usb hd and i can't make it connect like a usb 2.0
  device.
  this device is ntfs format
 
 
  I check if the device is using ehci (dmesg after i plug the device)
  [r...@localhost ~]# dmesg | grep USB
  usb 2-2: new high speed USB device using ehci_hcd and address 2
 
 
  I check if this device is connected on a usb 2.0
  [r...@localhost ~]# lsusb
  Bus 008 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub
  Bus 002 Device 015: ID 0471:2021 Philips
  Bus 002 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
 
 
  I mount the device with this options:
  /dev/sdc1 on /media/hd_backup type fuseblk
  (rw,nosuid,nodev,allow_other,blksize=4096)
 
 
  but when i use cp, mv or rsync, the max speed i get is max 6MB/s (a
  lot 800kB/s).
  If i use this device on Windows (tested with Vista and Seven), i get
  much high transfer rate.
  I read about sync and async options, but if i put sync or async on
  fstab, it does not alter the transfer rate.
 
 
  Is this the normal upload transfer rate? I am doing something wrong?

 Try this as an experiment:

 echo 1024  /sys/block/sdc/device/max_sectors

 and repeat your I/O measurement.

 poc


 --
 users mailing list
 users@lists.fedoraproject.org
 To unsubscribe or change subscription options:
 https://admin.fedoraproject.org/mailman/listinfo/users
 Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines

-- 
users mailing list
users@lists.fedoraproject.org
To unsubscribe or change subscription options:
https://admin.fedoraproject.org/mailman/listinfo/users
Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines


Re: Problem with an external usb HD - slow usb

2010-03-08 Thread NoSpaze
Am Montag, den 08.03.2010, 12:16 -0300 schrieb Luigi Castro Cardeles:

 the default max_sectors is 240. I change this to 1024 like you said
 but the problem continue.
 time dd if=/dev/sdc1 of=/dev/null bs=1M count=5
 i get that speed: 972 MB/s
 but if i run rsync, the upload transfer rate is very slow ( begins at
 4MB/s and goes below until 0.7KB/s)

Type of filesystem (ext3, ntfs)? Any noticeable messages on dmesg? Whta
does top tracing reports while transferring? Maybe you can also
check /var/log/messages

Let us know.
--
Rodolfo Alcazar Portillo - nosp...@gmail.com
otbits.blogspot.com / counter.li.org: #367962
--
(setq wq This is emacs, not vi) -- Ingvar


-- 
users mailing list
users@lists.fedoraproject.org
To unsubscribe or change subscription options:
https://admin.fedoraproject.org/mailman/listinfo/users
Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines


Re: Problem with an external usb HD - slow usb

2010-03-08 Thread Luigi Castro Cardeles
Hi,

ntfs.

Nothing strange on dmesg or /var/log/messages.

There is something strange:
i set a line on fstab with some options (rw,async) but when i mount (mount
-a), i get this:
type fuseblk (rw,nosuid,nodev,allow_other,blksize=4096)

I found a bug about this:
https://bugzilla.redhat.com/show_bug.cgi?id=474282but it is closed but
not solved (i think).

I filled a this: https://bugzilla.redhat.com/show_bug.cgi?id=571508.

I also find this:
http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=537336(not fedora but
related i think).

[]'s
Luigi Castro Cardeles


2010/3/8 NoSpaze nosp...@gmail.com

 Am Montag, den 08.03.2010, 12:16 -0300 schrieb Luigi Castro Cardeles:

  the default max_sectors is 240. I change this to 1024 like you said
  but the problem continue.
  time dd if=/dev/sdc1 of=/dev/null bs=1M count=5
  i get that speed: 972 MB/s
  but if i run rsync, the upload transfer rate is very slow ( begins at
  4MB/s and goes below until 0.7KB/s)

 Type of filesystem (ext3, ntfs)? Any noticeable messages on dmesg? Whta
 does top tracing reports while transferring? Maybe you can also
 check /var/log/messages

 Let us know.
 --
 Rodolfo Alcazar Portillo - nosp...@gmail.com
 otbits.blogspot.com / counter.li.org: #367962
 --
 (setq wq This is emacs, not vi) -- Ingvar


 --
 users mailing list
 users@lists.fedoraproject.org
 To unsubscribe or change subscription options:
 https://admin.fedoraproject.org/mailman/listinfo/users
 Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines

-- 
users mailing list
users@lists.fedoraproject.org
To unsubscribe or change subscription options:
https://admin.fedoraproject.org/mailman/listinfo/users
Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines


Re: Problem with an external usb HD - slow usb

2010-03-08 Thread Patrick O'Callaghan
On Mon, 2010-03-08 at 12:16 -0300, Luigi Castro Cardeles wrote:
 Hi list and Patrick,
 
 
 the default max_sectors is 240. I change this to 1024 like you said
 but the problem continue.
 
 
 If i try the speed:
 
 
 time dd if=/dev/sdc1 of=/dev/null bs=1M count=5
 i get that speed: 972 MB/s
 
 
 but if i run rsync, the upload transfer rate is very slow ( begins at
 4MB/s and goes below until 0.7KB/s)

[Please don't top-post on this list]

First of all, is this device a real hard disk, i.e. a mechanically
rotating magnetic surface, or is it some kind of Flash drive?

If it's the latter, then read on.

I've been looking into this recently because of wildly varying
performance when writing to a pendrive. It turns out that Flash memory
isn't really random access when it comes to writing (reading is OK
though). Quick summary:

The Flash technology only allows writing zeroes, not ones, and is
organized in blocks of say 128 or 512 bytes (this varies according to
manufacturer) so to write some binary data in the middle of an existing
block the procedure is:

1) Read the entire block to some short-term scratch memory
2) Reset the block to all 1's.
3) Modify the scratch memory with the new bits
4) Copy the 0 bits of the scratch to the Flash block

(all this happens inside the drive of course; AFAIK it's not visible
even at the level of the kernel driver).

This process takes a very long time, and when you're repeatedly writing
small amounts of data (e.g. to update a directory) it all has to be done
multiple times, even for the same drive block. A few days ago I copied a
2GB file to an existing VFAT filesystem on an 8GB pendrive, reputedly
one of the fastest on the market. It took over two hours. I then tried
just simply copying the data directly to the drive using 'dd' (i.e. no
filesystem). It finished in under 5 minutes.

BTW, rsync is a killer on these drives because it adds another layer of
reading and hashing. In this particular case it's a false economy.

poc


-- 
users mailing list
users@lists.fedoraproject.org
To unsubscribe or change subscription options:
https://admin.fedoraproject.org/mailman/listinfo/users
Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines


Re: Problem with an external usb HD - slow usb

2010-03-08 Thread Luigi Castro Cardeles
2010/3/8 Patrick O'Callaghan pocallag...@gmail.com
 [Please don't top-post on this list]

 First of all, is this device a real hard disk, i.e. a mechanically
 rotating magnetic surface, or is it some kind of Flash drive?

Hi,
sorry for top post and sorry about the poor english.
It is not a flash drive, is an real HD.

I search a lot on www about this issue and the only clue i find is
about sync/async option when mount the device and verify if it is
connected to usb 2.0 hub.
The strange thing is if i use windows to copy this diretory (drag on
drop), the full operation last more or less two six (copy directory
and umount - eject - the device),
The same operation under fedora last a lot longer. (last day, i let
the copy last for a full day and it is not finished - i pause in the
middle).

[]'s
Luigi Castro Cardeles
-- 
users mailing list
users@lists.fedoraproject.org
To unsubscribe or change subscription options:
https://admin.fedoraproject.org/mailman/listinfo/users
Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines


Re: Problem with an external usb HD - slow usb

2010-03-08 Thread Paolo Galtieri
On 03/08/2010 11:53 AM, Luigi Castro Cardeles wrote:
 2010/3/8 Patrick O'Callaghanpocallag...@gmail.com

 [Please don't top-post on this list]

 First of all, is this device a real hard disk, i.e. a mechanically
 rotating magnetic surface, or is it some kind of Flash drive?
  
 Hi,
 sorry for top post and sorry about the poor english.
 It is not a flash drive, is an real HD.

 I search a lot on www about this issue and the only clue i find is
 about sync/async option when mount the device and verify if it is
 connected to usb 2.0 hub.
 The strange thing is if i use windows to copy this diretory (drag on
 drop), the full operation last more or less two six (copy directory
 and umount - eject - the device),
 The same operation under fedora last a lot longer. (last day, i let
 the copy last for a full day and it is not finished - i pause in the
 middle).

 []'s
 Luigi Castro Cardeles


I have a similar problem.  I have 2 external USB disk drives, one is 
1.5TB the other 1TB.  Copies to and from the external disks to the local 
disk, or between the 2 external disks, take a long time and while the 
copy is going on the system is essentially unusable, e.g.. it can take 
15 to 30 seconds for virtual desktops to update.  Moving the mouse is 
very jerky, the mouse stops for 5 to 10 seconds then moves then stops 
again.  I run netbeans IDE with the netbeans projects on one of the 
external drives.  Even when I'm not doing anything with the IDE the disk 
light on my laptop will go on solid for several minutes leading to slow 
response times.

I'm running on a 2Ghz Core 2 Duo processor with 2Gb memory.  What I 
notice during the copies is that both CPUs are 75 - 90% in wait state.  
I'm also running an encrypted root file system.

The problem is really bad when I try running VMware Workstation 7.  The 
virtual machines are all located on one of the external disks.   When I 
run one VM the system response time on the system degrades significantly 
as noted above and I have to shutdown the VM if I want to get anything 
done.

Paolo
-- 
users mailing list
users@lists.fedoraproject.org
To unsubscribe or change subscription options:
https://admin.fedoraproject.org/mailman/listinfo/users
Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines


Re: Problem with an external usb HD - slow usb

2010-03-08 Thread Mikkel
On 03/08/2010 05:53 PM, Luigi Castro Cardeles wrote:
 
 well, ntfs filesystem doesn't accept async/sync param... Tom show that
 to me (man mount.ntfs-3g).
 
 https://bugzilla.redhat.com/show_bug.cgi?id=571508
 
 i will try that Patrick and post the results.
 
 Start to look for another solution :)
 
I know you posted it, but I must have deleted the message. Is the
drive connecting at full speed, or hi speed?

Mikkel
-- 

  Do not meddle in the affairs of dragons,
for thou art crunchy and taste good with Ketchup!



signature.asc
Description: OpenPGP digital signature
-- 
users mailing list
users@lists.fedoraproject.org
To unsubscribe or change subscription options:
https://admin.fedoraproject.org/mailman/listinfo/users
Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines


Re: Problem with an external usb HD - slow usb

2010-03-08 Thread Patrick O'Callaghan
On Mon, 2010-03-08 at 12:26 -0700, Paolo Galtieri wrote:
 On 03/08/2010 11:53 AM, Luigi Castro Cardeles wrote:
  2010/3/8 Patrick O'Callaghanpocallag...@gmail.com
 
  [Please don't top-post on this list]
 
  First of all, is this device a real hard disk, i.e. a mechanically
  rotating magnetic surface, or is it some kind of Flash drive?
   
  Hi,
  sorry for top post and sorry about the poor english.
  It is not a flash drive, is an real HD.
 
  I search a lot on www about this issue and the only clue i find is
  about sync/async option when mount the device and verify if it is
  connected to usb 2.0 hub.
  The strange thing is if i use windows to copy this diretory (drag on
  drop), the full operation last more or less two six (copy directory
  and umount - eject - the device),
  The same operation under fedora last a lot longer. (last day, i let
  the copy last for a full day and it is not finished - i pause in the
  middle).
 
  []'s
  Luigi Castro Cardeles
 
 
 I have a similar problem.  I have 2 external USB disk drives, one is 
 1.5TB the other 1TB.  Copies to and from the external disks to the local 
 disk, or between the 2 external disks, take a long time and while the 
 copy is going on the system is essentially unusable, e.g.. it can take 
 15 to 30 seconds for virtual desktops to update.  Moving the mouse is 
 very jerky, the mouse stops for 5 to 10 seconds then moves then stops 
 again.  I run netbeans IDE with the netbeans projects on one of the 
 external drives.  Even when I'm not doing anything with the IDE the disk 
 light on my laptop will go on solid for several minutes leading to slow 
 response times.
 
 I'm running on a 2Ghz Core 2 Duo processor with 2Gb memory.  What I 
 notice during the copies is that both CPUs are 75 - 90% in wait state.  
 I'm also running an encrypted root file system.
 
 The problem is really bad when I try running VMware Workstation 7.  The 
 virtual machines are all located on one of the external disks.   When I 
 run one VM the system response time on the system degrades significantly 
 as noted above and I have to shutdown the VM if I want to get anything 
 done.

Random comments:

* Are the two disks on the same USB bus (use lsusb to check)? If so,
move one of them.

* USB is a cpu-intensive protocol (compared with Firewire or SATA) since
it basically doesn't do any DMA, i.e. every 1kb or whatever protocol
transfer requires cpu intervention. The wire speed is only part of the
story.

* If your VM is configured with a lot of RAM, your host will tend to
swap more, but on your swap device which is probably SATA (you aren't
using the USB disks as swap are you?). If it's configured with less RAM,
the guest will swap more (between VM RAM and VM disk), which puts a
higher load on the kernel. You can try fiddling with the configuration
to see if it makes a difference.

poc

-- 
users mailing list
users@lists.fedoraproject.org
To unsubscribe or change subscription options:
https://admin.fedoraproject.org/mailman/listinfo/users
Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines


Re: Problem with an external usb HD - slow usb

2010-03-08 Thread Luigi Castro Cardeles
2010/3/8 Mikkel mik...@infinity-ltd.com:
 I know you posted it, but I must have deleted the message. Is the
 drive connecting at full speed, or hi speed?

 Mikkel
 --

  Do not meddle in the affairs of dragons,
 for thou art crunchy and taste good with Ketchup!


 --
 users mailing list
 users@lists.fedoraproject.org
 To unsubscribe or change subscription options:
 https://admin.fedoraproject.org/mailman/listinfo/users
 Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines



Hi Mikkel,

cat /var/log/messages

usb 2-2: new high speed USB device using ehci_hcd

[]'s
-- 
users mailing list
users@lists.fedoraproject.org
To unsubscribe or change subscription options:
https://admin.fedoraproject.org/mailman/listinfo/users
Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines


Re: Problem with an external usb HD - slow usb

2010-03-08 Thread Mikkel
On 03/08/2010 08:17 PM, Luigi Castro Cardeles wrote:
 
 Hi Mikkel,
 
 cat /var/log/messages
 
 usb 2-2: new high speed USB device using ehci_hcd
 
That is another reason your drive is slow. You are connected at USB
1.1 speeds, instead of USB 2.0 speeds.

new full speed USB device using ohci_hcd

It does not make a lot of sense, but the speeds go:

slow speed
high speed
full speed

Mikkel
-- 

  Do not meddle in the affairs of dragons,
for thou art crunchy and taste good with Ketchup!



signature.asc
Description: OpenPGP digital signature
-- 
users mailing list
users@lists.fedoraproject.org
To unsubscribe or change subscription options:
https://admin.fedoraproject.org/mailman/listinfo/users
Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines


Re: Problem with an external usb HD - slow usb

2010-03-08 Thread Paolo Galtieri
On 03/08/2010 06:16 PM, Patrick O'Callaghan wrote:
 On Mon, 2010-03-08 at 12:26 -0700, Paolo Galtieri wrote:

 On 03/08/2010 11:53 AM, Luigi Castro Cardeles wrote:
  
 2010/3/8 Patrick O'Callaghanpocallag...@gmail.com


 [Please don't top-post on this list]

 First of all, is this device a real hard disk, i.e. a mechanically
 rotating magnetic surface, or is it some kind of Flash drive?

  
 Hi,
 sorry for top post and sorry about the poor english.
 It is not a flash drive, is an real HD.

 I search a lot on www about this issue and the only clue i find is
 about sync/async option when mount the device and verify if it is
 connected to usb 2.0 hub.
 The strange thing is if i use windows to copy this diretory (drag on
 drop), the full operation last more or less two six (copy directory
 and umount - eject - the device),
 The same operation under fedora last a lot longer. (last day, i let
 the copy last for a full day and it is not finished - i pause in the
 middle).

 []'s
 Luigi Castro Cardeles


 I have a similar problem.  I have 2 external USB disk drives, one is
 1.5TB the other 1TB.  Copies to and from the external disks to the local
 disk, or between the 2 external disks, take a long time and while the
 copy is going on the system is essentially unusable, e.g.. it can take
 15 to 30 seconds for virtual desktops to update.  Moving the mouse is
 very jerky, the mouse stops for 5 to 10 seconds then moves then stops
 again.  I run netbeans IDE with the netbeans projects on one of the
 external drives.  Even when I'm not doing anything with the IDE the disk
 light on my laptop will go on solid for several minutes leading to slow
 response times.

 I'm running on a 2Ghz Core 2 Duo processor with 2Gb memory.  What I
 notice during the copies is that both CPUs are 75 - 90% in wait state.
 I'm also running an encrypted root file system.

 The problem is really bad when I try running VMware Workstation 7.  The
 virtual machines are all located on one of the external disks.   When I
 run one VM the system response time on the system degrades significantly
 as noted above and I have to shutdown the VM if I want to get anything
 done.
  
 Random comments:

 * Are the two disks on the same USB bus (use lsusb to check)? If so,
 move one of them.

 * USB is a cpu-intensive protocol (compared with Firewire or SATA) since
 it basically doesn't do any DMA, i.e. every 1kb or whatever protocol
 transfer requires cpu intervention. The wire speed is only part of the
 story.

 * If your VM is configured with a lot of RAM, your host will tend to
 swap more, but on your swap device which is probably SATA (you aren't
 using the USB disks as swap are you?). If it's configured with less RAM,
 the guest will swap more (between VM RAM and VM disk), which puts a
 higher load on the kernel. You can try fiddling with the configuration
 to see if it makes a difference.

 poc


The drives are on different busses. One drive is plugged into a hub the 
other directly into the laptop.  The VM is configured with 1Gb of RAM 
which is half the total amount.  Obviously increasing the system RAM 
will help some.  The swap partition is on the system drive.  I'll take a 
look at the VM configus and see if there is anything I can change.   All 
the partitions on the 2 external USB drives are ntfs so there is that 
issue as well.  I'll do some playing around.

Thanks,
Paolo
-- 
users mailing list
users@lists.fedoraproject.org
To unsubscribe or change subscription options:
https://admin.fedoraproject.org/mailman/listinfo/users
Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines


Problem with an external usb HD - slow usb

2010-03-06 Thread Luigi Castro Cardeles
Hi list,

I use fedora 12 on a dell inspiron 1545 laptop.
(2.6.31.12-174.2.22.fc12.x86_64).
i have a external usb hd and i can't make it connect like a usb 2.0 device.
this device is ntfs format

I check if the device is using ehci (dmesg after i plug the device)
[r...@localhost ~]# dmesg | grep USB
usb 2-2: new high speed USB device using ehci_hcd and address 2

I check if this device is connected on a usb 2.0
[r...@localhost ~]# lsusb
Bus 008 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub
Bus 002 Device 015: ID 0471:2021 Philips
Bus 002 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub

I mount the device with this options:
/dev/sdc1 on /media/hd_backup type fuseblk
(rw,nosuid,nodev,allow_other,blksize=4096)

but when i use cp, mv or rsync, the max speed i get is max 6MB/s (a lot
800kB/s).
If i use this device on Windows (tested with Vista and Seven), i get much
high transfer rate.
I read about sync and async options, but if i put sync or async on fstab, it
does not alter the transfer rate.

Is this the normal upload transfer rate? I am doing something wrong?

[]'s
Luigi Castro Cardeles
-- 
users mailing list
users@lists.fedoraproject.org
To unsubscribe or change subscription options:
https://admin.fedoraproject.org/mailman/listinfo/users
Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines


Re: Problem with an external usb HD - slow usb

2010-03-06 Thread Patrick O'Callaghan
On Sat, 2010-03-06 at 11:05 -0300, Luigi Castro Cardeles wrote:
 Hi list,
 
 
 I use fedora 12 on a dell inspiron 1545 laptop.
 (2.6.31.12-174.2.22.fc12.x86_64).
 i have a external usb hd and i can't make it connect like a usb 2.0
 device.
 this device is ntfs format
 
 
 I check if the device is using ehci (dmesg after i plug the device)
 [r...@localhost ~]# dmesg | grep USB
 usb 2-2: new high speed USB device using ehci_hcd and address 2
 
 
 I check if this device is connected on a usb 2.0 
 [r...@localhost ~]# lsusb
 Bus 008 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub
 Bus 002 Device 015: ID 0471:2021 Philips 
 Bus 002 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
 
 
 I mount the device with this options:
 /dev/sdc1 on /media/hd_backup type fuseblk
 (rw,nosuid,nodev,allow_other,blksize=4096)
 
 
 but when i use cp, mv or rsync, the max speed i get is max 6MB/s (a
 lot 800kB/s).
 If i use this device on Windows (tested with Vista and Seven), i get
 much high transfer rate.
 I read about sync and async options, but if i put sync or async on
 fstab, it does not alter the transfer rate.
 
 
 Is this the normal upload transfer rate? I am doing something wrong?

Try this as an experiment:

echo 1024  /sys/block/sdc/device/max_sectors

and repeat your I/O measurement.

poc


-- 
users mailing list
users@lists.fedoraproject.org
To unsubscribe or change subscription options:
https://admin.fedoraproject.org/mailman/listinfo/users
Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines