Re: Problem with an external usb HD - slow usb
News: upgrade to fedora 13 and using ext4 filesystem = ~26MB/s []'s Luigi Castro Cardeles 2010/4/29 Luigi Castro Cardeles luigi.carde...@gmail.com Hi list, just to update: since kernel 2.6.32.11-99.fc12.x86_64, the usb speed with that device has improved to 8~6,5MB/s... []'s Luigi Castro Cardeles -- users mailing list users@lists.fedoraproject.org To unsubscribe or change subscription options: https://admin.fedoraproject.org/mailman/listinfo/users Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines
Re: Problem with an external usb HD - slow usb
On 08/03/2010 07:04 PM, Luigi Castro Cardeles wrote: News: upgrade to fedora 13 and using ext4 filesystem = ~26MB/s []'s Luigi Castro Cardeles 2010/4/29 Luigi Castro Cardeles luigi.carde...@gmail.com mailto:luigi.carde...@gmail.com Hi list, just to update: since kernel 2.6.32.11-99.fc12.x86_64, the usb speed with that device has improved to 8~6,5MB/s... []'s Luigi Castro Cardeles If you want even better performance, reiserfs4 was benchmarked to exceed ALL other Linux filesystems, including xfs, ext2/3/4 See http://kerneltrap.org/node/6776 -- users mailing list users@lists.fedoraproject.org To unsubscribe or change subscription options: https://admin.fedoraproject.org/mailman/listinfo/users Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines
Re: Problem with an external usb HD - slow usb
On Tue, Aug 3, 2010 at 10:12 PM, JD jd1...@gmail.com wrote: If you want even better performance, reiserfs4 was benchmarked to exceed ALL other Linux filesystems, including xfs, ext2/3/4 See http://kerneltrap.org/node/6776 How do you get that from your link? The article has nothing to do with Reiser 4 and the post from Hans Resier containing the clams you make is from 2006 (4 years ago, before he went to prison, where he remains). What does this have to do with Reiser 4 vs. ext4 performance *today*, 4 years later? -- Chris -- users mailing list users@lists.fedoraproject.org To unsubscribe or change subscription options: https://admin.fedoraproject.org/mailman/listinfo/users Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines
Re: Problem with an external usb HD - slow usb
On 08/03/2010 09:31 PM, Christofer C. Bell wrote: On Tue, Aug 3, 2010 at 10:12 PM, JDjd1...@gmail.com wrote: If you want even better performance, reiserfs4 was benchmarked to exceed ALL other Linux filesystems, including xfs, ext2/3/4 See http://kerneltrap.org/node/6776 How do you get that from your link? The article has nothing to do with Reiser 4 and the post from Hans Resier containing the clams you make is from 2006 (4 years ago, before he went to prison, where he remains). What does this have to do with Reiser 4 vs. ext4 performance *today*, 4 years later? Here is the conclusion from 2009: Conclusion: REISERFS and JFS are pretty close contenders for first place, followed by BTRFS and EXT4. Good old EXT3 would be my pick for fifth, leaving XFS and the still immature, but interesting log based filesystem NILFS2 in last place. At URL: http://agcbsm.blogspot.com/2009/12/linux-filesystem-benchmarks.html Also, benchmarks in 2008: Ext4 is great for /small/ files read, read+write, and delete. But for /medium/ files, resiserfs outshines it by a very good margin. Ditto for /large/ files read+write - resierfs shines the best. See http://www.jejik.com/articles/2008/04/benchmarking_linux_filesystems_on_software_raid_1/ unfortunately, there is a dearth of /official/ benchmarks for linux filesystems that are very recent (ca. 2009/2010). -- users mailing list users@lists.fedoraproject.org To unsubscribe or change subscription options: https://admin.fedoraproject.org/mailman/listinfo/users Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines
Re: Problem with an external usb HD - slow usb
Hi list, just to update: since kernel 2.6.32.11-99.fc12.x86_64, the usb speed with that device has improved to 8~6,5MB/s... []'s Luigi Castro Cardeles -- users mailing list users@lists.fedoraproject.org To unsubscribe or change subscription options: https://admin.fedoraproject.org/mailman/listinfo/users Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines
Re: Problem with an external usb HD - slow usb
On Fri, 2010-03-12 at 03:36 -0800, Don Quixote de la Mancha wrote: On Thu, Mar 11, 2010 at 10:54 AM, Patrick O'Callaghan pocallag...@gmail.com wrote: It's likely that the disk came with a special driver for Windows, whereas the Linux version is using a generic driver. I'd guess the answer is probably in the Windows driver code, but of course it will be binary and proprietary so it's of no use to anyone. There are lots of I/O devices that claim to comply with some published protocol, but really don't. Some operating systems deal with this by providing special-case code for particular devices that, while strictly speaking violate the protocols, at least get the device working for the user. Many devices provide unique vendor and device IDs that can be used to know when such workarounds need to be activated. I know that Linux includes such code to support otherwise broken microprocessors. I don't know whether it also provides support for broken USB storage devices. A specific example is that I can recall a post to one of the FreeBSD lists which mentioned the addition of a special workaround for the Kingston USB Flash drives. Interesting. I have a couple of these. Do you have a more specific reference? Google shows a bunch of stuff but nothing that indicates any specific issue with Kingston versus other brands. poc -- users mailing list users@lists.fedoraproject.org To unsubscribe or change subscription options: https://admin.fedoraproject.org/mailman/listinfo/users Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines
Re: Problem with an external usb HD - slow usb
On Wed, 2010-03-10 at 10:28 -0300, Luigi Castro Cardeles wrote: 2010/3/9 Roberto Ragusa m...@robertoragusa.it: Luigi Castro Cardeles wrote: 2010/3/9 Mikkel mik...@infinity-ltd.com: slow speed high speed full speed so: low-speed - uhci full-speed - ohci high-speed - ehci When the USB group created the 2.0 specifications it made a good effort to confuse good speed (480Mbit/s) with awful speed (12Mbit/s) devices, so to manage to sell all the ancient stuff by putting a USB2.0 label on them. This thread clearly demonstrates how successful they were. :-( -- Roberto Ragusamail at robertoragusa.it -- users mailing list users@lists.fedoraproject.org To unsubscribe or change subscription options: https://admin.fedoraproject.org/mailman/listinfo/users Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines but using the same external hd on windows is faster then on linux... at that point, i am trying to understand that :D the device is: philips case sde3275fc/97 still struggling with that. It's likely that the disk came with a special driver for Windows, whereas the Linux version is using a generic driver. I'd guess the answer is probably in the Windows driver code, but of course it will be binary and proprietary so it's of no use to anyone. poc -- users mailing list users@lists.fedoraproject.org To unsubscribe or change subscription options: https://admin.fedoraproject.org/mailman/listinfo/users Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines
Re: Problem with an external usb HD - slow usb
Patrick O'Callaghan wrote: [...] It's likely that the disk came with a special driver for Windows, whereas the Linux version is using a generic driver. I'd guess the answer is probably in the Windows driver code, but of course it will be binary and proprietary so it's of no use to anyone. Clearly it's of _some_ use to _someone_. It just isn't of use to _you_. Mike -- p=p=%c%s%c;main(){printf(p,34,p,34);};main(){printf(p,34,p,34);} Oppose globalization and One World Governments like the UN. This message made from 100% recycled bits. You have found the bank of Larn. I speak only for myself, and I am unanimous in that! -- users mailing list users@lists.fedoraproject.org To unsubscribe or change subscription options: https://admin.fedoraproject.org/mailman/listinfo/users Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines
Re: Problem with an external usb HD - slow usb
On Thu, 2010-03-11 at 18:13 -0600, Mike McCarty wrote: Patrick O'Callaghan wrote: [...] It's likely that the disk came with a special driver for Windows, whereas the Linux version is using a generic driver. I'd guess the answer is probably in the Windows driver code, but of course it will be binary and proprietary so it's of no use to anyone. Clearly it's of _some_ use to _someone_. It just isn't of use to _you_. No, it's of no use to anyone using a non-Windows system. Isn't that what we're talking about on this list? poc -- users mailing list users@lists.fedoraproject.org To unsubscribe or change subscription options: https://admin.fedoraproject.org/mailman/listinfo/users Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines
Re: Problem with an external usb HD - slow usb
Patrick O'Callaghan wrote: On Thu, 2010-03-11 at 18:13 -0600, Mike McCarty wrote: Clearly it's of _some_ use to _someone_. It just isn't of use to _you_. No, it's of no use to anyone using a non-Windows system. Isn't that what we're talking about on this list? There are those who install Windows drivers on Linux systems. Mike -- p=p=%c%s%c;main(){printf(p,34,p,34);};main(){printf(p,34,p,34);} Oppose globalization and One World Governments like the UN. This message made from 100% recycled bits. You have found the bank of Larn. I speak only for myself, and I am unanimous in that! -- users mailing list users@lists.fedoraproject.org To unsubscribe or change subscription options: https://admin.fedoraproject.org/mailman/listinfo/users Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines
Re: Problem with an external usb HD - slow usb
Patrick O'Callaghan wrote: On Thu, 2010-03-11 at 18:13 -0600, Mike McCarty wrote: Patrick O'Callaghan wrote: [...] It's likely that the disk came with a special driver for Windows, whereas the Linux version is using a generic driver. I'd guess the answer is probably in the Windows driver code, but of course it will be binary and proprietary so it's of no use to anyone. Clearly it's of _some_ use to _someone_. It just isn't of use to _you_. No, it's of no use to anyone using a non-Windows system. Isn't that what we're talking about on this list? Actually, my other reply wasn't quite apropos to your question in this exact context. This particular driver is not especially useful in this particular context, except as a comparison of what can be done using the exact same hardware. Also, people who use Fedora use it on dual boot systems. This echo is Community support for Fedora users, some of whom are also Windows (of various versions) users. Comparisons and contrasts between the performance of the identical same hardware using different drivers is of definite benefit for diagnostic purposes. However, in a broader context, simply because a driver is closed source and proprietary does not mean that it is of no use to anyone. AIUI, nVidia provides some Linux drivers which are closed, and used by people here, as an example. Mike -- p=p=%c%s%c;main(){printf(p,34,p,34);};main(){printf(p,34,p,34);} Oppose globalization and One World Governments like the UN. This message made from 100% recycled bits. You have found the bank of Larn. I speak only for myself, and I am unanimous in that! -- users mailing list users@lists.fedoraproject.org To unsubscribe or change subscription options: https://admin.fedoraproject.org/mailman/listinfo/users Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines
Re: Problem with an external usb HD - slow usb
On Thu, 2010-03-11 at 19:24 -0600, Mike McCarty wrote: Patrick O'Callaghan wrote: On Thu, 2010-03-11 at 18:13 -0600, Mike McCarty wrote: Patrick O'Callaghan wrote: [...] It's likely that the disk came with a special driver for Windows, whereas the Linux version is using a generic driver. I'd guess the answer is probably in the Windows driver code, but of course it will be binary and proprietary so it's of no use to anyone. Clearly it's of _some_ use to _someone_. It just isn't of use to _you_. No, it's of no use to anyone using a non-Windows system. Isn't that what we're talking about on this list? Actually, my other reply wasn't quite apropos to your question in this exact context. This particular driver is not especially useful in this particular context, except as a comparison of what can be done using the exact same hardware. Also, people who use Fedora use it on dual boot systems. This echo is Community support for Fedora users, some of whom are also Windows (of various versions) users. Comparisons and contrasts between the performance of the identical same hardware using different drivers is of definite benefit for diagnostic purposes. Of course. That's why I brought it up in the first place. However, in a broader context, simply because a driver is closed source and proprietary does not mean that it is of no use to anyone. AIUI, nVidia provides some Linux drivers which are closed, and used by people here, as an example. I made no such generalization. You're taking a far too literal reading of an off-the-cuff phrase, and missing the point I was trying to make, to wit, that proprietary (and usually undocumented) drivers can do anything at all and we aren't going to know about it without enormous effort. IOW what can be done with the exact same hardware in practice *cannot* be done except via the proprietary driver. The OP's question about his disk system performance could well be unanswerable. All this is of course completely hypothetical. poc -- users mailing list users@lists.fedoraproject.org To unsubscribe or change subscription options: https://admin.fedoraproject.org/mailman/listinfo/users Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines
Re: Problem with an external usb HD - slow usb
2010/3/9 Mikkel mik...@infinity-ltd.com: On 03/08/2010 08:17 PM, Luigi Castro Cardeles wrote: Hi Mikkel, cat /var/log/messages usb 2-2: new high speed USB device using ehci_hcd That is another reason your drive is slow. You are connected at USB 1.1 speeds, instead of USB 2.0 speeds. new full speed USB device using ohci_hcd It does not make a lot of sense, but the speeds go: slow speed high speed full speed Mikkel -- Do not meddle in the affairs of dragons, for thou art crunchy and taste good with Ketchup! -- users mailing list users@lists.fedoraproject.org To unsubscribe or change subscription options: https://admin.fedoraproject.org/mailman/listinfo/users Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines Hi, This is from tuxdera: USB is running in Low-Speed (0.1875 MB/sec) or Full-Speed (maximum 1.5 MB/sec) mode instead of High-Speed mode (maximum 60 MB/sec). from linux-usb: http://www.linux-usb.org/FAQ.html#gs6; so: low-speed - uhci full-speed - ohci high-speed - ehci no? []'s Luigi Castro Cardeles -- users mailing list users@lists.fedoraproject.org To unsubscribe or change subscription options: https://admin.fedoraproject.org/mailman/listinfo/users Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines
Re: Problem with an external usb HD - slow usb
Luigi Castro Cardeles wrote: 2010/3/9 Mikkel mik...@infinity-ltd.com: slow speed high speed full speed so: low-speed - uhci full-speed - ohci high-speed - ehci When the USB group created the 2.0 specifications it made a good effort to confuse good speed (480Mbit/s) with awful speed (12Mbit/s) devices, so to manage to sell all the ancient stuff by putting a USB2.0 label on them. This thread clearly demonstrates how successful they were. :-( -- Roberto Ragusamail at robertoragusa.it -- users mailing list users@lists.fedoraproject.org To unsubscribe or change subscription options: https://admin.fedoraproject.org/mailman/listinfo/users Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines
Re: Problem with an external usb HD - slow usb
Hi list and Patrick, the default max_sectors is 240. I change this to 1024 like you said but the problem continue. If i try the speed: time dd if=/dev/sdc1 of=/dev/null bs=1M count=5 i get that speed: 972 MB/s but if i run rsync, the upload transfer rate is very slow ( begins at 4MB/s and goes below until 0.7KB/s) []'s Luigi Castro Cardeles 2010/3/6 Patrick O'Callaghan pocallag...@gmail.com On Sat, 2010-03-06 at 11:05 -0300, Luigi Castro Cardeles wrote: Hi list, I use fedora 12 on a dell inspiron 1545 laptop. (2.6.31.12-174.2.22.fc12.x86_64). i have a external usb hd and i can't make it connect like a usb 2.0 device. this device is ntfs format I check if the device is using ehci (dmesg after i plug the device) [r...@localhost ~]# dmesg | grep USB usb 2-2: new high speed USB device using ehci_hcd and address 2 I check if this device is connected on a usb 2.0 [r...@localhost ~]# lsusb Bus 008 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub Bus 002 Device 015: ID 0471:2021 Philips Bus 002 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub I mount the device with this options: /dev/sdc1 on /media/hd_backup type fuseblk (rw,nosuid,nodev,allow_other,blksize=4096) but when i use cp, mv or rsync, the max speed i get is max 6MB/s (a lot 800kB/s). If i use this device on Windows (tested with Vista and Seven), i get much high transfer rate. I read about sync and async options, but if i put sync or async on fstab, it does not alter the transfer rate. Is this the normal upload transfer rate? I am doing something wrong? Try this as an experiment: echo 1024 /sys/block/sdc/device/max_sectors and repeat your I/O measurement. poc -- users mailing list users@lists.fedoraproject.org To unsubscribe or change subscription options: https://admin.fedoraproject.org/mailman/listinfo/users Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines -- users mailing list users@lists.fedoraproject.org To unsubscribe or change subscription options: https://admin.fedoraproject.org/mailman/listinfo/users Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines
Re: Problem with an external usb HD - slow usb
Am Montag, den 08.03.2010, 12:16 -0300 schrieb Luigi Castro Cardeles: the default max_sectors is 240. I change this to 1024 like you said but the problem continue. time dd if=/dev/sdc1 of=/dev/null bs=1M count=5 i get that speed: 972 MB/s but if i run rsync, the upload transfer rate is very slow ( begins at 4MB/s and goes below until 0.7KB/s) Type of filesystem (ext3, ntfs)? Any noticeable messages on dmesg? Whta does top tracing reports while transferring? Maybe you can also check /var/log/messages Let us know. -- Rodolfo Alcazar Portillo - nosp...@gmail.com otbits.blogspot.com / counter.li.org: #367962 -- (setq wq This is emacs, not vi) -- Ingvar -- users mailing list users@lists.fedoraproject.org To unsubscribe or change subscription options: https://admin.fedoraproject.org/mailman/listinfo/users Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines
Re: Problem with an external usb HD - slow usb
Hi, ntfs. Nothing strange on dmesg or /var/log/messages. There is something strange: i set a line on fstab with some options (rw,async) but when i mount (mount -a), i get this: type fuseblk (rw,nosuid,nodev,allow_other,blksize=4096) I found a bug about this: https://bugzilla.redhat.com/show_bug.cgi?id=474282but it is closed but not solved (i think). I filled a this: https://bugzilla.redhat.com/show_bug.cgi?id=571508. I also find this: http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=537336(not fedora but related i think). []'s Luigi Castro Cardeles 2010/3/8 NoSpaze nosp...@gmail.com Am Montag, den 08.03.2010, 12:16 -0300 schrieb Luigi Castro Cardeles: the default max_sectors is 240. I change this to 1024 like you said but the problem continue. time dd if=/dev/sdc1 of=/dev/null bs=1M count=5 i get that speed: 972 MB/s but if i run rsync, the upload transfer rate is very slow ( begins at 4MB/s and goes below until 0.7KB/s) Type of filesystem (ext3, ntfs)? Any noticeable messages on dmesg? Whta does top tracing reports while transferring? Maybe you can also check /var/log/messages Let us know. -- Rodolfo Alcazar Portillo - nosp...@gmail.com otbits.blogspot.com / counter.li.org: #367962 -- (setq wq This is emacs, not vi) -- Ingvar -- users mailing list users@lists.fedoraproject.org To unsubscribe or change subscription options: https://admin.fedoraproject.org/mailman/listinfo/users Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines -- users mailing list users@lists.fedoraproject.org To unsubscribe or change subscription options: https://admin.fedoraproject.org/mailman/listinfo/users Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines
Re: Problem with an external usb HD - slow usb
On Mon, 2010-03-08 at 12:16 -0300, Luigi Castro Cardeles wrote: Hi list and Patrick, the default max_sectors is 240. I change this to 1024 like you said but the problem continue. If i try the speed: time dd if=/dev/sdc1 of=/dev/null bs=1M count=5 i get that speed: 972 MB/s but if i run rsync, the upload transfer rate is very slow ( begins at 4MB/s and goes below until 0.7KB/s) [Please don't top-post on this list] First of all, is this device a real hard disk, i.e. a mechanically rotating magnetic surface, or is it some kind of Flash drive? If it's the latter, then read on. I've been looking into this recently because of wildly varying performance when writing to a pendrive. It turns out that Flash memory isn't really random access when it comes to writing (reading is OK though). Quick summary: The Flash technology only allows writing zeroes, not ones, and is organized in blocks of say 128 or 512 bytes (this varies according to manufacturer) so to write some binary data in the middle of an existing block the procedure is: 1) Read the entire block to some short-term scratch memory 2) Reset the block to all 1's. 3) Modify the scratch memory with the new bits 4) Copy the 0 bits of the scratch to the Flash block (all this happens inside the drive of course; AFAIK it's not visible even at the level of the kernel driver). This process takes a very long time, and when you're repeatedly writing small amounts of data (e.g. to update a directory) it all has to be done multiple times, even for the same drive block. A few days ago I copied a 2GB file to an existing VFAT filesystem on an 8GB pendrive, reputedly one of the fastest on the market. It took over two hours. I then tried just simply copying the data directly to the drive using 'dd' (i.e. no filesystem). It finished in under 5 minutes. BTW, rsync is a killer on these drives because it adds another layer of reading and hashing. In this particular case it's a false economy. poc -- users mailing list users@lists.fedoraproject.org To unsubscribe or change subscription options: https://admin.fedoraproject.org/mailman/listinfo/users Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines
Re: Problem with an external usb HD - slow usb
2010/3/8 Patrick O'Callaghan pocallag...@gmail.com [Please don't top-post on this list] First of all, is this device a real hard disk, i.e. a mechanically rotating magnetic surface, or is it some kind of Flash drive? Hi, sorry for top post and sorry about the poor english. It is not a flash drive, is an real HD. I search a lot on www about this issue and the only clue i find is about sync/async option when mount the device and verify if it is connected to usb 2.0 hub. The strange thing is if i use windows to copy this diretory (drag on drop), the full operation last more or less two six (copy directory and umount - eject - the device), The same operation under fedora last a lot longer. (last day, i let the copy last for a full day and it is not finished - i pause in the middle). []'s Luigi Castro Cardeles -- users mailing list users@lists.fedoraproject.org To unsubscribe or change subscription options: https://admin.fedoraproject.org/mailman/listinfo/users Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines
Re: Problem with an external usb HD - slow usb
On 03/08/2010 11:53 AM, Luigi Castro Cardeles wrote: 2010/3/8 Patrick O'Callaghanpocallag...@gmail.com [Please don't top-post on this list] First of all, is this device a real hard disk, i.e. a mechanically rotating magnetic surface, or is it some kind of Flash drive? Hi, sorry for top post and sorry about the poor english. It is not a flash drive, is an real HD. I search a lot on www about this issue and the only clue i find is about sync/async option when mount the device and verify if it is connected to usb 2.0 hub. The strange thing is if i use windows to copy this diretory (drag on drop), the full operation last more or less two six (copy directory and umount - eject - the device), The same operation under fedora last a lot longer. (last day, i let the copy last for a full day and it is not finished - i pause in the middle). []'s Luigi Castro Cardeles I have a similar problem. I have 2 external USB disk drives, one is 1.5TB the other 1TB. Copies to and from the external disks to the local disk, or between the 2 external disks, take a long time and while the copy is going on the system is essentially unusable, e.g.. it can take 15 to 30 seconds for virtual desktops to update. Moving the mouse is very jerky, the mouse stops for 5 to 10 seconds then moves then stops again. I run netbeans IDE with the netbeans projects on one of the external drives. Even when I'm not doing anything with the IDE the disk light on my laptop will go on solid for several minutes leading to slow response times. I'm running on a 2Ghz Core 2 Duo processor with 2Gb memory. What I notice during the copies is that both CPUs are 75 - 90% in wait state. I'm also running an encrypted root file system. The problem is really bad when I try running VMware Workstation 7. The virtual machines are all located on one of the external disks. When I run one VM the system response time on the system degrades significantly as noted above and I have to shutdown the VM if I want to get anything done. Paolo -- users mailing list users@lists.fedoraproject.org To unsubscribe or change subscription options: https://admin.fedoraproject.org/mailman/listinfo/users Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines
Re: Problem with an external usb HD - slow usb
On 03/08/2010 05:53 PM, Luigi Castro Cardeles wrote: well, ntfs filesystem doesn't accept async/sync param... Tom show that to me (man mount.ntfs-3g). https://bugzilla.redhat.com/show_bug.cgi?id=571508 i will try that Patrick and post the results. Start to look for another solution :) I know you posted it, but I must have deleted the message. Is the drive connecting at full speed, or hi speed? Mikkel -- Do not meddle in the affairs of dragons, for thou art crunchy and taste good with Ketchup! signature.asc Description: OpenPGP digital signature -- users mailing list users@lists.fedoraproject.org To unsubscribe or change subscription options: https://admin.fedoraproject.org/mailman/listinfo/users Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines
Re: Problem with an external usb HD - slow usb
On Mon, 2010-03-08 at 12:26 -0700, Paolo Galtieri wrote: On 03/08/2010 11:53 AM, Luigi Castro Cardeles wrote: 2010/3/8 Patrick O'Callaghanpocallag...@gmail.com [Please don't top-post on this list] First of all, is this device a real hard disk, i.e. a mechanically rotating magnetic surface, or is it some kind of Flash drive? Hi, sorry for top post and sorry about the poor english. It is not a flash drive, is an real HD. I search a lot on www about this issue and the only clue i find is about sync/async option when mount the device and verify if it is connected to usb 2.0 hub. The strange thing is if i use windows to copy this diretory (drag on drop), the full operation last more or less two six (copy directory and umount - eject - the device), The same operation under fedora last a lot longer. (last day, i let the copy last for a full day and it is not finished - i pause in the middle). []'s Luigi Castro Cardeles I have a similar problem. I have 2 external USB disk drives, one is 1.5TB the other 1TB. Copies to and from the external disks to the local disk, or between the 2 external disks, take a long time and while the copy is going on the system is essentially unusable, e.g.. it can take 15 to 30 seconds for virtual desktops to update. Moving the mouse is very jerky, the mouse stops for 5 to 10 seconds then moves then stops again. I run netbeans IDE with the netbeans projects on one of the external drives. Even when I'm not doing anything with the IDE the disk light on my laptop will go on solid for several minutes leading to slow response times. I'm running on a 2Ghz Core 2 Duo processor with 2Gb memory. What I notice during the copies is that both CPUs are 75 - 90% in wait state. I'm also running an encrypted root file system. The problem is really bad when I try running VMware Workstation 7. The virtual machines are all located on one of the external disks. When I run one VM the system response time on the system degrades significantly as noted above and I have to shutdown the VM if I want to get anything done. Random comments: * Are the two disks on the same USB bus (use lsusb to check)? If so, move one of them. * USB is a cpu-intensive protocol (compared with Firewire or SATA) since it basically doesn't do any DMA, i.e. every 1kb or whatever protocol transfer requires cpu intervention. The wire speed is only part of the story. * If your VM is configured with a lot of RAM, your host will tend to swap more, but on your swap device which is probably SATA (you aren't using the USB disks as swap are you?). If it's configured with less RAM, the guest will swap more (between VM RAM and VM disk), which puts a higher load on the kernel. You can try fiddling with the configuration to see if it makes a difference. poc -- users mailing list users@lists.fedoraproject.org To unsubscribe or change subscription options: https://admin.fedoraproject.org/mailman/listinfo/users Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines
Re: Problem with an external usb HD - slow usb
2010/3/8 Mikkel mik...@infinity-ltd.com: I know you posted it, but I must have deleted the message. Is the drive connecting at full speed, or hi speed? Mikkel -- Do not meddle in the affairs of dragons, for thou art crunchy and taste good with Ketchup! -- users mailing list users@lists.fedoraproject.org To unsubscribe or change subscription options: https://admin.fedoraproject.org/mailman/listinfo/users Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines Hi Mikkel, cat /var/log/messages usb 2-2: new high speed USB device using ehci_hcd []'s -- users mailing list users@lists.fedoraproject.org To unsubscribe or change subscription options: https://admin.fedoraproject.org/mailman/listinfo/users Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines
Re: Problem with an external usb HD - slow usb
On 03/08/2010 08:17 PM, Luigi Castro Cardeles wrote: Hi Mikkel, cat /var/log/messages usb 2-2: new high speed USB device using ehci_hcd That is another reason your drive is slow. You are connected at USB 1.1 speeds, instead of USB 2.0 speeds. new full speed USB device using ohci_hcd It does not make a lot of sense, but the speeds go: slow speed high speed full speed Mikkel -- Do not meddle in the affairs of dragons, for thou art crunchy and taste good with Ketchup! signature.asc Description: OpenPGP digital signature -- users mailing list users@lists.fedoraproject.org To unsubscribe or change subscription options: https://admin.fedoraproject.org/mailman/listinfo/users Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines
Re: Problem with an external usb HD - slow usb
On 03/08/2010 06:16 PM, Patrick O'Callaghan wrote: On Mon, 2010-03-08 at 12:26 -0700, Paolo Galtieri wrote: On 03/08/2010 11:53 AM, Luigi Castro Cardeles wrote: 2010/3/8 Patrick O'Callaghanpocallag...@gmail.com [Please don't top-post on this list] First of all, is this device a real hard disk, i.e. a mechanically rotating magnetic surface, or is it some kind of Flash drive? Hi, sorry for top post and sorry about the poor english. It is not a flash drive, is an real HD. I search a lot on www about this issue and the only clue i find is about sync/async option when mount the device and verify if it is connected to usb 2.0 hub. The strange thing is if i use windows to copy this diretory (drag on drop), the full operation last more or less two six (copy directory and umount - eject - the device), The same operation under fedora last a lot longer. (last day, i let the copy last for a full day and it is not finished - i pause in the middle). []'s Luigi Castro Cardeles I have a similar problem. I have 2 external USB disk drives, one is 1.5TB the other 1TB. Copies to and from the external disks to the local disk, or between the 2 external disks, take a long time and while the copy is going on the system is essentially unusable, e.g.. it can take 15 to 30 seconds for virtual desktops to update. Moving the mouse is very jerky, the mouse stops for 5 to 10 seconds then moves then stops again. I run netbeans IDE with the netbeans projects on one of the external drives. Even when I'm not doing anything with the IDE the disk light on my laptop will go on solid for several minutes leading to slow response times. I'm running on a 2Ghz Core 2 Duo processor with 2Gb memory. What I notice during the copies is that both CPUs are 75 - 90% in wait state. I'm also running an encrypted root file system. The problem is really bad when I try running VMware Workstation 7. The virtual machines are all located on one of the external disks. When I run one VM the system response time on the system degrades significantly as noted above and I have to shutdown the VM if I want to get anything done. Random comments: * Are the two disks on the same USB bus (use lsusb to check)? If so, move one of them. * USB is a cpu-intensive protocol (compared with Firewire or SATA) since it basically doesn't do any DMA, i.e. every 1kb or whatever protocol transfer requires cpu intervention. The wire speed is only part of the story. * If your VM is configured with a lot of RAM, your host will tend to swap more, but on your swap device which is probably SATA (you aren't using the USB disks as swap are you?). If it's configured with less RAM, the guest will swap more (between VM RAM and VM disk), which puts a higher load on the kernel. You can try fiddling with the configuration to see if it makes a difference. poc The drives are on different busses. One drive is plugged into a hub the other directly into the laptop. The VM is configured with 1Gb of RAM which is half the total amount. Obviously increasing the system RAM will help some. The swap partition is on the system drive. I'll take a look at the VM configus and see if there is anything I can change. All the partitions on the 2 external USB drives are ntfs so there is that issue as well. I'll do some playing around. Thanks, Paolo -- users mailing list users@lists.fedoraproject.org To unsubscribe or change subscription options: https://admin.fedoraproject.org/mailman/listinfo/users Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines
Problem with an external usb HD - slow usb
Hi list, I use fedora 12 on a dell inspiron 1545 laptop. (2.6.31.12-174.2.22.fc12.x86_64). i have a external usb hd and i can't make it connect like a usb 2.0 device. this device is ntfs format I check if the device is using ehci (dmesg after i plug the device) [r...@localhost ~]# dmesg | grep USB usb 2-2: new high speed USB device using ehci_hcd and address 2 I check if this device is connected on a usb 2.0 [r...@localhost ~]# lsusb Bus 008 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub Bus 002 Device 015: ID 0471:2021 Philips Bus 002 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub I mount the device with this options: /dev/sdc1 on /media/hd_backup type fuseblk (rw,nosuid,nodev,allow_other,blksize=4096) but when i use cp, mv or rsync, the max speed i get is max 6MB/s (a lot 800kB/s). If i use this device on Windows (tested with Vista and Seven), i get much high transfer rate. I read about sync and async options, but if i put sync or async on fstab, it does not alter the transfer rate. Is this the normal upload transfer rate? I am doing something wrong? []'s Luigi Castro Cardeles -- users mailing list users@lists.fedoraproject.org To unsubscribe or change subscription options: https://admin.fedoraproject.org/mailman/listinfo/users Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines
Re: Problem with an external usb HD - slow usb
On Sat, 2010-03-06 at 11:05 -0300, Luigi Castro Cardeles wrote: Hi list, I use fedora 12 on a dell inspiron 1545 laptop. (2.6.31.12-174.2.22.fc12.x86_64). i have a external usb hd and i can't make it connect like a usb 2.0 device. this device is ntfs format I check if the device is using ehci (dmesg after i plug the device) [r...@localhost ~]# dmesg | grep USB usb 2-2: new high speed USB device using ehci_hcd and address 2 I check if this device is connected on a usb 2.0 [r...@localhost ~]# lsusb Bus 008 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub Bus 002 Device 015: ID 0471:2021 Philips Bus 002 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub I mount the device with this options: /dev/sdc1 on /media/hd_backup type fuseblk (rw,nosuid,nodev,allow_other,blksize=4096) but when i use cp, mv or rsync, the max speed i get is max 6MB/s (a lot 800kB/s). If i use this device on Windows (tested with Vista and Seven), i get much high transfer rate. I read about sync and async options, but if i put sync or async on fstab, it does not alter the transfer rate. Is this the normal upload transfer rate? I am doing something wrong? Try this as an experiment: echo 1024 /sys/block/sdc/device/max_sectors and repeat your I/O measurement. poc -- users mailing list users@lists.fedoraproject.org To unsubscribe or change subscription options: https://admin.fedoraproject.org/mailman/listinfo/users Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines