Re: [Bug-wget] Filename size limit
Hello David Pérez Fernández, Am 2011-07-20 08:42:46, hacktest Du folgendes herunter: I´m using Wget on Windows Vista and it runs faster than other web crawlers (like Httrack). Sometimes filename length exceeds the filesystem limit (in Vista this limit it is 260 characters included the folder name). Are you sure it is INCLUDING the Path? I have PATH + FELENAME much longer then 260 Characters. It is Windows (Win7, Viasco, XP) which write it on my Samba Server Is there any option to use a hash function (SHA, MD5 ) to code filenames in a shorter way? Is there any plan to implement it? Use the -O filename option Thanks, Greetings and nice Day/Evening Michelle Konzack -- # Debian GNU/Linux Consultant ## Development of Intranet and Embedded Systems with Debian GNU/Linux itsystems@tdnet Franceitsystems@tdnet Owner Michelle KonzackOwner Michelle Konzack Apt. 917 (homeoffice) Gewerbe Straße 3 50, rue de Soultz 77694 Kehl/Germany 67100 Strasbourg/France Tel: +49-177-9351947 mobil Tel: +33-6-61925193 mobil Tel: +49-176-86004575 office http://www.itsystems.tamay-dogan.net/ http://www.flexray4linux.org/ http://www.debian.tamay-dogan.net/ http://www.can4linux.org/ Jabber linux4miche...@jabber.ccc.de ICQ#328449886 Linux-User #280138 with the Linux Counter, http://counter.li.org/ signature.pgp Description: Digital signature
[Bug-wget] Re: Re: Re: Storing the URL in extended attributes
Hello Stefan Tomanek, Am 2010-10-18 23:11:58, hacktest Du folgendes herunter: Do you think SELinux, ACLs etc. are good ideas? They are based on the same principles. SELinux absolutely no. ACLs are only very rarely used by me. I had a filesystem with 15 U320 (230 MByte/sec) drives of 300 GByte, mean realy fast and expensive drives but with arround 180mio INODES it took more then 3 days to recover from a crash, since then I have stoped SELinux and ACL plus some other tools which write several million ZERO size files into the filesystem. The biggest problem was, I was not warned about this mess. Same for The Gimp and VLC, mean, I set the diretory permission to 000 and does not more allow to write to it. If a program crash because it can not write its crap, I deinstall it and will never recommend it to anyone.. Note: Programs which disallow to disable such things are crap. So for wget it should only be used if the user set explicite a commandline option or in the wgetrc. Of course, it should not activated hardcoded or as a default in the wgetrc. Thanks, Greetings and nice Day/Evening Michelle Konzack -- # Debian GNU/Linux Consultant ## Development of Intranet and Embedded Systems with Debian GNU/Linux itsyst...@tdnet France EURL itsyst...@tdnet UG (limited liability) Owner Michelle KonzackOwner Michelle Konzack Apt. 917 (homeoffice) 50, rue de Soultz Kinzigstraße 17 67100 Strasbourg/France 77694 Kehl/Germany Tel: +33-6-61925193 mobil Tel: +49-177-9351947 mobil Tel: +33-9-52705884 fix http://www.itsystems.tamay-dogan.net/ http://www.flexray4linux.org/ http://www.debian.tamay-dogan.net/ http://www.can4linux.org/ Jabber linux4miche...@jabber.ccc.de ICQ#328449886 Linux-User #280138 with the Linux Counter, http://counter.li.org/ signature.pgp Description: Digital signature
[Bug-wget] Re: Re: Storing the URL in extended attributes
Hello Stefan Tomanek, Am 2010-10-18 12:45:38, hacktest Du folgendes herunter: Dies schrieb Michelle Konzack (linux4miche...@tamay-dogan.net): http://github.com/wertarbyte/wget/tree/xattrurl I am right that this works only on Windos and not GNU/Linux? However, such function would be very handy. Probably the other way around, since I do not have any windows system in my reach. I am however refining the patch in collaboration with the curl crowd, making it even more useful. Freedesktop.org has a list of proposed extended attributes that might be useful: http://freedesktop.org/wiki/CommonExtendedAttributes Does this mean, for each file I download it create an extra file? Thats not realy funny, because my wget downloads daily more then 40.000 files and since I use an NFSv4 server as /home/ shared with arround 80 users this thing would consume several million inodes per month. I have already set the directory ~/.cache/vlc/art to 04 because I was running of of diskspace and inodes with several GBytes and million of Inodes of crappy no usable microfiles which VLC has downloaded non-asked from the internet or wherelse. This is the same crap with GIMP which created last year more then 23.000.000 thumbnails. Sorry, but such things are not welcome here. Note: My fileserver has 13 TByte (Raid-5) of diskspace and nearly 400.000.000 inodes with blocksize of 4 kByte I have already moved the Maildirs to another Volume to minimize the risk of dataloss since we have more then 48.000.000 Messages in our maildirs. Du you realy think this kind of attr is a good idea? Immagine you download 1mio files and have each file with ExtAttr which double the inodes and if your system crash, it require nearly 4 times longer to recover Thanks, Greetings and nice Day/Evening Michelle Konzack -- # Debian GNU/Linux Consultant ## Development of Intranet and Embedded Systems with Debian GNU/Linux itsyst...@tdnet France EURL itsyst...@tdnet UG (limited liability) Owner Michelle KonzackOwner Michelle Konzack Apt. 917 (homeoffice) 50, rue de Soultz Kinzigstraße 17 67100 Strasbourg/France 77694 Kehl/Germany Tel: +33-6-61925193 mobil Tel: +49-177-9351947 mobil Tel: +33-9-52705884 fix http://www.itsystems.tamay-dogan.net/ http://www.flexray4linux.org/ http://www.debian.tamay-dogan.net/ http://www.can4linux.org/ Jabber linux4miche...@jabber.ccc.de ICQ#328449886 Linux-User #280138 with the Linux Counter, http://counter.li.org/ signature.pgp Description: Digital signature
Re: [Bug-wget] Problem with Twitter Basic Authetification
Hello Roland Mösl, Am 2010-07-14 10:21:06, hacktest Du folgendes herunter: I use Perl and make the requests to Twitter.com with WGET. If you use already perl, why do you not use its native curl package? Thanks, Greetings and nice Day/Evening Michelle Konzack -- # Debian GNU/Linux Consultant ## Development of Intranet and Embedded Systems with Debian GNU/Linux itsyst...@tdnet France EURL itsyst...@tdnet UG (limited liability) Owner Michelle KonzackOwner Michelle Konzack Apt. 917 (homeoffice) 50, rue de Soultz Kinzigstraße 17 67100 Strasbourg/France 77694 Kehl/Germany Tel: +33-6-61925193 mobil Tel: +49-177-9351947 mobil Tel: +33-9-52705884 fix http://www.itsystems.tamay-dogan.net/ http://www.flexray4linux.org/ http://www.debian.tamay-dogan.net/ http://www.can4linux.org/ Jabber linux4miche...@jabber.ccc.de ICQ#328449886 Linux-User #280138 with the Linux Counter, http://counter.li.org/ signature.pgp Description: Digital signature
[Bug-wget] Re: Linux GUI for Wget:
Am 2009-10-17 19:05:40, schrieb Mr.Mizzen: Linux GUI for Wget: For those that might be interested, I have made a full featured GUI for Wget. Details and source are available at www.imperial-command.net/siteripper.html The GUI handles all Wget options. Perhaps the most important feature is the unlimited number of sessions that can be saved. The inspiration (and code) was from Grsync the GUI for rsync. As such, it was made with Glade and the code is C. If anyone needs to contact me, please send mail to mr.mizzen imperial-command.net Best regards, Bizzar, because I use under FVWM a GUI since more then 6 years... Also there is gwget which is a GNOME Front-End for wget. Do you know http://www.linuxberg.com/? There are more then 10 GUI Front-Ends Thanks, Greetings and nice Day/Evening Michelle Konzack Systemadministrator Tamay Dogan Network Debian GNU/Linux Consultant -- Linux-User #280138 with the Linux Counter, http://counter.li.org/ # Debian GNU/Linux Consultant # Michelle Konzack Apt. 917 ICQ #328449886 +49/177/935194750, rue de Soultz MSN LinuxMichi +33/6/61925193 67100 Strasbourg/France IRC #Debian (irc.icq.com) signature.pgp Description: Digital signature