RE: freebsd and utf-8 directory names
hi, as I said the evironment setting for the Hungarian local per the handb -Original Message- From: owner-freebsd-curr...@freebsd.org [mailto:owner-freebsd-curr...@freebsd.org] On Behalf Of Jamie Landeg-Jones Sent: Thursday, July 03, 2014 5:58 AM To: ke...@freebsd.org; d...@gmx.com Cc: freebsd-current@freebsd.org; thera...@freebsd.org Subject: Re: freebsd and utf-8 directory names Kevin Lo ke...@freebsd.org wrote: Well, I'm going to close that PR. :-) [ ... ] I basically replied with the same thing in a followup on the bug itself exactly 24 hours ago! :-) https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=191540 cheers, Jamie ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: freebsd and utf-8 directory names
Thanks for confirming this. I just closed that bug. :-) Kevin On Thu, Jul 03, 2014 at 05:24:54PM +0200, MS - Krasznai András wrote: Hi, Kevin, I made the experiment and there was no fault, the result contains the stat outputs. I used login-class (according to the handbook) to set the environment, and added the -L hu_HU.UTF-8 option to the appropriate line in fstab rgds András From: owner-freebsd-curr...@freebsd.org [owner-freebsd-curr...@freebsd.org] On Behalf Of Kevin Lo [ke...@freebsd.org] Sent: Thursday, July 03, 2014 5:33 AM To: d...@gmx.com Cc: freebsd-current@freebsd.org; David Chisnall Subject: Re: freebsd and utf-8 directory names On Wed, Jul 02, 2014 at 12:27:07AM +0200, d...@gmx.com wrote: David Chisnall wrote, On 07/01/2014 19:06: Please note that forums.freebsd.org is not a bug tracker. I tried searching the bug tracker for bugs with FAT and filename or FAT and utf-8/utf8/character in their names and could not find any reference to this issue. If you actually want to see bugs fixed, rather than just complain about them, please file them here: https://bugs.freebsd.org/bugzilla/enter_bug.cgi Make sure that you provide all of the steps required to reproduce them. I neglected to submit a bug report because: (1) there were already at least 3 bug reports related to (FAT32 and) character sets or encodings, some of them even had patches; (2) the reports were very old, indicating that the FreeBSD developers don't care about FAT32; (3) at least one report was seemingly related, and I didn't want to create a(nother) possible duplicate. But now, eat this: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=191540 Well, I'm going to close that PR. :-) First, set LANG environment variable to hu_HU.UTF-8 in your case: # setenv LANG hu_HU.UTF-8 Second, mount the FAT32 partition in Hungarian locale: # mount_msdosfs -L hu_HU.UTF-8 /dev/da0s1 /mnt Third, untar your attachement file: # tar xvf /mnt/files.zip x 1’.txt x 2–.txt # stat 1’.txt 128 244744 -rwxr-xr-x 1 root wheel 4294967295 0 Jan 1 08:00:00 1980 Aug 1 16:57:52 2011 Aug 1 16:57:52 2011 Jul 3 11:28:24 2014 16384 0 0x800 1’.txt # stat 2–.txt 128 244746 -rwxr-xr-x 1 root wheel 4294967295 0 Jan 1 08:00:00 1980 Aug 1 16:55:20 2011 Aug 1 16:55:20 2011 Jul 3 11:28:24 2014 16384 0 0x800 2–.txt Let me know if that works for you, thanks. Kevin ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: freebsd and utf-8 directory names
Kevin Lo wrote, On 07/03/2014 05:33: On Wed, Jul 02, 2014 at 12:27:07AM +0200, d...@gmx.com wrote: But now, eat this: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=191540 Well, I'm going to close that PR. :-) First, [...] Let me know if that works for you, thanks. Yes, that did work. When I'll have more time and resources, I'll try to find out why/what didn't work at the time of the IRC conversation. It is possible that Windows was using something like UTF-16, but I tested only UTF-8 -- though the apparent unavailability of any UTF-16 locale on my system indicates that base FreeBSD installations are not able to properly mount commonly-used FAT32 partitions (think about flash drives). Another next step is to find out whether a regular user can set a locale environment variable and then create a file that system utilities -- which have one pre-set locale -- (think about disk space usage quota enforcers) won't handle well. ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
RE: freebsd and utf-8 directory names
thanks, I will do that. I started to setup my locale again, and found that earlier I should have made a mistake because the new setup (almost) perfectly works: I set up login class for me following the handbook as hungarian (LANG=hu_HU.UTF-8, and charset=UTF-8; set keyboard layout to hungarian with setxkbmap hu, and used the hungarian locale in fstab to mount the fat32 partition.). there are two characters in the Hungarian alphabet which are not in the ISO-Latin1 code set (o with double accent and u with double accent, both lower and upper case) which are displayed as space in filenames, but now libreoffice is able to open the files. All other hungarian characters appeared as normal. I will do the test you suggested but it can take 1-2 days, I do not have time for it right now. rgds András Krasznai -Original Message- From: owner-freebsd-curr...@freebsd.org [mailto:owner-freebsd-curr...@freebsd.org] On Behalf Of Kevin Lo Sent: Thursday, July 03, 2014 5:33 AM To: d...@gmx.com Cc: freebsd-current@freebsd.org; David Chisnall Subject: Re: freebsd and utf-8 directory names On Wed, Jul 02, 2014 at 12:27:07AM +0200, d...@gmx.com wrote: David Chisnall wrote, On 07/01/2014 19:06: Please note that forums.freebsd.org is not a bug tracker. I tried searching the bug tracker for bugs with FAT and filename or FAT and utf-8/utf8/character in their names and could not find any reference to this issue. If you actually want to see bugs fixed, rather than just complain about them, please file them here: https://bugs.freebsd.org/bugzilla/enter_bug.cgi Make sure that you provide all of the steps required to reproduce them. I neglected to submit a bug report because: (1) there were already at least 3 bug reports related to (FAT32 and) character sets or encodings, some of them even had patches; (2) the reports were very old, indicating that the FreeBSD developers don't care about FAT32; (3) at least one report was seemingly related, and I didn't want to create a(nother) possible duplicate. But now, eat this: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=191540 Well, I'm going to close that PR. :-) First, set LANG environment variable to hu_HU.UTF-8 in your case: # setenv LANG hu_HU.UTF-8 Second, mount the FAT32 partition in Hungarian locale: # mount_msdosfs -L hu_HU.UTF-8 /dev/da0s1 /mnt Third, untar your attachement file: # tar xvf /mnt/files.zip x 1’.txt x 2–.txt # stat 1’.txt 128 244744 -rwxr-xr-x 1 root wheel 4294967295 0 Jan 1 08:00:00 1980 Aug 1 16:57:52 2011 Aug 1 16:57:52 2011 Jul 3 11:28:24 2014 16384 0 0x800 1’.txt # stat 2–.txt 128 244746 -rwxr-xr-x 1 root wheel 4294967295 0 Jan 1 08:00:00 1980 Aug 1 16:55:20 2011 Aug 1 16:55:20 2011 Jul 3 11:28:24 2014 16384 0 0x800 2–.txt Let me know if that works for you, thanks. Kevin ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
RE: freebsd and utf-8 directory names
Hi, Kevin, I made the experiment and there was no fault, the result contains the stat outputs. I used login-class (according to the handbook) to set the environment, and added the -L hu_HU.UTF-8 option to the appropriate line in fstab rgds András From: owner-freebsd-curr...@freebsd.org [owner-freebsd-curr...@freebsd.org] On Behalf Of Kevin Lo [ke...@freebsd.org] Sent: Thursday, July 03, 2014 5:33 AM To: d...@gmx.com Cc: freebsd-current@freebsd.org; David Chisnall Subject: Re: freebsd and utf-8 directory names On Wed, Jul 02, 2014 at 12:27:07AM +0200, d...@gmx.com wrote: David Chisnall wrote, On 07/01/2014 19:06: Please note that forums.freebsd.org is not a bug tracker. I tried searching the bug tracker for bugs with FAT and filename or FAT and utf-8/utf8/character in their names and could not find any reference to this issue. If you actually want to see bugs fixed, rather than just complain about them, please file them here: https://bugs.freebsd.org/bugzilla/enter_bug.cgi Make sure that you provide all of the steps required to reproduce them. I neglected to submit a bug report because: (1) there were already at least 3 bug reports related to (FAT32 and) character sets or encodings, some of them even had patches; (2) the reports were very old, indicating that the FreeBSD developers don't care about FAT32; (3) at least one report was seemingly related, and I didn't want to create a(nother) possible duplicate. But now, eat this: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=191540 Well, I'm going to close that PR. :-) First, set LANG environment variable to hu_HU.UTF-8 in your case: # setenv LANG hu_HU.UTF-8 Second, mount the FAT32 partition in Hungarian locale: # mount_msdosfs -L hu_HU.UTF-8 /dev/da0s1 /mnt Third, untar your attachement file: # tar xvf /mnt/files.zip x 1’.txt x 2–.txt # stat 1’.txt 128 244744 -rwxr-xr-x 1 root wheel 4294967295 0 Jan 1 08:00:00 1980 Aug 1 16:57:52 2011 Aug 1 16:57:52 2011 Jul 3 11:28:24 2014 16384 0 0x800 1’.txt # stat 2–.txt 128 244746 -rwxr-xr-x 1 root wheel 4294967295 0 Jan 1 08:00:00 1980 Aug 1 16:55:20 2011 Aug 1 16:55:20 2011 Jul 3 11:28:24 2014 16384 0 0x800 2–.txt Let me know if that works for you, thanks. Kevin ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org result Description: result ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
RE: freebsd and utf-8 directory names
Ok, I wrote yesterday that I will test it (again, I would say, because when I recognised the problem I did some testing. I picked up the FreeBSD Handbook and repeated the procedure listed in the localization section - with no success or at most half success). Naturally I may have made mistake, may have omitted some steps, but I will repeat. anyway, the whole thing started as working in a Windows environment I wanted to setup FreeBSD as a second operating system on my laptop, and I wanted to be able to do my work using freebsd only. The partitioning was done originally from Windows, Fat32 was formatted from Windows 7, and I use fat32 because when I started to use FreeBSD the NTFS support in FreeBSD was only for reading. The directory structure was created from windows, most of the files are various documents created either by me or my colleaugues and most of them are in some of Microsoft document format for compatibility reasons (I mean compatibility with my colleaugues). rgds András Krasznai -Original Message- From: Jamie Landeg-Jones [mailto:ja...@dyslexicfish.net] Sent: Tuesday, July 01, 2014 7:40 PM To: MS - Krasznai András; freebsd-current@freebsd.org; d...@gmx.com Subject: Re: freebsd and utf-8 directory names MS - Krasznai Andr??s krasznai.and...@mands.hu wrote: xfe display the file and directory names correctly together with creation date and time (simple 'ls' does not; it shows double question marks in the place of Hungarian characters. ls | od -c shows that such characters are represented in ls output as two characters e.g. 241 253 or such, I can test again but now I do not remember the exact numbers; the first of the two is the same for all Hungarian characters) That says to me that your locale is still not set correctly. The ls on it's own could be due to a non-compatible terminal emulator, but the fact that 'od' is showing two bytes rather than trying to display a character (however messed up the output may be) implies the characters are simply not valid in the locale you have set. It would be useful to have the exact numbers from the 'od' (a test filename with more than 2 Hungarian characters would be useful) and an approximate description (or screenshot) on how they should look. cheers, jamie ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: freebsd and utf-8 directory names
On Wed, Jul 02, 2014 at 12:27:07AM +0200, d...@gmx.com wrote: David Chisnall wrote, On 07/01/2014 19:06: Please note that forums.freebsd.org is not a bug tracker. I tried searching the bug tracker for bugs with FAT and filename or FAT and utf-8/utf8/character in their names and could not find any reference to this issue. If you actually want to see bugs fixed, rather than just complain about them, please file them here: https://bugs.freebsd.org/bugzilla/enter_bug.cgi Make sure that you provide all of the steps required to reproduce them. I neglected to submit a bug report because: (1) there were already at least 3 bug reports related to (FAT32 and) character sets or encodings, some of them even had patches; (2) the reports were very old, indicating that the FreeBSD developers don't care about FAT32; (3) at least one report was seemingly related, and I didn't want to create a(nother) possible duplicate. But now, eat this: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=191540 Well, I'm going to close that PR. :-) First, set LANG environment variable to hu_HU.UTF-8 in your case: # setenv LANG hu_HU.UTF-8 Second, mount the FAT32 partition in Hungarian locale: # mount_msdosfs -L hu_HU.UTF-8 /dev/da0s1 /mnt Third, untar your attachement file: # tar xvf /mnt/files.zip x 1’.txt x 2–.txt # stat 1’.txt 128 244744 -rwxr-xr-x 1 root wheel 4294967295 0 Jan 1 08:00:00 1980 Aug 1 16:57:52 2011 Aug 1 16:57:52 2011 Jul 3 11:28:24 2014 16384 0 0x800 1’.txt # stat 2–.txt 128 244746 -rwxr-xr-x 1 root wheel 4294967295 0 Jan 1 08:00:00 1980 Aug 1 16:55:20 2011 Aug 1 16:55:20 2011 Jul 3 11:28:24 2014 16384 0 0x800 2–.txt Let me know if that works for you, thanks. Kevin ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: freebsd and utf-8 directory names
Kevin Lo ke...@freebsd.org wrote: Well, I'm going to close that PR. :-) [ ... ] I basically replied with the same thing in a followup on the bug itself exactly 24 hours ago! :-) https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=191540 cheers, Jamie ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: freebsd and utf-8 directory names
MS - Krasznai András wrote, On 06/30/2014 08:30: There is a partition formatted for FAT32 where I store documents which I would like to view (and edit) both in windows and freebsd. The problem is that if the path name contains certain Hungarian characters (e.g o with double accent), then libreoffice in FreeBSD refuses to open them complaining about illegal characters. The directory was created in windows, the document also, and I can handle them perfectly from windows (what is more, libreoffice under a linux can also open those documents). Some accented characters are shown as a question mark in FreeBSD, and some others are as a black rectangle; these latter are causing problems. If a file-nam contains such characters then the file is shown as 0- length in Midnight Commander. This is not limited to Hungarian characters. There are bugs in FreeBSD's FAT handling code. According to an IRC discussion with mux, FreeBSD has plenty of VOP_LOOKUP bugs, and this case hits such a bug. To allow FreeBSD to read files with fancy UTF-8 characters in their names, mount the FAT32 partition with ``-o shortnames''. Then, you won't be able to use proper file naming (so this is not even a workaround), but at least you'll be able to read the said files. Poke the FreeBSD developers to start fixing bugs, maybe (but not very likely) that will help. Also, you're at least the 3rd user (I'm at least the 2nd) that runs into this case; ie., here's a report: http://forums.freebsd.org/showthread.php?t=14612 (of course, this does not contain a solution). ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
RE: freebsd and utf-8 directory names
Hi, I am not very satisfied with this situation. Today I was looking up the Hungarian FreeBSD site, but the Hungarian translation of the handbook deals only with settings for German, Russian and Japanese environment. A little additional info: I installed xfe (x11-fm/xfe) file manager in the same freebsd configuration. This application displays and handles those diretories and files perfectly, but as soon as I want to open such a file with double click on it (I set xfe to invoke libreoffice in this case) libreoffice still refuses to open the file. Even midnight commander fails to handle such files. What does xfe do differently? rgds András -Original Message- From: owner-freebsd-curr...@freebsd.org [mailto:owner-freebsd-curr...@freebsd.org] On Behalf Of d...@gmx.com Sent: Tuesday, July 01, 2014 4:42 PM To: freebsd-current@freebsd.org Subject: Re: freebsd and utf-8 directory names MS - Krasznai András wrote, On 06/30/2014 08:30: There is a partition formatted for FAT32 where I store documents which I would like to view (and edit) both in windows and freebsd. The problem is that if the path name contains certain Hungarian characters (e.g o with double accent), then libreoffice in FreeBSD refuses to open them complaining about illegal characters. The directory was created in windows, the document also, and I can handle them perfectly from windows (what is more, libreoffice under a linux can also open those documents). Some accented characters are shown as a question mark in FreeBSD, and some others are as a black rectangle; these latter are causing problems. If a file-nam contains such characters then the file is shown as 0- length in Midnight Commander. This is not limited to Hungarian characters. There are bugs in FreeBSD's FAT handling code. According to an IRC discussion with mux, FreeBSD has plenty of VOP_LOOKUP bugs, and this case hits such a bug. To allow FreeBSD to read files with fancy UTF-8 characters in their names, mount the FAT32 partition with ``-o shortnames''. Then, you won't be able to use proper file naming (so this is not even a workaround), but at least you'll be able to read the said files. Poke the FreeBSD developers to start fixing bugs, maybe (but not very likely) that will help. Also, you're at least the 3rd user (I'm at least the 2nd) that runs into this case; ie., here's a report: http://forums.freebsd.org/showthread.php?t=14612 (of course, this does not contain a solution). ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: freebsd and utf-8 directory names
MS - Krasznai András wrote, On 07/01/2014 17:07: I installed xfe (x11-fm/xfe) file manager in the same freebsd configuration. This application displays and handles those diretories and files perfectly, but as soon as I want to open such a file with double click on it (I set xfe to invoke libreoffice in this case) libreoffice still refuses to open the file. [...] What does xfe do differently? What do you mean by handling and displaying properly? Listing (directory contents) is one thing, being able to stat or open the file is different. ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: freebsd and utf-8 directory names
Den 30. juni 2014 08:56, skrev Rainer Hurling: Am 30.06.2014 08:30 (UTC+1) schrieb MS - Krasznai András: Hi I have been using FreeBSD as desktop since 2003, and living in a mixed (windows-linux) environment I installed FreeBSd along with my usual (Windows 7) work environment, I have a dualboot configured laptop. I use FreeBSD-10 STABLE. There is a partition formatted for FAT32 where I store documents which I would like to view (and edit) both in windows and freebsd. The problem is that if the path name contains certain Hungarian characters (e.g o with double accent), then libreoffice in FreeBSD refuses to open them complaining about illegal characters. The directory was created in windows, the document also, and I can handle them perfectly from windows (what is more, libreoffice under a linux can also open those documents). Some accented characters are shown as a question mark in FreeBSD, and some others are as a black rectangle; these latter are causing problems. If a file-nam contains such characters then the file is shown as 0- length in Midnight Commander. I tried some steps described in the „Localization” part of the FreeBSD Handbook, but things did not improve. I installed PC-BSD with Hungarian language support, thinking that it would handle the localized directory names correctly but no, it gives the same error message. This problem is really annoying. How could I solve it? In my German environment I also use FAT32 formatted drives, mounted like: /dev/adaXsX /XXXmsdosfs rw,large,-Lde_DE.UTF-8 0 0 This should also work for Hungarian? I second this advice, it should work well for any language (It certainly is fine for my Norwegian). To expand on Rainer's suggestion: The -L parameter in the mount line is from the mount_msdosfs(8) utility. The man page says: -L locale Specify locale name used for file name conversions for DOS and Win'95 names. By default ISO 8859-1 assumed as local character set. The locale of your environment and mount command must match. In my case it is: LC_CTYPE=no_NO.UTF-8 mount_msdosfs -L no_NO.UTF-8 /dev/da3s1 /mnt/tmp (Regarding whether the default of ISO 8859-1 for mount_msdosfs should be changed to some UTF-8 locale to better match what people are using in this age is an entirely different matter. ;-) Best regards, Gyrd ^_^ HTH, Rainer Hurling Krasznai András rendszermérnök MS Informatikai Zrt. 1136 Budapest, Pannónia u. 17/A. Telefon: +36 1 703-2923 Mobil:+36 30 703-2923 ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: freebsd and utf-8 directory names
On Tue, Jul 01, 2014 at 04:41:56PM +0200, d...@gmx.com wrote: Poke the FreeBSD developers to start fixing bugs, maybe (but not very likely) that will help. Or become a FreeBSD developer, fix the problem, submit a patch, and make everyone happy. Yes, I know the path of least resistance is to moan about how the FreeBSD developers won't fix your problem. -- Steve ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: freebsd and utf-8 directory names
Steve Kargl wrote, On 07/01/2014 17:30: Or become a FreeBSD developer, fix the problem, submit a patch, and make everyone happy. I would be very interested in 1-on-1 coaching from you. I will pay for your work with awesome patches. ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
RE: freebsd and utf-8 directory names
xfe display the file and directory names correctly together with creation date and time (simple 'ls' does not; it shows double question marks in the place of Hungarian characters. ls | od -c shows that such characters are represented in ls output as two characters e.g. 241 253 or such, I can test again but now I do not remember the exact numbers; the first of the two is the same for all Hungarian characters) rgds András -Original Message- From: d...@gmx.com [mailto:d...@gmx.com] Sent: Tuesday, July 01, 2014 5:20 PM To: MS - Krasznai András; freebsd-current@freebsd.org Subject: Re: freebsd and utf-8 directory names MS - Krasznai András wrote, On 07/01/2014 17:07: I installed xfe (x11-fm/xfe) file manager in the same freebsd configuration. This application displays and handles those diretories and files perfectly, but as soon as I want to open such a file with double click on it (I set xfe to invoke libreoffice in this case) libreoffice still refuses to open the file. [...] What does xfe do differently? What do you mean by handling and displaying properly? Listing (directory contents) is one thing, being able to stat or open the file is different. ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
RE: freebsd and utf-8 directory names
hi I use the -L hu_HU.UTF-8 option in fstab, but I admit I forgot to set the LCxxx variables. I will test it soon. rgds András -Original Message- From: Gyrd Thane Lange [mailto:gyrd...@thanelange.no] Sent: Tuesday, July 01, 2014 5:30 PM To: Rainer Hurling; MS - Krasznai András; freebsd-current@freebsd.org Subject: Re: freebsd and utf-8 directory names Den 30. juni 2014 08:56, skrev Rainer Hurling: Am 30.06.2014 08:30 (UTC+1) schrieb MS - Krasznai András: Hi I have been using FreeBSD as desktop since 2003, and living in a mixed (windows-linux) environment I installed FreeBSd along with my usual (Windows 7) work environment, I have a dualboot configured laptop. I use FreeBSD-10 STABLE. There is a partition formatted for FAT32 where I store documents which I would like to view (and edit) both in windows and freebsd. The problem is that if the path name contains certain Hungarian characters (e.g o with double accent), then libreoffice in FreeBSD refuses to open them complaining about illegal characters. The directory was created in windows, the document also, and I can handle them perfectly from windows (what is more, libreoffice under a linux can also open those documents). Some accented characters are shown as a question mark in FreeBSD, and some others are as a black rectangle; these latter are causing problems. If a file-nam contains such characters then the file is shown as 0- length in Midnight Commander. I tried some steps described in the „Localization” part of the FreeBSD Handbook, but things did not improve. I installed PC-BSD with Hungarian language support, thinking that it would handle the localized directory names correctly but no, it gives the same error message. This problem is really annoying. How could I solve it? In my German environment I also use FAT32 formatted drives, mounted like: /dev/adaXsX /XXXmsdosfs rw,large,-Lde_DE.UTF-8 0 0 This should also work for Hungarian? I second this advice, it should work well for any language (It certainly is fine for my Norwegian). To expand on Rainer's suggestion: The -L parameter in the mount line is from the mount_msdosfs(8) utility. The man page says: -L locale Specify locale name used for file name conversions for DOS and Win'95 names. By default ISO 8859-1 assumed as local character set. The locale of your environment and mount command must match. In my case it is: LC_CTYPE=no_NO.UTF-8 mount_msdosfs -L no_NO.UTF-8 /dev/da3s1 /mnt/tmp (Regarding whether the default of ISO 8859-1 for mount_msdosfs should be changed to some UTF-8 locale to better match what people are using in this age is an entirely different matter. ;-) Best regards, Gyrd ^_^ HTH, Rainer Hurling Krasznai András rendszermérnök MS Informatikai Zrt. 1136 Budapest, Pannónia u. 17/A. Telefon: +36 1 703-2923 Mobil:+36 30 703-2923 ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: freebsd and utf-8 directory names
On Tue, Jul 01, 2014 at 05:36:20PM +0200, d...@gmx.com wrote: Steve Kargl wrote, On 07/01/2014 17:30: Or become a FreeBSD developer, fix the problem, submit a patch, and make everyone happy. I would be very interested in 1-on-1 coaching from you. I will pay for your work with awesome patches. As I have no use for UTF-8 and msdosfs works for me, I have no interest here. As far as coaching, I'll give you the secret to how I started fixing libm: step 1. Obtain src/ step 2. Read relevent files in src/ step 3. Find problem. step 4. Search literature. step 5. Fix problem. step 6. Submit patch 6a. Receive review of patch. 6b. Fix patch based on review. 6c. Resubmit patch. [[step 7. commit patch] step 8. goto step 2. Repeat often enough and be rewarded with commit bit and step 7 is no longer optional. -- Steve ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: freebsd and utf-8 directory names
Steve Kargl wrote, On 07/01/2014 18:34: As far as coaching, I'll give you the secret to how I started fixing libm: step 1. Obtain src/ step 2. Read relevent files in src/ step 3. Find problem. step 4. Search literature. step 5. Fix problem. step 6. Submit patch 6a. Receive review of patch. 6b. Fix patch based on review. 6c. Resubmit patch. [[step 7. commit patch] step 8. goto step 2. In other words, You, the general user, should learn the art of operating system development (on your own) for the sole purpose of being able to fix the bug yourself. ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: freebsd and utf-8 directory names
On 1 Jul 2014, at 15:41, d...@gmx.com wrote: Also, you're at least the 3rd user (I'm at least the 2nd) that runs into this case; ie., here's a report: http://forums.freebsd.org/showthread.php?t=14612 (of course, this does not contain a solution). Please note that forums.freebsd.org is not a bug tracker. I tried searching the bug tracker for bugs with FAT and filename or FAT and utf-8/utf8/character in their names and could not find any reference to this issue. If you actually want to see bugs fixed, rather than just complain about them, please file them here: https://bugs.freebsd.org/bugzilla/enter_bug.cgi Make sure that you provide all of the steps required to reproduce them. David ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: freebsd and utf-8 directory names
On Tue, Jul 01, 2014 at 06:53:31PM +0200, d...@gmx.com wrote: Steve Kargl wrote, On 07/01/2014 18:34: As far as coaching, I'll give you the secret to how I started fixing libm: step 1. Obtain src/ step 2. Read relevent files in src/ step 3. Find problem. step 4. Search literature. step 5. Fix problem. step 6. Submit patch 6a. Receive review of patch. 6b. Fix patch based on review. 6c. Resubmit patch. [[step 7. commit patch] step 8. goto step 2. In other words, You, the general user, should learn the art of operating system development (on your own) for the sole purpose of being able to fix the bug yourself. No. In other words, If fixing the bug is so important to you that it must be fixed, then perhaps, you should take the initiative to learn enough to fix the bug. Or, in other other words, Give a man a fish, he eats for a day; teach a man to fish, he eats for a lifetime. Finally, as a general user, it is often counter-productive to include vailed invectives in your emails to a public list. See for example: Poke the FreeBSD developers to start fixing bugs, maybe (but not very likely) that will help. Sheesh, as if FreeBSD developer never fix any bugs. -- Steve ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: freebsd and utf-8 directory names
On Tue, 1 Jul 2014, d...@gmx.com wrote: In other words, You, the general user, should learn the art of operating system development (on your own) for the sole purpose of being able to fix the bug yourself. It's one approach to solving a technical problem, but not the only one. You can fix it yourself, possibly involving a lot of learning. Or you can ask, encourage, or even pay others to fix it. This should all start with a bug report to make sure the problem is documented. If people already know there are bugs in the msdosfs code, those same people should be able to supply details to fill out the bug report. ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: freebsd and utf-8 directory names
MS - Krasznai Andr??s krasznai.and...@mands.hu wrote: xfe display the file and directory names correctly together with creation date and time (simple 'ls' does not; it shows double question marks in the place of Hungarian characters. ls | od -c shows that such characters are represented in ls output as two characters e.g. 241 253 or such, I can test again but now I do not remember the exact numbers; the first of the two is the same for all Hungarian characters) That says to me that your locale is still not set correctly. The ls on it's own could be due to a non-compatible terminal emulator, but the fact that 'od' is showing two bytes rather than trying to display a character (however messed up the output may be) implies the characters are simply not valid in the locale you have set. It would be useful to have the exact numbers from the 'od' (a test filename with more than 2 Hungarian characters would be useful) and an approximate description (or screenshot) on how they should look. cheers, jamie ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: freebsd and utf-8 directory names
David Chisnall wrote, On 07/01/2014 19:06: Please note that forums.freebsd.org is not a bug tracker. I tried searching the bug tracker for bugs with FAT and filename or FAT and utf-8/utf8/character in their names and could not find any reference to this issue. If you actually want to see bugs fixed, rather than just complain about them, please file them here: https://bugs.freebsd.org/bugzilla/enter_bug.cgi Make sure that you provide all of the steps required to reproduce them. I neglected to submit a bug report because: (1) there were already at least 3 bug reports related to (FAT32 and) character sets or encodings, some of them even had patches; (2) the reports were very old, indicating that the FreeBSD developers don't care about FAT32; (3) at least one report was seemingly related, and I didn't want to create a(nother) possible duplicate. But now, eat this: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=191540 ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
freebsd and utf-8 directory names
Hi I have been using FreeBSD as desktop since 2003, and living in a mixed (windows-linux) environment I installed FreeBSd along with my usual (Windows 7) work environment, I have a dualboot configured laptop. I use FreeBSD-10 STABLE. There is a partition formatted for FAT32 where I store documents which I would like to view (and edit) both in windows and freebsd. The problem is that if the path name contains certain Hungarian characters (e.g o with double accent), then libreoffice in FreeBSD refuses to open them complaining about illegal characters. The directory was created in windows, the document also, and I can handle them perfectly from windows (what is more, libreoffice under a linux can also open those documents). Some accented characters are shown as a question mark in FreeBSD, and some others are as a black rectangle; these latter are causing problems. If a file-nam contains such characters then the file is shown as 0- length in Midnight Commander. I tried some steps described in the „Localization” part of the FreeBSD Handbook, but things did not improve. I installed PC-BSD with Hungarian language support, thinking that it would handle the localized directory names correctly but no, it gives the same error message. This problem is really annoying. How could I solve it? Krasznai András rendszermérnök MS Informatikai Zrt. 1136 Budapest, Pannónia u. 17/A. Telefon: +36 1 703-2923 Mobil:+36 30 703-2923 ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: freebsd and utf-8 directory names
Am 30.06.2014 08:30 (UTC+1) schrieb MS - Krasznai András: Hi I have been using FreeBSD as desktop since 2003, and living in a mixed (windows-linux) environment I installed FreeBSd along with my usual (Windows 7) work environment, I have a dualboot configured laptop. I use FreeBSD-10 STABLE. There is a partition formatted for FAT32 where I store documents which I would like to view (and edit) both in windows and freebsd. The problem is that if the path name contains certain Hungarian characters (e.g o with double accent), then libreoffice in FreeBSD refuses to open them complaining about illegal characters. The directory was created in windows, the document also, and I can handle them perfectly from windows (what is more, libreoffice under a linux can also open those documents). Some accented characters are shown as a question mark in FreeBSD, and some others are as a black rectangle; these latter are causing problems. If a file-nam contains such characters then the file is shown as 0- length in Midnight Commander. I tried some steps described in the „Localization” part of the FreeBSD Handbook, but things did not improve. I installed PC-BSD with Hungarian language support, thinking that it would handle the localized directory names correctly but no, it gives the same error message. This problem is really annoying. How could I solve it? In my German environment I also use FAT32 formatted drives, mounted like: /dev/adaXsX /XXXmsdosfs rw,large,-Lde_DE.UTF-8 0 0 This should also work for Hungarian? HTH, Rainer Hurling Krasznai András rendszermérnök MS Informatikai Zrt. 1136 Budapest, Pannónia u. 17/A. Telefon: +36 1 703-2923 Mobil:+36 30 703-2923 ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
