[tw] Re: Special characters
Hi All yeah I have encountered this problem frequently.. only in my case its characters with portugues accents that get scrambled. hope we have a solution to this sometime soon Skye Em terça-feira, 6 de outubro de 2009 05h59min33s UTC-3, Jakob Graulund Jørgensen escreveu: > > Hi > > I am having some trouble loading tiddlers with special characters (the > Danish letters æ, ø and å). > > I’m using the ImportTiddlersPlugin and the Danish letters appear as > Chinese characters after importing them. > > Using the CreateTiddlersFromCSV there is no such error. > > The problem is, however, that I want to use the ImportTiddlersPlugin. > > So I think I need to correct the problem post-import (because I simply > don’t understand what the ImportTiddlersPlugin does to the Danish > letters). > > The Danish letters appear in a custom field I’ve created called > ‘names’. > > So I would like an easy way to replace all of the content of the > custom field ‘names’ with the proper Danish names (using æ, ø and å) > without messing with the rest of the tiddler’s content and without > having to manually open and edit each tiddler. > -- You received this message because you are subscribed to the Google Groups "TiddlyWiki" group. To unsubscribe from this group and stop receiving emails from it, send an email to tiddlywiki+unsubscr...@googlegroups.com. To post to this group, send email to tiddlywiki@googlegroups.com. Visit this group at http://groups.google.com/group/tiddlywiki. For more options, visit https://groups.google.com/groups/opt_out.
[tw] Re: Special characters
I encounter the same problem. After a quick look to the code of ImportTiddlersPlugin. Currently, the convertUTF8ToUnicode() is deactivate only for TW version 2.5.2 > if (version.major+version.minor*.1+version.revision*.01!=2.52) > txt=convertUTF8ToUnicode(txt); > I change it for all version starting from 2.5.2 : > if (version.major+version.minor*.1+version.revision*.01 < 2.52) > txt=convertUTF8ToUnicode(txt); > After that, I import all my tiddlers without Chinese characters. Best regards, -- You received this message because you are subscribed to the Google Groups "TiddlyWiki" group. To unsubscribe from this group and stop receiving emails from it, send an email to tiddlywiki+unsubscr...@googlegroups.com. To post to this group, send email to tiddlywiki@googlegroups.com. Visit this group at http://groups.google.com/group/tiddlywiki. For more options, visit https://groups.google.com/groups/opt_out.
[tw] Re: Special characters
> Your problem arises due to some very subtle Unicode vs. UTF-8 > character encoding issues related to the TW core file I/O functions > that ImportTiddlersPlugin uses to open and read local files (using OS- > based filesystem access) or remote files (using XMLHttpRequest). Is there any way to bypass the problem? I know I can load the tiddlers using CreateTidllersFromCSV but I have 748, so each time I do that it takes forever. (is there any way to speed that up?) Could I change me raw data-file (my csv-document) in any way so that the importplugin dosent misinterper the characters (ive already tried saving the csv-document as UTF-8 encoded without any succes). Or could perhaps change all my custom fields post-import ie using the tweakplugin or something similiar. It is only aesthetics that I use the right characters (æ, ø and å) and not the anglo-saxon rewrite (ae, oe and aa) but it just looks so wrong. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "TiddlyWiki" group. To post to this group, send email to tiddlywiki@googlegroups.com To unsubscribe from this group, send email to tiddlywiki+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/tiddlywiki?hl=en -~--~~~~--~~--~--~---
[tw] Re: Special characters
> I am having some trouble loading tiddlers with special characters (the > Danish letters æ, ø and å). > I’m using the ImportTiddlersPlugin and the Danish letters appear as > Chinese characters after importing them. > Using the CreateTiddlersFromCSV there is no such error. Your problem arises due to some very subtle Unicode vs. UTF-8 character encoding issues related to the TW core file I/O functions that ImportTiddlersPlugin uses to open and read local files (using OS- based filesystem access) or remote files (using XMLHttpRequest). These functions seem to have some problems dealing with languages that use extended character sets. Without correct recognition of the inbound character's encoding, *implicit* conversion of the incoming text data can occur simply by mis-interpreting 1-byte vs. 2-byte character encodings. In comparison, CreateTiddlersFromCSV does not read from files... instead, you manually copy/paste the data into the multi-line text input in the form. This, of course, completely bypasses the core's encoding issues, as the data transfer into the edit field is being done via OS-based clipboard activities, rather than direct or remote file I/O functions. Of course, this is a troubling problem. TiddlyWiki is supposed to handle alternative multi-byte character sets. I'm sure it's just a small fix (like adding an explicit call to a character conversion function somewhere deep in the core code), but it's probably going to take a while to figure out where and why things are not currently working as intended. -e --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "TiddlyWiki" group. To post to this group, send email to tiddlywiki@googlegroups.com To unsubscribe from this group, send email to tiddlywiki+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/tiddlywiki?hl=en -~--~~~~--~~--~--~---
