Thank you Steve. The encoding is set correctly for both JAVA_OPTS and CATALINA_OPTS. There are many other utf-8 based applications/sites running on the same server without giving this strange behavior.
I may be late to tell you all I managed to solve this issue. The connection string saved in fedora.fcfg has some syntax error. you know that, the mysql connection string separates connection credentials and properties by "&", and fedora installer replaces every "&" with "&" to escape "&". The error was, some "&"s were replaced by 2 "&"s. I don't know if this was my input error or fedora installer error. Anyway, I adjusted the connection string and re-ingest the items correctly. The original connection string: dbc:mysql://ServerIP/DBName?user=userName&password=password&useUnicode=true&characterEncoding=utf8&jdbcCompliantTruncation=false the erroneous one: dbc:mysql://ServerIP/DBName?user=userName&password=password&&useUnicode=true&&characterEncoding=utf8&&jdbcCompliantTruncation=false the correct one: dbc:mysql://ServerIP/DBName?user=userName&password=password&useUnicode=true&characterEncoding=utf8&jdbcCompliantTruncation=false Mohammed Abo Ouda Bibliotheca Alexandrina -----Original Message----- From: Steve Bayliss [mailto:[email protected]] Sent: Wednesday, July 21, 2010 10:34 AM To: Dar; 'Peter Cliff' Cc: [email protected] Subject: RE: [Fedora-commons-users] Problem while ingesting UTF-8 Foxml Hi Mohammed Did you manage to resolve this? If not, can you try setting the Java character encoding (for the JVM running your servlet container, eg Tomcat) You can specify -Dfile.encoding=utf-8 eg in JAVA_OPTS or CATALINA_OPTS before you start Tomcat. Please let us know if this makes a difference. Regards Steve > -----Original Message----- > From: Dar [mailto:[email protected]] > Sent: 14 July 2010 14:46 > To: 'Peter Cliff'; Dar > Cc: [email protected] > Subject: Re: [Fedora-commons-users] Problem while ingesting > UTF-8 Foxml > > > I'm using MySQL administrator and Toad for Mysql; both are > giving the same problem. I'm pretty sure that this is not a > viewing problem. I did a trial to update the table (doFields) > with utf-8 text using an update statement. Surprisingly, the > text is saved and viewed correctly!. I guess the problem is > somehow related the database connector that Fedora uses. > > > Thank you and best regards, > > Mohammed Abo Ouda > > -----Original Message----- > From: Peter Cliff [mailto:[email protected]] > Sent: Wednesday, July 14, 2010 4:39 PM > To: Dar > Cc: [email protected] > Subject: Re: [Fedora-commons-users] Problem while ingesting > UTF-8 Foxml > > Hello! > > You don't say what you are using to view the Fedora DB, but > this sounds like it may be a problem with viewing the > contents of the database rather than what is in it. If, for > example, you were exploring the DB via phpmyadmin, you'd need > to unsure your browser has the correct character encoding > selected (UTF8 in this case). > > Dunno if that helps? > > Pete > > On 14 Jul 2010, at 14:00, Dar wrote: > > > Dear All, > > > > I’m trying to add a Foxml contains “UTF-8” characters > (Arabic characters). the object is ingested correctly into Fedora. > > > > My issue is; when I explore the Fedora DB (which is MySQL > in my case) the doFields table (which holds the DC fields) I > found that all fields data are encoded incorrectly (question > marks instead of the original Arabic text) although I set > the table DEFAULT CHARACTER SET to utf8, DEFAULT COLLATE to > utf8_general_ci and the db connection string in fedora.fcfg > sets the characterEncoding=utf8 > > > > Could you please help ? > > > > > > Thank you and best regards, > > > > Mohammed Abo Ouda > > Bibliotheca Alexandrina > > > > > > > > > -------------------------------------------------------------- > ---------------- > > This SF.net email is sponsored by Sprint > > What will you do first with EVO, the first 4G phone? > > Visit sprint.com/first -- > http://p.sf.net/sfu/sprint-com-first<Mail Attachment.txt> > > > -------------------------------------------------------------- > ---------------- > This SF.net email is sponsored by Sprint > What will you do first with EVO, the first 4G phone? > Visit sprint.com/first -- http://p.sf.net/sfu/sprint-com-first > _______________________________________________ > Fedora-commons-users mailing list > [email protected] > https://lists.sourceforge.net/lists/listinfo/fedora-commons-users > ------------------------------------------------------------------------------ This SF.net email is sponsored by Sprint What will you do first with EVO, the first 4G phone? Visit sprint.com/first -- http://p.sf.net/sfu/sprint-com-first _______________________________________________ Fedora-commons-users mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/fedora-commons-users
