[jira] [Commented] (UIMA-3818) Unsuported XML entity by XmiCas(De)serializer

[Gregoire Jadi (JIRA)]

    [ 
https://issues.apache.org/jira/browse/UIMA-3818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13996093#comment-13996093
 ] 

Gregoire Jadi commented on UIMA-3818:
-------------------------------------

According to [this 
tool|http://unicode.online-toolz.com/tools/unicode-html-entities-convertor.php],
 the problem isn't in XmiCasDeserializer.deserialize but in 
XmiCasSerializer.serialize.

The character '𝒪' should be encoded as '𝒪', but is encoded as 
"𝒪�"

Here is the content of '/tmp/test.xmi':

{code:xml}
<?xml version="1.0" encoding="UTF-8"?><xmi:XMI 
xmlns:tcas="http:///uima/tcas.ecore"; xmlns:xmi="http://www.omg.org/XMI"; 
xmlns:cas="http:///uima/cas.ecore"; 
xmlns:types="http:///jgreg/internship/nii/types.ecore"; 
xmi:version="2.0"><cas:NULL xmi:id="0"/><cas:Sofa xmi:id="1" sofaNum="1" 
sofaID="_InitialView" mimeType="text" 
sofaString="&#119978;&#56490;"/><tcas:DocumentAnnotation xmi:id="8" sofa="1" 
begin="0" end="2" language="x-unspecified"/><cas:View sofa="1" 
members="8"/></xmi:XMI>
{code}

> Unsuported XML entity by XmiCas(De)serializer
> ---------------------------------------------
>
>                 Key: UIMA-3818
>                 URL: https://issues.apache.org/jira/browse/UIMA-3818
>             Project: UIMA
>          Issue Type: Bug
>          Components: Collection Processing
>    Affects Versions: 2.4.2SDK
>            Reporter: Gregoire Jadi
>
> The UTF8 character '𝒪' can not be deserialized by 
> `XmiCasDeserializer.deserialize'.
> Here is a way to reproduce this:
> {code:java}
> import java.io.File;
> import java.io.FileInputStream;
> import java.io.FileOutputStream;
> import java.io.InputStream;
> import java.io.OutputStream;
> import org.apache.uima.cas.impl.XmiCasDeserializer;
> import org.apache.uima.cas.impl.XmiCasSerializer;
> import org.apache.uima.fit.factory.JCasFactory;
> import org.apache.uima.jcas.JCas;
> public class Test {
>     public static void main(String[] args) throws Exception {
>         JCas jCas = JCasFactory.createJCas();
>         jCas.setDocumentText("𝒪");
>         File file = new File("/tmp/test.xmi");
>         OutputStream outputStream = new FileOutputStream(file);
>         XmiCasSerializer.serialize(jCas.getCas(), outputStream);
>         InputStream inputStream = new FileInputStream(file);
>         XmiCasDeserializer.deserialize(inputStream, jCas.getCas());
>     }
> }
> {code}
> And here is the stacktrace:
> {code}
> [Fatal Error] :1:350: Character reference "&#56490" is an invalid XML 
> character.
> Exception in thread "main" org.xml.sax.SAXParseException; lineNumber: 1; 
> columnNumber: 350; Character reference "&#56490" is an invalid XML character.
>       at org.apache.xerces.parsers.AbstractSAXParser.parse(Unknown Source)
>       at 
> org.apache.uima.cas.impl.XmiCasDeserializer.deserialize(XmiCasDeserializer.java:1955)
>       at 
> org.apache.uima.cas.impl.XmiCasDeserializer.deserialize(XmiCasDeserializer.java:1872)
>       at Test.main(Test.java:24)
>      [java] Java Result: 1
> {code}
> Please tell me if you need more information.



--
This message was sent by Atlassian JIRA
(v6.2#6252)