heyang wang created ZEPPELIN-2641: ------------------------------------- Summary: Livy interpreter doesn't support Chinese encoding Key: ZEPPELIN-2641 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2641 Project: Zeppelin Issue Type: Bug Components: livy-interpreter Affects Versions: 0.7.1, 0.8.0 Reporter: heyang wang Priority: Critical
When using Livy to interact with spark. Spark sql with Chinese character always return empty result. The reason is because Zeppelin use restTemplate.java from spring frame work. When sending restful request to Livy, the headers is defined as Content-Type:application/json. This setting doesn't specify the encoding of the charset and spring will use ISO-8895-1 by default. But ISO-8895-1 isn't compatible with Chinese. The code Livy receive from Zeppelin contain invalid Chinese encoding and will be interpret by spark as ?. Change header from application/json to MediaType.APPLICATION_JSON_UTF8_VALUE in BaseLivyInterpreter.java and rebuild can solve this problem. It seems encoding problem affect more than Chinese since ISO-8895-1's coverage is restricted. I think update the encoding to UTF-8 would be helpful. -- This message was sent by Atlassian JIRA (v6.4.14#64029)