Re: Why chinese character gash appear when i use spark textFile?

2017-04-05 Thread Yan Facai
:18_?:1.0 > > > hadoop fs -cat xxx > 1.0100733314 18_百度输入法:100733314 8919173c6d49abfab02853458247e584 > 1:129:18_百度输入法:1.0 > > Why chinese character gash appear when i use spark textFile? > The code of hdfs file is utf-8. > > > Thanks >

Why chinese character gash appear when i use spark textFile?

2017-04-05 Thread Jone Zhang
法:1.0 Why chinese character gash appear when i use spark textFile? The code of hdfs file is utf-8. Thanks

Why chinese character gash appear when i use spark textFile?

2017-04-05 Thread JoneZhang
:100733314 8919173c6d49abfab02853458247e5841:129:18_百度输入法:1.0 Why chinese character gash appear when i use spark textFile? The code of hdfs file is utf-8. Thanks -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Why-chinese-character-gash-appear-when-i-use-spark-textFile-tp