This option is not available with exec source From: Marina [mailto:[email protected]] Sent: Tuesday, May 12, 2015 5:56 PM To: [email protected] Subject: Re: Unicode data handling with flume
Did you try specifying encoding for your source, for example like this: a1.sources.r1.inputCharset = ISO8859-1 << whatever charset you need>> ? Marina ________________________________ From: "Vishwakarma, Chhaya" <[email protected]<mailto:[email protected]>> To: "[email protected]<mailto:[email protected]>" <[email protected]<mailto:[email protected]>> Sent: Tuesday, May 12, 2015 4:20 AM Subject: Unicode data handling with flume Hi all, I'm trying to put a CSV file into HDFS using flume, file contains some unicode characters also. Once the file is there in HDFS I tried to view the content, but unable to see the records properly. File content Name age sal msg Abc 21 1200 Lukè éxample àpple Xyz 23 1400 er stîget ûf mit grôzer Output in console I did hdfs dfs -get /flume/events/csv/events.1234567 Below is the output Name,age,sal,msg Abc,21,1200,Luk��xample��pple Xyz,23,1400,er st�get �f mit gr�zer Does flume supports Unicode characters? If not how it can be handled? Flume version is 1.4.0
