RE: Kafka UTF 8 encoding problem

2016-11-09 Thread Radoslaw Gruchalski
y other idea? -Original Message- From: Radoslaw Gruchalski [mailto:ra...@gruchalski.com] Sent: Wednesday, November 9, 2016 2:33 PM To: Ali Akhtar; users@kafka.apache.org Subject: Re: Kafka UTF 8 encoding problem Yes, understandandable, however, the OP mentions the data in UTF-8. If it’s

RE: Kafka UTF 8 encoding problem

2016-11-09 Thread Baris Akgun (Garanti Teknoloji)
other idea? -Original Message----- From: Radoslaw Gruchalski [mailto:ra...@gruchalski.com] Sent: Wednesday, November 9, 2016 2:33 PM To: Ali Akhtar; users@kafka.apache.org Subject: Re: Kafka UTF 8 encoding problem Yes, understandandable, however, the OP mentions the data in UTF-8. If it’s

RE: Kafka UTF 8 encoding problem

2016-11-09 Thread Baris Akgun (Garanti Teknoloji)
[mailto:ra...@gruchalski.com] Sent: Wednesday, November 9, 2016 2:33 PM To: Ali Akhtar; users@kafka.apache.org Subject: Re: Kafka UTF 8 encoding problem Yes, understandandable, however, the OP mentions the data in UTF-8. If it’s not UTF, it needs to be converted to UTF. Or consider using

Re: Kafka UTF 8 encoding problem

2016-11-09 Thread Radoslaw Gruchalski
> kafka api but I always face with same issue. > > > > Thanks > > > > *From:* Radoslaw Gruchalski [mailto:ra...@gruchalski.com] > *Sent:* Wednesday, November 9, 2016 1:49 PM > *To:* Baris Akgun (Garanti Teknoloji); users@kafka.apache.org > *Subject:* Re: Kafka UTF

Re: Kafka UTF 8 encoding problem

2016-11-09 Thread Ali Akhtar
equest.required.acks", "1"); > > > > Consumer side// > > > > I am using Spark Streaming Kafka API, I also try with Kafka CLI and Java > kafka api but I always face with same issue. > > > > Thanks > > > > *From:* Radoslaw Gruchalski

RE: Kafka UTF 8 encoding problem

2016-11-09 Thread Radoslaw Gruchalski
* Baris Akgun (Garanti Teknoloji); users@kafka.apache.org *Subject:* Re: Kafka UTF 8 encoding problem Baris, Kafka does not care about encoding, everything is transported as bytes. What’s the configueration of your producer / consumer? Are you using Java / JVM? – Best regards, Radek Gruchalski ra...@

RE: Kafka UTF 8 encoding problem

2016-11-09 Thread Baris Akgun (Garanti Teknoloji)
Kafka API, I also try with Kafka CLI and Java kafka api but I always face with same issue. Thanks From: Radoslaw Gruchalski [mailto:ra...@gruchalski.com] Sent: Wednesday, November 9, 2016 1:49 PM To: Baris Akgun (Garanti Teknoloji); users@kafka.apache.org Subject: Re: Kafka UTF 8 encoding pr

Re: Kafka UTF 8 encoding problem

2016-11-09 Thread Radoslaw Gruchalski
Baris, Kafka does not care about encoding, everything is transported as bytes. What’s the configueration of your producer / consumer? Are you using Java / JVM? – Best regards, Radek Gruchalski ra...@gruchalski.com On November 9, 2016 at 11:42:02 AM, Baris Akgun (Garanti Teknoloji) ( barisa...@g

Re: Kafka UTF 8 encoding problem

2016-11-09 Thread Ali Akhtar
I would recommend base64 encoding the message on the producer side, and decoding it on the consumer side. On Wed, Nov 9, 2016 at 3:40 PM, Baris Akgun (Garanti Teknoloji) < barisa...@garanti.com.tr> wrote: > Hi All, > > We are using Kafka 0,9.0.0 and we want to send our messages to topic in > UTF-

Kafka UTF 8 encoding problem

2016-11-09 Thread Baris Akgun (Garanti Teknoloji)
Hi All, We are using Kafka 0,9.0.0 and we want to send our messages to topic in UTF-8 format but when we consume the messages from topic we saw that kafka does not keep the original utf-8 format and we did not see the messages exactly. For example our message that includes turkish characters i