What is the way to produce events from windows OS

Hi . I am working on project: Project has producer which runs on Windows OS (C#) . Consumer is java on Linux. Question: What is the way to write to Kafka from Windows OS? As I understand C# client is legacy. So what is the way to write to Kafka from Windows? Can I use C/C++ client from

RE: producer creating multiple log files after message sending

Hi Neha, I was able to figure this out, this is happening due to time based rolling. But now problem, when I fetch the messages for particular topic, server is reading only one log file, returns those messages only. Is there any way I can combine all log files which are already produced into

Re: producer creating multiple log files after message sending

Otherwise if you are using the high level consumer (ZookeeperConsumerConnector) in code, you will have to start a new consumer with a different group id. Thanks, Swapnil On 4/18/13 2:09 AM, Swapnil Ghike sgh...@linkedin.com wrote: Snehalata, Are you using the console consumer? You can pass a

Re: producer creating multiple log files after message sending

I think there is a misunderstanding here. The log file division is completely transparent to the consumer. The consumer consumes by offset (0,1,2,3,...) and these offsets span log files (i.e. there is a single, monotonically increasing set of offsets over all log files in a partition). In other

Re: producer creating multiple log files after message sending

Jay, This makes perfect sense and it is very helpful. thanks, Jason On Thu, Apr 18, 2013 at 12:20 PM, Jay Kreps jay.kr...@gmail.com wrote: I think there is a misunderstanding here. The log file division is completely transparent to the consumer. The consumer consumes by offset

Re: What is the way to produce events from windows OS

Can you use the java client on Windows? Thanks, Jun On Thu, Apr 18, 2013 at 12:11 AM, Oleg Ruchovets oruchov...@gmail.comwrote: Hi . I am working on project: Project has producer which runs on Windows OS (C#) . Consumer is java on Linux. Question: What is the way to write to

Is the information at https://cwiki.apache.org/confluence/display/KAFKA/Operations up to date ?

Hello, We're considering to use Kafka, and would like to know the Java/ Scala/Kafka version combination in which it is being used in production. The wiki Operations page states that We are running Kafka 0.7 right now but may move to trunk as we fix bugs. While I read here that 0.8 was

Re: Is the information at https://cwiki.apache.org/confluence/display/KAFKA/Operations up to date ?

We have been testing 0.8 at LinkedIn for some time. We plan to release an 0.8 beta version next week. Thanks, Jun On Thu, Apr 18, 2013 at 12:29 PM, Itai Frenkel it...@gigaspaces.com wrote: Hello, We're considering to use Kafka, and would like to know the Java/ Scala/Kafka version

Re: Is the information at https://cwiki.apache.org/confluence/display/KAFKA/Operations up to date ?

Jun, I have been trying to test 0.8 using two consumers on the same group ID. When I start the second consumer the first stops receiving messages. Can you help? Single Kafka server, single topic, 3 partitions, single Zookeeper. 1 console consumer running in one session. 1 console consumer

Re: How to create the initial zookeeper chroot path for zk.connect?

Yes, using the latest Kafka 0.7.2, just tried to reproduce again 1. Install a single node Kafka, three nodes zookeeper instances kafka1 zookeeper1 zookeeper2 zookeeper3 2. Using a simple Kafka config, able to start without error in the log brokerid=1 log.dir=/data/kafka