Kafka Streaming Join for range of gps coordinates

2016-08-27 Thread Farhon Zaharia
Hello friends, I am designing a new streaming component and am looking at how to use Kafka Streams. I need some guidance with the appropriate flow. *Problem to solve:* The problem I am working on is I have a large group of riders and drivers. I would like to match available riders to nearby

Kafka startup exception while recovering log file

2016-08-27 Thread Gaurav Agarwal
Hi All, We are facing a weird problem where Kafka broker fails to start due to an unhandled exception while 'recovering' a log segment. I have been able to isolate the problem to a single record and providing the details below: During Kafka restart, if index files are corrupted or they don't

kafka-streams project compiles using maven but failed using sbt

2016-08-27 Thread Tommy Go
Hi I am playing with kafka-streams using Scala, but found some strange issue, the following project compiles using mvn but failed using sbt: https://github.com/deeplambda/kstream-debug [error] /Users/tommy/tmp/kstream-debug/src/main/scala/kafka/streams/WordCountDemo.scala:49: missing parameter

Kafka bootup exception while recovering log file

2016-08-27 Thread Gaurav Agarwal
Hi All, We are facing a weird problem where Kafka broker fails to start due to an unhandled exception while 'recovering' a log segment. I have been able to isolate the problem to a single record and providing the details below: During Kafka restart, if index files are corrupted or they don't