In the kafka llgs I get this entry from the client....is this a client or
kafja server issue? if in the kafka server..how do I resolve?
[2014-02-26 05:45:47,322] INFO Closing socket connection to
/107.170.xxx.xxx due to invalid request: Request of length 1903520116 is
not valid, it is larger than the maximum size of 104857600 bytes.
(kafka.network.Processor)
On Wed, Feb 26, 2014 at 1:41 PM, David Montgomery <davidmontgom...@gmail.com
> wrote:
> I moved lib files..the consumer still gets the below error
> this is how I install kafka from the online docs. are the docs
> incorrect?
>
> tar -xzf kafka-0.8.0-src.tgz
> cd kafka-#{version}-src
> ./sbt update
> ./sbt package
> ./sbt assembly-package-dependency
>
>
>
>
>
>
>
> 2014-02-26 05:36:35,298 INFO [main]
> io.druid.segment.realtime.RealtimeManager - Calling the FireDepartment and
> getting a Firehose.
> 2014-02-26 05:36:35,300 ERROR [main] io.druid.cli.CliBroker - Error when
> starting up. Failing.
> java.lang.reflect.InvocationTargetException
>
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at
> com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler.start(Lifecycle.java:331)
> at com.metamx.common.lifecycle.Lifecycle.start(Lifecycle.java:250)
> at io.druid.guice.LifecycleModule$2.start(LifecycleModule.java:136)
> at io.druid.cli.GuiceRunnable.initLifecycle(GuiceRunnable.java:72)
> at io.druid.cli.ServerRunnable.run(ServerRunnable.java:40)
> at io.druid.cli.Main.main(Main.java:91)
> Caused by: java.lang.NoClassDefFoundError: scala/ScalaObject
> at java.lang.ClassLoader.defineClass1(Native Method)
> at java.lang.ClassLoader.defineClass(ClassLoader.java:800)
> at
> java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
> at java.net.URLClassLoader.defineClass(URLClassLoader.java:449)
> at java.net.URLClassLoader.access$100(URLClassLoader.java:71)
> at java.net.URLClassLoader$1.run(URLClassLoader.java:361)
> at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
> at
> io.druid.firehose.kafka.KafkaEightFirehoseFactory.connect(KafkaEightFirehoseFactory.java:76)
> at
> io.druid.segment.realtime.FireDepartment.connect(FireDepartment.java:90)
> at
> io.druid.segment.realtime.RealtimeManager$FireChief.init(RealtimeManager.java:150)
> at
> io.druid.segment.realtime.RealtimeManager.start(RealtimeManager.java:87)
> ... 10 more
> Caused by: java.lang.ClassNotFoundException: scala.ScalaObject
> at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
> at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
> ... 25 more
> ^Z
> [3]+ Stopped tail -f realtime.log
>
>
>
> On Wed, Feb 26, 2014 at 1:26 PM, Jun Rao <jun...@gmail.com> wrote:
>
>> You just need to copy scala-library.jar. The version depends on scala
>> version that the kafka jar is built with.
>>
>> Thanks,
>>
>> Jun
>>
>>
>> On Tue, Feb 25, 2014 at 9:21 PM, David Montgomery <
>> davidmontgom...@gmail.com
>> > wrote:
>>
>> > Below are the scala jar files I have on the system. Which do I move?
>> >
>> > and I move to this dir? /var/lib/kafka-0.8.0-src/lib
>> >
>> >
>> >
>> >
>> > root@do-kafka-sg-development-20140217110812:/var/lib/kafka-0.8.0-src#
>> find
>> > / -name *scala*.jar
>> > /root/.ivy2/cache/org.scalatest/scalatest/jars/scalatest-1.2.jar
>> >
>> /root/.ivy2/cache/org.scala-lang/scala-library/jars/scala-library-2.8.0.jar
>> >
>> /root/.ivy2/cache/org.scala-lang/scala-library/jars/scala-library-2.9.2.jar
>> >
>> >
>> /root/.ivy2/cache/org.scala-lang/scala-compiler/jars/scala-compiler-2.9.2.jar
>> >
>> >
>> /root/.ivy2/cache/org.scala-lang/scala-compiler/jars/scala-compiler-2.8.0.jar
>> > /root/.sbt/boot/scala-2.9.2/lib/scala-compiler.jar
>> > /root/.sbt/boot/scala-2.9.2/lib/scala-library.jar
>> > /root/.sbt/boot/scala-2.8.0/lib/scala-compiler.jar
>> > /root/.sbt/boot/scala-2.8.0/lib/scala-library.jar
>> >
>> >
>> >
>> >
>> > On Wed, Feb 26, 2014 at 1:11 PM, Jun Rao <jun...@gmail.com> wrote:
>> >
>> > > You just need to add the scala jar to the lib dir.
>> > >
>> > > Thanks,
>> > >
>> > > Jun
>> > >
>> > >
>> > > On Tue, Feb 25, 2014 at 8:40 PM, David Montgomery <
>> > > davidmontgom...@gmail.com
>> > > > wrote:
>> > >
>> > > > Hi,
>> > > >
>> > > > This is how I start kafka.
>> > > >
>> > > > command = /var/lib/kafka-<%=@version%>-src/bin/kafka-server-start.sh
>> > > > /var/lib/kafka-<%=@version%>-src/config/server.properties
>> > > >
>> > > > In another application I get teh below error. The suggestion is to
>> add
>> > > the
>> > > > scalar libraries to the path. How do I do that?
>> > > >
>> > > >
>> > > > thanks
>> > > >
>> > > >
>> > > > java.lang.reflect.
>> > > > InvocationTargetException
>> > > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> > > > at
>> > > >
>> > > >
>> > >
>> >
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>> > > > at
>> > > >
>> > > >
>> > >
>> >
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> > > > at java.lang.reflect.Method.invoke(Method.java:606)
>> > > > at
>> > > >
>> > > >
>> > >
>> >
>> com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler.start(Lifecycle.java:331)
>> > > > at
>> com.metamx.common.lifecycle.Lifecycle.start(Lifecycle.java:250)
>> > > > at
>> io.druid.guice.LifecycleModule$2.start(LifecycleModule.java:136)
>> > > > at
>> io.druid.cli.GuiceRunnable.initLifecycle(GuiceRunnable.java:72)
>> > > > at io.druid.cli.ServerRunnable.run(ServerRunnable.java:40)
>> > > > at io.druid.cli.Main.main(Main.java:91)
>> > > > Caused by: java.lang.NoClassDefFoundError: scala/ScalaObject
>> > > > at java.lang.ClassLoader.defineClass1(Native Method)
>> > > > at java.lang.ClassLoader.defineClass(ClassLoader.java:800)
>> > > > at
>> > > >
>> java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
>> > > > at java.net.URLClassLoader.defineClass(URLClassLoader.java:449)
>> > > > at java.net.URLClassLoader.access$100(URLClassLoader.java:71)
>> > > > at java.net.URLClassLoader$1.run(URLClassLoader.java:361)
>> > > > at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
>> > > > at java.security.AccessController.doPrivileged(Native Method)
>> > > > at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
>> > > > at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
>> > > > at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
>> > > > at
>> > > >
>> > > >
>> > >
>> >
>> io.druid.firehose.kafka.KafkaEightFirehoseFactory.connect(KafkaEightFirehoseFactory.java:76)
>> > > > at
>> > > >
>> > io.druid.segment.realtime.FireDepartment.connect(FireDepartment.java:90)
>> > > > at
>> > > >
>> > > >
>> > >
>> >
>> io.druid.segment.realtime.RealtimeManager$FireChief.init(RealtimeManager.java:150)
>> > > > at
>> > > >
>> > io.druid.segment.realtime.RealtimeManager.start(RealtimeManager.java:87)
>> > > > ... 10 more
>> > > > Caused by: java.lang.ClassNotFoundException: scala.ScalaObject
>> > > > at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
>> > > > at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
>> > > > at java.security.AccessController.doPrivileged(Native Method)
>> > > > at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
>> > > > at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
>> > > > at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
>> > > > ... 25 more
>> > > >
>> > >
>> >
>>
>
>
