This just means that you exceed the max request size. You can change the
config on the broker.
Thanks,
jun
On Tue, Feb 25, 2014 at 10:23 PM, David Montgomery <
davidmontgom...@gmail.com> wrote:
> In the kafka llgs I get this entry from the client....is this a client or
> kafja server issue? if in the kafka server..how do I resolve?
>
> [2014-02-26 05:45:47,322] INFO Closing socket connection to
> /107.170.xxx.xxx due to invalid request: Request of length 1903520116 is
> not valid, it is larger than the maximum size of 104857600 bytes.
> (kafka.network.Processor)
>
>
>
> On Wed, Feb 26, 2014 at 1:41 PM, David Montgomery <
> davidmontgom...@gmail.com
> > wrote:
>
> > I moved lib files..the consumer still gets the below error
> > this is how I install kafka from the online docs. are the docs
> > incorrect?
> >
> > tar -xzf kafka-0.8.0-src.tgz
> > cd kafka-#{version}-src
> > ./sbt update
> > ./sbt package
> > ./sbt assembly-package-dependency
> >
> >
> >
> >
> >
> >
> >
> > 2014-02-26 05:36:35,298 INFO [main]
> > io.druid.segment.realtime.RealtimeManager - Calling the FireDepartment
> and
> > getting a Firehose.
> > 2014-02-26 05:36:35,300 ERROR [main] io.druid.cli.CliBroker - Error when
> > starting up. Failing.
> > java.lang.reflect.InvocationTargetException
> >
> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > at
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> > at
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > at java.lang.reflect.Method.invoke(Method.java:606)
> > at
> >
> com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler.start(Lifecycle.java:331)
> > at com.metamx.common.lifecycle.Lifecycle.start(Lifecycle.java:250)
> > at io.druid.guice.LifecycleModule$2.start(LifecycleModule.java:136)
> > at io.druid.cli.GuiceRunnable.initLifecycle(GuiceRunnable.java:72)
> > at io.druid.cli.ServerRunnable.run(ServerRunnable.java:40)
> > at io.druid.cli.Main.main(Main.java:91)
> > Caused by: java.lang.NoClassDefFoundError: scala/ScalaObject
> > at java.lang.ClassLoader.defineClass1(Native Method)
> > at java.lang.ClassLoader.defineClass(ClassLoader.java:800)
> > at
> > java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
> > at java.net.URLClassLoader.defineClass(URLClassLoader.java:449)
> > at java.net.URLClassLoader.access$100(URLClassLoader.java:71)
> > at java.net.URLClassLoader$1.run(URLClassLoader.java:361)
> > at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
> > at java.security.AccessController.doPrivileged(Native Method)
> > at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
> > at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
> > at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
> > at
> >
> io.druid.firehose.kafka.KafkaEightFirehoseFactory.connect(KafkaEightFirehoseFactory.java:76)
> > at
> > io.druid.segment.realtime.FireDepartment.connect(FireDepartment.java:90)
> > at
> >
> io.druid.segment.realtime.RealtimeManager$FireChief.init(RealtimeManager.java:150)
> > at
> > io.druid.segment.realtime.RealtimeManager.start(RealtimeManager.java:87)
> > ... 10 more
> > Caused by: java.lang.ClassNotFoundException: scala.ScalaObject
> > at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
> > at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
> > at java.security.AccessController.doPrivileged(Native Method)
> > at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
> > at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
> > at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
> > ... 25 more
> > ^Z
> > [3]+ Stopped tail -f realtime.log
> >
> >
> >
> > On Wed, Feb 26, 2014 at 1:26 PM, Jun Rao <jun...@gmail.com> wrote:
> >
> >> You just need to copy scala-library.jar. The version depends on scala
> >> version that the kafka jar is built with.
> >>
> >> Thanks,
> >>
> >> Jun
> >>
> >>
> >> On Tue, Feb 25, 2014 at 9:21 PM, David Montgomery <
> >> davidmontgom...@gmail.com
> >> > wrote:
> >>
> >> > Below are the scala jar files I have on the system. Which do I move?
> >> >
> >> > and I move to this dir? /var/lib/kafka-0.8.0-src/lib
> >> >
> >> >
> >> >
> >> >
> >> > root@do-kafka-sg-development-20140217110812:/var/lib/kafka-0.8.0-src#
> >> find
> >> > / -name *scala*.jar
> >> > /root/.ivy2/cache/org.scalatest/scalatest/jars/scalatest-1.2.jar
> >> >
> >>
> /root/.ivy2/cache/org.scala-lang/scala-library/jars/scala-library-2.8.0.jar
> >> >
> >>
> /root/.ivy2/cache/org.scala-lang/scala-library/jars/scala-library-2.9.2.jar
> >> >
> >> >
> >>
> /root/.ivy2/cache/org.scala-lang/scala-compiler/jars/scala-compiler-2.9.2.jar
> >> >
> >> >
> >>
> /root/.ivy2/cache/org.scala-lang/scala-compiler/jars/scala-compiler-2.8.0.jar
> >> > /root/.sbt/boot/scala-2.9.2/lib/scala-compiler.jar
> >> > /root/.sbt/boot/scala-2.9.2/lib/scala-library.jar
> >> > /root/.sbt/boot/scala-2.8.0/lib/scala-compiler.jar
> >> > /root/.sbt/boot/scala-2.8.0/lib/scala-library.jar
> >> >
> >> >
> >> >
> >> >
> >> > On Wed, Feb 26, 2014 at 1:11 PM, Jun Rao <jun...@gmail.com> wrote:
> >> >
> >> > > You just need to add the scala jar to the lib dir.
> >> > >
> >> > > Thanks,
> >> > >
> >> > > Jun
> >> > >
> >> > >
> >> > > On Tue, Feb 25, 2014 at 8:40 PM, David Montgomery <
> >> > > davidmontgom...@gmail.com
> >> > > > wrote:
> >> > >
> >> > > > Hi,
> >> > > >
> >> > > > This is how I start kafka.
> >> > > >
> >> > > > command =
> /var/lib/kafka-<%=@version%>-src/bin/kafka-server-start.sh
> >> > > > /var/lib/kafka-<%=@version%>-src/config/server.properties
> >> > > >
> >> > > > In another application I get teh below error. The suggestion is
> to
> >> add
> >> > > the
> >> > > > scalar libraries to the path. How do I do that?
> >> > > >
> >> > > >
> >> > > > thanks
> >> > > >
> >> > > >
> >> > > > java.lang.reflect.
> >> > > > InvocationTargetException
> >> > > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >> > > > at
> >> > > >
> >> > > >
> >> > >
> >> >
> >>
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> >> > > > at
> >> > > >
> >> > > >
> >> > >
> >> >
> >>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> >> > > > at java.lang.reflect.Method.invoke(Method.java:606)
> >> > > > at
> >> > > >
> >> > > >
> >> > >
> >> >
> >>
> com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler.start(Lifecycle.java:331)
> >> > > > at
> >> com.metamx.common.lifecycle.Lifecycle.start(Lifecycle.java:250)
> >> > > > at
> >> io.druid.guice.LifecycleModule$2.start(LifecycleModule.java:136)
> >> > > > at
> >> io.druid.cli.GuiceRunnable.initLifecycle(GuiceRunnable.java:72)
> >> > > > at io.druid.cli.ServerRunnable.run(ServerRunnable.java:40)
> >> > > > at io.druid.cli.Main.main(Main.java:91)
> >> > > > Caused by: java.lang.NoClassDefFoundError: scala/ScalaObject
> >> > > > at java.lang.ClassLoader.defineClass1(Native Method)
> >> > > > at java.lang.ClassLoader.defineClass(ClassLoader.java:800)
> >> > > > at
> >> > > >
> >> java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
> >> > > > at
> java.net.URLClassLoader.defineClass(URLClassLoader.java:449)
> >> > > > at java.net.URLClassLoader.access$100(URLClassLoader.java:71)
> >> > > > at java.net.URLClassLoader$1.run(URLClassLoader.java:361)
> >> > > > at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
> >> > > > at java.security.AccessController.doPrivileged(Native Method)
> >> > > > at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
> >> > > > at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
> >> > > > at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
> >> > > > at
> >> > > >
> >> > > >
> >> > >
> >> >
> >>
> io.druid.firehose.kafka.KafkaEightFirehoseFactory.connect(KafkaEightFirehoseFactory.java:76)
> >> > > > at
> >> > > >
> >> >
> io.druid.segment.realtime.FireDepartment.connect(FireDepartment.java:90)
> >> > > > at
> >> > > >
> >> > > >
> >> > >
> >> >
> >>
> io.druid.segment.realtime.RealtimeManager$FireChief.init(RealtimeManager.java:150)
> >> > > > at
> >> > > >
> >> >
> io.druid.segment.realtime.RealtimeManager.start(RealtimeManager.java:87)
> >> > > > ... 10 more
> >> > > > Caused by: java.lang.ClassNotFoundException: scala.ScalaObject
> >> > > > at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
> >> > > > at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
> >> > > > at java.security.AccessController.doPrivileged(Native Method)
> >> > > > at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
> >> > > > at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
> >> > > > at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
> >> > > > ... 25 more
> >> > > >
> >> > >
> >> >
> >>
> >
> >
>
