Re: How ot had scala libraries to path
Hmm, not sure how duid picks up the jars. Perhaps you can ask duid mailing
list? Do you know if duid is on Kafka 0.7 or 0.8?
Thanks,
Jun
On Mon, Mar 3, 2014 at 3:37 AM, David Montgomery
wrote:
> I have reverted back to 7. I can produce and consume using the python lib
> brod.
>
>
>
>
>
>
> Druid consumer gives this error.
>
> My libs are here. So..kafka cant find scala?
>
>
> /var/lib/kafka-0.7.2-incubating-src/core/lib_managed/scala_2.8.0/test/scalatest-1.2.jar
>
> /var/lib/kafka-0.7.2-incubating-src/project/boot/scala-2.7.7/lib/scala-compiler.jar
>
> /var/lib/kafka-0.7.2-incubating-src/project/boot/scala-2.7.7/lib/scala-library.jar
>
> /var/lib/kafka-0.7.2-incubating-src/project/boot/scala-2.8.0/lib/scala-compiler.jar
>
> /var/lib/kafka-0.7.2-incubating-src/project/boot/scala-2.8.0/lib/scala-library.jar
>
>
> Here is how I install:]'cd kafka-0.7.2-incubating-src
> ./sbt update
> ./sbt package
> echo 'KAFKA_JMX_OPTS="-Dcom.sun.management.jmxremote=true
> -Dcom.sun.management.jmxremote.authenticate=false
> -Dcom.sun.management.jmxremote.ssl=false"' | tee -a
> /var/lib/kafka-0.7.2-incubating-src/bin/kafka-run-class.sh
> echo 'export JMX_PORT=${JMX_PORT:-}' | tee -a
> /var/lib/kafka-0.7.2-incubating-src/bin/kafka-server-start.sh
>
> Here is how I start
> /var/lib/kafka-0.7.2-incubating-src/bin/kafka-server-start.sh
> /var/lib/kafka-0.7.2-incubating-src/config/server.properties
>
>
>
> ing SASL (unknown error)
> 2014-03-03 11:19:40,237 INFO [main]
> com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking
> start method[public void io.druid.segment.realtime.RealtimeManager.start()
> throws java.io.IOException] on
> object[io.druid.segment.realtime.RealtimeManager@73ed27ed].
> 2014-03-03 11:19:40,241 INFO [main]
> io.druid.segment.realtime.RealtimeManager - Calling the FireDepartment and
> getting a Firehose.
> 2014-03-03 11:19:40,249 ERROR [main] io.druid.cli.CliBroker - Error when
> starting up. Failing.
> java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
>
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at
>
> com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler.start(Lifecycle.java:331)
> at com.metamx.common.lifecycle.Lifecycle.start(Lifecycle.java:250)
> at io.druid.guice.LifecycleModule$2.start(LifecycleModule.java:136)
> at io.druid.cli.GuiceRunnable.initLifecycle(GuiceRunnable.java:72)
> at io.druid.cli.ServerRunnable.run(ServerRunnable.java:40)
> at io.druid.cli.Main.main(Main.java:91)
> Caused by: java.lang.NoClassDefFoundError: scala/ScalaObject
> at java.lang.ClassLoader.defineClass1(Native Method)
> at java.lang.ClassLoader.defineClass(ClassLoader.java:800)
> at
> java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
> at java.net.URLClassLoader.defineClass(URLClassLoader.java:449)
> at java.net.URLClassLoader.access$100(URLClassLoader.java:71)
> at java.net.URLClassLoader$1.run(URLClassLoader.java:361)
> at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
> at
>
> io.druid.firehose.kafka.KafkaSevenFirehoseFactory.connect(KafkaSevenFirehoseFactory.java:89)
> at
> io.druid.segment.realtime.FireDepartment.connect(FireDepartment.java:90)
> at
>
> io.druid.segment.realtime.RealtimeManager$FireChief.init(RealtimeManager.java:150)
> at
> io.druid.segment.realtime.RealtimeManager.start(RealtimeManager.java:87)
> ... 10 more
> Caused by: java.lang.ClassNotFoundException: scala.ScalaObject
> at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
> at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
> ... 25 more
>
>
>
> On Wed, Feb 26, 2014 at 12:40 PM, David Montgomery <
> davidmontgom...@gmail.com> wrote:
>
> > Hi,
> >
> > This is how I start kafka.
> >
> > command = /var/lib/kafka-<%=@version%>-src/bin/kafka-server-start.sh
> > /var/lib/kafka-<%=@version%>-src/config/server.properties
> >
> > In another application I get teh below error. The suggestion is to add
> > the scalar libraries to the path. How do I do that?
> >
> >
> > thanks
> >
> >
> > java.lang.reflect.
> > InvocationTargetException
> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > at
> >
Re: How ot had scala libraries to path
I have reverted back to 7. I can produce and consume using the python lib
brod.
Druid consumer gives this error.
My libs are here. So..kafka cant find scala?
/var/lib/kafka-0.7.2-incubating-src/core/lib_managed/scala_2.8.0/test/scalatest-1.2.jar
/var/lib/kafka-0.7.2-incubating-src/project/boot/scala-2.7.7/lib/scala-compiler.jar
/var/lib/kafka-0.7.2-incubating-src/project/boot/scala-2.7.7/lib/scala-library.jar
/var/lib/kafka-0.7.2-incubating-src/project/boot/scala-2.8.0/lib/scala-compiler.jar
/var/lib/kafka-0.7.2-incubating-src/project/boot/scala-2.8.0/lib/scala-library.jar
Here is how I install:]'cd kafka-0.7.2-incubating-src
./sbt update
./sbt package
echo 'KAFKA_JMX_OPTS="-Dcom.sun.management.jmxremote=true
-Dcom.sun.management.jmxremote.authenticate=false
-Dcom.sun.management.jmxremote.ssl=false"' | tee -a
/var/lib/kafka-0.7.2-incubating-src/bin/kafka-run-class.sh
echo 'export JMX_PORT=${JMX_PORT:-}' | tee -a
/var/lib/kafka-0.7.2-incubating-src/bin/kafka-server-start.sh
Here is how I start
/var/lib/kafka-0.7.2-incubating-src/bin/kafka-server-start.sh
/var/lib/kafka-0.7.2-incubating-src/config/server.properties
ing SASL (unknown error)
2014-03-03 11:19:40,237 INFO [main]
com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking
start method[public void io.druid.segment.realtime.RealtimeManager.start()
throws java.io.IOException] on
object[io.druid.segment.realtime.RealtimeManager@73ed27ed].
2014-03-03 11:19:40,241 INFO [main]
io.druid.segment.realtime.RealtimeManager - Calling the FireDepartment and
getting a Firehose.
2014-03-03 11:19:40,249 ERROR [main] io.druid.cli.CliBroker - Error when
starting up. Failing.
java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler.start(Lifecycle.java:331)
at com.metamx.common.lifecycle.Lifecycle.start(Lifecycle.java:250)
at io.druid.guice.LifecycleModule$2.start(LifecycleModule.java:136)
at io.druid.cli.GuiceRunnable.initLifecycle(GuiceRunnable.java:72)
at io.druid.cli.ServerRunnable.run(ServerRunnable.java:40)
at io.druid.cli.Main.main(Main.java:91)
Caused by: java.lang.NoClassDefFoundError: scala/ScalaObject
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:800)
at
java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:449)
at java.net.URLClassLoader.access$100(URLClassLoader.java:71)
at java.net.URLClassLoader$1.run(URLClassLoader.java:361)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
at
io.druid.firehose.kafka.KafkaSevenFirehoseFactory.connect(KafkaSevenFirehoseFactory.java:89)
at
io.druid.segment.realtime.FireDepartment.connect(FireDepartment.java:90)
at
io.druid.segment.realtime.RealtimeManager$FireChief.init(RealtimeManager.java:150)
at
io.druid.segment.realtime.RealtimeManager.start(RealtimeManager.java:87)
... 10 more
Caused by: java.lang.ClassNotFoundException: scala.ScalaObject
at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
... 25 more
On Wed, Feb 26, 2014 at 12:40 PM, David Montgomery <
davidmontgom...@gmail.com> wrote:
> Hi,
>
> This is how I start kafka.
>
> command = /var/lib/kafka-<%=@version%>-src/bin/kafka-server-start.sh
> /var/lib/kafka-<%=@version%>-src/config/server.properties
>
> In another application I get teh below error. The suggestion is to add
> the scalar libraries to the path. How do I do that?
>
>
> thanks
>
>
> java.lang.reflect.
> InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at
> com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler.start(Lifecycle.java:331)
> at com.metamx.common.lifecycle.Lifecycle.start(Lifecycle.java:250)
> at io.druid.guice.L
Re: How ot had scala libraries to path
This just means that you exceed the max request size. You can change the
config on the broker.
Thanks,
jun
On Tue, Feb 25, 2014 at 10:23 PM, David Montgomery <
davidmontgom...@gmail.com> wrote:
> In the kafka llgs I get this entry from the clientis this a client or
> kafja server issue? if in the kafka server..how do I resolve?
>
> [2014-02-26 05:45:47,322] INFO Closing socket connection to
> /107.170.xxx.xxx due to invalid request: Request of length 1903520116 is
> not valid, it is larger than the maximum size of 104857600 bytes.
> (kafka.network.Processor)
>
>
>
> On Wed, Feb 26, 2014 at 1:41 PM, David Montgomery <
> davidmontgom...@gmail.com
> > wrote:
>
> > I moved lib files..the consumer still gets the below error
> > this is how I install kafka from the online docs.are the docs
> > incorrect?
> >
> > tar -xzf kafka-0.8.0-src.tgz
> > cd kafka-#{version}-src
> > ./sbt update
> > ./sbt package
> > ./sbt assembly-package-dependency
> >
> >
> >
> >
> >
> >
> >
> > 2014-02-26 05:36:35,298 INFO [main]
> > io.druid.segment.realtime.RealtimeManager - Calling the FireDepartment
> and
> > getting a Firehose.
> > 2014-02-26 05:36:35,300 ERROR [main] io.druid.cli.CliBroker - Error when
> > starting up. Failing.
> > java.lang.reflect.InvocationTargetException
> >
> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > at
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> > at
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > at java.lang.reflect.Method.invoke(Method.java:606)
> > at
> >
> com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler.start(Lifecycle.java:331)
> > at com.metamx.common.lifecycle.Lifecycle.start(Lifecycle.java:250)
> > at io.druid.guice.LifecycleModule$2.start(LifecycleModule.java:136)
> > at io.druid.cli.GuiceRunnable.initLifecycle(GuiceRunnable.java:72)
> > at io.druid.cli.ServerRunnable.run(ServerRunnable.java:40)
> > at io.druid.cli.Main.main(Main.java:91)
> > Caused by: java.lang.NoClassDefFoundError: scala/ScalaObject
> > at java.lang.ClassLoader.defineClass1(Native Method)
> > at java.lang.ClassLoader.defineClass(ClassLoader.java:800)
> > at
> > java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
> > at java.net.URLClassLoader.defineClass(URLClassLoader.java:449)
> > at java.net.URLClassLoader.access$100(URLClassLoader.java:71)
> > at java.net.URLClassLoader$1.run(URLClassLoader.java:361)
> > at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
> > at java.security.AccessController.doPrivileged(Native Method)
> > at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
> > at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
> > at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
> > at
> >
> io.druid.firehose.kafka.KafkaEightFirehoseFactory.connect(KafkaEightFirehoseFactory.java:76)
> > at
> > io.druid.segment.realtime.FireDepartment.connect(FireDepartment.java:90)
> > at
> >
> io.druid.segment.realtime.RealtimeManager$FireChief.init(RealtimeManager.java:150)
> > at
> > io.druid.segment.realtime.RealtimeManager.start(RealtimeManager.java:87)
> > ... 10 more
> > Caused by: java.lang.ClassNotFoundException: scala.ScalaObject
> > at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
> > at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
> > at java.security.AccessController.doPrivileged(Native Method)
> > at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
> > at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
> > at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
> > ... 25 more
> > ^Z
> > [3]+ Stopped tail -f realtime.log
> >
> >
> >
> > On Wed, Feb 26, 2014 at 1:26 PM, Jun Rao wrote:
> >
> >> You just need to copy scala-library.jar. The version depends on scala
> >> version that the kafka jar is built with.
> >>
> >> Thanks,
> >>
> >> Jun
> >>
> >>
> >> On Tue, Feb 25, 2014 at 9:21 PM, David Montgomery <
> >> davidmontgom...@gmail.com
> >> > wrote:
> >>
> >> > Below are the scala jar files I have on the system. Which do I move?
> >> >
> >> > and I move to this dir? /var/lib/kafka-0.8.0-src/lib
> >> >
> >> >
> >> >
> >> >
> >> > root@do-kafka-sg-development-20140217110812:/var/lib/kafka-0.8.0-src#
> >> find
> >> > / -name *scala*.jar
> >> > /root/.ivy2/cache/org.scalatest/scalatest/jars/scalatest-1.2.jar
> >> >
> >>
> /root/.ivy2/cache/org.scala-lang/scala-library/jars/scala-library-2.8.0.jar
> >> >
> >>
> /root/.ivy2/cache/org.scala-lang/scala-library/jars/scala-library-2.9.2.jar
> >> >
> >> >
> >>
> /root/.ivy2/cache/org.scala-lang/scala-compiler/jars/scala-compiler-2.9.2.jar
> >> >
> >> >
> >>
> /root/.ivy2/cache/org.scala-lang/scala-compiler/jars/scala-compiler-2.8.0.jar
> >> > /root/.sbt/boot/scala-2.9.2/lib/scala-compiler.
Re: How ot had scala libraries to path
In the kafka llgs I get this entry from the clientis this a client or
kafja server issue? if in the kafka server..how do I resolve?
[2014-02-26 05:45:47,322] INFO Closing socket connection to
/107.170.xxx.xxx due to invalid request: Request of length 1903520116 is
not valid, it is larger than the maximum size of 104857600 bytes.
(kafka.network.Processor)
On Wed, Feb 26, 2014 at 1:41 PM, David Montgomery wrote:
> I moved lib files..the consumer still gets the below error
> this is how I install kafka from the online docs.are the docs
> incorrect?
>
> tar -xzf kafka-0.8.0-src.tgz
> cd kafka-#{version}-src
> ./sbt update
> ./sbt package
> ./sbt assembly-package-dependency
>
>
>
>
>
>
>
> 2014-02-26 05:36:35,298 INFO [main]
> io.druid.segment.realtime.RealtimeManager - Calling the FireDepartment and
> getting a Firehose.
> 2014-02-26 05:36:35,300 ERROR [main] io.druid.cli.CliBroker - Error when
> starting up. Failing.
> java.lang.reflect.InvocationTargetException
>
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at
> com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler.start(Lifecycle.java:331)
> at com.metamx.common.lifecycle.Lifecycle.start(Lifecycle.java:250)
> at io.druid.guice.LifecycleModule$2.start(LifecycleModule.java:136)
> at io.druid.cli.GuiceRunnable.initLifecycle(GuiceRunnable.java:72)
> at io.druid.cli.ServerRunnable.run(ServerRunnable.java:40)
> at io.druid.cli.Main.main(Main.java:91)
> Caused by: java.lang.NoClassDefFoundError: scala/ScalaObject
> at java.lang.ClassLoader.defineClass1(Native Method)
> at java.lang.ClassLoader.defineClass(ClassLoader.java:800)
> at
> java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
> at java.net.URLClassLoader.defineClass(URLClassLoader.java:449)
> at java.net.URLClassLoader.access$100(URLClassLoader.java:71)
> at java.net.URLClassLoader$1.run(URLClassLoader.java:361)
> at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
> at
> io.druid.firehose.kafka.KafkaEightFirehoseFactory.connect(KafkaEightFirehoseFactory.java:76)
> at
> io.druid.segment.realtime.FireDepartment.connect(FireDepartment.java:90)
> at
> io.druid.segment.realtime.RealtimeManager$FireChief.init(RealtimeManager.java:150)
> at
> io.druid.segment.realtime.RealtimeManager.start(RealtimeManager.java:87)
> ... 10 more
> Caused by: java.lang.ClassNotFoundException: scala.ScalaObject
> at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
> at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
> ... 25 more
> ^Z
> [3]+ Stopped tail -f realtime.log
>
>
>
> On Wed, Feb 26, 2014 at 1:26 PM, Jun Rao wrote:
>
>> You just need to copy scala-library.jar. The version depends on scala
>> version that the kafka jar is built with.
>>
>> Thanks,
>>
>> Jun
>>
>>
>> On Tue, Feb 25, 2014 at 9:21 PM, David Montgomery <
>> davidmontgom...@gmail.com
>> > wrote:
>>
>> > Below are the scala jar files I have on the system. Which do I move?
>> >
>> > and I move to this dir? /var/lib/kafka-0.8.0-src/lib
>> >
>> >
>> >
>> >
>> > root@do-kafka-sg-development-20140217110812:/var/lib/kafka-0.8.0-src#
>> find
>> > / -name *scala*.jar
>> > /root/.ivy2/cache/org.scalatest/scalatest/jars/scalatest-1.2.jar
>> >
>> /root/.ivy2/cache/org.scala-lang/scala-library/jars/scala-library-2.8.0.jar
>> >
>> /root/.ivy2/cache/org.scala-lang/scala-library/jars/scala-library-2.9.2.jar
>> >
>> >
>> /root/.ivy2/cache/org.scala-lang/scala-compiler/jars/scala-compiler-2.9.2.jar
>> >
>> >
>> /root/.ivy2/cache/org.scala-lang/scala-compiler/jars/scala-compiler-2.8.0.jar
>> > /root/.sbt/boot/scala-2.9.2/lib/scala-compiler.jar
>> > /root/.sbt/boot/scala-2.9.2/lib/scala-library.jar
>> > /root/.sbt/boot/scala-2.8.0/lib/scala-compiler.jar
>> > /root/.sbt/boot/scala-2.8.0/lib/scala-library.jar
>> >
>> >
>> >
>> >
>> > On Wed, Feb 26, 2014 at 1:11 PM, Jun Rao wrote:
>> >
>> > > You just need to add the scala jar to the lib dir.
>> > >
>> > > Thanks,
>> > >
>> > > Jun
>> > >
>> > >
>> > > On Tue, Feb 25, 2014 at 8:40 PM, David Montgomery <
>> > > davidmontgom...@gmail.com
>> > > > wrote:
>> > >
>> > > >
Re: How ot had scala libraries to path
I moved lib files..the consumer still gets the below error
this is how I install kafka from the online docs.are the docs
incorrect?
tar -xzf kafka-0.8.0-src.tgz
cd kafka-#{version}-src
./sbt update
./sbt package
./sbt assembly-package-dependency
2014-02-26 05:36:35,298 INFO [main]
io.druid.segment.realtime.RealtimeManager - Calling the FireDepartment and
getting a Firehose.
2014-02-26 05:36:35,300 ERROR [main] io.druid.cli.CliBroker - Error when
starting up. Failing.
java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler.start(Lifecycle.java:331)
at com.metamx.common.lifecycle.Lifecycle.start(Lifecycle.java:250)
at io.druid.guice.LifecycleModule$2.start(LifecycleModule.java:136)
at io.druid.cli.GuiceRunnable.initLifecycle(GuiceRunnable.java:72)
at io.druid.cli.ServerRunnable.run(ServerRunnable.java:40)
at io.druid.cli.Main.main(Main.java:91)
Caused by: java.lang.NoClassDefFoundError: scala/ScalaObject
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:800)
at
java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:449)
at java.net.URLClassLoader.access$100(URLClassLoader.java:71)
at java.net.URLClassLoader$1.run(URLClassLoader.java:361)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
at
io.druid.firehose.kafka.KafkaEightFirehoseFactory.connect(KafkaEightFirehoseFactory.java:76)
at
io.druid.segment.realtime.FireDepartment.connect(FireDepartment.java:90)
at
io.druid.segment.realtime.RealtimeManager$FireChief.init(RealtimeManager.java:150)
at
io.druid.segment.realtime.RealtimeManager.start(RealtimeManager.java:87)
... 10 more
Caused by: java.lang.ClassNotFoundException: scala.ScalaObject
at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
... 25 more
^Z
[3]+ Stopped tail -f realtime.log
On Wed, Feb 26, 2014 at 1:26 PM, Jun Rao wrote:
> You just need to copy scala-library.jar. The version depends on scala
> version that the kafka jar is built with.
>
> Thanks,
>
> Jun
>
>
> On Tue, Feb 25, 2014 at 9:21 PM, David Montgomery <
> davidmontgom...@gmail.com
> > wrote:
>
> > Below are the scala jar files I have on the system. Which do I move?
> >
> > and I move to this dir? /var/lib/kafka-0.8.0-src/lib
> >
> >
> >
> >
> > root@do-kafka-sg-development-20140217110812:/var/lib/kafka-0.8.0-src#
> find
> > / -name *scala*.jar
> > /root/.ivy2/cache/org.scalatest/scalatest/jars/scalatest-1.2.jar
> >
> /root/.ivy2/cache/org.scala-lang/scala-library/jars/scala-library-2.8.0.jar
> >
> /root/.ivy2/cache/org.scala-lang/scala-library/jars/scala-library-2.9.2.jar
> >
> >
> /root/.ivy2/cache/org.scala-lang/scala-compiler/jars/scala-compiler-2.9.2.jar
> >
> >
> /root/.ivy2/cache/org.scala-lang/scala-compiler/jars/scala-compiler-2.8.0.jar
> > /root/.sbt/boot/scala-2.9.2/lib/scala-compiler.jar
> > /root/.sbt/boot/scala-2.9.2/lib/scala-library.jar
> > /root/.sbt/boot/scala-2.8.0/lib/scala-compiler.jar
> > /root/.sbt/boot/scala-2.8.0/lib/scala-library.jar
> >
> >
> >
> >
> > On Wed, Feb 26, 2014 at 1:11 PM, Jun Rao wrote:
> >
> > > You just need to add the scala jar to the lib dir.
> > >
> > > Thanks,
> > >
> > > Jun
> > >
> > >
> > > On Tue, Feb 25, 2014 at 8:40 PM, David Montgomery <
> > > davidmontgom...@gmail.com
> > > > wrote:
> > >
> > > > Hi,
> > > >
> > > > This is how I start kafka.
> > > >
> > > > command = /var/lib/kafka-<%=@version%>-src/bin/kafka-server-start.sh
> > > > /var/lib/kafka-<%=@version%>-src/config/server.properties
> > > >
> > > > In another application I get teh below error. The suggestion is to
> add
> > > the
> > > > scalar libraries to the path. How do I do that?
> > > >
> > > >
> > > > thanks
> > > >
> > > >
> > > > java.lang.reflect.
> > > > InvocationTargetException
> > > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > > > at
> > > >
> > > >
> > >
> >
> sun.reflect.NativeMethodAccessorI
Re: How ot had scala libraries to path
You just need to copy scala-library.jar. The version depends on scala version that the kafka jar is built with. Thanks, Jun On Tue, Feb 25, 2014 at 9:21 PM, David Montgomery wrote: > Below are the scala jar files I have on the system. Which do I move? > > and I move to this dir? /var/lib/kafka-0.8.0-src/lib > > > > > root@do-kafka-sg-development-20140217110812:/var/lib/kafka-0.8.0-src# find > / -name *scala*.jar > /root/.ivy2/cache/org.scalatest/scalatest/jars/scalatest-1.2.jar > /root/.ivy2/cache/org.scala-lang/scala-library/jars/scala-library-2.8.0.jar > /root/.ivy2/cache/org.scala-lang/scala-library/jars/scala-library-2.9.2.jar > > /root/.ivy2/cache/org.scala-lang/scala-compiler/jars/scala-compiler-2.9.2.jar > > /root/.ivy2/cache/org.scala-lang/scala-compiler/jars/scala-compiler-2.8.0.jar > /root/.sbt/boot/scala-2.9.2/lib/scala-compiler.jar > /root/.sbt/boot/scala-2.9.2/lib/scala-library.jar > /root/.sbt/boot/scala-2.8.0/lib/scala-compiler.jar > /root/.sbt/boot/scala-2.8.0/lib/scala-library.jar > > > > > On Wed, Feb 26, 2014 at 1:11 PM, Jun Rao wrote: > > > You just need to add the scala jar to the lib dir. > > > > Thanks, > > > > Jun > > > > > > On Tue, Feb 25, 2014 at 8:40 PM, David Montgomery < > > davidmontgom...@gmail.com > > > wrote: > > > > > Hi, > > > > > > This is how I start kafka. > > > > > > command = /var/lib/kafka-<%=@version%>-src/bin/kafka-server-start.sh > > > /var/lib/kafka-<%=@version%>-src/config/server.properties > > > > > > In another application I get teh below error. The suggestion is to add > > the > > > scalar libraries to the path. How do I do that? > > > > > > > > > thanks > > > > > > > > > java.lang.reflect. > > > InvocationTargetException > > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > > > at > > > > > > > > > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > > > at > > > > > > > > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > > > at java.lang.reflect.Method.invoke(Method.java:606) > > > at > > > > > > > > > com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler.start(Lifecycle.java:331) > > > at com.metamx.common.lifecycle.Lifecycle.start(Lifecycle.java:250) > > > at io.druid.guice.LifecycleModule$2.start(LifecycleModule.java:136) > > > at io.druid.cli.GuiceRunnable.initLifecycle(GuiceRunnable.java:72) > > > at io.druid.cli.ServerRunnable.run(ServerRunnable.java:40) > > > at io.druid.cli.Main.main(Main.java:91) > > > Caused by: java.lang.NoClassDefFoundError: scala/ScalaObject > > > at java.lang.ClassLoader.defineClass1(Native Method) > > > at java.lang.ClassLoader.defineClass(ClassLoader.java:800) > > > at > > > java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142) > > > at java.net.URLClassLoader.defineClass(URLClassLoader.java:449) > > > at java.net.URLClassLoader.access$100(URLClassLoader.java:71) > > > at java.net.URLClassLoader$1.run(URLClassLoader.java:361) > > > at java.net.URLClassLoader$1.run(URLClassLoader.java:355) > > > at java.security.AccessController.doPrivileged(Native Method) > > > at java.net.URLClassLoader.findClass(URLClassLoader.java:354) > > > at java.lang.ClassLoader.loadClass(ClassLoader.java:425) > > > at java.lang.ClassLoader.loadClass(ClassLoader.java:358) > > > at > > > > > > > > > io.druid.firehose.kafka.KafkaEightFirehoseFactory.connect(KafkaEightFirehoseFactory.java:76) > > > at > > > > io.druid.segment.realtime.FireDepartment.connect(FireDepartment.java:90) > > > at > > > > > > > > > io.druid.segment.realtime.RealtimeManager$FireChief.init(RealtimeManager.java:150) > > > at > > > > io.druid.segment.realtime.RealtimeManager.start(RealtimeManager.java:87) > > > ... 10 more > > > Caused by: java.lang.ClassNotFoundException: scala.ScalaObject > > > at java.net.URLClassLoader$1.run(URLClassLoader.java:366) > > > at java.net.URLClassLoader$1.run(URLClassLoader.java:355) > > > at java.security.AccessController.doPrivileged(Native Method) > > > at java.net.URLClassLoader.findClass(URLClassLoader.java:354) > > > at java.lang.ClassLoader.loadClass(ClassLoader.java:425) > > > at java.lang.ClassLoader.loadClass(ClassLoader.java:358) > > > ... 25 more > > > > > >
Re: How ot had scala libraries to path
Below are the scala jar files I have on the system. Which do I move? and I move to this dir? /var/lib/kafka-0.8.0-src/lib root@do-kafka-sg-development-20140217110812:/var/lib/kafka-0.8.0-src# find / -name *scala*.jar /root/.ivy2/cache/org.scalatest/scalatest/jars/scalatest-1.2.jar /root/.ivy2/cache/org.scala-lang/scala-library/jars/scala-library-2.8.0.jar /root/.ivy2/cache/org.scala-lang/scala-library/jars/scala-library-2.9.2.jar /root/.ivy2/cache/org.scala-lang/scala-compiler/jars/scala-compiler-2.9.2.jar /root/.ivy2/cache/org.scala-lang/scala-compiler/jars/scala-compiler-2.8.0.jar /root/.sbt/boot/scala-2.9.2/lib/scala-compiler.jar /root/.sbt/boot/scala-2.9.2/lib/scala-library.jar /root/.sbt/boot/scala-2.8.0/lib/scala-compiler.jar /root/.sbt/boot/scala-2.8.0/lib/scala-library.jar On Wed, Feb 26, 2014 at 1:11 PM, Jun Rao wrote: > You just need to add the scala jar to the lib dir. > > Thanks, > > Jun > > > On Tue, Feb 25, 2014 at 8:40 PM, David Montgomery < > davidmontgom...@gmail.com > > wrote: > > > Hi, > > > > This is how I start kafka. > > > > command = /var/lib/kafka-<%=@version%>-src/bin/kafka-server-start.sh > > /var/lib/kafka-<%=@version%>-src/config/server.properties > > > > In another application I get teh below error. The suggestion is to add > the > > scalar libraries to the path. How do I do that? > > > > > > thanks > > > > > > java.lang.reflect. > > InvocationTargetException > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > > at > > > > > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > > at > > > > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > > at java.lang.reflect.Method.invoke(Method.java:606) > > at > > > > > com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler.start(Lifecycle.java:331) > > at com.metamx.common.lifecycle.Lifecycle.start(Lifecycle.java:250) > > at io.druid.guice.LifecycleModule$2.start(LifecycleModule.java:136) > > at io.druid.cli.GuiceRunnable.initLifecycle(GuiceRunnable.java:72) > > at io.druid.cli.ServerRunnable.run(ServerRunnable.java:40) > > at io.druid.cli.Main.main(Main.java:91) > > Caused by: java.lang.NoClassDefFoundError: scala/ScalaObject > > at java.lang.ClassLoader.defineClass1(Native Method) > > at java.lang.ClassLoader.defineClass(ClassLoader.java:800) > > at > > java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142) > > at java.net.URLClassLoader.defineClass(URLClassLoader.java:449) > > at java.net.URLClassLoader.access$100(URLClassLoader.java:71) > > at java.net.URLClassLoader$1.run(URLClassLoader.java:361) > > at java.net.URLClassLoader$1.run(URLClassLoader.java:355) > > at java.security.AccessController.doPrivileged(Native Method) > > at java.net.URLClassLoader.findClass(URLClassLoader.java:354) > > at java.lang.ClassLoader.loadClass(ClassLoader.java:425) > > at java.lang.ClassLoader.loadClass(ClassLoader.java:358) > > at > > > > > io.druid.firehose.kafka.KafkaEightFirehoseFactory.connect(KafkaEightFirehoseFactory.java:76) > > at > > io.druid.segment.realtime.FireDepartment.connect(FireDepartment.java:90) > > at > > > > > io.druid.segment.realtime.RealtimeManager$FireChief.init(RealtimeManager.java:150) > > at > > io.druid.segment.realtime.RealtimeManager.start(RealtimeManager.java:87) > > ... 10 more > > Caused by: java.lang.ClassNotFoundException: scala.ScalaObject > > at java.net.URLClassLoader$1.run(URLClassLoader.java:366) > > at java.net.URLClassLoader$1.run(URLClassLoader.java:355) > > at java.security.AccessController.doPrivileged(Native Method) > > at java.net.URLClassLoader.findClass(URLClassLoader.java:354) > > at java.lang.ClassLoader.loadClass(ClassLoader.java:425) > > at java.lang.ClassLoader.loadClass(ClassLoader.java:358) > > ... 25 more > > >
Re: How ot had scala libraries to path
You just need to add the scala jar to the lib dir. Thanks, Jun On Tue, Feb 25, 2014 at 8:40 PM, David Montgomery wrote: > Hi, > > This is how I start kafka. > > command = /var/lib/kafka-<%=@version%>-src/bin/kafka-server-start.sh > /var/lib/kafka-<%=@version%>-src/config/server.properties > > In another application I get teh below error. The suggestion is to add the > scalar libraries to the path. How do I do that? > > > thanks > > > java.lang.reflect. > InvocationTargetException > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at > > com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler.start(Lifecycle.java:331) > at com.metamx.common.lifecycle.Lifecycle.start(Lifecycle.java:250) > at io.druid.guice.LifecycleModule$2.start(LifecycleModule.java:136) > at io.druid.cli.GuiceRunnable.initLifecycle(GuiceRunnable.java:72) > at io.druid.cli.ServerRunnable.run(ServerRunnable.java:40) > at io.druid.cli.Main.main(Main.java:91) > Caused by: java.lang.NoClassDefFoundError: scala/ScalaObject > at java.lang.ClassLoader.defineClass1(Native Method) > at java.lang.ClassLoader.defineClass(ClassLoader.java:800) > at > java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142) > at java.net.URLClassLoader.defineClass(URLClassLoader.java:449) > at java.net.URLClassLoader.access$100(URLClassLoader.java:71) > at java.net.URLClassLoader$1.run(URLClassLoader.java:361) > at java.net.URLClassLoader$1.run(URLClassLoader.java:355) > at java.security.AccessController.doPrivileged(Native Method) > at java.net.URLClassLoader.findClass(URLClassLoader.java:354) > at java.lang.ClassLoader.loadClass(ClassLoader.java:425) > at java.lang.ClassLoader.loadClass(ClassLoader.java:358) > at > > io.druid.firehose.kafka.KafkaEightFirehoseFactory.connect(KafkaEightFirehoseFactory.java:76) > at > io.druid.segment.realtime.FireDepartment.connect(FireDepartment.java:90) > at > > io.druid.segment.realtime.RealtimeManager$FireChief.init(RealtimeManager.java:150) > at > io.druid.segment.realtime.RealtimeManager.start(RealtimeManager.java:87) > ... 10 more > Caused by: java.lang.ClassNotFoundException: scala.ScalaObject > at java.net.URLClassLoader$1.run(URLClassLoader.java:366) > at java.net.URLClassLoader$1.run(URLClassLoader.java:355) > at java.security.AccessController.doPrivileged(Native Method) > at java.net.URLClassLoader.findClass(URLClassLoader.java:354) > at java.lang.ClassLoader.loadClass(ClassLoader.java:425) > at java.lang.ClassLoader.loadClass(ClassLoader.java:358) > ... 25 more >
How ot had scala libraries to path
Hi, This is how I start kafka. command = /var/lib/kafka-<%=@version%>-src/bin/kafka-server-start.sh /var/lib/kafka-<%=@version%>-src/config/server.properties In another application I get teh below error. The suggestion is to add the scalar libraries to the path. How do I do that? thanks java.lang.reflect. InvocationTargetException at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler.start(Lifecycle.java:331) at com.metamx.common.lifecycle.Lifecycle.start(Lifecycle.java:250) at io.druid.guice.LifecycleModule$2.start(LifecycleModule.java:136) at io.druid.cli.GuiceRunnable.initLifecycle(GuiceRunnable.java:72) at io.druid.cli.ServerRunnable.run(ServerRunnable.java:40) at io.druid.cli.Main.main(Main.java:91) Caused by: java.lang.NoClassDefFoundError: scala/ScalaObject at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClass(ClassLoader.java:800) at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142) at java.net.URLClassLoader.defineClass(URLClassLoader.java:449) at java.net.URLClassLoader.access$100(URLClassLoader.java:71) at java.net.URLClassLoader$1.run(URLClassLoader.java:361) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354) at java.lang.ClassLoader.loadClass(ClassLoader.java:425) at java.lang.ClassLoader.loadClass(ClassLoader.java:358) at io.druid.firehose.kafka.KafkaEightFirehoseFactory.connect(KafkaEightFirehoseFactory.java:76) at io.druid.segment.realtime.FireDepartment.connect(FireDepartment.java:90) at io.druid.segment.realtime.RealtimeManager$FireChief.init(RealtimeManager.java:150) at io.druid.segment.realtime.RealtimeManager.start(RealtimeManager.java:87) ... 10 more Caused by: java.lang.ClassNotFoundException: scala.ScalaObject at java.net.URLClassLoader$1.run(URLClassLoader.java:366) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354) at java.lang.ClassLoader.loadClass(ClassLoader.java:425) at java.lang.ClassLoader.loadClass(ClassLoader.java:358) ... 25 more
