Re: Problem with jackson lib running on spark

2016-04-01 Thread Ted Yu
Thanks for sharing the workaround. Probably send a PR on tranquilizer github :-) On Fri, Apr 1, 2016 at 12:50 PM, Marcelo Oikawa wrote: > Hi, list. > > Just to close the thread. Unfortunately, I didnt solve the jackson lib > problem but I did a workaround that

Re: Problem with jackson lib running on spark

2016-04-01 Thread Marcelo Oikawa
Hi, list. Just to close the thread. Unfortunately, I didnt solve the jackson lib problem but I did a workaround that works fine for me. Perhaps this help another one. The problem raised from this line when I try to create tranquilizer object (used to connect to Druid) using this utility

Re: Problem with jackson lib running on spark

2016-03-31 Thread Marcelo Oikawa
> Please exclude jackson-databind - that was where the AnnotationMap class > comes from. > I tried as you suggest but i getting the same error. Seems strange because when I see the generated jar there is nothing related as AnnotationMap but there is a databind there. ​ > > On Thu, Mar 31,

Re: Problem with jackson lib running on spark

2016-03-31 Thread Ted Yu
Please exclude jackson-databind - that was where the AnnotationMap class comes from. On Thu, Mar 31, 2016 at 11:37 AM, Marcelo Oikawa < marcelo.oik...@webradar.com> wrote: > Hi, Alonso. > > As you can see jackson-core is provided by several libraries, try to >> exclude it from spark-core, i

Re: Problem with jackson lib running on spark

2016-03-31 Thread Marcelo Oikawa
Hi, Alonso. As you can see jackson-core is provided by several libraries, try to > exclude it from spark-core, i think the minor version is included within > it. > There is no more than one jackson-core provides by spark-core. There are jackson-core and jackson-core-asl but are differents

Re: Problem with jackson lib running on spark

2016-03-31 Thread Alonso Isidoro Roman
As you can see jackson-core is provided by several libraries, try to exclude it from spark-core, i think the minor version is included within it. Use this guide to see how to do it: https://maven.apache.org/guides/introduction/introduction-to-optional-and-excludes-dependencies.html Alonso

Re: Problem with jackson lib running on spark

2016-03-31 Thread Marcelo Oikawa
Hey, Alonso. here is the output: [INFO] spark-processor:spark-processor-druid:jar:1.0-SNAPSHOT [INFO] +- org.apache.spark:spark-streaming_2.10:jar:1.6.1:provided [INFO] | +- org.apache.spark:spark-core_2.10:jar:1.6.1:provided [INFO] | | +-

Re: Problem with jackson lib running on spark

2016-03-31 Thread Alonso Isidoro Roman
Run mvn dependency:tree and print the output here, i suspect that jackson library is included within more than one dependency. Alonso Isidoro Roman. Mis citas preferidas (de hoy) : "Si depurar es el proceso de quitar los errores de software, entonces programar debe ser el proceso de

Re: Problem with jackson lib running on spark

2016-03-31 Thread Marcelo Oikawa
Hey, Ted 2.4.4 > > Looks like Tranquility uses different version of jackson. > > How do you build your jar ? > I'm building a jar with dependencies using the maven assembly plugin. Below is all jackson's dependencies: [INFO]

Re: Problem with jackson lib running on spark

2016-03-31 Thread Ted Yu
Spark 1.6.1 uses this version of jackson: 2.4.4 Looks like Tranquility uses different version of jackson. How do you build your jar ? Consider using maven-shade-plugin to resolve the conflict if you use maven. Cheers On Thu, Mar 31, 2016 at 9:50 AM, Marcelo Oikawa

Problem with jackson lib running on spark

2016-03-31 Thread Marcelo Oikawa
Hi, list. We are working on a spark application that sends messages to Druid. For that, we're using Tranquility core. In my local test, I'm using the "spark-1.6.1-bin-hadoop2.6" distribution and the following dependencies in my app: org.apache.spark spark-streaming_2.10 1.6.1