Re: Spark reading from Hbase throws java.lang.NoSuchMethodError: org.json4s.jackson.JsonMethods

Yes I fear you have to shade and create an uberjar > Am 17.02.2020 um 23:27 schrieb Mich Talebzadeh : > >  > I stripped everything from the jar list. This is all I have > > sspark-shell --jars shc-core-1.1.1-2.1-s_2.11.jar, \ > json4s-native_2.11-3.5.3.jar, \ >

Re: Spark reading from Hbase throws java.lang.NoSuchMethodError: org.json4s.jackson.JsonMethods

Hi Mich! Please try to keep your thread on a single mailing list. It's much easier to have things show up on a new list if you give a brief summary of the discussion and a pointer to the original thread (lists.apache.org is great for this). It looks like you're using "SHC" aka the "Spark HBase

Re: Spark reading from Hbase throws java.lang.NoSuchMethodError: org.json4s.jackson.JsonMethods

Hi, Does anyone has any more suggestion for the error I reported below please? Thanks, Mich *Disclaimer:* Use it at your own risk. Any and all responsibility for any loss, damage or destruction of data or any other property which may arise from relying on this email's technical content is

Re: Spark reading from Hbase throws java.lang.NoSuchMethodError: org.json4s.jackson.JsonMethods

I stripped everything from the jar list. This is all I have sspark-shell --jars shc-core-1.1.1-2.1-s_2.11.jar, \ json4s-native_2.11-3.5.3.jar, \ json4s-jackson_2.11-3.5.3.jar, \ hbase-client-1.2.3.jar, \ hbase-common-1.2.3.jar Now I still

Re: Spark reading from Hbase throws java.lang.NoSuchMethodError: org.json4s.jackson.JsonMethods

Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw * http://talebzadehmich.wordpress.com *Disclaimer:* Use it at your own risk. Any and all

Re: Spark reading from Hbase throws java.lang.NoSuchMethodError: org.json4s.jackson.JsonMethods

Is there a reason why different Scala (it seems at least 2.10/2.11) versions are mixed? This never works. Do you include by accident a dependency to with an old Scala version? Ie the Hbase datasource maybe? > Am 17.02.2020 um 22:15 schrieb Mich Talebzadeh : > >  > Thanks Muthu, > > > I am

Re: Spark reading from Hbase throws java.lang.NoSuchMethodError: org.json4s.jackson.JsonMethods

Hello Mich, Thank you for the mail. From, what I can understand from json4s history, spark and the versions you have... 1. Apache Spark 2.4.3 uses json4s 3.5.3 (to be specific it uses json4s-jackson) 2. json4s 3.2.11 and 3.2.10 is not compatible (ref: https://github.com/json4s/json4s/issues/212)

Re: Spark reading from Hbase throws java.lang.NoSuchMethodError: org.json4s.jackson.JsonMethods

Thanks Muthu, I am using the following jar files for now in local mode i.e. spark-shell_local --jars ….. json4s-jackson_2.10-3.2.10.jar json4s_2.11-3.2.11.jar json4s-native_2.10-3.4.0.jar Which one is the incorrect one please/ Regards, Mich *Disclaimer:* Use it at your own risk. Any and

Re: Spark reading from Hbase throws java.lang.NoSuchMethodError: org.json4s.jackson.JsonMethods

I suspect the spark job is somehow having an incorrect (newer) version of json4s in the classpath. json4s 3.5.3 is the utmost version that can be used. Thanks, Muthu On Mon, Feb 17, 2020, 06:43 Mich Talebzadeh wrote: > Hi, > > Spark version 2.4.3 > Hbase 1.2.7 > > Data is stored in Hbase as

Spark reading from Hbase throws java.lang.NoSuchMethodError: org.json4s.jackson.JsonMethods

Hi, Spark version 2.4.3 Hbase 1.2.7 Data is stored in Hbase as Json. example of a row shown below [image: image.png] I am trying to read this table in Spark Scala import org.apache.spark.sql.{SQLContext, _} import org.apache.spark.sql.execution.datasources.hbase._ import