Hi Takako , Thanks a ton for your quick reply .......it worked
like a charm by changing to spark 2.1.3 ...
Regards,Alok
On Monday, May 20, 2019, 1:11:54 PM GMT+5:30, takako shimamoto
<chiboch...@gmail.com> wrote:
This message is eligible for Automatic Cleanup! (chiboch...@gmail.com) Add
cleanup rule | More info
Hi Alok,
As of Spark 2.4.0, Spark depends on json4s 3.5.3.
How did you install your environment on which you ran "pio train"?
If you would like to use Spark 2.4.0, you need to build PredictionIO
with Spark 2.4 support like the following:
./make-distribution.sh -Dspark.version=2.4.0
See:
https://predictionio.apache.org/install/install-sourcecode/#downloading-source-code
If you are using the binary distribution, it doesn't work because it
is pre-built with Spark 2.1.3 (i.e., json4s 3.2.11)
On Mon, May 20, 2019 at 9:58 AM Alok Jain <contact_alokj...@yahoo.com> wrote:
>
> Hi ,
> I am getting an error while running the pio train . Please see the
>following output :
>
> alok@alok-VirtualBox:~/machine/MyRecommendation$ pio status
> [INFO] [Management$] Inspecting PredictionIO...
> [INFO] [Management$] PredictionIO 0.14.0 is installed at
> /home/alok/machine/PredictionIO-0.14.0
> [INFO] [Management$] Inspecting Apache Spark...
> [INFO] [Management$] Apache Spark is installed at
> /home/alok/machine/PredictionIO-0.14.0/vendors/spark-2.4.0-bin-hadoop2.7
> [INFO] [Management$] Apache Spark 2.4.0 detected (meets minimum requirement
> of 2.0.2)
> [INFO] [Management$] Inspecting storage backend connections...
> [INFO] [Storage$] Verifying Meta Data Backend (Source: PGSQL)...
> WARNING: An illegal reflective access operation has occurred
> WARNING: Illegal reflective access by org.postgresql.jdbc.TimestampUtils
> (file:/home/alok/machine/PredictionIO-0.14.0/lib/postgresql-42.0.0.jar) to
> field java.util.TimeZone.defaultTimeZone
> WARNING: Please consider reporting this to the maintainers of
> org.postgresql.jdbc.TimestampUtils
> WARNING: Use --illegal-access=warn to enable warnings of further illegal
> reflective access operations
> WARNING: All illegal access operations will be denied in a future release
> [INFO] [Storage$] Verifying Model Data Backend (Source: PGSQL)...
> [INFO] [Storage$] Verifying Event Data Backend (Source: PGSQL)...
> [INFO] [Storage$] Test writing to Event Store (App Id 0)...
> [INFO] [Management$] Your system is all ready to go.
>
>
>
> Now the output of pio train :
>
> [INFO] [Engine] Extracting datasource params...
> [INFO] [WorkflowUtils$] No 'name' is found. Default empty String will be used.
> Exception in thread "main" java.lang.NoSuchMethodError:
> org.json4s.ParserUtil$.quote(Ljava/lang/String;)Ljava/lang/String;
> at org.json4s.native.JsonMethods$$anonfun$2.apply(JsonMethods.scala:42)
> at org.json4s.native.JsonMethods$$anonfun$2.apply(JsonMethods.scala:42)
> at scala.collection.immutable.List.map(List.scala:284)
> at org.json4s.native.JsonMethods$class.render(JsonMethods.scala:42)
> at org.json4s.native.JsonMethods$.render(JsonMethods.scala:62)
> at
>org.apache.predictionio.workflow.WorkflowUtils$$anonfun$getParamsFromJsonByFieldAndClass$2$$anonfun$2.apply(WorkflowUtils.scala:177)
> at
>org.apache.predictionio.workflow.WorkflowUtils$$anonfun$getParamsFromJsonByFieldAndClass$2$$anonfun$2.apply(WorkflowUtils.scala:168)
> at scala.Option.map(Option.scala:146)
> at
>org.apache.predictionio.workflow.WorkflowUtils$$anonfun$getParamsFromJsonByFieldAndClass$2.apply(WorkflowUtils.scala:168)
> at
>org.apache.predictionio.workflow.WorkflowUtils$$anonfun$getParamsFromJsonByFieldAndClass$2.apply(WorkflowUtils.scala:159)
> at scala.Option.map(Option.scala:146)
> at
>org.apache.predictionio.workflow.WorkflowUtils$.getParamsFromJsonByFieldAndClass(WorkflowUtils.scala:159)
> at
>org.apache.predictionio.controller.Engine.jValueToEngineParams(Engine.scala:363)
> at
>org.apache.predictionio.workflow.CreateWorkflow$.main(CreateWorkflow.scala:222)
> at
>org.apache.predictionio.workflow.CreateWorkflow.main(CreateWorkflow.scala)
> at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native
>Method)
> at
>java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
>java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.base/java.lang.reflect.Method.invoke(Method.java:566)
> at
>org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
> at
>org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849)
> at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167)
> at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195)
> at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
> at
>org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924)
> at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933)
> at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
>
>
>
>
>
