[
https://issues.apache.org/jira/browse/GRIFFIN-190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16606643#comment-16606643
]
Lionel Liu commented on GRIFFIN-190:
------------------------------------
Hi [~mkisly],
When using something
sparkJob.file=hdfs://localhost:9000/griffin/griffin-measure.jar we get an error
wrong fs expected [file:///] .
Where did you get this error? In griffin service log or in livy log? Suppose it
would be in livy log, in griffin service, we do NOT parse the value of
"sparkJob.file" as a path, we just directly send the string value to livy as
the value of "file" filed like this: "file":
"hdfs://localhost:9000/griffin/griffin-measure.jar".
In application.properties, "fs.defaultFS" is only used to check done file
existence, it will not affect the spark job submission.
I guess there might be some issue of the environment. I'm not sure how's your
livy and spark configured, maybe you can refer to our docker image built up
scripts:
[https://github.com/bhlx3lyx7/griffin-docker/tree/master/env2/conf/spark]
[https://github.com/bhlx3lyx7/griffin-docker/tree/master/env2/conf/livy]
Or the error might be caused by the other parameters like: "sparkJob.jars" or
"spark.yarn.dist.files", they also affect if you need enable Hive Context when
submitting spark jobs.
> Blank Health and DQ Metrics Screen
> ----------------------------------
>
> Key: GRIFFIN-190
> URL: https://issues.apache.org/jira/browse/GRIFFIN-190
> Project: Griffin (Incubating)
> Issue Type: Bug
> Affects Versions: 0.2.0-incubating
> Reporter: Cory Woytasik
> Priority: Major
>
> Griffin is up and running. We have both an accuracy measure and a profiling
> measure that is set to run every minute via jobs. When we click the chart
> icon next to the job we receive a "no content" message. When we click on the
> Health link or DQ Metrics link they think for a second and then display a
> blank screen. We are thinking this might be ES related, but aren't
> completely sure. Need some help. We assume it's a path or property setup
> issue. Here are the versions we are running:
> Hive - 3.1.0
> Elasticsearch - 5.3.1
> griffin - 0.2.0
> hadoop - 3.1.1
> livy - 0.3.0
> spark - 2.3.1
> Using postgres too
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
