Repository: incubator-griffin Updated Branches: refs/heads/master 21187ebd4 -> e51245b92
Update deploy-guide.md Updated document with new configuration files. Author: Sparsh Singhal <sparsh.sing...@hashmapinc.com> Closes #393 from SparshSinghalHM/patch-3. Project: http://git-wip-us.apache.org/repos/asf/incubator-griffin/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-griffin/commit/e51245b9 Tree: http://git-wip-us.apache.org/repos/asf/incubator-griffin/tree/e51245b9 Diff: http://git-wip-us.apache.org/repos/asf/incubator-griffin/diff/e51245b9 Branch: refs/heads/master Commit: e51245b9268c83946c249ee81b9ac1bfd548c402 Parents: 21187eb Author: Sparsh Singhal <sparsh.sing...@hashmapinc.com> Authored: Mon Aug 20 22:32:45 2018 +0800 Committer: Lionel Liu <bhlx3l...@163.com> Committed: Mon Aug 20 22:32:45 2018 +0800 ---------------------------------------------------------------------- griffin-doc/deploy/deploy-guide.md | 54 ++++++++++++++++----------------- 1 file changed, 27 insertions(+), 27 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/e51245b9/griffin-doc/deploy/deploy-guide.md ---------------------------------------------------------------------- diff --git a/griffin-doc/deploy/deploy-guide.md b/griffin-doc/deploy/deploy-guide.md index d19e28f..a12db2e 100644 --- a/griffin-doc/deploy/deploy-guide.md +++ b/griffin-doc/deploy/deploy-guide.md @@ -70,6 +70,8 @@ You should also modify some configurations of Griffin for your environment. - <b>service/src/main/resources/application.properties</b> ``` + # griffin server port (default 8080) + server.port = 8080 # jpa spring.datasource.url = jdbc:postgresql://<your IP>:5432/quartz?autoReconnect=true&useSSL=false spring.datasource.username = <user name> @@ -103,39 +105,37 @@ You should also modify some configurations of Griffin for your environment. # authentication properties, uncomment if basic authentication is enabled # elasticsearch.user = user # elasticsearch.password = password - ``` + # livy + # Port Livy: 8998 Livy2:8999 + livy.uri=http://localhost:8999/batches -- <b>measure/src/main/resources/env-streaming.json</b> - ``` - "persist": [ - ... - { - "type": "http", - "config": { - "method": "post", - "api": "http://<your ES IP>:<ES rest port>/griffin/accuracy" - } - } - ] - ``` - Rename the modified env-streaming.json file as env.json and put it into HDFS. - -- <b>service/src/main/resources/sparkJob.properties</b> - ``` - sparkJob.file = hdfs://<griffin measure path>/griffin-measure.jar - sparkJob.args_1 = hdfs://<griffin env path>/env.json + # yarn url + yarn.uri=http://localhost:8088 - # other dependent jars - sparkJob.jars = + + ``` - # hive-site.xml location - spark.yarn.dist.files = hdfs://<path to>/hive-site.xml +- <b>service/src/main/resources/sparkProperties.json</b> + ``` + { + "file": "hdfs:///<griffin measure path>/griffin-measure.jar", + "className": "org.apache.griffin.measure.Application", + "name": "griffin", + "queue": "default", + "numExecutors": 3, + "executorCores": 1, + "driverMemory": "1g", + "executorMemory": "1g", + "conf": { + "spark.yarn.dist.files": "hdfs:///<path to>/hive-site.xml" + }, + "files": [ + ] + } - livy.uri = http://<your IP>:8998/batches - yarn.uri = http://<your IP>:8088 ``` - \<griffin measure path> is the location where you should put the jar file of measure module. - - \<griffin env path> is the location where you should put the env.json file. + ### Build and Run