Repository: incubator-samza Updated Branches: refs/heads/master 610ee8492 -> 40bbe4da5
SAMZA-322: update YARN deploy tutorial Project: http://git-wip-us.apache.org/repos/asf/incubator-samza/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-samza/commit/40bbe4da Tree: http://git-wip-us.apache.org/repos/asf/incubator-samza/tree/40bbe4da Diff: http://git-wip-us.apache.org/repos/asf/incubator-samza/diff/40bbe4da Branch: refs/heads/master Commit: 40bbe4da58e8990044ea2ecb65cdd79fb71bdcd2 Parents: 610ee84 Author: Yan Fang <[email protected]> Authored: Wed Jul 16 09:51:49 2014 -0700 Committer: Yan Fang <[email protected]> Committed: Wed Jul 16 09:51:49 2014 -0700 ---------------------------------------------------------------------- .../0.7.0/deploy-samza-job-from-hdfs.md | 33 ++------------------ 1 file changed, 2 insertions(+), 31 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/incubator-samza/blob/40bbe4da/docs/learn/tutorials/0.7.0/deploy-samza-job-from-hdfs.md ---------------------------------------------------------------------- diff --git a/docs/learn/tutorials/0.7.0/deploy-samza-job-from-hdfs.md b/docs/learn/tutorials/0.7.0/deploy-samza-job-from-hdfs.md index 145d51c..ab33dd3 100644 --- a/docs/learn/tutorials/0.7.0/deploy-samza-job-from-hdfs.md +++ b/docs/learn/tutorials/0.7.0/deploy-samza-job-from-hdfs.md @@ -21,34 +21,6 @@ title: Deploying a Samza job from HDFS This tutorial uses [hello-samza](../../../startup/hello-samza/0.7.0/) to illustrate how to run a Samza job if you want to publish the Samza job's .tar.gz package to HDFS. -### Build a new Samza job package - -Build a new Samza job package to include the hadoop-hdfs-version.jar. - -* Add dependency statement in pom.xml of samza-job-package - -{% highlight xml %} -<dependency> - <groupId>org.apache.hadoop</groupId> - <artifactId>hadoop-hdfs</artifactId> - <version>2.2.0</version> -</dependency> -{% endhighlight %} - -* Add the following code to src/main/assembly/src.xml in samza-job-package. - -{% highlight xml %} -<include>org.apache.hadoop:hadoop-hdfs</include> -{% endhighlight %} - -* Create .tar.gz package - -{% highlight bash %} -mvn clean pacakge -{% endhighlight %} - -* Make sure hadoop-common-version.jar has the same version as your hadoop-hdfs-version.jar. Otherwise, you may still have errors. - ### Upload the package {% highlight bash %} @@ -57,7 +29,7 @@ hadoop fs -put ./samza-job-package/target/samza-job-package-0.7.0-dist.tar.gz /p ### Add HDFS configuration -Put the hdfs-site.xml file of your cluster into ~/.samza/conf directory. (The same place as the yarn-site.xml) +Put the hdfs-site.xml file of your cluster into ~/.samza/conf directory (The same place as the yarn-site.xml). If you set HADOOP\_CONF\_DIR, put the hdfs-site.xml in your configuration directory if the hdfs-site.xml is not there. ### Change properties file @@ -67,5 +39,4 @@ Change the yarn.package.path in the properties file to your HDFS location. yarn.package.path=hdfs://<hdfs name node ip>:<hdfs name node port>/path/to/tgz {% endhighlight %} -Then you should be able to run the Samza job as described in [hello-samza](../../../startup/hello-samza/0.7.0/). - +Then you should be able to run the Samza job as described in [hello-samza](../../../startup/hello-samza/0.7.0/). \ No newline at end of file
