Re: [RESULT] [VOTE] Apache Giraph 1.1.0 RC2
Thanks for pushing this though Roman. Looks great! On 11/18/14, 4:30 AM, Roman Shaposhnik wrote: Hi! with 3 binding +1, one non-binding +1, no 0s or -1s the vote to publish Apache Giraph 1.1.0 RC2 as the 1.1.0 release of Apache Giraph passes. Thanks to everybody who spent time on validating the bits! The vote tally is +1s: Claudio Martella (binding) Maja Kabiljo (binding) Eli Reisman (binding) Roman Shaposhnik (non-binding) I'll do the publishing tonight and will send an announcement! Thanks, Roman (AKA 1.1.0 RM) On Thu, Nov 13, 2014 at 5:28 AM, Roman Shaposhnik wrote: This vote is for Apache Giraph, version 1.1.0 release It fixes the following issues: http://s.apache.org/a8X *** Please download, test and vote by Mon 11/17 noon PST Note that we are voting upon the source (tag): release-1.1.0-RC2 Source and binary files are available at: http://people.apache.org/~rvs/giraph-1.1.0-RC2/ Staged website is available at: http://people.apache.org/~rvs/giraph-1.1.0-RC2/site/ Maven staging repo is available at: https://repository.apache.org/content/repositories/orgapachegiraph-1003 Please notice, that as per earlier agreement two sets of artifacts are published differentiated by the version ID: * version ID 1.1.0 corresponds to the artifacts built for the hadoop_1 profile * version ID 1.1.0-hadoop2 corresponds to the artifacts built for hadoop_2 profile. The tag to be voted upon (release-1.1.0-RC1): https://git-wip-us.apache.org/repos/asf?p=giraph.git;a=log;h=refs/tags/release-1.1.0-RC2 The KEYS file containing PGP keys we use to sign the release: http://svn.apache.org/repos/asf/bigtop/dist/KEYS Thanks, Roman.
Re: [VOTE] Apache Giraph 1.1.0 RC2
On Thu, Nov 13, 2014 at 5:28 AM, Roman Shaposhnik wrote: > This vote is for Apache Giraph, version 1.1.0 release +1 (non-binding) Thanks, Roman.
[RESULT] [VOTE] Apache Giraph 1.1.0 RC2
Hi! with 3 binding +1, one non-binding +1, no 0s or -1s the vote to publish Apache Giraph 1.1.0 RC2 as the 1.1.0 release of Apache Giraph passes. Thanks to everybody who spent time on validating the bits! The vote tally is +1s: Claudio Martella (binding) Maja Kabiljo (binding) Eli Reisman (binding) Roman Shaposhnik (non-binding) I'll do the publishing tonight and will send an announcement! Thanks, Roman (AKA 1.1.0 RM) On Thu, Nov 13, 2014 at 5:28 AM, Roman Shaposhnik wrote: > This vote is for Apache Giraph, version 1.1.0 release > > It fixes the following issues: > http://s.apache.org/a8X > > *** Please download, test and vote by Mon 11/17 noon PST > > Note that we are voting upon the source (tag): >release-1.1.0-RC2 > > Source and binary files are available at: >http://people.apache.org/~rvs/giraph-1.1.0-RC2/ > > Staged website is available at: >http://people.apache.org/~rvs/giraph-1.1.0-RC2/site/ > > Maven staging repo is available at: >https://repository.apache.org/content/repositories/orgapachegiraph-1003 > > Please notice, that as per earlier agreement two sets > of artifacts are published differentiated by the version ID: > * version ID 1.1.0 corresponds to the artifacts built for > the hadoop_1 profile > * version ID 1.1.0-hadoop2 corresponds to the artifacts > built for hadoop_2 profile. > > The tag to be voted upon (release-1.1.0-RC1): > > https://git-wip-us.apache.org/repos/asf?p=giraph.git;a=log;h=refs/tags/release-1.1.0-RC2 > > The KEYS file containing PGP keys we use to sign the release: >http://svn.apache.org/repos/asf/bigtop/dist/KEYS > > Thanks, > Roman.
Re: Help with Giraph on Yarn
Hi Das, if you are referring to the following error: >> Caused by: java.io.FileNotFoundException: File does not exist: >> hdfs://hadoop-master:9000/user/yarn/giraph_yarn_jar_cache/application_1415264041937_0009/giraph-examples-1.1.0-SNAPSHOT-for-hadoop-2.5.1-jar-with-dependencies.jar > I just run the script as yarn user, since as you can see from the error, it try to access to the graph cache on the yarn user. What error are you receiving? Regards, Alessandro Il giorno 17/nov/2014, alle ore 17:10, D Adams ha scritto: > Greetings, > Alessandro, I keep getting the same errors you were getting but from > reading the thread, I still cannot figure out how to remedy it. Could you > please break down how you solved this issue? Thank you > > V/r > Das > > On Nov 16, 2014 3:40 PM, "Eli Reisman" wrote: > Sounds like you got it figured out since last time I checked this list, sorry > it was a pain. Feel free to drop a JIRA ticket if we can make help message > etc. for -yj option more clear, there's lots to improve there. > > On Sat, Nov 8, 2014 at 7:26 AM, Alessandro Negro wrote: > Hi Tripti, > finally I was able to run the test with success. It was an issue of > permission since I was running as ale not as yarn. > Let me say that now I’m able to run graph examples on Yarn 2.5.1. This is the > final result: > > 14/11/08 16:24:00 INFO yarn.GiraphYarnClient: Completed Giraph: > org.apache.giraph.examples.SimpleShortestPathsComputation: SUCCEEDED, total > running time: 0 minutes, 21 seconds. > > > Many thanks for your support, > Alessandro > > Il giorno 06/nov/2014, alle ore 15:16, Tripti Singh ha > scritto: > >> I don't know if u have access to this node. But if u do, u could check if >> the file is indeed there and u have access to it. >> >> Sent from my iPhone >> >> On 06-Nov-2014, at 6:12 pm, "Alessandro Negro" wrote: >> >>> You are right it works, but now I receive the following error: >>> >>> SLF4J: Class path contains multiple SLF4J bindings. >>> SLF4J: Found binding in >>> [jar:file:/private/tmp/hadoop-yarn/nm-local-dir/usercache/ale/appcache/application_1415264041937_0009/filecache/10/giraph-examples-1.1.0-SNAPSHOT-for-hadoop-2.5.1-jar-with-dependencies.jar!/org/slf4j/impl/StaticLoggerBinder.class] >>> SLF4J: Found binding in >>> [jar:file:/opt/yarn/hadoop-2.5.1/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class] >>> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an >>> explanation. >>> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] >>> 2014-11-06 13:15:37.120 java[10158:1803] Unable to load realm info from >>> SCDynamicStore >>> Exception in thread "pool-4-thread-1" java.lang.IllegalStateException: >>> Could not configure the containerlaunch context for GiraphYarnTasks. >>> at >>> org.apache.giraph.yarn.GiraphApplicationMaster.getTaskResourceMap(GiraphApplicationMaster.java:391) >>> at >>> org.apache.giraph.yarn.GiraphApplicationMaster.access$500(GiraphApplicationMaster.java:78) >>> at >>> org.apache.giraph.yarn.GiraphApplicationMaster$LaunchContainerRunnable.buildContainerLaunchContext(GiraphApplicationMaster.java:522) >>> at >>> org.apache.giraph.yarn.GiraphApplicationMaster$LaunchContainerRunnable.run(GiraphApplicationMaster.java:479) >>> at >>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) >>> at >>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) >>> at java.lang.Thread.run(Thread.java:744) >>> Caused by: java.io.FileNotFoundException: File does not exist: >>> hdfs://hadoop-master:9000/user/yarn/giraph_yarn_jar_cache/application_1415264041937_0009/giraph-examples-1.1.0-SNAPSHOT-for-hadoop-2.5.1-jar-with-dependencies.jar >>> at >>> org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1072) >>> at >>> org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1064) >>> at >>> org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) >>> at >>> org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1064) >>> at org.apache.giraph.yarn.YarnUtils.addFileToResourceMap(YarnUtils.java:153) >>> at org.apache.giraph.yarn.YarnUtils.addFsResourcesToMap(YarnUtils.java:77) >>> at >>> org.apache.giraph.yarn.GiraphApplicationMaster.getTaskResourceMap(GiraphApplicationMaster.java:387) >>> ... 6 more >>> >>> >>> That justify the other error I receive in the task: > Could not find or load main class org.apache.giraph.yarn.GiraphYarnTask >>> >>> >>> Thanks, >>> >>> Il giorno 06/nov/2014, alle ore 13:07, Tripti Singh >>> ha scritto: >>> Why r u adding two jars? Example jar ideally contains core library so everything should be available with just one example jar included Sent from my iPhone On 06-Nov-2014, at 4:33 pm, "Alessandro Negro" wrote: > Hi, > now it see
Re: Help with Giraph on Yarn
Hi Eli, no I think that the help message is clear enough, generally when I read “jar” I always mean absolute path for jar, but this is a my personal misunderstanding. Thanks, Alessandro Il giorno 16/nov/2014, alle ore 21:39, Eli Reisman ha scritto: > Sounds like you got it figured out since last time I checked this list, sorry > it was a pain. Feel free to drop a JIRA ticket if we can make help message > etc. for -yj option more clear, there's lots to improve there. > > On Sat, Nov 8, 2014 at 7:26 AM, Alessandro Negro wrote: > Hi Tripti, > finally I was able to run the test with success. It was an issue of > permission since I was running as ale not as yarn. > Let me say that now I’m able to run graph examples on Yarn 2.5.1. This is the > final result: > > 14/11/08 16:24:00 INFO yarn.GiraphYarnClient: Completed Giraph: > org.apache.giraph.examples.SimpleShortestPathsComputation: SUCCEEDED, total > running time: 0 minutes, 21 seconds. > > > Many thanks for your support, > Alessandro > > Il giorno 06/nov/2014, alle ore 15:16, Tripti Singh ha > scritto: > >> I don't know if u have access to this node. But if u do, u could check if >> the file is indeed there and u have access to it. >> >> Sent from my iPhone >> >> On 06-Nov-2014, at 6:12 pm, "Alessandro Negro" wrote: >> >>> You are right it works, but now I receive the following error: >>> >>> SLF4J: Class path contains multiple SLF4J bindings. >>> SLF4J: Found binding in >>> [jar:file:/private/tmp/hadoop-yarn/nm-local-dir/usercache/ale/appcache/application_1415264041937_0009/filecache/10/giraph-examples-1.1.0-SNAPSHOT-for-hadoop-2.5.1-jar-with-dependencies.jar!/org/slf4j/impl/StaticLoggerBinder.class] >>> SLF4J: Found binding in >>> [jar:file:/opt/yarn/hadoop-2.5.1/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class] >>> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an >>> explanation. >>> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] >>> 2014-11-06 13:15:37.120 java[10158:1803] Unable to load realm info from >>> SCDynamicStore >>> Exception in thread "pool-4-thread-1" java.lang.IllegalStateException: >>> Could not configure the containerlaunch context for GiraphYarnTasks. >>> at >>> org.apache.giraph.yarn.GiraphApplicationMaster.getTaskResourceMap(GiraphApplicationMaster.java:391) >>> at >>> org.apache.giraph.yarn.GiraphApplicationMaster.access$500(GiraphApplicationMaster.java:78) >>> at >>> org.apache.giraph.yarn.GiraphApplicationMaster$LaunchContainerRunnable.buildContainerLaunchContext(GiraphApplicationMaster.java:522) >>> at >>> org.apache.giraph.yarn.GiraphApplicationMaster$LaunchContainerRunnable.run(GiraphApplicationMaster.java:479) >>> at >>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) >>> at >>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) >>> at java.lang.Thread.run(Thread.java:744) >>> Caused by: java.io.FileNotFoundException: File does not exist: >>> hdfs://hadoop-master:9000/user/yarn/giraph_yarn_jar_cache/application_1415264041937_0009/giraph-examples-1.1.0-SNAPSHOT-for-hadoop-2.5.1-jar-with-dependencies.jar >>> at >>> org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1072) >>> at >>> org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1064) >>> at >>> org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) >>> at >>> org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1064) >>> at org.apache.giraph.yarn.YarnUtils.addFileToResourceMap(YarnUtils.java:153) >>> at org.apache.giraph.yarn.YarnUtils.addFsResourcesToMap(YarnUtils.java:77) >>> at >>> org.apache.giraph.yarn.GiraphApplicationMaster.getTaskResourceMap(GiraphApplicationMaster.java:387) >>> ... 6 more >>> >>> >>> That justify the other error I receive in the task: > Could not find or load main class org.apache.giraph.yarn.GiraphYarnTask >>> >>> >>> Thanks, >>> >>> Il giorno 06/nov/2014, alle ore 13:07, Tripti Singh >>> ha scritto: >>> Why r u adding two jars? Example jar ideally contains core library so everything should be available with just one example jar included Sent from my iPhone On 06-Nov-2014, at 4:33 pm, "Alessandro Negro" wrote: > Hi, > now it seems better, I need to add: > > giraph-1.1.0-SNAPSHOT-for-hadoop-2.5.1-jar-with-dependencies.jar,giraph-examples-1.1.0-SNAPSHOT-for-hadoop-2.5.1-jar-with-dependencies.jar > > > Now it seems that after a lot of cycle it fail with this error: > > Could not find or load main class org.apache.giraph.yarn.GiraphYarnTask > > But in this case the error appear in task-3-stderr.log not in > gam-stderr.log where there is the following error: > > LF4J: Class path contains multiple SLF4J bindings. > SLF4J: Found bindi
