Re: Giraph and HBase

Nice! Thanks for sharing! Roman. On Tue, Dec 13, 2016 at 12:38 PM, Robert Yokota wrote: > Hi, > > In case anyone is interested in analyzing graphs in HBase with Apache > Giraph, this might be helpful: > >

Re: Apache Giraph Visualisation

On Sun, Aug 7, 2016 at 7:50 PM, agc studio wrote: > Hi Team, > > I have been looking for a graph drawing/visualisation implemented algorithm > for Giraph. Are there any such implementations? Can you be more specific/give examples? Thanks, Roman.

Re: Anybody's considering to present at ApacheCON EU?

Awesome! Meantime, I'll take a look at the HBase one. Thanks, Roman. On Mon, Jul 18, 2016 at 5:05 PM, Sergey Edunov <edu...@gmail.com> wrote: > Hi Roman, > > I'll take care of out of core test case. > > Regards, > Sergey Edunov > > On Mon, Jul 18, 2016 at

Re: Giraph out-of-core feature is not helping!

I remember seeing a discussion that discouraged users from utilizing OOC. I am vague on the details but you can try searching the archives. Thanks, Roman. On Fri, Dec 4, 2015 at 4:34 PM, Khaled Ammar wrote: > Hi, > > I am using Giraph-1.1.0 to do large graph processing.

Re: How can I build giraph 1.1.0-hadoop2 distribution from the source?

On Thu, Sep 10, 2015 at 4:09 AM, Anton Petersson wrote: > Dear Roman, > > Thanks for your reply. > My application code runs on hadoop 2.4.1, by including the following > dependency. > > > org.apache.giraph > giraph-core > 1.1.0-hadoop2 > > > > I tried to change

Re: Please welcome our newest committer, Igor Kabiljo!

Great work, Igor! Thanks, Roman. On Tue, Feb 10, 2015 at 8:42 PM, Maja Kabiljo majakabi...@fb.com wrote: I am pleased to announce that Igor Kabiljo has been invited to become a committer by the Project Management Committee (PMC) of Apache Giraph, and he accepted. Igor's most important

Re: YARN vs. MR1: is YARN a good idea?

Perfect summary! Thanks for writing it. Thanks, Roman. On Fri, Dec 19, 2014 at 12:09 PM, Eli Reisman apache.mail...@gmail.com wrote: Giraph on YARN thus far doesn't break any compatibility with the MapReduce version. When I was working on it more actively, it had a slightly faster job startup

Re: ClassNotFoundException GiraphYarn Task with Giraph 1.1.0 for Hadoop 2.5.1

On Sun, Dec 14, 2014 at 11:21 PM, Philipp Nolte p...@daslaboratorium.de wrote: Maybe its just a configuration thing. How did you build Giraph in the first place? Also, what's your mapred-site.xml and yarn-site.xml in HADOOP_CONF_DIR? Finally, what version of Hadoop are you using? And from what

Re: ClassNotFoundException GiraphYarn Task with Giraph 1.1.0 for Hadoop 2.5.1

Fixing YARN backend would be nice, but in the meantime, what prevents you from using a MR backend? That is known to work. Thanks, Roman. On Sun, Dec 14, 2014 at 2:41 PM, Philipp Nolte p...@daslaboratorium.de wrote: Hello everyone, I have been developing a Giraph application and now wanted to

Re: ClassNotFoundException GiraphYarn Task with Giraph 1.1.0 for Hadoop 2.5.1

On Sun, Dec 14, 2014 at 4:09 PM, Philipp Nolte p...@daslaboratorium.de wrote: I’ve had a look at the assembled giraph-core jar file and it does not contain any GiraphYarnTask. How so? Running my application using the GiraphRunner works fine as long as I only have one worker (local mode). To

Re: Can't complete Shortest Path Example: error code 127

On 08 Dec 2014, at 23:59, Roman Shaposhnik ro...@shaposhnik.org wrote: On Mon, Dec 8, 2014 at 9:23 AM, Dr. Alessio Arleo ingar...@icloud.com wrote: Hello everybody I managed to compile Giraph 1.1 for Hadoop 2.6.0 with pure_yarn maven profile. I am running on a VM environment so I took

Re: Can't complete Shortest Path Example: error code 127

On Mon, Dec 8, 2014 at 9:23 AM, Dr. Alessio Arleo ingar...@icloud.com wrote: Hello everybody I managed to compile Giraph 1.1 for Hadoop 2.6.0 with pure_yarn maven profile. I am running on a VM environment so I took the necessary actions as listed in the Giraph Quick Start Guide. I think it

Re: Please welcome our newest committer, Sergey Edunov!

Congrats! Great to have you onboard! On Wed, Dec 3, 2014 at 10:34 AM, Maja Kabiljo majakabi...@fb.com wrote: I am happy to announce that the Project Management Committee (PMC) for Apache Giraph has elected Sergey Edunov to become a committer, and he accepted. Sergey has been an active member

[ANNOUNCE] Giraph 1.1.0 is now available

The Apache Giraph team is pleased to announce the immediate release of Giraph 1.1.0. Download it from your favorite Apache mirror at: http://www.apache.org/dyn/closer.cgi/giraph/giraph-1.1.0 This release has also been pushed to Apache's maven repository as two separate versions: * 1.1.0

[RESULT] [VOTE] Apache Giraph 1.1.0 RC2

) Eli Reisman (binding) Roman Shaposhnik (non-binding) I'll do the publishing tonight and will send an announcement! Thanks, Roman (AKA 1.1.0 RM) On Thu, Nov 13, 2014 at 5:28 AM, Roman Shaposhnik ro...@shaposhnik.org wrote: This vote is for Apache Giraph, version 1.1.0 release It fixes

Re: [VOTE] Apache Giraph 1.1.0 RC2

On Thu, Nov 13, 2014 at 5:28 AM, Roman Shaposhnik ro...@shaposhnik.org wrote: This vote is for Apache Giraph, version 1.1.0 release +1 (non-binding) Thanks, Roman.

[VOTE] Apache Giraph 1.1.0 RC2

This vote is for Apache Giraph, version 1.1.0 release It fixes the following issues: http://s.apache.org/a8X *** Please download, test and vote by Mon 11/17 noon PST Note that we are voting upon the source (tag): release-1.1.0-RC2 Source and binary files are available at:

Re: [VOTE] Apache Giraph 1.1.0 RC1

, I did re-run the build this weekend, and it built succesfully for the default profile and the hadoop_2 one. I ran a couple of examples on the cluster, and it ran succesfully. I'm +1. On Tue, Nov 4, 2014 at 8:10 PM, Roman Shaposhnik ro...@shaposhnik.org wrote: On Tue, Nov 4, 2014 at 5:47 AM

Re: [VOTE] Apache Giraph 1.1.0 RC2

On Thu, Nov 13, 2014 at 5:32 AM, Panagiotis Eustratiadis ep.pan@gmail.com wrote: Was the issue with the aggregators on release-1.1 fixed? The only extra fix in this latest RC is: https://issues.apache.org/jira/browse/GIRAPH-961 Thanks, Roman.

Re: Differences in building Giraph

At this point you either need Hadoop 2.5+ or you need to manually hack the two offending files. Thanks, Roman. On Thu, Nov 6, 2014 at 9:44 PM, Sundara Raghavan Sankaran sun...@crayondata.com wrote: Hi Giraph Experts, I'm trying to build Giraph (trunk) for Hadoop 2.4.0. I know that there are 2

Re: Compiling Giraph 1.1

What's the exact compilation incantation you use? Thanks, Roman. On Tue, Nov 4, 2014 at 9:56 AM, Ryan freelanceflashga...@gmail.com wrote: I'm attempting to build, compile and install Giraph 1.1 on a server running CDH5.1.2. A few weeks ago I successfully compiled it by changing the hadoop_2

Re: [VOTE] Apache Giraph 1.1.0 RC1

On Mon, Nov 3, 2014 at 4:51 PM, Maja Kabiljo majakabi...@fb.com wrote: We¹ve been running code which is the same as release candidate plus fix on GIRAPH-961 in production for 5 days now, no problems. This is hadoop_facebook profile, using only hive-io from all io modules. Great! This tells me

Re: [VOTE] Apache Giraph 1.1.0 RC1

On Tue, Nov 4, 2014 at 5:47 AM, Claudio Martella claudio.marte...@gmail.com wrote: I am indeed having some problems. mvn install will fail because the test is opening too many files: [snip] I have to investigate why this happens. I'm not using a different ulimit than what I have on my Mac OS

Re: [VOTE] Apache Giraph 1.1.0 RC1

Ping! Any progress on testing the current RC? Thanks, Roman. On Fri, Oct 31, 2014 at 9:00 AM, Claudio Martella claudio.marte...@gmail.com wrote: Oh, thanks for the info! On Fri, Oct 31, 2014 at 3:06 PM, Roman Shaposhnik ro...@shaposhnik.org wrote: On Fri, Oct 31, 2014 at 3:26 AM, Claudio

Re: Issue with Giraph on multinode cluster

Please create a JIRA and attach your patch to it. Thanks, Roman. On Mon, Oct 20, 2014 at 2:23 AM, Bojan Babic gba...@gmail.com wrote: I've made a patch that worked for me. Not sure, if I should post JIRA issue. In attach, you can find hack. On Fri, Oct 17, 2014 at 5:52 PM, Bojan Babic

Re: [VOTE] Apache Giraph 1.1.0 RC1

On Fri, Oct 31, 2014 at 3:26 AM, Claudio Martella claudio.marte...@gmail.com wrote: Hi Roman, thanks again for this. I have had a look at the staging site so far (our cluster has been down whole week... universities...), and I was wondering if you have an insight why some of the docs are

[VOTE] Apache Giraph 1.1.0 RC1

This vote is for Apache Giraph, version 1.1.0 release It fixes the following issues: http://s.apache.org/a8X *** Please download, test and vote by Mon 11/3 noon PST Note that we are voting upon the source (tag): release-1.1.0-RC1 Source and binary files are available at:

Re: Empty Output when running Shortest Path Algorithm !!

I this should should give you some clue: 14/09/21 13:34:03 WARN job.GiraphConfigurationValidator: Output format vertex index type is not known 14/09/21 13:34:03 WARN job.GiraphConfigurationValidator: Output format vertex value type is not known 14/09/21 13:34:03 WARN

Re: Are the unit tests supposed to fail?

On Mon, Jul 7, 2014 at 4:50 PM, Toshio ITO toshio9@toshiba.co.jp wrote: Hi Roman, I previously reported some cases where Giraph unit tests failed. http://mail-archives.apache.org/mod_mbox/giraph-user/201406.mbox/%3c87a990dkni.wl%25toshio9@toshiba.co.jp%3E This thread talks about

Re: Giraph 1.1.0 and Jetty 7

On Fri, Jul 4, 2014 at 9:11 AM, Carlo Sartiani sarti...@gmail.com wrote: We examined the code of Giraph 1.1.0, but we actually did not find any place where a Collector object is created and/or Jetty is really used. Do you have any idea on how to solve this issue? Please, observe that we are

Re: Giraph (1.1.0-SNAPSHOT and 1.0.0-RC3) unit tests fail

Yes, the failures around Accumulo in hadoop_2 profile are expected and nothing to worry about. I should've probably mentioned it in my RC announcement email. Sorry about that. Any failures in hadoop_1 profile would be a reason to reconsider RC0. Thanks, Roman. P.S. This is one of the reasons

Re: Giraph (1.1.0-SNAPSHOT and 1.0.0-RC3) unit tests fail

Please try profiles hadoop_1 and hadoop_2. These are the two profiles that we're targeting for the upcoming 1.1.0 release. The rest of profiles are optional and may or may NOT work. Thanks, Roman. On Thu, Jun 26, 2014 at 3:34 AM, Toshio ITO toshio9@toshiba.co.jp wrote: Hi all, I recently

Re: Is it possible to know the mapper task a particular vertex is assigned to?

On Wed, Mar 5, 2014 at 9:53 PM, Pankaj Malhotra pankajiit...@gmail.com wrote: Hi, How can I find the mapper task a particular vertex is assigned to? I can do this by doing a sysout and then looking at the logs. But there must be a smarter way to do this. Please suggest. That mapping is not

Giraph talks at Hadoop Summit

Hi! not sure if anybody from the Giraph community submitted any talks to Hadoop Summit, but here's the one I submitted: https://hadoopsummit.uservoice.com/forums/242790-committer-track/suggestions/5568061-apache-giraph-start-analyzing-graph-relationships Feel free to upvote if you feel like

Re: Issue in running giraph example in hadoop2.2

You need to configure Giraph not to split workers and master via giraph.SplitMasterWorker=false You can either set it in giraph-site.xml or pass via command line option -ca giraph.SplitMasterWorker=false Thanks, Roman. On Sat, Feb 22, 2014 at 10:19 PM, Arun Kumar toga...@gmail.com wrote: While

Re: Problem running SimpleShortestPathsComputation on CDH5 with Hadoop 2.2.0

On Wed, Feb 19, 2014 at 1:12 PM, Stefan Beskow stefan.bes...@sas.com wrote: Hi. I checked out and built Giraph for Cloudera CDH5 with Hadoop 2.2.0 using the following: git clone git://git.apache.org/giraph.git snapshot_from_git cd snapshot_from_git mvn -Phadoop_yarn -Dhadoop.version=2.2.0

Re: Giraph 1.1.0 Apache Giraph Distribution ........................ FAILURE and Unsupported major.minor version 51.0 error.

Try applying this patch (you may need to apply it with a fuzz): https://issues.apache.org/jira/browse/GIRAPH-794 and let us know if it helps (it should). Thanks, Roman. On Thu, Feb 6, 2014 at 2:23 PM, Rocky Grey rockyg...@gmail.com wrote: Hi I pulled the latest repository from Git -

Re: Release date for 1.1.0

On Thu, Jan 30, 2014 at 5:04 PM, Avery Ching ach...@apache.org wrote: I've upgraded HBase in Giraph-833 ( HBase 0.90.5- 0.94.16) https://issues.apache.org/jira/browse/GIRAPH-833 Any reason it is not marked as for 1.1.0? Thanks, Roman.

Re: Release date for 1.1.0

? Thanks, Ivy -Original Message- From: shaposh...@gmail.com [mailto:shaposh...@gmail.com] On Behalf Of Roman Shaposhnik Sent: Monday, January 06, 2014 9:22 PM To: user@giraph.apache.org Subject: Re: Release date for 1.1.0 On Mon, Jan 6, 2014 at 6:13 AM, Ahmet Emre Aladağ aladage

Re: Release date for 1.1.0

Subject: RE: Release date for 1.1.0 May I know what are the Giraph release process? Thanks, Ivy -Original Message- From: shaposh...@gmail.com [mailto:shaposh...@gmail.com] On Behalf Of Roman Shaposhnik Sent: Monday, January 06, 2014 9:22 PM To: user@giraph.apache.org Subject: Re

Re: Preconfigured BigTop running Giraph

Hi Martin, sorry for the belated reply. I am wondering how did you configure your cluster? Did you use Bigtop's puppet recipies or did you do it by hand? It seems that Giraph is working fine on the toy cluster that I'm deploying with the Bigtop bits. But I'm using Puppet and the topology is

Re: giraph-hive having problem with cdh-4.4 (hadoop2.0)

I could bet this is because the default version of Hive you're pulling is compiled against Hadoop 1, not Hadoop from CDH. If you want to run against a CDH cluster -- you have to make sure you change versions of all dependecies to be CDH ones (take a look at the properties section of the Giraph's

Re: Issue Running Giraph Job

Do you have a dedicated Zookeeper ensemble running on your cluster? It feels like something is conflicting on ports with an embedded one. Thanks, Roman. On Wed, Oct 30, 2013 at 12:48 PM, Artie Pesh-Imam artie.pesh-i...@tapad.com wrote: Hi all, I'm able to run this job locally but when I try

Re: Release date for 1.1.0

+dev@ On Tue, Oct 29, 2013 at 9:47 AM, Avery Ching ach...@apache.org wrote: I would like that as well. Does someone else want to coordinate this one? =) If all of the PMC members are fine with a non-committer driving a release -- I'd be more than happy to volunteer as an RM for 1.1.0. That

Re: External Documentation about Giraph

On Wed, May 29, 2013 at 2:25 PM, Maria Stylianou mars...@gmail.com wrote: Hello guys, This semester I'm doing my master thesis using Giraph in a daily basis. In my blog (marsty5.wordpress.com) I wrote some posts about Giraph, some of the new users may find them useful! And maybe some of the

Re: [VOTE] Release Giraph 1.0 (rc0)

On Fri, Apr 12, 2013 at 3:56 PM, Avery Ching ach...@apache.org wrote: Fellow Giraphers, We have a our first release candidate since graduating from incubation. This is a source release, primarily due to the different versions of Hadoop we support with munge (similar to the 0.1 release).