Hi,
for everybody who is interested: here is a video that shows how to generate
Giraph applications with EMF and Henshin:
https://www.youtube.com/watch?v=PbEZxEdSo2A
We would be happy about any feedback (rather use the Henshin mailing list
though).
Cheers,
Christian
Hi Panagiotis,
you could use Java UUIDs. But you would need two longs for this. Otherwise
you could also define your own application specific logic to generate
universal IDs.
Cheers,
Christian
2014-07-29 12:14 GMT+02:00 Panagiotis Eustratiadis :
> Hello everyone,
>
> I'm looking for a way to g
Hi,
what is the recommended setup for developing Giraph applications in Eclipse?
Cheers,
Christian
Hi all,
FYI: we are currently working on a Giraph code generator in the Henshin
tool. You can find some more info here: bit.ly/1eoLJ64
Regards,
Christian
Tue, Sep 10, 2013 at 1:44 PM, Christian Krause wrote:
>
>> I still see the number of counters increasing in the job tracker :(. Can
>> I also set it in my giraph-site.xml or directly in my MasterCompute class?
>>
>> Cheers,
>> Christian
>>
>>
>> 2
Hi,
by default, how many threads are used for the compute method? I thought
that Giraph would automatically use multiple threads by default, but then I
stumbled onto this log message:
2013-09-11 11:51:44,501 INFO org.apache.giraph.graph.GraphTaskManager:
execute: 6 partitions to process with 1 com
re the GiraphRunner specific parameters, e.g. -D giraph.
> useSuperstepCounters=false
>
>
> On Tue, Sep 10, 2013 at 1:15 PM, Christian Krause wrote:
>
>> Thanks a lot. One last question: where do I set options like
>> USE_SUPERSTEP_COUNTERS?
>>
>> Christian
>>
&
;
> >
> > On 9/9/13 6:43 AM, Claudio Martella wrote:
> >
> > No, I used a different counters limit on that hadoop version. Setting
> > mapreduce.job.counters.limit to a higher number and restarting JT and TT
> > worked for me. Maybe 64000 might be too high? Try
Sorry, it still doesn't work (I ran into a different problem before I
reached the limit).
I am using Hadoop 0.20.203.0. Is the limit of 120 counters maybe hardcoded?
Cheers
Christian
Am 09.09.2013 08:29 schrieb "Christian Krause" :
> I changed the property name to mapred.job.
I changed the property name to mapred.job.counters.limit and restarted it
again. Now it works.
Thanks,
Christian
2013/9/7 Claudio Martella
> did you restart TT and JT?
>
>
> On Sat, Sep 7, 2013 at 7:09 AM, Christian Krause wrote:
>
>> Hi,
>> I've incre
Hi,
I've increased the counter limit in mapred-site.xml, but I still get the
error: Exceeded counter limits - Counters=121 Limit=120. Groups=6 Limit=50.
This is my config:
cat conf/mapred-site.xml
...
mapreduce.job.counters.limit
64000
mapred.task.tim
My apologies. Now it works. Maybe it was some caching problem of Maven.
Cheers,
Christian
On 08/18/2013 01:21 PM, Christian Krause wrote:
What's this??
[ERROR]
/home/***/giraph-git/giraph-examples/target/munged/test/org/apache/giraph/vertex/TestComputationTypes.java:[1
What's this??
[ERROR]
/home/***/giraph-git/giraph-examples/target/munged/test/org/apache/giraph/vertex/TestComputationTypes.java:[100,20]
org.apache.giraph.vertex.TestComputationTypes.GeneratedVertexMismatchValueFactory
is not abstract and does not override abstract method
createVertexValue()
Hi,
I get these compile errors. Could it be that some classes are missing?
Cheers,
Christian
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-compiler-plugin:3.0:compile
(default-compile) on project giraph-core: Compilation failure:
Compilation failure:
[ERROR]
/home/christian/g
the counter).
Cheers,
Christian
2013/7/3 Avery Ching
> What are the requirements of your global ids? If they simply need to be
> unique, you can split the id space across workers and assign them
> incrementally.
>
>
> On 6/30/13 1:09 AM, Christian Krause wrote:
>
>>
Hi,
I was wondering if there is a way to register a global factory for new
vertex IDs. Currently, I have to come up with new IDs in my compute
method which does work, but with the penality that the required memory
for vertex IDs is unnecessarily high. If there was a global vertex ID
factory I
cts being
managed/used in a mapper and compute upwards from there.
That said a -Xmx 4G would be the low end of what I
would specify. Also, you may want to set the options
whcih change how Java does garbage collection.
Hope this helps.
On 6/27/2013 12:20 PM, Christian Krause wr
Hi,
I implemented a benchmark that allows me to generate an arbitrarily
large graph (depending on the number of iterations). Now I would like to
configure Giraph so that I can make the best use of my hardware for this
benchmark. Based on the number of nodes in my cluster, their amount of
main
umber. Strange..
Cheers,
Christian
2013/6/26 Claudio Martella
> Hi,
>
> inline are my (tentative) answers.
>
>
> On Wed, Jun 26, 2013 at 6:34 PM, Christian Krause wrote:
>
>> Hi,
>>
>> if I create new vertices, will they be executed in the next superstep
Hi,
if I create new vertices, will they be executed in the next superstep?
And does it make a difference whether I create them using
addVertexRequest() or sendMessage()?
Another question: if I mutate the graph in superstep X and X is the last
superstep, will the changes be executed? It is no
public void setSize(int size) {
boolean resize = size > getCapacity();
super.setSize(size);
if (resize) {
setCapacity(size);
}
}
}
2013/6/24 Christian Krause
> It seems this is related to this issue:
> http://stackoverflow.com/questions/159
It seems this is related to this issue:
http://stackoverflow.com/questions/15957870/why-byteswritable-setsizesize-make-the-space-of-bytes-to-1-5size
But I am using the byte[] constructor, so I still don't get it...
Christian
2013/6/24 Christian Krause
> Hi,
> I am using BytesW
I am also a Giraph beginner. The default addresses of the web interfaces of
your master nodes are localhost:50030 and localhost:50070 (assuming your
localhost is your master). Just open them in a browser...
Cheers,
Christian
Hi,
You have a failed map task. Take a look at the web interface of the Job
Tracker. Open the logs of your job and look for exceptions.
Cheers,
Christian
2013/6/24 김원배
> Hi, I'm beginner on giraph.
> I have a problem with running shortestpath example.
>
> I'm using giraph-1.0.0
> hadoop 0.20.2
Hi,
I am using BytesWritables as messages and vertex IDs. The strange thing is
when I send a message or create a new vertex, a 0 is appended to my
original byte array. From my log I can see that I am sending the correct
data and in the next superstep I get my array with an appended 0. Does
anybody
I found the log messages. For anyone who is interested, see this post:
http://stackoverflow.com/questions/7305015/how-to-log-messages-from-hadoop
Christian
2013/6/20 Christian Krause
> Hi,
> I can't find the log messages produced by my compute() method in my logs.
> My mess
Hi,
I can't find the log messages produced by my compute() method in my logs.
My messages are debug messages and I have set the property
hadoop.root.logger=DEBUG.console
in my log4j.properties.
What else do I need to do to see my log messages? Should they appear in the
normal job log? Or on the
It seems to be a problem with Hadoop YARN. I switched to the default Hadoop
version.
2013/6/5 Christian Krause
> Hi,
> I'm using Hadoop 2.0.3.alpha with a single node set-up, and Giraph 1.0.0.
> When I try the PageRank example I get this error:
>
> Excep
Hi,
I'm using Hadoop 2.0.3.alpha with a single node set-up, and Giraph 1.0.0.
When I try the PageRank example I get this error:
Exception in thread "main" java.lang.IllegalArgumentException:
checkLocalJobRunnerConfiguration: When using LocalJobRunner, must have only
one worker since only 1 task at
29 matches
Mail list logo
