Hi Kyle,
combiners are set by the user, as you recognized, and called automatically
by the infrastructure at different moments in the path. Combined messages
are passed transparently to the compute method (namely less messages than a
vertex would have received without a combiner).
Have a look at
Dear Mr. Martella,
Once achieved the conditions for updating the vertex data base, what it the
best way for the Injector Vertex to call an input reader again?
I am able to access all the HDFS data, but I guess the vertex would need to
have access to the input splits and also the vertex input
As I said, the injection of the new vertices/edges would have to be done
manually, hence without any support of the infrastructure. I'd suggest
you implement a WorkerContext class that supports the reading of a specific
file with a specific format (under your control) from HDFS, and that is
Hi Yasser,
You can do this through the Configuration parameters. You should call:
description1.addParameter(myApplication.vertexInputPath, file1.txt);
and
description2.addParameter(myApplication.vertexInputPath, file2.txt);
Then from the code of your InputFormat class you can get this parameter
