Re: Giraph automated parameter tuning

2019-03-21 Thread Muaz Twaty
Hi Dionysios, thank you for your reply :D. We are planning on trying multiple optimization algorithms and maybe implement a search algorithm (like hill-climbing algorithm guided by a prediction model). We are targeting very expensive (time consuming) graph jobs. Regarding the results, I will keep

Re: Giraph automated parameter tuning

2019-03-19 Thread Dionysios Logothetis
Hi Muaz, this is a very interesting topic! First of all, the top 2 (number of workers, heap size) are indeed the most important. Also, I think giraph.numComputeThreads and probably the netty-related thread parameter are more important. The following are less important: - giraph.maxMutationsPerR

Giraph automated parameter tuning

2019-03-13 Thread Muaz Twaty
Hello Giraph community, "*Parameter tuning of graph processing frameworks*" is the domain of research for my master thesis. The objective of the thesis is to find an automated method to choose an optimal/sub-optimal configuration for the graph processing frameworks. At this point, I reviewed the s