[
https://issues.apache.org/jira/browse/GIRAPH-877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14044636#comment-14044636
]
Sebastian Schelter commented on GIRAPH-877:
---
You could investigate whether
[
https://issues.apache.org/jira/browse/GIRAPH-877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14044560#comment-14044560
]
Sebastian Schelter commented on GIRAPH-877:
---
There is already an impr
[
https://issues.apache.org/jira/browse/GIRAPH-870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13937272#comment-13937272
]
Sebastian Schelter commented on GIRAPH-870:
---
Here is a selection of rese
d was replacing the IntWriteable Id's with Text.
Anyone has any Idea what the problem could be, I'm running out of Idea's.
cheers Martin
On Thu, Feb 27, 2014 at 4:59 PM, Sebastian Schelter wrote:
Hi Martin
I don't think that there are problems with comparing and sorting Te
Hi,
It seems a team from Telefonica built a machine learning library on top
of Giraph:
http://grafos.ml/
Looks pretty interesting to me :)
Best,
Sebastian
[
https://issues.apache.org/jira/browse/GIRAPH-867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sebastian Schelter updated GIRAPH-867:
--
Attachment: GIRAPH-867.patch
> Fix comments in PageRankComputat
Sebastian Schelter created GIRAPH-867:
-
Summary: Fix comments in PageRankComputation
Key: GIRAPH-867
URL: https://issues.apache.org/jira/browse/GIRAPH-867
Project: Giraph
Issue Type
[
https://issues.apache.org/jira/browse/GIRAPH-866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13913504#comment-13913504
]
Sebastian Schelter commented on GIRAPH-866:
---
+1 lgtm
> Fix checkstyl
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/18457/#review35378
---
Ship it!
Ship It!
- Sebastian Schelter
On Feb. 25, 2014, 6:55
Hi Armando & Claudio,
I tested your latest patch, unfortunately it still doesn't work for me.
I applied the patch to the current trunk, copied my algorithm code and
ran it on the cluster. If it runs in memory, everything works well. If I
enable out-of-core I run into the deadlock as before.
2014 at 1:53 PM, Sebastian Schelter wrote:
Hi Roman,
I'm testing the patch for GIRAPH-825 with Armando and Claudio. I'm traveling
this week, but I will continue with the tests next week.
Understood, but the question then becomes -- how long do we hold off a release
for? How badly do
Hi Roman,
I'm testing the patch for GIRAPH-825 with Armando and Claudio. I'm
traveling this week, but I will continue with the tests next week.
Best,
Sebastian
On 02/18/2014 10:33 PM, Roman Shaposhnik wrote:
Hi!
it looks like we're currently standing at 7 unresolved
issues scheduled to go
t also with the
WattsStrogatzInputformat, that creates another type of graph. For what I
understand, this should not happen due to the topology. I think we should
just try to replicate this behavior, hopefully without a very large graph
that makes debugging difficult.
On Sat, Feb 15, 2014 at 8:42 PM, Seb
an you try like that?
On Thu, Feb 13, 2014 at 9:50 PM, Sebastian Schelter wrote:
Hi Armando,
I uploaded my test code to github at:
https://github.com/sscdotopen/giraph/tree/hyperball64-ooc
I'm working on an algorithm to estimate the neighborhood function of the
graph (similar to [1]).
fCoreGraph=true,
giraph.maxPartitionsInMemory=20
Best,
Sebastian
[1] http://arxiv.org/abs/1308.2144
[2] http://konect.uni-koblenz.de/networks/twitter_mpi
On 02/12/2014 04:21 PM, Armando Miraglia wrote:
Hi Sebastian,
On Wed, Feb 12, 2014 at 02:59:20PM +0100, Sebastian Schelter wrote:
No. Should I
2014 at 2:59 PM, Sebastian Schelter wrote:
No. Should I have done that?
On 02/12/2014 02:57 PM, Claudio Martella wrote:
did you also set stickyPartitions to some numbers?
On Wed, Feb 12, 2014 at 1:00 PM, Sebastian Schelter
wrote:
Updating documentation is never a bad idea :)
I rer
No. Should I have done that?
On 02/12/2014 02:57 PM, Claudio Martella wrote:
did you also set stickyPartitions to some numbers?
On Wed, Feb 12, 2014 at 1:00 PM, Sebastian Schelter wrote:
Updating documentation is never a bad idea :)
I reran my test with giraph.maxPartitionsInMemory >
set the number of stickypartitions by hand.
On Wed, Feb 12, 2014 at 10:03 AM, Sebastian Schelter wrote:
I ran a first test with the new DiskBackedPartitionStore and it didn't
work for me unfortunately. The job never leaves the input phase (superstep
-1). I sshd onto one of the workers and it s
x27;d really appreciate if
somebody else could run some additional tests as well. thanks!
On Wed, Feb 12, 2014 at 12:39 AM, Sebastian Schelter wrote:
I'll test the patch from GIRAPH-825 this week.
On 02/12/2014 12:10 AM, Roman Shaposhnik wrote:
Hi!
Given how big the diff here are:
I'll test the patch from GIRAPH-825 this week.
On 02/12/2014 12:10 AM, Roman Shaposhnik wrote:
Hi!
Given how big the diff here are:
https://issues.apache.org/jira/browse/GIRAPH-825
https://issues.apache.org/jira/browse/GIRAPH-840
I am wondering whether it is realistic
to have them in
ced a regression. Armando has worked on a re-design of the
DiskBackedPartitionStore, which we will be uploaded for a review as soon as
we finish testing it.
Stay tuned.
On Mon, Feb 10, 2014 at 6:42 PM, Sebastian Schelter wrote:
Hi,
I'm trying to process a huge graph on our cluster and therefo
[
https://issues.apache.org/jira/browse/GIRAPH-844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sebastian Schelter reassigned GIRAPH-844:
-
Assignee: Sebastian Schelter (was: Roman Shaposhnik)
> TextInputFormat
Hi,
I'm trying to process a huge graph on our cluster and therefore enabled
out-of-core. Unfortunately, I run into a NullPointerException during the
input phase.
What can I do to fix this? I'm using the following settings:
giraph.oneToAllMsgSending=true
giraph.isStaticGraph=true
giraph.numCo
[
https://issues.apache.org/jira/browse/GIRAPH-844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sebastian Schelter updated GIRAPH-844:
--
Attachment: GIRAPH-844.patch
small patch to fix this issue, can someone have a quick
On Mon, Feb 10, 2014 at 4:23 PM, Sebastian Schelter wrote:
Thanks,
but I want to submit a patch and in order for that, all tests should
successfully run.
--sebastian
On 02/10/2014 11:47 AM, Unmesh Joshi wrote:
Try to build with
mvn -DskipTests=true package
This creates all the output jar
Thanks,
but I want to submit a patch and in order for that, all tests should
successfully run.
--sebastian
On 02/10/2014 11:47 AM, Unmesh Joshi wrote:
Try to build with
mvn -DskipTests=true package
This creates all the output jar files.
On Feb 10, 2014 11:33 AM, "Sebastian Schelter&qu
Hi,
I'm having problems with building trunk on my local machine, I get the
following error in TestHBaseRootMarkerVertextFormat. Is anybody else
getting the same? I'm working on GIRAPH-844 btw.
--sebastian
---
Test s
[
https://issues.apache.org/jira/browse/GIRAPH-845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13890478#comment-13890478
]
Sebastian Schelter commented on GIRAPH-845:
---
Build fails on my local mac
Sebastian Schelter created GIRAPH-844:
-
Summary: TextInputFormat for SimpleShortestPaths
Key: GIRAPH-844
URL: https://issues.apache.org/jira/browse/GIRAPH-844
Project: Giraph
Issue Type
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/17446/#review32968
---
Ship it!
Ship It!
- Sebastian Schelter
On Jan. 28, 2014, 6:55
/ComputationDoneName.java
<https://reviews.apache.org/r/17446/#comment62033>
typo in that sentence?
- Sebastian Schelter
On Jan. 28, 2014, 5:41 a.m., Avery Ching wrote:
>
> ---
> This is an automatically generated e
Isn't the input superstep what you're looking for? You'll find its time
in the jobtracker logs.
-sebastian
On 17.06.2013 20:03, Ashish Jain wrote:
> Hi,
>
> I am interested in benchmarking the time a program takes to load a graph.
> What area of the code would be a good place to start looking to
Armando,
which setup of Hadoop do you use? You should definitely have the
userlogs directory.
-sebastian
On 15.06.2013 19:31, Armando Miraglia wrote:
> On Sat, Jun 15, 2013 at 02:18:33PM -0300, Gustavo Enrique Salazar Torres
> wrote:
>> Hmm, did you check at log/userlogs/ ? There is directory f
[
https://issues.apache.org/jira/browse/GIRAPH-624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13634987#comment-13634987
]
Sebastian Schelter commented on GIRAPH-624:
---
looks good +1
You can
[
https://issues.apache.org/jira/browse/GIRAPH-624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13632284#comment-13632284
]
Sebastian Schelter commented on GIRAPH-624:
---
I think we should always make
[
https://issues.apache.org/jira/browse/GIRAPH-624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13632252#comment-13632252
]
Sebastian Schelter commented on GIRAPH-624:
---
Shouldn't the input
[
https://issues.apache.org/jira/browse/GIRAPH-635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sebastian Schelter updated GIRAPH-635:
--
Attachment: GIRAPH-635.patch
> Website Documentation: Missing presentati
Sebastian Schelter created GIRAPH-635:
-
Summary: Website Documentation: Missing presentations
Key: GIRAPH-635
URL: https://issues.apache.org/jira/browse/GIRAPH-635
Project: Giraph
Issue
+1 on OutEdges
Am 15.04.2013 20:05 schrieb "Avery Ching" :
> +1 on OutEdges.
>
> On 4/15/13 10:58 AM, Alessandro Presta wrote:
>
>> Hi all,
>>
>> The more I look at it, the more I think that VertexEdges was an
>> unfortunate naming choice on my part: I was trying to convey the idea that
>> it cont
hope this is the last RC.
>
> Avery
>
> On 4/14/13 9:34 AM, Sebastian Schelter wrote:
>
>> Hi Avery,
>>
>> I see your concerns. The benchmarking question is difficult, we had very
>> bad experiences with Mahout in that regards. E.g., we once had a
>> M/
ll for the 1.0 release.
>
> Let me know what you think.
>
> Avery
>
> On 4/13/13 10:46 AM, Sebastian Schelter wrote:
>> Hi Avery,
>>
>> I found the bug and can I provide a patch today or tomorrow, so
>> hopefully we can include that in the release (to
/
Thanks,
Sebastian Schelter
/RandomWalkWithRestartVertexTest.java
a3dbd45
Diff: https://reviews.apache.org/r/10451/diff/
Testing
---
Passed local unit tests, will test on cluster tomorrow
Thanks,
Sebastian Schelter
Sebastian Schelter created GIRAPH-630:
-
Summary: Convergence detection broken in
o.a.g.examples.PageRankVertex
Key: GIRAPH-630
URL: https://issues.apache.org/jira/browse/GIRAPH-630
Project
lease or simply just ship a 1.1, say in the next month with this
> fix and supporting YARN's 2.0.4? I'd like to get on a more normal
> release cycle rather than once a year =).
>
> Avery
>
> On 4/13/13 3:02 AM, Sebastian Schelter wrote:
>> Hi there,
>>
>&g
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10387/#review18923
---
Ship it!
Ship It!
- Sebastian Schelter
On April 9, 2013, 10:47
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10342/#review18787
---
Ship it!
Ship It!
- Sebastian Schelter
On April 8, 2013, 5:21
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10285/#review18750
---
Ship it!
Ship It!
- Sebastian Schelter
On April 4, 2013, 5:45
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10201/#review18556
---
Ship it!
Ship It!
- Sebastian Schelter
On March 30, 2013, 2:11
the writers for
multithreaded output. Other than that, the patch looks fine.
- Sebastian Schelter
On March 29, 2013, 9:13 p.m., Maja Kabiljo wrote:
>
> ---
> This is an automatically generated e-mail. To reply, visit
/MultiThreadedSuperstepOutput.java
<https://reviews.apache.org/r/10201/#comment38854>
Maybe add a check whether all writers were correctly returned?
- Sebastian Schelter
On March 29, 2013, 9:13 p.m., Maja Kabiljo wrote:
>
> -
x27;s just personal taste. Other
than that, I really like the refactoring and I think it greatly enhances
readability of the code.
- Sebastian Schelter
On March 27, 2013, 11:03 p.m., Nitay Joffe wrote:
>
> ---
> This is an automa
x27;s just personal taste. Other
than that, I really like the refactoring and I think it greatly enhances
readability of the code.
- Sebastian Schelter
On March 27, 2013, 11:03 p.m., Nitay Joffe wrote:
>
> ---
> This is an automa
[
https://issues.apache.org/jira/browse/GIRAPH-480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sebastian Schelter resolved GIRAPH-480.
---
Resolution: Fixed
Fix Version/s: 0.2.0
> Add convergence detection
[
https://issues.apache.org/jira/browse/GIRAPH-480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13615445#comment-13615445
]
Sebastian Schelter commented on GIRAPH-480:
---
Oh, I forgot to resolve this i
[
https://issues.apache.org/jira/browse/GIRAPH-584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13615058#comment-13615058
]
Sebastian Schelter commented on GIRAPH-584:
---
Looks like a very good ide
e, Mar 19, 2013 at 1:23 PM, Claudio Martella <
> claudio.marte...@gmail.com> wrote:
>
>> Yes, I had that problem. It is a problem with an old version of git. Try
>> upgrading to the latest one.
>> (i am supposing you're using apple's by default, which is the old o
Hi,
I'm trying to do my first commit since we changed to git and I'm having
the following problem:
git push -u origin trunk
error: no DAV locking support on
https://git-wip-us.apache.org/repos/asf/giraph.git/
fatal: git-http-push failed
Can anyone help with that?
Thanks,
Sebastian
h/examples/RandomWalkTestUtils.java
PRE-CREATION
giraph-examples/src/test/java/org/apache/giraph/examples/RandomWalkWithRestartVertexTest.java
489b35a
Diff: https://reviews.apache.org/r/9850/diff/
Testing
---
Ran the junit tests locally
Thanks,
Sebastian Schelter
Hi,
does anyone have time for a short look at
https://reviews.apache.org/r/9850/ ?
Please let me know if the changes need more explanation.
Best,
Sebastian
t;> algorithm ?
>>>>>
>>>>> I just subscribed to mahout-dev@ in case some discussion starts there
>>>>> too.
>>>>>
>>>>> Nicolas
>>>>>
>>>>> [1]
>>>>> http://www.psi.toronto.
starts there too.
>
> Nicolas
>
> [1] http://www.psi.toronto.edu/affinitypropagation/FreyDueckScience07.pdf
>
> Le 12 mars 2013 à 08:50, Sebastian Schelter a écrit :
>
>> Hi fellow Giraphers,
>>
>> on Mahout's dev@ mailinglist, there is a discussion
Hi fellow Giraphers,
on Mahout's dev@ mailinglist, there is a discussion about a potential
(experimental) future integration of Giraph. Might be good to hear your
opinion about that.
Best,
Sebastian
mples/RandomWalkWithRestartVertexTest.java
489b35a
Diff: https://reviews.apache.org/r/9850/diff/
Testing
---
Ran the junit tests locally
Thanks,
Sebastian Schelter
For me, Giraph on Hadoop 1.0.4 runs into some kind of deadlock after the
input was loaded when using it with 200 workers on a billion-scale graph
I tried several versions of zookeeper, but nothing helped.
Best,
Sebastian
On 19.02.2013 21:55, Claudio Martella wrote:
> I'm running PR with tru
Hi,
I saw that checkpointing is disabled by default. I'd like to know (out
of scientific curiosity) why we decided to have this as default.
Best,
Sebastian
[
https://issues.apache.org/jira/browse/GIRAPH-488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13560540#comment-13560540
]
Sebastian Schelter commented on GIRAPH-488:
---
Hi Eli,
your patch fixed
[
https://issues.apache.org/jira/browse/GIRAPH-489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13558299#comment-13558299
]
Sebastian Schelter commented on GIRAPH-489:
---
looks good, please attach i
[
https://issues.apache.org/jira/browse/GIRAPH-489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sebastian Schelter resolved GIRAPH-489.
---
Resolution: Duplicate
duplicates GIRAPH-487
> Bug in GiraphRun
Sebastian Schelter created GIRAPH-488:
-
Summary: ArrayOutOfBoundsException in
org.apache.giraph.worker.InputSplitPathOrganizer
Key: GIRAPH-488
URL: https://issues.apache.org/jira/browse/GIRAPH-488
Sebastian Schelter created GIRAPH-487:
-
Summary: VertexInputPath in GiraphRunner refers to EdgeInputPath
Key: GIRAPH-487
URL: https://issues.apache.org/jira/browse/GIRAPH-487
Project: Giraph
Hi,
I'm currently working on GIRAPH-480 to add a convergence check to
RandomWalkVertex (which is an abstract version of PageRank and
RandomWalkWithRestart).
RandomWalkVertex extends LongDoubleFloatDoubleEdgeListVertex which means
that the edge values (the transition probabilities between the vert
[
https://issues.apache.org/jira/browse/GIRAPH-480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sebastian Schelter updated GIRAPH-480:
--
Description:
I propose to add convergence detection to the RandomWalkVertex
Sebastian Schelter created GIRAPH-480:
-
Summary: Add convergence detection to
org.apache.giraph.examples.RandomWalkVertex
Key: GIRAPH-480
URL: https://issues.apache.org/jira/browse/GIRAPH-480
[
https://issues.apache.org/jira/browse/GIRAPH-203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13464232#comment-13464232
]
Sebastian Schelter commented on GIRAPH-203:
---
A superb source of datasets is
Stratosphere even employs its own memory management by serializing data
to preallocated byte arrays. This does not only allow for a very compact
representation of the data, but also avoids major GC pauses and allows
different buffer implementations to gracefully spill to disk.
On 17.08.2012 17:17,
Hi Benjamin,
just asking out of curiosity, to what library did you move? GraphChi?
Best,
Sebastian
On 27.07.2012 13:20, Benjamin Heitmann (JIRA) wrote:
>
> [
> https://issues.apache.org/jira/browse/GIRAPH-180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedComm
Sebastian Schelter created GIRAPH-245:
-
Summary: BasicRPCCommunications fails with custom vertices
Key: GIRAPH-245
URL: https://issues.apache.org/jira/browse/GIRAPH-245
Project: Giraph
[
https://issues.apache.org/jira/browse/GIRAPH-157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13291156#comment-13291156
]
Sebastian Schelter commented on GIRAPH-157:
---
Eli,
the whole purpos
[
https://issues.apache.org/jira/browse/GIRAPH-157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13290149#comment-13290149
]
Sebastian Schelter commented on GIRAPH-157:
---
You tackle an NP-complete pro
[
https://issues.apache.org/jira/browse/GIRAPH-127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13290126#comment-13290126
]
Sebastian Schelter commented on GIRAPH-127:
---
Any update on the work on
[
https://issues.apache.org/jira/browse/GIRAPH-4?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13285798#comment-13285798
]
Sebastian Schelter commented on GIRAPH-4:
-
I really like it, +1 from my
82 matches
Mail list logo