, Jyotirmoy Sundi sundi...@gmail.com wrote:
Hi Folks,
I am seeing this error recently in jobs, can you please throw some
light on what resolveMutations in NettyWorkerServer.java tries to achieve ?
*Trace:*
Caused by: java.lang.IllegalStateException: resolveMutations: Already has
Filename for above changes : NettyWorkerServer.java
On Wed, May 14, 2014 at 8:05 AM, Jyotirmoy Sundi sundi...@gmail.com wrote:
Hi,
Not throwing the exception in resolveMutations worked for me. Is it
possible to get some understanding of what effects it would have if any
because
.
On Sat, Mar 1, 2014 at 9:18 PM, Jyotirmoy Sundi sundi...@gmail.comwrote:
Hi Folks,
The job was working properly in MR1 without any issue. I am trying to
run a simple CC sample Giraph job on YARN. . I have attached the stacktrace
and a few errors. Any pointers will be really helpful
PM, Jyotirmoy Sundi sundi...@gmail.com wrote:
Hmmm,
I am running in cloudera manager. The number of application master,master
and worker seems as per the config stats.
I get the following response in master mapper while running on a small
graph
MASTER_ONLY checkWorkers: Only found 2
Hi Folks,
The job was working properly in MR1 without any issue. I am trying
to run a simple CC sample Giraph job on YARN. . I have attached the
stacktrace and a few errors. Any pointers will be really helpful for
the below errors.
*1. BspServiceMaster (YARN profile) is FAILING this task,
see that my fat jar includes guava
13.x in it, but Im running into this same problem.
--
Artie Pesh-Imam
Software Engineer @ Tapad
201-253-9647
--
From: Jyotirmoy Sundi Jyotirmoy Sundi sundi...@gmail.com
Reply: user@giraph.apache.org user@giraph.apache.org
Date
wrote:
got it, thank you very much!
On Wed, Oct 16, 2013 at 10:43 AM, Jyotirmoy Sundi
sundi...@gmail.comwrote:
Put it as -Dgiraph.useOutOfCoreMessages=true
-Dgiraph.useOutOfCoreGraph=true after GiraphRuuner
like
hadoop jar girap.jar org.apache.giraph.GiraphRunner
of core performance of my cluster.
Thanks very much,
Jian
--
Best Regards,
Jyotirmoy Sundi
Data Engineer,
Admobius
San Francisco, CA 94158
taking ~800G , is it the mapping information stored ? is there anyway of
doing profiling over it ?
Thanks
--
Best Regards,
Jyotirmoy Sundi
Data Engineer,
Admobius
San Francisco, CA 94158
!
On Wed, Oct 16, 2013 at 10:43 AM, Jyotirmoy Sundi sundi...@gmail.comwrote:
Put it as -Dgiraph.useOutOfCoreMessages=true
-Dgiraph.useOutOfCoreGraph=true after GiraphRuuner
like
hadoop jar girap.jar org.apache.giraph.GiraphRunner
-Dgiraph.useOutOfCoreMessages=true
-Dgiraph.useOutOfCoreGraph=true
Just an ack if anybody faces the same issue.This issue has to do with a
previous version of guava11.0.2 used in cdh4, its fixed now.
Thanks
Sundi
On Thu, Oct 10, 2013 at 11:57 AM, Jyotirmoy Sundi sundi...@gmail.comwrote:
Hi,
It seems like a bug with synchronization while trying to add
the new interface), then my jobs would
finish fine.
On Mon, Oct 14, 2013 at 11:13 AM, Jyotirmoy Sundi sundi...@gmail.comwrote:
Hi folks,
We are successfully able to run Giraph for 1B vertices and
around 20B edges in our cluster. This is great. But when we run it over 5B
vertices
The latest trunk compiled without the need not change any interfaces apart
from just adding a new exception to one of the class.
On Mon, Oct 14, 2013 at 11:40 AM, Jyotirmoy Sundi sundi...@gmail.comwrote:
Thanks will try that out, rewriting in saveVertices to match the new
interfaces does
(DiskBackedPartitionStore.java:895)
at
java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:92)
On Wed, Oct 9, 2013 at 9:13 PM, Jyotirmoy Sundi sundi...@gmail.com wrote:
Hi,
Any pointers on this error would be appreciated.
java.lang.IllegalStateException: addPartition
,
Jyotirmoy Sundi
Admobius
San Francisco, CA 94158
On Thu, Sep 26, 2013 at 6:08 PM, Jyotirmoy Sundi sundi...@gmail.com wrote:
Hi ,
I got the connected component working for 1B nodes, but when I run the job
again, it fails with the below error. Aprt form this in zookeeper the data
On 10/1/13 6:27 PM, Jyotirmoy Sundi wrote:
Hi ,
I am able to run apache giraph successfully with around 500M pairs to
find Connected components. It works great but not always, the issue seems
to be with the time out zookeeper time out. Some of the client(around 5-10
) out of 100, produces
.rsk.admobius.com:50030/machines.jsp?type=active16884
36.000 http://had24.rsk.admobius.com:50030/machines.jsp?type=blacklisted0
--
Best Regards,
Jyotirmoy Sundi
Data Engineer,
Admobius
San Francisco, CA 94158
, unregistering health on
/_hadoopBsp/job_201309260044_0086/_applicationAttemptsDir/0/_superstepDir/-1/_workerHealthyDir/had13.rsk.admobius.com_3
on superstep -1
--
--
Best Regards,
Jyotirmoy Sundi
Data Engineer,
Admobius
San Francisco, CA 94158
(ZooKeeperExt.java:152)
at
org.apache.giraph.worker.InputSplitsHandler.markInputSplitPathFinished(InputSplitsHandler.java:159)
... 9 more
--
Best Regards,
Jyotirmoy Sundi
Data Engineer,
Admobius
San Francisco, CA 94158
19 matches
Mail list logo
