Damn, wrong group. Sorry
On Thursday, March 14, 2013 10:37:30 AM UTC-7, Brian Craft wrote:
>
> I just tried loading a real data file (30M tsv) for the first time (I
> mean, instead of just unit tests on my loading program with tiny files),
> which resulted in this output:
>
> Exception in thread "main" clojure.lang.ExceptionInfo: :peer/timeout
> Transaction timed out. {:db/error :peer/timeout}
> at clojure.core$ex_info.invoke(core.clj:4227)
> at datomic.error$raise.invoke(error.clj:24)
> (blah blah blah)
>
> Mar 14, 2013 10:11:39 AM org.hornetq.core.logging.impl.JULLogDelegate warn
> WARNING: Connection failure has been detected: Did not receive data from
> server for
> org.hornetq.core.remoting.impl.netty.NettyConnection@76e222eb[local= /
> 127.0.0.1:59944, remote=localhost/127.0.0.1:4334] [code=3]
>
>
>
> More remarkable, the transactor output nearly a million lines of
> traceback. Tail shown here, with line numbers
>
> 928765 at
> datomic.common$interruptible$fn__289.doInvoke(common.clj:383)
> [datomic-free-transactor-0.8.3767.jar:na]
> 928766 at clojure.lang.RestFn.applyTo(RestFn.java:137)
> [clojure-1.4.0.jar:na]
> 928767 at clojure.core$apply.invoke(core.clj:603)
> [clojure-1.4.0.jar:na]
> 928768 at
> datomic.common$background$proc__294$fn__295.invoke(common.clj:402)
> [datomic-free-transactor-0.8.3767.jar:na]
> 928769 at
> datomic.common$background$proc__294.invoke(common.clj:401)
> [datomic-free-transactor-0.8.3767.jar:na]
> 928770 at clojure.lang.AFn.run(AFn.java:24) [clojure-1.4.0.jar:na]
> 928771 at java.lang.Thread.run(Thread.java:619) [na:1.6.0_11]
>
>
> It also exited with this
>
> Critical failure, cannot continue: Agent failed
> java.lang.OutOfMemoryError: Java heap space
>
> So, my first thought is perhaps I'm going about this the wrong way. I'm
> doing a bulk load by calling d/transact on a lazy sequence of data
> structures representing all the facts in the 30M file. Should I be doing
> this differently?
>
> My second thought is perhaps datomic should throttle its logging, since a
> million lines of traceback is a bit excessive. It's the same traceback
> (about 16 lines) repeated, only the timestamp changes.
>
--
--
You received this message because you are subscribed to the Google
Groups "Clojure" group.
To post to this group, send email to [email protected]
Note that posts from new members are moderated - please be patient with your
first post.
To unsubscribe from this group, send email to
[email protected]
For more options, visit this group at
http://groups.google.com/group/clojure?hl=en
---
You received this message because you are subscribed to the Google Groups
"Clojure" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
For more options, visit https://groups.google.com/groups/opt_out.
