I just tried loading a real data file (30M tsv) for the first time (I mean,
instead of just unit tests on my loading program with tiny files), which
resulted in this output:
Exception in thread "main" clojure.lang.ExceptionInfo: :peer/timeout
Transaction timed out. {:db/error :peer/timeout}
at clojure.core$ex_info.invoke(core.clj:4227)
at datomic.error$raise.invoke(error.clj:24)
(blah blah blah)
Mar 14, 2013 10:11:39 AM org.hornetq.core.logging.impl.JULLogDelegate warn
WARNING: Connection failure has been detected: Did not receive data from
server for
org.hornetq.core.remoting.impl.netty.NettyConnection@76e222eb[local=
/127.0.0.1:59944, remote=localhost/127.0.0.1:4334] [code=3]
More remarkable, the transactor output nearly a million lines of traceback.
Tail shown here, with line numbers
928765 at
datomic.common$interruptible$fn__289.doInvoke(common.clj:383)
[datomic-free-transactor-0.8.3767.jar:na]
928766 at clojure.lang.RestFn.applyTo(RestFn.java:137)
[clojure-1.4.0.jar:na]
928767 at clojure.core$apply.invoke(core.clj:603)
[clojure-1.4.0.jar:na]
928768 at
datomic.common$background$proc__294$fn__295.invoke(common.clj:402)
[datomic-free-transactor-0.8.3767.jar:na]
928769 at
datomic.common$background$proc__294.invoke(common.clj:401)
[datomic-free-transactor-0.8.3767.jar:na]
928770 at clojure.lang.AFn.run(AFn.java:24) [clojure-1.4.0.jar:na]
928771 at java.lang.Thread.run(Thread.java:619) [na:1.6.0_11]
It also exited with this
Critical failure, cannot continue: Agent failed
java.lang.OutOfMemoryError: Java heap space
So, my first thought is perhaps I'm going about this the wrong way. I'm
doing a bulk load by calling d/transact on a lazy sequence of data
structures representing all the facts in the 30M file. Should I be doing
this differently?
My second thought is perhaps datomic should throttle its logging, since a
million lines of traceback is a bit excessive. It's the same traceback
(about 16 lines) repeated, only the timestamp changes.
--
--
You received this message because you are subscribed to the Google
Groups "Clojure" group.
To post to this group, send email to [email protected]
Note that posts from new members are moderated - please be patient with your
first post.
To unsubscribe from this group, send email to
[email protected]
For more options, visit this group at
http://groups.google.com/group/clojure?hl=en
---
You received this message because you are subscribed to the Google Groups
"Clojure" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
For more options, visit https://groups.google.com/groups/opt_out.
