Hi!
We are making some tests with arango DB for status tracking, but we are
having some troubles:
ArangoDB is running on a ec2 m4.2xlarge instance (32Gb Ram, 64GB Swap), as
a single instance.
Basically we do a lot of insert (using java driver and batchMode) in a
single collection;
We do just a few selects when consulting status of some operation (for
tracking purposes, so really few selects are done);
After reaching something near of 124,000,000 documents inserted, the
collection becomes unresponsive, at the point that we need to drop the
collection. If we do not, arangoDB becomes unresponsive.
We used the aws marketplace instance for these tests, and changed the v8
contexts to 1 because of the first crashes, but this has not solved the
issue (we upgraded arango to v 3.0.10).
Arango is consuming all the ram available in this machine, and 6GB has been
used in the swap partition.
Am I reaching some limit of arangoDb? Is there some config that I am
missing? Is it normal for arangoDB to consume all that ram in this scenario?
This is the code for insertions that we are using:
@Override
public void save(OfferStatus offerStatus) throws Exception {
BaseDocument status = new BaseDocument();
status.addAttribute("date", offerStatus.getDate());
status.addAttribute("status", offerStatus.getState());
status.addAttribute("ticketNumber",
offerStatus.getMessage().getTicket().getTicketNumber());
status.addAttribute("sku",
offerStatus.getMessage().getOffer().getSku());
status.addAttribute("sellerId",
offerStatus.getMessage().getTicket().getSellerId());
try {
arango.createDocument(COLLECTION_NAME, status, false);
} catch (ArangoException e) {
[...]
}
}
@Override
public void save(Collection<OfferStatus> offerStatus) throws Exception {
arango.startBatchMode();
for (OfferStatus status : offerStatus) {
save(status);
}
arango.executeBatch();
}
which results in inserts like this:
- {"date":"2016-10-30T07:06:32.514-0200","sellerId":65,"sku":"5714370",
"status":"RECEIVED_CLASSIFIER","ticketNumber":
"2b68a5186875c141daf69b9daea5053e"}
TicketNumber and sellerId are hash indexes.
Can you please give me some tip of what is going wrong?
--
You received this message because you are subscribed to the Google Groups
"ArangoDB" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
For more options, visit https://groups.google.com/d/optout.
