Status: Accepted
Owner: [email protected]
CC: [email protected]
Labels: Type-Defect Priority-Medium
New issue 922 by [email protected]: OOM during creating ngram index
https://code.google.com/p/asterixdb/issues/detail?id=922
Use the generated twitter message dataset.
13.75 GB per partition, 4 partitions per machine, 6GB heap size, 256MB
in-memory components for each index.
Asterix Configuration
nc.java.opts :-Xmx6144m
-XX:MinHeapFreeRatio=5 -XX:MaxHeapFreeRatio=15
cc.java.opts :-Xmx4096m -XX:MinHeapFreeRatio=5
-XX:MaxHeapFreeRatio=15
max.wait.active.cluster :60
storage.buffercache.pagesize :131072
storage.buffercache.size :1073741824
storage.buffercache.maxopenfiles :214748364
storage.memorycomponent.pagesize :131072
storage.memorycomponent.numpages :2048
storage.metadata.memorycomponent.numpages:64
storage.memorycomponent.numcomponents :2
storage.memorycomponent.globalbudget :2147483648
DDL:
create index tNGramIdx on TwitterMessages(message-text) type ngram(2);
Error:
java.lang.OutOfMemoryError: unable to create new native thread
--
You received this message because this project is configured to send all
issue notifications to this address.
You may adjust your notification preferences at:
https://code.google.com/hosting/settings