Some more data.
After I added 1 million records - DB size grew to 133M
I deleted all those records (delete from V) - DB size grew to 479M
I added 1 million records more - DB size grew to 4.4Gb !!!!
I deleted them all - DB size dropped to 4.2Gb
I restarted DB - DB size after restart 142M (There is no data in DB at this
point)
I added 1 million records - DB size grew to 4.3Gb again !!!!
Every time I was adding data I got those messages
*2014-01-29 12:41:56:433 INFO Max cache limit is reached (3000 vs. 3329),
sync flush is performed. [OWriteAheadLog$LogSegment]*
*2014-01-29 12:42:02:690 INFO Max cache limit is reached (3000 vs. 3325),
sync flush is performed. [OWriteAheadLog$LogSegment]*
*2014-01-29 12:42:11:614 INFO Max cache limit is reached (3000 vs. 3327),
sync flush is performed. [OWriteAheadLog$LogSegment]*
*2014-01-29 12:42:16:327 INFO Max cache limit is reached (3000 vs. 3327),
sync flush is performed. [OWriteAheadLog$LogSegment]*
*2014-01-29 12:42:29:467 INFO Max cache limit is reached (3000 vs. 3327),
sync flush is performed. [OWriteAheadLog$LogSegment]*
*2014-01-29 12:42:45:358 INFO Max cache limit is reached (3000 vs. 3327),
sync flush is performed. [OWriteAheadLog$LogSegment]*
*2014-01-29 12:42:49:333 INFO Max cache limit is reached (3000 vs. 3035),
sync flush is performed. [OWriteAheadLog$LogSegment]*
*2014-01-29 12:42:57:850 INFO Max cache limit is reached (3000 vs. 3285),
sync flush is performed. [OWriteAheadLog$LogSegment]*
and insertion rate stayed the same low ~1600 records/sec.
Just in case, here is how I inserting data
private void addIdentities__(List<Identity> identities){
for(Identity identity:identities){
String clusterName =
identity.getCollection().getCase().getName().toLowerCase();
if(!db.getClusterNames().contains(clusterName))
db.addCluster(clusterName, OStorage.CLUSTER_TYPE.PHYSICAL);
Vertex v = graph.addVertex(classes.get(identity.getType()));
v.setProperty(Fields.NAME, identity.getNormValue());
v.setProperty(Fields.COUNT, identity.getCount());
}
}
public void addIdentities(List<Identity> identities){
if(graph instanceof OrientGraph){
int size = identities.size();
int step = 100000;
int from = 0;
int to = step;
if(size<step)
to = size;
while(true){
addIdentities__(identities.subList(from, to));
graph.commit();
if(to==size)
break;
from = to;
to += step;
if(to>size)
to = size;
}
} else if(graph instanceof OrientGraphNoTx){
addIdentities__(identities);
}
}
At this test I'm using OrientGraph.
Any ideas what's going on there?
Thanks!
-Andrey
--
---
You received this message because you are subscribed to the Google Groups
"OrientDB" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
For more options, visit https://groups.google.com/groups/opt_out.
