OK, the disk space used by AAE is a function of the number of keys rather than the size of the objects stored in Riak. Let us know the disk usage after the AAE trees are finished building.
When nodes go down in a Riak cluster, the remaining nodes spin up fallback partitions to handle writes/reads for data the downed node owned. Since this node was down for a long time, the count of keys built up on these fallback partitions which would result in increased AAE disk usage. We recommend using less than 75% of available disk space during normal cluster operation. This allows for growth when nodes go down. Let us know what disk usage looks like after trees are built. Thanks, -- Brian Sparrow Developer Advocate Basho Technologies Sent with Sparrow (http://www.sparrowmailapp.com/?sig) On Tuesday, May 20, 2014 at 12:17 PM, Ingo Rockel wrote: > Brian, > > the used version is 1.4.2. No, not all aae-Trees are built. We had to > free disk space on two nodes last weekend, these are currently building > their tree. And I also saw missing parts on two other nodes. The others > currently consume between 80GB and 110GB. The ones building their trees > consume less. > > Thanks, > > Ingo > > Am 20.05.2014 17:16, schrieb Brian Sparrow: > > Ingo, > > > > Sorry for the lack of response. What version of Riak are you using? At > > this point, i assumee riak-admin aae_status shows alls trees as built > > across the cluster. How much space is the AAE directory currently using? > > > > Thanks, > > Brian > > > > -- > > Brian Sparrow > > Developer Advocate > > Basho Technologies > > > > Sent with Sparrow <http://www.sparrowmailapp.com/?sig> > > > > On Tuesday, May 20, 2014 at 10:55 AM, Ingo Rockel wrote: > > > > > Hi, > > > > > > sorry to bother again, can anyone shed a light on this issue? > > > > > > Best, > > > > > > Ingo > > > > > > Am 12.05.2014 15:44, schrieb Ingo Rockel: > > > > Hi, > > > > > > > > we had a little outage of our 12 node riak cluster yesterday, the first > > > > so far, four nodes had gone down because of exhausted disk space. > > > > > > > > What happened: our backup crashed, leaving one node down. Because of a > > > > misconfiguration in our monitoring, this node stayed down for 9 days. It > > > > was then started and recovered after about 7 hours of running. > > > > > > > > But then the disk space usage on six of our nodes start to explode until > > > > the disks were full on four of them. This seems to have been caused by > > > > AAE. We have about 320GB of real user data stored in levelDB and > > > > yesterday night AAE consumed about 150GB on each of this nodes. Is this > > > > normal or what should I expect? > > > > > > > > I deleted the "anti_entropy" on these six nodes and started the nodes > > > > again, running fine since then. AAE gets rebuild but at a lot of lower > > > > level so far. I would be happy if someone could shed a light on this, I > > > > didn't find anything helpful in the logs or the docs on > > > > docs.basho.com <http://docs.basho.com> > > > > > > > > Best, > > > > > > > > Ingo > > > > > > > > > -- > > > Software Architect > > > > > > Blue Lion mobile GmbH > > > Tel. +49 (0) 221 788 797 14 > > > Fax. +49 (0) 221 788 797 19 > > > Mob. +49 (0) 176 24 87 30 89 > > > > > > ingo.roc...@bluelionmobile.com <mailto:ingo.roc...@bluelionmobile.com> > > > > > > qeep: Hefferwolf > > > > > > > > > > > > > > > > > > www.bluelionmobile.com <http://www.bluelionmobile.com> > > > www.qeep.net <http://www.qeep.net> > > > > > > _______________________________________________ > > > riak-users mailing list > > > riak-users@lists.basho.com <mailto:riak-users@lists.basho.com> > > > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com > > > > > > > > > > > -- > Software Architect > > Blue Lion mobile GmbH > Tel. +49 (0) 221 788 797 14 > Fax. +49 (0) 221 788 797 19 > Mob. +49 (0) 176 24 87 30 89 > > ingo.roc...@bluelionmobile.com (mailto:ingo.roc...@bluelionmobile.com) > >>> qeep: Hefferwolf > > www.bluelionmobile.com (http://www.bluelionmobile.com) > www.qeep.net (http://www.qeep.net) > >
_______________________________________________ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
