On Tue, Feb 24, 2009 at 12:45 AM, Erik Romijn <[email protected]> wrote:
> Hi,
>
> This looks interesting. A quick question: what is the amount of on-disk
> data that you collect with this?
>
> With RIS, we now collect 22GB of gzipped MRT per month, for ~110 full
> peers. So every full peer gets us about 200MB of gzipped data per month.
>
> Are these figures higher with your XML-based format (with compression -
> I imagine the XML compresses better than MRT) ?
>
> I know that disk space is considered cheap, but we still have
> limitations in this.
>
Hi, the latest version of XML format includes more information and more
verbose.
We have new experiment results based on data from route-views4 (2009 Jan).
+-----------+--------------+-------+------------+-------+
| format | umcompressed | ratio | compressed | ratio |
+-----------+--------------+-------+------------+-------+
| XFB | 12,564(MB) | 14.87 | 211(MB) | 1.99 |
| XFB(full) | 15,039 | 17.80 | 368 | 3.47 |
| bgpdump | 2,315 | 2.74 | 103 | 0.97 |
| MRT | 845 | 1.00 | 106 | 1.00 |
+-----------+--------------+-------+------------+-------+
Storage Size Comparison
. XFB is the PURE xml representation of BGP updates,
while XFB(full) also includes the MRT binary data in the xml string.
The lastest xml format takes around double storage space compared with
MRT.
. The bzip2 compression is promising, it compress 12G uncompressed xml
to 211MB bz2 files.
-Payne
_______________________________________________
GROW mailing list
[email protected]
https://www.ietf.org/mailman/listinfo/grow
