Re: [rrd-users] rrdfetch resolution problem

[Matt Pounsett]

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1


On 2007-May-02, at 20:10, Alex van den Bogaerdt wrote:

> On Wed, May 02, 2007 at 05:02:22PM -0400, Matt Pounsett wrote:
>
>> Thanks for the clarification.. I understand what's going on now, and
>> should be able to work around it.  I think we'll wind up re-creating
>> these in order to get more of the data we want, later.
>
> Don't forget to read that fine manual on "rrdtool resize" !
> http://oss.oetiker.ch/rrdtool/doc/rrdresize.en.html

Oooh.. I hadn't spotted that.  Thanks, it will be extremely helpful.

> Do not increase the amount of rows significantly in one go.  Do this
> bit by bit, or else you will see NaN a lot when you query data that
> is available in other RRAs, but rrdtool selects the 5-minute RRA as
> a best match. Think about this for a while if you don't get it at
> first.

I think this would happen anyway, wouldn't it?  According to the  
docs, new rows are always added as old data... so if I were to double  
the number of rows, the RRA would just go back twice as far in the  
past, and the new stuff should be untouched.  Shouldn't it?


-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.6 (Darwin)

iD8DBQFGOTv1ae4z2vjbC8sRAmLZAKDzKhyKYo0WyY56tvJflOOpqJ9yQgCdEEjb
BptN1Qb3Fqm8o66IwObOWgA=
=/gjf
-END PGP SIGNATURE-

___
rrd-users mailing list
rrd-users@lists.oetiker.ch
https://lists.oetiker.ch/cgi-bin/listinfo/rrd-users

Re: [rrd-users] Fwd: Duplicate values along the Y-axis of a graph

[Alex van den Bogaerdt]

On Wed, May 02, 2007 at 12:52:07PM -0600, David Ball wrote:
>Resending this message without the image attachment, as it wasn't
> making it past the moderator (or at least, he/she/they haven't
> permitted it yet, as far as I know).

At least one of the moderators has been, is, and will be quite busy.
Sorry for that. Apparently the other moderators were also unavailable.
FWIW, I would have rejected your post anyway. Too big is too big. Please
use a link to some website next time. If you don't have a public website,
use one of the free photo-sharing sites.

> -- Forwarded message --
> From: David Ball <[EMAIL PROTECTED]>
> Date: Wed, 2 May 2007 09:00:59 -0600
> Subject: Duplicate values along the Y-axis of a graph
> To: rrd-users@lists.oetiker.ch
> 
>   I'm generating graphs (successfully) for over 160 interfaces, and
> ONE of them (that I've discovered so far) has this strange tendency to
> show duplicate values down the Y-axis.  Can anyone provide a hint as
> to why they think this may be occurring?  I'm not even sure where I
> should start looking.  See attached .png for an example.  I'm not
> specifying any -y, -Y, --units-exponent, etc. which might alter the Y
> axis values.  They're being determined automagically by RRDTool.
>   Thanks in advance for any light that might be shed.

I've seen this myself.  It happens when all rates are close together
and high.  Example: all rates are between 1,100,100 and 1,100,400.
RRDtool may be displaying 1.1M a couple of times. (I don't know if
the example is actually working as I just told; it is just for the
discussion). The grid lines are placed at 1,100,000 (1.1M rounded),
1,100,100 (also 1.1M rounded), 1,100,200 and so on.

One of the options will make RRDtool behave better in this case.
I think it is --alt-y-grid.

HTH
-- 
Alex van den Bogaerdt
http://www.vandenbogaerdt.nl/rrdtool/

___
rrd-users mailing list
rrd-users@lists.oetiker.ch
https://lists.oetiker.ch/cgi-bin/listinfo/rrd-users

Re: [rrd-users] rrdfetch resolution problem

[Alex van den Bogaerdt]

On Wed, May 02, 2007 at 05:02:22PM -0400, Matt Pounsett wrote:

> Thanks for the clarification.. I understand what's going on now, and  
> should be able to work around it.  I think we'll wind up re-creating  
> these in order to get more of the data we want, later.

Don't forget to read that fine manual on "rrdtool resize" !
http://oss.oetiker.ch/rrdtool/doc/rrdresize.en.html

Do not increase the amount of rows significantly in one go.  Do this
bit by bit, or else you will see NaN a lot when you query data that
is available in other RRAs, but rrdtool selects the 5-minute RRA as
a best match. Think about this for a while if you don't get it at
first.

HTH
-- 
Alex van den Bogaerdt
http://www.vandenbogaerdt.nl/rrdtool/

___
rrd-users mailing list
rrd-users@lists.oetiker.ch
https://lists.oetiker.ch/cgi-bin/listinfo/rrd-users

Re: [rrd-users] trigger an alert?

[Sven Ulland]

John Conner wrote:
> Hi guys,
> 
> I know there is a "Aberrant Behavior Detection" function coming with the 
> new version of rrdtool, but I can't get some more detailed documents on 
> how to use it,  also from what I learned, what "Aberrant Behavior 
> Detection" does is just highlighting the abnormal part of data on the 
> graphic rrdtool generated on the fly, there still will be no alert, no 
> log, no further action (such as calling an outside script) can be taken.
> 
> Is this true?

It depends on your definition of logging and action.

> If it is not, how can I make rrdool (trigger an alert|call an outside 
> script) when it see some abnormal data?

I use the aberrant behaviour detection in rrdtool and I find
it quite handy. To detect problems, i use the 'rrdtool updatev'
command, which will output FAILURE=1.0 (different syntax), if
it detects failures. FAILURE=0.0 if not. In other words, I parse
the output of the command, and trigger alerts based on it. You
should probably implement a wrapper around the parsing/alarming,
so that you won't get flooded with mails/SMS messages every five
minutes while a deviation is happening.

Sven

___
rrd-users mailing list
rrd-users@lists.oetiker.ch
https://lists.oetiker.ch/cgi-bin/listinfo/rrd-users

Re: [rrd-users] rrdfetch resolution problem

[Matt Pounsett]

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1


On 2007-May-02, at 16:54, Simon Hobson wrote:

> You only store 7 days worth of data at 300s resolution. Your basic
> step is 300s, your first RRA is 2016 time 1 step
> (RRA:AVERAGE:0.5:1:2016) which works out to 168 hours or 7 days.

Aha!  Okay.. this explains a lot.  Not being the one that created the  
RRDs in the first place, there are 'design' decisions here that I  
hadn't considered.

Thanks for the clarification.. I understand what's going on now, and  
should be able to work around it.  I think we'll wind up re-creating  
these in order to get more of the data we want, later.

Thanks for the help, everyone!

Matt


-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.6 (Darwin)

iD8DBQFGOPxhae4z2vjbC8sRApUeAJ9Ke9SIjsDhoG1JCD7tEJOT8ben6gCghm+B
QGfeTb16B7l1B4pqu7i/e78=
=aLyD
-END PGP SIGNATURE-

___
rrd-users mailing list
rrd-users@lists.oetiker.ch
https://lists.oetiker.ch/cgi-bin/listinfo/rrd-users

Re: [rrd-users] rrdfetch resolution problem

[Simon Hobson]

Matt Pounsett wrote:

>my @TrackRRTypes = qw( A  ANY CNAME MX NS PTR SOA );
>my @args = ( "rrds/$host.rrd",
>  qw(--step 300 ),
>  "-b", $start_time-300,
>  (map { "DS:$_:ABSOLUTE:600:0:1000" } @TrackRRTypes ),
>  'DS:OTHER:ABSOLUTE:600:0:1000',
>  'DS:TOTAL:ABSOLUTE:600:0:1000',
>  'RRA:AVERAGE:0.5:1:2016',
>  'RRA:MIN:0.5:12:17250',
>  'RRA:MAX:0.5:12:17250',
>  'RRA:AVERAGE:0.5:12:17520',
>  'RRA:MIN:0.5:288:3650',
>  'RRA:MAX:0.5:288:3650',
>  'RRA:AVERAGE:0.5:288:3650',
>);
>RRDs::create( @args );

You only store 7 days worth of data at 300s resolution. Your basic 
step is 300s, your first RRA is 2016 time 1 step 
(RRA:AVERAGE:0.5:1:2016) which works out to 168 hours or 7 days.

Beyond that you CANNOT get 300s resolution data because it no longer exists.

The next step is to store min, max, and average for a little under 
two years at 1 hour resolution. RRA:AVERAGE:0.5:12:17520 means to 
store one consolidated value for every 12 steps (12 x 5m = 1h), and 
to store 17250 values which works out 718.75 days.

After that you have 24hr samples (5min * 288 = 24h) for 10 years (3650 days).


So if you ask for data covering anything from 7 days to nearly 2 
years ago you will get 1 consolidated value per hour. If you go back 
2 years or more then you will only get one value per day. RRD tools 
will NOT give you mixed data - if you really wanted to plot a graph 
over say the last 2 weeks and use the highest resolution data then 
you would have to extract two sets of data (up to a week, beyond a 
week) and plot them using some other tool.

___
rrd-users mailing list
rrd-users@lists.oetiker.ch
https://lists.oetiker.ch/cgi-bin/listinfo/rrd-users

Re: [rrd-users] rrdfetch resolution problem

[Matt Pounsett]

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1


Thanks for the followup, Sam.


On 2007-May-02, at 15:33, Sam Umbach wrote:

> It's my understanding that fetch will use the highest resolution RRA
> containing the entire time interval you request (start time through
> end time).

Since the step value for the RRD is 300, shouldn't the "highest  
resolution RRA" be 300 (or possibly less)?  Based on the rrdinfo  
output I submitted earlier, I think the highest resolution should be  
at least 300 seconds, but I seem to be only able to get 3600 seconds  
out of it.

> If you perform an rrdtool dump, do you see the values
> you're looking for?

Yes, though the start/end restrictions don't seem to work.. The  
AVERAGE rra section will only give me data back to April 25, even  
though I know there's data going back to the beginning of January,  
and the MIN and MAX rra sections give me data from 2005, which I know  
isn't in the RRD.

This is doing:
% rrdtool dump server1.rrd -s 1167627600 -e 1175399700

> We need more detail about your rrd file
> (specifically the RRA definitions) to be helpful.  Please send the
> rrdtool create command you used to create the rrd or a full rrd dump.

The following code is used by a CGI that receives data submissions  
from remote sites to create RRDs that don't exist yet.  All of the  
RRDs were created with this same code.  $start_time is the time stamp  
of the earliest chunk of data in the submission, and the rest should  
be self explanatory.

my @TrackRRTypes = qw( A  ANY CNAME MX NS PTR SOA );
my @args = ( "rrds/$host.rrd",
 qw(--step 300 ),
 "-b", $start_time-300,
 (map { "DS:$_:ABSOLUTE:600:0:1000" } @TrackRRTypes ),
 'DS:OTHER:ABSOLUTE:600:0:1000',
 'DS:TOTAL:ABSOLUTE:600:0:1000',
 'RRA:AVERAGE:0.5:1:2016',
 'RRA:MIN:0.5:12:17250',
 'RRA:MAX:0.5:12:17250',
 'RRA:AVERAGE:0.5:12:17520',
 'RRA:MIN:0.5:288:3650',
 'RRA:MAX:0.5:288:3650',
 'RRA:AVERAGE:0.5:288:3650',
);
RRDs::create( @args );


-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.6 (Darwin)

iD8DBQFGOPTwae4z2vjbC8sRAr13AKDGdjS0viVGBDtaWChpXdU6f/pLHQCdF1Zv
bQ2Uy+UcJzsBg+YH19h+mxc=
=dfQ8
-END PGP SIGNATURE-

___
rrd-users mailing list
rrd-users@lists.oetiker.ch
https://lists.oetiker.ch/cgi-bin/listinfo/rrd-users

[rrd-users] unsuscribe

[ricardo]

un
   
-

LLama Gratis a cualquier PC del Mundo.
Llamadas a fijos y móviles desde 1 céntimo por minuto.
http://es.voice.yahoo.com___
rrd-users mailing list
rrd-users@lists.oetiker.ch
https://lists.oetiker.ch/cgi-bin/listinfo/rrd-users

Re: [rrd-users] rrdfetch resolution problem

[Sam Umbach]

> I've got a set of RRDs we created to track DNS traffic with a 300
> second (5 minute) resolution.  I'm trying to retrieve the 5 minute
> averages, maximums and minimums for the last quarter in order to run
> some statistics that I can't generate directly from rrd.
> Unfortunately, I can't seem to convince rrdtool to give me data in
> any resolution other than 1 hour.  Can someone point out where I'm
> going wrong?

Matt,

It's my understanding that fetch will use the highest resolution RRA
containing the entire time interval you request (start time through
end time).  If you perform an rrdtool dump, do you see the values
you're looking for?  We need more detail about your rrd file
(specifically the RRA definitions) to be helpful.  Please send the
rrdtool create command you used to create the rrd or a full rrd dump.

Thanks,
Sam

___
rrd-users mailing list
rrd-users@lists.oetiker.ch
https://lists.oetiker.ch/cgi-bin/listinfo/rrd-users

Re: [rrd-users] Fwd: Duplicate values along the Y-axis of a graph

[Tobias Oetiker]

Hi David,

note that we use greylisting on the mailinglist server, so it may
be that your first mail is still pending (in case this was your
first posting) ...

in any event, I would be very interested in seeing the commandline
you use to generate the 'offending' graph ... also if you can send
me a dump of the rrd file along with the graph command, this would
be very helpful in determining how to resolve the problem ...

cheers
tobi


-- 
Tobi Oetiker, OETIKER+PARTNER AG, Aarweg 15 CH-4600 Olten
http://it.oetiker.ch [EMAIL PROTECTED] ++41 62 213 9902

___
rrd-users mailing list
rrd-users@lists.oetiker.ch
https://lists.oetiker.ch/cgi-bin/listinfo/rrd-users

Re: [rrd-users] Second y-axis on plot?

[Tobias Oetiker]

Hi Rob,

at the moment there is no provision for a second axis in rrdtool

cheers
tobi

Today Rob Newman wrote:

> Hi everyone,
>
> I am plotting 2 different data sources on one graph, each of which have very
> different maxima and minima. Due to plotting on the same graph with the same
> scale, changes in values are often masked. Is there a way to get rrdtool graph
> to create a second y-axis and plot one of the data sources on the second
> y-axis?
>
> I searched online and in the documentation for an answer, but did not come up
> with anything. If this is not possible, I know I can normalize one of the data
> sources, so they have similar values, but a second y-axis would be nicer.
>
> Thanks in advance,
> - Rob
> 
>
> Rob Newman Ph.D.
> Institute of Geophysics and Planetary Physics
> Scripps Institution of Oceanography
> University of California, San Diego
> 9500 Gilman Drive, La Jolla, CA 92093-0225, USA
>
>

-- 
Tobi Oetiker, OETIKER+PARTNER AG, Aarweg 15 CH-4600 Olten
http://it.oetiker.ch [EMAIL PROTECTED] ++41 62 213 9902

___
rrd-users mailing list
rrd-users@lists.oetiker.ch
https://lists.oetiker.ch/cgi-bin/listinfo/rrd-users

[rrd-users] Fwd: Duplicate values along the Y-axis of a graph

[David Ball]

   Resending this message without the image attachment, as it wasn't
making it past the moderator (or at least, he/she/they haven't
permitted it yet, as far as I know).

David


-- Forwarded message --
From: David Ball <[EMAIL PROTECTED]>
Date: Wed, 2 May 2007 09:00:59 -0600
Subject: Duplicate values along the Y-axis of a graph
To: rrd-users@lists.oetiker.ch

  I'm generating graphs (successfully) for over 160 interfaces, and
ONE of them (that I've discovered so far) has this strange tendency to
show duplicate values down the Y-axis.  Can anyone provide a hint as
to why they think this may be occurring?  I'm not even sure where I
should start looking.  See attached .png for an example.  I'm not
specifying any -y, -Y, --units-exponent, etc. which might alter the Y
axis values.  They're being determined automagically by RRDTool.
  Thanks in advance for any light that might be shed.

PS. Am using 1.2.19, though I don't see it occuring if 1.0.37.

David

___
rrd-users mailing list
rrd-users@lists.oetiker.ch
https://lists.oetiker.ch/cgi-bin/listinfo/rrd-users

[rrd-users] Second y-axis on plot?

[Rob Newman]

Hi everyone,

I am plotting 2 different data sources on one graph, each of which  
have very different maxima and minima. Due to plotting on the same  
graph with the same scale, changes in values are often masked. Is  
there a way to get rrdtool graph to create a second y-axis and plot  
one of the data sources on the second y-axis?


I searched online and in the documentation for an answer, but did not  
come up with anything. If this is not possible, I know I can  
normalize one of the data sources, so they have similar values, but a  
second y-axis would be nicer.


Thanks in advance,
- Rob


Rob Newman Ph.D.
Institute of Geophysics and Planetary Physics
Scripps Institution of Oceanography
University of California, San Diego
9500 Gilman Drive, La Jolla, CA 92093-0225, USA


___
rrd-users mailing list
rrd-users@lists.oetiker.ch
https://lists.oetiker.ch/cgi-bin/listinfo/rrd-users

[rrd-users] rrdfetch resolution problem

[Matt Pounsett]

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1


I've got a set of RRDs we created to track DNS traffic with a 300  
second (5 minute) resolution.  I'm trying to retrieve the 5 minute  
averages, maximums and minimums for the last quarter in order to run  
some statistics that I can't generate directly from rrd.   
Unfortunately, I can't seem to convince rrdtool to give me data in  
any resolution other than 1 hour.  Can someone point out where I'm  
going wrong?

Here's the beginning of the 'info' output for one of the rrds in  
question:

filename = "server1.rrd"
rrd_version = "0003"
step = 300
last_update = 1178128200
ds[A].type = "ABSOLUTE"
ds[A].minimal_heartbeat = 600
ds[A].min = 0.00e+00
ds[A].max = 1.00e+07
ds[A].last_ds = "UNKN"
ds[A].value = 0.00e+00
ds[A].unknown_sec = 0
ds[].type = "ABSOLUTE"
ds[].minimal_heartbeat = 600
ds[].min = 0.00e+00
ds[].max = 1.00e+07
ds[].last_ds = "UNKN"
ds[].value = 0.00e+00
ds[].unknown_sec = 0
[...]

And my query and the output I'm getting:

$ rrdtool fetch server1.rrd AVERAGE -r 300 -s 1167627600 -e  
1175399700 | tail -5
1175385600: 2.499425e+02 3.729972e+01 4.19e+00  
2.625000e-01 1.245508e+02 1.046667e+00 1.49e-01  
4.863889e-01 2.327083e+01 4.412017e+02
1175389200: 2.453747e+02 3.831833e+01 3.796944e+00  
2.669444e-01 1.374683e+02 1.064167e+00 1.30e-01  
5.02e-01 2.33e+01 4.502328e+02
1175392800: 2.477100e+02 3.907444e+01 3.845000e+00  
2.80e-01 1.464294e+02 1.149444e+00 1.269444e-01  
4.67e-01 2.406111e+01 4.6314305556e+02
1175396400: 2.3973138889e+02 3.945083e+01 3.715278e+00  
2.863889e-01 1.346375e+02 1.874722e+00 1.380556e-01  
4.930556e-01 2.402139e+01 4.443486e+02
117540: 2.360075e+02 3.952528e+01 4.06e+00  
2.75e-01 1.3610638889e+02 1.209167e+00 1.497222e-01  
4.802778e-01 2.454917e+01 4.423669e+02

If I leave off the call to 'tail' one can see that the time range is  
working fine, however note that the time stamps are all on the hour,  
and not in 5 minute intervals.

Any clues as to what the problem is here?

-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.6 (Darwin)

iD8DBQFGONMeae4z2vjbC8sRAjdlAKDBB9nhcpuYhG8jR4QJgTZZWsTCJACgzcLv
nxDKeusTKHtD1QnIjaPdQeU=
=B0LL
-END PGP SIGNATURE-

___
rrd-users mailing list
rrd-users@lists.oetiker.ch
https://lists.oetiker.ch/cgi-bin/listinfo/rrd-users

[rrd-users] trigger an alert?

[John Conner]

Hi guys,

I know there is a "Aberrant Behavior Detection" function coming with the new
version of rrdtool, but I can't get some more detailed documents on how to
use it,  also from what I learned, what "Aberrant Behavior Detection" does
is just highlighting the abnormal part of data on the graphic rrdtool
generated on the fly, there still will be no alert, no log, no further
action (such as calling an outside script) can be taken.

Is this true?

If it is not, how can I make rrdool (trigger an alert|call an outside
script) when it see some abnormal data?

Any input is highly appreciated!


Joh
___
rrd-users mailing list
rrd-users@lists.oetiker.ch
https://lists.oetiker.ch/cgi-bin/listinfo/rrd-users

[rrd-users] [rrd] ANNOUNCE rrdtool 1.2.22

[Tobias Oetiker]

Hi List,

I have release RRDtool 1.2.22

Brought to you by the 2007 RRDtool sponsors:
---
GOLD:   www.groundworkopensource.com
www.zenoss.com
SILVER: www.op5.com, www.hosteurope.de, www.contego.net
---

Details about this release:

Bug fixes

 * fixed tcl bindings build process (missing header)
 * fixed out of tree python build process (rpm packaging)

As always, rrdtool is available from

 http://oss.oetiker.ch/rrdtool/pub

enjoy
tobi

P.S. check out our new non-blog-site http://insights.oetiker.ch !
-- 
Tobi Oetiker, OETIKER+PARTNER AG, Aarweg 15 CH-4600 Olten
http://it.oetiker.ch [EMAIL PROTECTED] ++41 62 213 9902

___
rrd-users mailing list
rrd-users@lists.oetiker.ch
https://lists.oetiker.ch/cgi-bin/listinfo/rrd-users

Re: [rrd-users] unsubscribe

[Andreas Maus]

On Wed, May 02, 2007 at 06:07:02PM +0800, Judith Pancho wrote:
> unsubscribe rrd-users
You are posting to the wrong address.
If you take a look at the mail headers you can
see the coorect address to unsubscribe:

[... snipp ...]
Precedence: list
List-Id: Help and discussion among RRDtool users 
List-Unsubscribe: ,

List-Archive: 
List-Post: 
List-Help: 
List-Subscribe: ,

Content-Type: multipart/mixed; boundary="===1204732199=="
Sender: [EMAIL PROTECTED]
Errors-To: [EMAIL PROTECTED]
X-Virus-Scanned: by amavisd-new at oetiker.ch
X-Virus-Scanned: by amavisd-new at science-computing.de
[... snipp ...]

HTH,

Andreas.

-- 
Dipl.-Ing. Andreas Maus science+computing ag
System Administration   Hagellocher Weg 73
mail: [EMAIL PROTECTED]   72070 Tuebingen, Germany
tel.: +49 7071 9457 456 www.science-computing.de


pgp0unXqk0U5I.pgp
Description: PGP signature
___
rrd-users mailing list
rrd-users@lists.oetiker.ch
https://lists.oetiker.ch/cgi-bin/listinfo/rrd-users

[rrd-users] unsubscribe

[Judith Pancho]

unsubscribe rrd-users


-- 
This message has been scanned for viruses and
dangerous content by MailScanner, and is
believed to be clean.

___
rrd-users mailing list
rrd-users@lists.oetiker.ch
https://lists.oetiker.ch/cgi-bin/listinfo/rrd-users