Re: [rrd-users] since when rrdtool tune can add another DS?

2015-10-15 Thread Tobias Oetiker
Hi Peter,

in the 1.5 series there is a much better solution for the whole
'modify rrd' problem ... create has the ability to pre-populate a
new rrd file based on an existing one ...

the stuff in rrd_tune is obviously a merge error, stuff being
documented before it was ever implemented.


cheers
tobi

Today Petr wrote:

> Hi all,
>
> according to online documentation "rrdtool tune file.rrd
> DS:x:yyy:zzz:11:22" can add a new DS to an existing file.rrd. However,
> when I tried it on my Debian with rrdtool version 1.4.7 it did not work at
> all.
>
> I read the whole https://oss.oetiker.ch/rrdtool/pub/CHANGES but couldn't
> find any mention about rrdtune being able to add or delete a DS in an
> existing RRD file.
>
> Any idea since what version this got implemented, please?
>
> Thanks,
>
> Petr
>
>
>
> --
> View this message in context: 
> http://rrd-mailinglists.937164.n2.nabble.com/since-when-rrdtool-tune-can-add-another-DS-tp7583163.html
> Sent from the RRDtool Users Mailinglist mailing list archive at Nabble.com.
>
> ___
> rrd-users mailing list
> rrd-users@lists.oetiker.ch
> https://lists.oetiker.ch/cgi-bin/listinfo/rrd-users
>
>

-- 
Tobi Oetiker, OETIKER+PARTNER AG, Aarweg 15 CH-4600 Olten, Switzerland
www.oetiker.ch t...@oetiker.ch +41 62 775 9902

___
rrd-users mailing list
rrd-users@lists.oetiker.ch
https://lists.oetiker.ch/cgi-bin/listinfo/rrd-users


Re: [rrd-users] building rrd-update only ?

2015-10-15 Thread Per Jessen
Steve Shipway wrote:

>>I was wondering if it would be possible to build a simple rrd-update
>>for
>>only updating rrd databases ?  I.e. without the graphing functionality
>>etc?
> 
> If I remember correctly, 1.5 has this option in the build, for
> precisely this reason.
> 

Ah, that must be the --disable-rrd_graph option. Thanks. 



-- 
Per Jessen, Zürich (6.8°C)
http://www.hostsuisse.com/ - virtual servers, made in Switzerland.

___
rrd-users mailing list
rrd-users@lists.oetiker.ch
https://lists.oetiker.ch/cgi-bin/listinfo/rrd-users


[rrd-users] since when rrdtool tune can add another DS?

2015-10-15 Thread Petr
Hi all,

according to online documentation "rrdtool tune file.rrd
DS:x:yyy:zzz:11:22" can add a new DS to an existing file.rrd. However,
when I tried it on my Debian with rrdtool version 1.4.7 it did not work at
all.

I read the whole https://oss.oetiker.ch/rrdtool/pub/CHANGES but couldn't
find any mention about rrdtune being able to add or delete a DS in an
existing RRD file.

Any idea since what version this got implemented, please?

Thanks,

Petr



--
View this message in context: 
http://rrd-mailinglists.937164.n2.nabble.com/since-when-rrdtool-tune-can-add-another-DS-tp7583163.html
Sent from the RRDtool Users Mailinglist mailing list archive at Nabble.com.

___
rrd-users mailing list
rrd-users@lists.oetiker.ch
https://lists.oetiker.ch/cgi-bin/listinfo/rrd-users


[rrd-users] building rrd-update only ?

2015-10-15 Thread Per Jessen
I'm collecting data on multiple systems/servers, for subsequent
evaluation only on one system.  When I recently wanted to install
rrdtool on a new system, the package manager (zypper) wanted to install
an additional 65Mb of "stuff".  Most of this seemed to be dragged in
by/via libpango. 
I was wondering if it would be possible to build a simple rrd-update for
only updating rrd databases ?  I.e. without the graphing functionality
etc?


-- 
Per Jessen, Zürich (4.8°C)
http://www.hostsuisse.com/ - dedicated server rental in Switzerland.

___
rrd-users mailing list
rrd-users@lists.oetiker.ch
https://lists.oetiker.ch/cgi-bin/listinfo/rrd-users


Re: [rrd-users] building rrd-update only ?

2015-10-15 Thread Steve Shipway
>I was wondering if it would be possible to build a simple rrd-update for
>only updating rrd databases ?  I.e. without the graphing functionality
>etc?

If I remember correctly, 1.5 has this option in the build, for precisely this 
reason.

Steve

Steve Shipway
University of Auckland ITS
UNIX Systems Design Lead
s.ship...@auckland.ac.nz
Ph: +64 9 373 7599 ext 86487


___
rrd-users mailing list
rrd-users@lists.oetiker.ch
https://lists.oetiker.ch/cgi-bin/listinfo/rrd-users


Re: [rrd-users] since when rrdtool tune can add another DS?

2015-10-15 Thread Petr Stehlik
Tobias Oetiker píše v Čt 15. 10. 2015 v 14:36 +0200:
> Hi Peter,
> 
> in the 1.5 series there is a much better solution for the whole
> 'modify rrd' problem ... create has the ability to pre-populate a
> new rrd file based on an existing one ...

I've read about the new create ability but not about the new tune
ability.

> the stuff in rrd_tune is obviously a merge error, stuff being
> documented before it was ever implemented.

It doesn't need to be a merge error - the online documentation is for
the latest 1.5.4 so I know it is implemented in the 1.5.4. But I don't
know since when it is implemented and I need to choose which Debian OS
I'm going to install to get the desired functionality. Jessie, the
current stable, has RRD 1.4.8. Is it enough or do I need to backport RRD
from Stretch (testing) where is the 1.5.4?

It sounds like it's in the 1.5 series only but I wanted to be sure
before reinstalling the OS, you know :)

Thanks,

Petr


___
rrd-users mailing list
rrd-users@lists.oetiker.ch
https://lists.oetiker.ch/cgi-bin/listinfo/rrd-users


Re: [rrd-users] Local maximum and minimum

2015-10-15 Thread Simon Hobson
Philip Gwyn  wrote:

> Hello,
> 
> I have a 1-wire setup in my attic.  I log temperature and humidity and 
> generate daily/weekly/monthly graphs.  I use a modified temps.pl from Thierry 
> Hugue.
> 
> What I would very much like is to graph the local maximum and minimum 
> temperature.  This would be roughly the maximum and minimum over a 24 hour 
> period.  The MAXIMUM and MINIMUM operators don't do what I want - they find 
> the max for the entire period.

If you have a 24 hours consolidation for MAX and another for MIN, then that 
will contain values for max and min per day*. You can then graph that and get a 
graph of min/max by day. You may have to specify the consolidation when 
graphing if you have other min & max consolidations.

* Where "day" is a 24 hour period starting at midnight UTC. It will not be 
midnight to midnight if your local timezone isn't UTC.

___
rrd-users mailing list
rrd-users@lists.oetiker.ch
https://lists.oetiker.ch/cgi-bin/listinfo/rrd-users


[rrd-users] rrdtool memory usage and the Raspberry Pi

2015-10-15 Thread Jared Henley

Hi,

I've been working on a logging application that uses rrdtool.  It works 
brilliantly on my PC, not so good on the Raspberry Pi model B+.  But 
before I go there, there's something interesting I noticed while working 
on the PC.


I'm creating a database with the following command (in rrdpython)

rrdtool.create(filepath,
'--step', '1s',
'DS:progreset:GAUGE:1000s:0:1',
'RRA:MAX:0.1:5s:5000m',



This creates a 386MB file.

I didn't think too hard about it, until I did a graph to a CSV file.  Of 
course the CSV would be less space-efficient than the binary rrd file, 
right?  But the generated CSV turns out to be only 15MB?


rrdtool seems to use 64-bit integers for everything, so I figure the rrd 
file above should use:
8 bytes per RRA entry * 29 RRAs + 1 timestamp * 60,000 locations in the 
round-robin (5000 minutes / 5 seconds) = 14.4MB.  I'm confused. Why is 
the rrd file 30 times bigger than I'd expect?  I did experiment with a 
step size of 5 seconds, but the created file was the same size.  But I 
can live with largish files.


However, creating the databases on the Raspberry Pi was a dismal 
failure.  Memory usage climbed until the process crashed.  I assume the 
out-of-memory process killer did it.  Since the Raspberry Pi only has 
about 384MB of memory free after booting up, it is fairly memory 
constrained.  Is rrdtool creating the entire file in memory before 
writing it out to disk?


So I copied some rrd files from the PC to the Raspberry Pi.  I wasn't 
surprised that they didn't work - presumably an endianness issue.  
However, the rrd graph generation code was able to load up and complain 
about badness in the file, so there's at least enough RAM to load up 
rrdtool.


I wonder if I am going about this the wrong way?  In the last hour I've 
seen references to people having hundreds of rrd files.  Is it 
recommended to split your data up into lots of small chunks?  Are there 
other recommendations about how to use rrdtool in the most 
memory-efficient manner?


Many thanks,
Jared

___
rrd-users mailing list
rrd-users@lists.oetiker.ch
https://lists.oetiker.ch/cgi-bin/listinfo/rrd-users


Re: [rrd-users] since when rrdtool tune can add another DS?

2015-10-15 Thread Tobi Oetiker
hi petr

> On 15.10.2015, at 17:07, Petr Stehlik  wrote:
> 
> Tobias Oetiker píše v Čt 15. 10. 2015 v 14:36 +0200:
>> Hi Peter,
>> 
>> in the 1.5 series there is a much better solution for the whole
>> 'modify rrd' problem ... create has the ability to pre-populate a
>> new rrd file based on an existing one ...
> 
> I've read about the new create ability but not about the new tune
> ability.
> 

there is no new tune ability in 1.5 as I said all this functionality was moved 
into create ...

and to get a current version of rrdtool just download the source and configure 
make install it. works fine.

cheers
tobi


>> the stuff in rrd_tune is obviously a merge error, stuff being
>> documented before it was ever implemented.
> 
> It doesn't need to be a merge error - the online documentation is for
> the latest 1.5.4 so I know it is implemented in the 1.5.4. But I don't
> know since when it is implemented and I need to choose which Debian OS
> I'm going to install to get the desired functionality. Jessie, the
> current stable, has RRD 1.4.8. Is it enough or do I need to backport RRD
> from Stretch (testing) where is the 1.5.4?
> 
> It sounds like it's in the 1.5 series only but I wanted to be sure
> before reinstalling the OS, you know :)
> 
> Thanks,
> 
> Petr
> 
> 

___
rrd-users mailing list
rrd-users@lists.oetiker.ch
https://lists.oetiker.ch/cgi-bin/listinfo/rrd-users


Re: [rrd-users] since when rrdtool tune can add another DS?

2015-10-15 Thread Petr Stehlik
Tobi Oetiker píše v Čt 15. 10. 2015 v 19:41 +0200:
> there is no new tune ability in 1.5 as I said all this functionality was 
> moved into create ...

I see! So in order to add a new DS you have to create a whole new RRD?
That's a pity. Using the tune on a live RRD file would be way easier for
users.

BTW, even man page of rrd create still points to rrd tune regarding
adding a DS (indirectly).

> and to get a current version of rrdtool just download the source and 
> configure make install it. works fine.

in Debian there are many RRD libraries in separate packages
( https://packages.debian.org/search?suite=wheezy=rrd ). They
all have to be upgraded as well, I believe. Plain configure make install
will not address that, I am afraid. I, for example, need to update the
php5-rrd (i.e. /usr/lib/php5/20100525/rrd.so).

Petr


___
rrd-users mailing list
rrd-users@lists.oetiker.ch
https://lists.oetiker.ch/cgi-bin/listinfo/rrd-users


Re: [rrd-users] since when rrdtool tune can add another DS?

2015-10-15 Thread Tobi Oetiker
hi peter

> On 15.10.2015, at 20:33, Petr Stehlik  wrote:
> 
> Tobi Oetiker píše v Čt 15. 10. 2015 v 19:41 +0200:
>> there is no new tune ability in 1.5 as I said all this functionality was 
>> moved into create ...
> 
> I see! So in order to add a new DS you have to create a whole new RRD?
> That's a pity. Using the tune on a live RRD file would be way easier for
> users.
> 

adding a ds is a deep structural
change for an rrd file. so however it is done, a new file has to be created.

with the new create aproach you have the advantage of being able to do even 
more advanced changes like modifying the samplingrate and the like


> BTW, even man page of rrd create still points to rrd tune regarding
> adding a DS (indirectly).
> 

if you are working through them, please do a pull request vs the 1.5 branch o  
github, that would be great!


>> and to get a current version of rrdtool just download the source and 
>> configure make install it. works fine.
> 
> in Debian there are many RRD libraries in separate packages
> ( https://packages.debian.org/search?suite=wheezy=rrd ). They
> all have to be upgraded as well, I believe. Plain configure make install
> will not address that, I am afraid. I, for example, need to update the
> php5-rrd (i.e. /usr/lib/php5/20100525/rrd.so).
> 

you can install
rrdtool 1.5
in a separate location on your system, without hurting the existing setup. and 
use it in your project.

cheers
tobi


> Petr
> 
> 

___
rrd-users mailing list
rrd-users@lists.oetiker.ch
https://lists.oetiker.ch/cgi-bin/listinfo/rrd-users


[rrd-users] Local maximum and minimum

2015-10-15 Thread Philip Gwyn

Hello,

I have a 1-wire setup in my attic.  I log temperature and humidity and 
generate daily/weekly/monthly graphs.  I use a modified temps.pl from 
Thierry Hugue.


What I would very much like is to graph the local maximum and minimum 
temperature.  This would be roughly the maximum and minimum over a 24 
hour period.  The MAXIMUM and MINIMUM operators don't do what I want - 
they find the max for the entire period.


Is this at all possible with RRD graphs?  Or do I have to create another 
data set and calculate it by hand?


-Philip


___
rrd-users mailing list
rrd-users@lists.oetiker.ch
https://lists.oetiker.ch/cgi-bin/listinfo/rrd-users