From 76f3796de7748ca43dba8988b33e1812fc7ab343 Mon Sep 17 00:00:00 2001 From: oetiker Date: Mon, 12 May 2008 15:33:31 +0000 Subject: [PATCH] Fixed handling of unknown data at PDP build time. There was a long standing (even documented) missfeature in rrdtool which caused uknown-data to be accepted as long as it was less than the mrhb. This was never the intended behaviour and had interesting side effects (http://oss.oetiker.ch/rrdtool-trac/ticket/125): If you have a 60 Second step with 59s unknown data and 1 second of known data the whole become known data as long as the mrhb was > step. The intended behaviour was that a step should become unknown as soon as it contains more than 50% of unknown data. The patch fixes both the documentation and the code. git-svn-id: svn://svn.oetiker.ch/rrdtool/branches/1.2/program@1340 a5681a0c-68f1-0310-ab6d-d61299d08faa --- doc/rrdcreate.pod | 24 ++++++++++-------------- src/rrd_update.c | 2 +- 2 files changed, 11 insertions(+), 15 deletions(-) diff --git a/doc/rrdcreate.pod b/doc/rrdcreate.pod index a47acbb..b5f4556 100644 --- a/doc/rrdcreate.pod +++ b/doc/rrdcreate.pod @@ -343,28 +343,24 @@ Here is an explanation by Don Baarda on the inner workings of RRDtool. It may help you to sort out why all this *UNKNOWN* data is popping up in your databases: -RRDtool gets fed samples at arbitrary times. From these it builds Primary -Data Points (PDPs) at exact times on every "step" interval. The PDPs are -then accumulated into RRAs. +RRDtool gets fed samples/updates at arbitrary times. From these it builds Primary +Data Points (PDPs) on every "step" interval. The PDPs are +then accumulated into the RRAs. The "heartbeat" defines the maximum acceptable interval between -samples. If the interval between samples is less than "heartbeat", +samples/updates. If the interval between samples is less than "heartbeat", then an average rate is calculated and applied for that interval. If the interval between samples is longer than "heartbeat", then that entire interval is considered "unknown". Note that there are other things that can make a sample interval "unknown", such as the rate -exceeding limits, or even an "unknown" input sample. +exceeding limits, or a sample that was explicitly marked as unknown. The known rates during a PDP's "step" interval are used to calculate -an average rate for that PDP. Also, if the total "unknown" time during -the "step" interval exceeds the "heartbeat", the entire PDP is marked +an average rate for that PDP. If the total "unknown" time accounts for +more than B the "step", the entire PDP is marked as "unknown". This means that a mixture of known and "unknown" sample -times in a single PDP "step" may or may not add up to enough "unknown" -time to exceed "heartbeat" and hence mark the whole PDP "unknown". So -"heartbeat" is not only the maximum acceptable interval between -samples, but also the maximum acceptable amount of "unknown" time per -PDP (obviously this is only significant if you have "heartbeat" less -than "step"). +times in a single PDP "step" may or may not add up to enough "known" +time to warrent for a known PDP. The "heartbeat" can be short (unusual) or long (typical) relative to the "step" interval between PDPs. A short "heartbeat" means you @@ -396,7 +392,7 @@ same average rate. I<-- Don Baarda Edon.baarda@baesystems.comE> u|15|/ "swt" expired u|16| |17|----* sample4, restart "hb", create "pdp" for step1 = - |18| / = unknown due to 10 "u" labled secs > "hb" + |18| / = unknown due to 10 "u" labled secs > 0.5 * step |19| / |20| / |21|----* sample5, restart "hb" diff --git a/src/rrd_update.c b/src/rrd_update.c index c4c713a..147e833 100644 --- a/src/rrd_update.c +++ b/src/rrd_update.c @@ -779,7 +779,7 @@ _rrd_update(const char *filename, const char *tmplt, int argc, const char **argv > rrd.ds_def[i].par[DS_mrhb_cnt].u_cnt) || */ /* if the interval is larger thatn mrhb we get NAN */ (interval > rrd.ds_def[i].par[DS_mrhb_cnt].u_cnt) || - (occu_pdp_st-proc_pdp_st <= + (rrd.stat_head -> pdp_step / 2.0 < rrd.pdp_prep[i].scratch[PDP_unkn_sec_cnt].u_cnt)) { pdp_temp[i] = DNAN; } else { -- 2.30.2