Test coverage history

1. Introduction

This document summarizes the coverage of the P4DTI by its automated test suites at various historical points.

The intended readership is project testers.

This document is not confidential.

2. Coverage

Changelevel             11325          14720          23380          24804         25093
Date                  2001-04-11     2001-08-06     2001-10-19    2001-12-05     2001-12-12
Event               Release 1.1.1  Release 1.1.6  Release 1.2.1   Coverage(1)  Added tests(2)
=============================================================================================
Name               Stmt Exec Cove Stmt Exec Cove Stmt Exec Cove Stmt Exec Cove Stmt Exec Cove
=============================================================================================
bugzilla            425  298  70%  459  368  80%  529  420  79%  586  484  82%  587  491  83%
catalog               5    5 100%    5    5 100%    5    5 100%    5    5 100%    5    5 100%
check_config         63   63 100%   80   80 100%   80   80 100%   92   92 100%   92   92 100%
config_loader         -    -    -    -    -    -    -    -    -   10    5  50%   10    5  50%
configure_bugzilla  213  181  84%  213  181  84%  211  179  84%  211  171  81%  220  179  81%
configure_teamtrack 140  135  96%  140  134  95%  162  153  94%  165  153  92%  173  162  93%
dt_bugzilla         479  150  31%  479  321  67%  463  312  67%  615  417  67%  621  460  74%
dt_interface         19   15  78%   19   15  78%   19   15  78%   19   18  94%    8    8 100%
dt_teamtrack        650  439  67%  789  668  84%  871  734  84%  918  779  84%  935  856  91%
init                 53   52  98%   55   54  98%   64   58  90%   50   50 100%   50   50 100%
logger               57   39  68%   57   39  68%   74   45  60%  113   66  58%  114   95  83%
message             100   99  99%  105  104  99%  106  105  99%  105  104  99%  106  106 100%
mysqldb_support       -    -    -    -    -    -    -    -    -   34   21  61%   34   21  61%
p4                  107   98  91%  108   99  91%  108   99  91%  182  174  95%  189  182  96%
replicator          591  274  46%  612  350  57%  621  355  57%  785  497  63%  826  709  85%
service               -    -    -    -    -    -    -    -    -  105   45  42%  109   46  42%
stacktrace           27    4  14%   27    4  14%   27    4  14%   26    4  15%   27   24  88%
teamtrack             -    -    -    8    6  75%    8    6  75%    8    6  75%    8    6  75%
translator           40   28  70%   40   36  90%   40   36  90%   40   36  90%   36   36 100%
=============================================================================================
TOTAL              2969 1880  63% 3196 2464  77% 3388 2606  76% 4069 3127  77% 4150 3533  85%

Notes:

1. Coverage testing was first tried at this point. See [GDR 2001-12-05a].

2. A first look through the coverage tests led to significant holes in coverage being plugged. These results are after this initial activity. See [GDR 2001-12-05b], [GDR 2001-12-09] and [GDR 2001-12-11].

A. References

B. Document History

Copyright © 2001 Ravenbrook Limited. This document is provided "as is", without any express or implied warranty. In no event will the authors be held liable for any damages arising from the use of this document. You may make and distribute verbatim copies of this document provided that you do not charge a fee for this document or for its distribution.