[Prev] [Next]
[TOC]
Sample ClearDDTS Reports
This appendix contains sample output from standard
ClearDDTS reports. Topics covered include:
Standard graphs and reports
The following tables lists all the metrics that are
provided by default with ClearDDTS. The metrics are categorized as table
(plain text), graph metrics, or Troff metrics.
Table metrics
| Report name |
Description |
| Problems by Project by State |
Lists the total number of defect records for each
project and how many records are in each state. This metric can help you
see which projects are nearing completion with most bugs Resolved and Verified
and few New or Open. |
| Problems by Project by Severity |
Lists the total number of defect records for each
project and how many records are of each severity. This metric can help
you see the relative severity of problems being found for each project. |
| Problems by Assigned Engineer by Severity |
Lists the total number of defect records each engineer
is assigned to fix broken down by severity level. This metric can help
you analyze how the work load is distributed across the engineering team
and who is working on the most critical bugs. |
| Problems by Assigned Engineer by State |
Lists the total number of defect records each engineer
is assigned to fix broken down by current state. This metric helps you
analyze how the work load is distributed across the engineering team and
the progress each engineer is making in resolving the assigned bugs. |
| Problems by Submitter by Severity |
Lists the total number of defect records found
by each submitter and the severity of the defects found. This metric gives
you insight into your bug submission process, allowing you to see who is
submitting bug reports, who is finding the most bugs, and who is reporting
the most critical defects. |
| Problem Arrival and Repair Rates |
Lists the number of New, Resolved, and Unresolved
defects each week for the project and time period you specify. This metric
helps you analyze engineering efficiency and progress by comparing the
number of new bugs submitted against the number resolved each week. |
| Three Line Summary of all Problems |
Provides a short summary for all defect records
by project. The three-line summary includes the defect ID, project, status,
severity, headline description, software module, version, assigned engineer,
date found, and date fixed. |
| Problems Submitted Over the Last Week |
Prints full defect reports for all problems submitted
in last 7 days. This report provides detailed information for your most
recent bugs. It can be especially useful at bug review meetings near the
end of a project when there are typically fewer bugs that require discussion. |
| Problems Resolved Over the Last Week |
Prints full defect reports for all problems resolved
in last 7 days. This report provides detailed information for your most
recent bugs. It can be especially useful at bug review meetings near the
end of a project. |
| General Problem Statistics |
Summarizes defect statistics for the projects and
dates specified. This report include information such as the percentage
of defects assigned to each engineer and found during each phase of product
development, and the percentage of defects in different severities and
states. |
| Full Text Listing of Queried Problems. |
Prints full defect reports for all problems matching
the search criteria. The format of the reports is similar to what you would
see if you used the dumpbug utility. |
Graph metrics
| Graph name |
Description |
| Graph of Phase Metrics |
Provides five different graphs that illustrate
when and where problems were found. Useful for root-cause analysis. |
| Phase Containment Effectiveness Bar Graph |
Graphs the percentage of defects caused, found,
and fixed within each phase of the project lifecycle. Ideally, problems
created in any phase should be found and fixed before the project moves
to the next phase of its lifecycle. This graph helps you see how effective
you are in finding and resolving defects in each phase. |
| Total Faults Sourced Per Phase |
Graphs the total number of errors and defects per
phase. |
| Graph of Problems by Resolution Type |
Graphs how defects were resolved. For example,
defects can be resolved through source code changes or documentation or
when declared unreproducible or not a bug. This graph shows the number
of defects resolved in each of these ways. |
| Graph of Submitters, Assigned Engineers, and Resolvers |
Provides four different graphs that illustrate
the number of defects found by each submitter-ID, the number of defects
each engineer is assigned to fix, the number of defects resolved by each
engineer, and the combined number of defects submitted, assigned, and resolved
by each engineer. |
| Problems by Severity, State, Problem Arrival Rate |
Provides 12 different graphs that illustrate combinations
of all problems by state, all problems by severity, unresolved problems
by severity, and problem arrival and resolution rates. |
| Graph of Problems by Severity |
Graphs the total number of defects of each severity
for the projects and dates specified. |
| Graphs - Repair Time and Diff between Est Time
and Actual Fix Time |
Provides two graphs concerning the time required
to fix defects. One graph illustrates the actual number of hours spent
fixing defects over the specified time period. The second graph illustrates
the difference between the estimated fix time and the actual repair time.
Useful for measuring schedule estimates. |
| Graph of Overdue Problems |
Graphs the number of defects that are at least
a week overdue (past the Estimated fix date). |
Troff metrics
| Report name |
Description |
| One Line Meeting Summary of Selected Problems (xddts
only) |
Provides a formatted one line summary of defects
for bug review meetings. This report is only available through the xddts
interface. |
| Phase Containment Effectiveness Report (xddts only) |
This report is similar to the Phase Containment
Effectiveness Bar Graph, but presents the information in a different format
and provides detail about the number of defects found in each phase (not
just the percent effectiveness for each phase). This report is only available
through the xddts interface. |
Sample table metrics
---------------------------------------------------------------------------
Table of Problems by Project by Severity.
---------------------------------------------------------------------------
ClearDDTS MANAGEMENT SUMMARY
of
PROBLEMS by PROJECT by STATE
(Mon Dec 16 10:23:12 PST 1996)
Project New Assnd Open Rslvd Verif Dup Postp Total
---------------------------------------------------------------------------
EZTxt 23 9 1 0 1 4 3 41
--------------------------------------------------------------------------
RTE.network 1 1 17 20 42 16 2 99
--------------------------------------------------------------------------
RTE.builds 2 0 5 27 13 4 1 52
--------------------------------------------------------------------------
RTE.audit 2 0 5 4 49 6 0 66
--------------------------------------------------------------------------
RTE.mail 2 9 4 3 8 1 0 27
--------------------------------------------------------------------------
RTE.devices 2 0 0 10 23 0 1 36
--------------------------------------------------------------------------
RTE.install 6 1 23 13 72 6 0 121
--------------------------------------------------------------------------
RTE.window_apl 4 10 19 48 15 37 5 138
--------------------------------------------------------------------------
RTE.file_sys 3 1 0 5 2 4 0 15
--------------------------------------------------------------------------
RTE.lib 17 3 32 53 69 10 52 236
--------------------------------------------------------------------------
--------------------------------------------------------------------------
TOTAL 62 34 106 183 294 88 64 831
--------------------------------------------------------------------------
Youngest Problem Date => 961210
Oldest Problem Date => 961028
Software Versions => Unknown 3.1.11 2.0
O.S. Versions => HpUx 9.0 Solaris 2 Sun 4.1.3
---------------------------------------------------------------------------
Table of Problems by Project by Severity.
---------------------------------------------------------------------------
ClearDDTS MANAGEMENT SUMMARY
of
PROBLEMS by PROJECT by SEVERITY
RESOLVED & UNRESOLVED PROBLEMS
(Mon Dec 16 10:23:20 PST 1996)
Project Sev1 Sev2 Sev3 Sev4 Sev5 Total
---------------------------------------------------------------------------
EZTxt 1 0 40 0 0 41
---------------------------------------------------------------------------
---------------------------------------------------------------------------
TOTAL 1 0 40 0 0 41
---------------------------------------------------------------------------
Youngest Problem Date => 961210
Oldest Problem Date => 961028
Software Versions => Unknown 3.1.11 2.0
O.S. Versions => HpUx 9.0 Solaris 2 Sun 4.1.3
Note: This report includes an additional variation that
only lists Unresolved Problems by Project and Severity. For example:
ClearDDTS MANAGEMENT SUMMARY
of
PROBLEMS by PROJECT by SEVERITY
UNRESOLVED PROBLEMS ONLY
(Mon Dec 16 10:23:20 PST 1996)
Project Sev1 Sev2 Sev3 Sev4 Sev5 Total
---------------------------------------------------------------------------
DDTs 1 0 32 0 0 33
---------------------------------------------------------------------------
---------------------------------------------------------------------------
TOTAL 1 0 32 0 0 33
---------------------------------------------------------------------------
Youngest Problem Date => 961210
Oldest Problem Date => 961028
Software Versions => Unknown 3.1.11 2.0
O.S. Versions => HpUx 9.0 Solaris 2 Sun 4.1.3
---------------------------------------------------------------------------
Table of Problems by Assigned Engineer by Severity.
---------------------------------------------------------------------------
ClearDDTS MANAGEMENT SUMMARY
of
PROBLEMS by ENGINEER by SEVERITY
RESOLVED & UNRESOLVED PROBLEMS
(Mon Dec 16 10:23:33 PST 1996)
Assigned Sev Sev Sev Sev Sev Total
Engineer 1 2 3 4 5
---------------------------------------------------------------------------
jeff 0 0 9 0 0 9
---------------------------------------------------------------------------
nguyen 1 0 2 0 0 3
---------------------------------------------------------------------------
chris 0 0 3 0 0 3
---------------------------------------------------------------------------
mcm 0 0 4 0 0 4
---------------------------------------------------------------------------
UNASSIGNED 0 0 22 0 0 22
---------------------------------------------------------------------------
---------------------------------------------------------------------------
TOTAL 1 0 40 0 0 41
---------------------------------------------------------------------------
Projects surveyed => EZTxt
Youngest Problem Date => 961210
Oldest Problem Date => 961028
Software Versions => Unknown 3.1.11 2.0
O.S. Versions => HpUx 9.0 Solaris 2 Sun 4.1.3
Note: This report example includes three additional
variations to further clarify the information in the report: Resolved &
Unresolved Problems by Engineer and Severity excluding self-reported problems,
Unresolved Problems by Engineer and Severity, and Unresolved Problems by
Engineer and Severity excluding self-reported problems.
---------------------------------------------------------------------------
Table of Problems by Assigned Engineer by State.
---------------------------------------------------------------------------
ClearDDTS MANAGEMENT SUMMARY
of
PROBLEMS by ENGINEER by STATE
(Mon Dec 16 10:23:45 PST 1996)
Assigned New Assnd Open Rslvd Verif Dup Postp Total
Engineer
---------------------------------------------------------------------------
jeff 0 4 1 0 0 2 2 9
---------------------------------------------------------------------------
nguyen 0 2 0 0 1 0 0 3
---------------------------------------------------------------------------
chris 1 2 0 0 0 0 0 3
---------------------------------------------------------------------------
mcm 0 1 0 0 0 2 1 4
---------------------------------------------------------------------------
UNASSIGN 22 0 0 0 0 0 0 22
---------------------------------------------------------------------------
---------------------------------------------------------------------------
TOTAL 23 9 1 0 1 4 3 41
---------------------------------------------------------------------------
Projects surveyed => EZTxt
Youngest Problem Date => 961210
Oldest Problem Date => 961028
Software Versions => Unknown 3.1.11 2.0
O.S. Versions => HpUx 9.0 Solaris 2 Sun 4.1.3
---------------------------------------------------------------------------
Table of Problems by Submitter by Severity.
---------------------------------------------------------------------------
ClearDDTS MANAGEMENT SUMMARY
of
PROBLEMS by SUBMITTING ENGINEER by SEVERITY
(Mon Dec 16 10:23:56 PST 1996)
Submitting Sev Sev Sev Sev Sev Total
Engineer 1 2 3 4 5
---------------------------------------------------------------------------
jan 0 0 3 0 0 3
---------------------------------------------------------------------------
fgoode 0 0 3 0 0 3
---------------------------------------------------------------------------
chris 0 0 1 0 0 1
---------------------------------------------------------------------------
williams 1 0 33 0 0 34
---------------------------------------------------------------------------
---------------------------------------------------------------------------
TOTAL 1 0 40 0 0 41
---------------------------------------------------------------------------
Projects surveyed => EZTxt
Youngest Problem Date => 961210
Oldest Problem Date => 961028
Software Versions => Unknown 3.1.11 2.0
O.S. Versions => HpUx 9.0 Solaris 2 Sun 4.1.3
---------------------------------------------------------------------------
Table of Problem Arrival and Repair Rates.
---------------------------------------------------------------------------
ClearDDTS MANAGEMENT SUMMARY
ARRIVAL & REPAIR RATE
SEVERITY 1 & 2 ONLY
(Mon Dec 16 10:24:19 PST 1996)
Week Date # New # Resolved Diff # Unresolved
----------------------------------------------------------------------
1 9-1-96 0 0 0 19
2 9-8-96 0 0 0 19
3 9-15-96 0 0 0 19
4 9-22-96 0 0 0 19
5 9-29-96 0 0 0 19
6 10-6-96 0 0 0 19
7 10-13-96 0 0 0 19
8 10-20-96 0 0 0 19
9 10-27-96 0 0 0 19
10 11-3-96 0 0 0 19
11 11-10-96 0 0 0 19
12 11-17-96 0 0 0 19
13 11-24-96 0 0 0 19
14 12-1-96 1 1 0 19
15 12-8-96 0 0 0 19
16 12-15-96 0 0 0 19
17 12-22-96 0 0 0 19
Projects surveyed => EZTxt
Note: This report example includes an additional variation
with the arrival and repair rate for all severity levels.
---------------------------------------------------------------------------
Three Line Summary of all Problems.
---------------------------------------------------------------------------
ClearDDTS MANAGEMENT SUMMARY
Three Line Problem Summaries
Mon Dec 16 10:24:21 PST 1996
PROBLEMS FOR PROJECT EZTxt
Problem Number = ANTig00074, Project = EZTxt,
St=P, Sv=3, walk through the state translation
Module: Unknown, Vers = Unknown,Engr = mcm,Found: 961210,Fixed: 961211
Problem Number = ANTig00066, Project = EZTxt,
St=P, Sv=3, text copy failed with no error msg
Module: copy, Vers = 2.0,Engr = jeff,Found: 961205,Fixed: 961206
Problem Number = ANTig00062, Project = EZTxt,
St=P, Sv=3, save copy needs new button
Module: copy, Vers = 2.0,Engr = jeff,Found: 961205,Fixed: 961206
Problem Number = ANTig00072, Project = EZTxt,
St=O, Sv=3, cancel goes into loop
Module: cancel, Vers = 3.1.11,Engr = mcm,Found: 961209,Fixed: ??
Problem Number = ANTig00071, Project = EZTxt,
St=O, Sv=3, nested options unclear
Module: querybox, Vers = 3,Engr = chris,Found: 961209,Fixed: ??
.
.
.
.
---------------------------------------------------------------------------
General Problem Statistics.
---------------------------------------------------------------------------
ClearDDTS MANAGEMENT SUMMARY
of
General Statistics
(Mon Dec 16 10:24:27 PST 1996)
Projects surveyed => EZTxt
Youngest Problem Date => 961210
Oldest 0 Date => 961028
Software Versions => Unknown 3.1.11 2.0
O.S. Versions => HpUx 9.0 Solaris 2 Sun 4.1.3
Assigned Engineer Statistics
Of 19 assigned Problems:
NO ONE assigned 0 Problems => 0.00%
mcm assigned 4 Problems => 21.05%
jeff assigned 9 Problems => 47.37%
nguyen assigned 3 Problems => 15.79%
chris assigned 3 Problems => 15.79%
Problem Submission Statistics
Of 41 Problems submitted:
williams submitted 34 Problems => 82.93%
fgoode submitted 3 Problems => 7.32%
jan submitted 3 Problems => 7.32%
chris submitted 1 Problems => 2.44%
How Found Statistics
Of 41 Problems found:
33 Problems found by customer use => 80.49%
3 Problems found by manual review => 7.32%
1 Problems found by functional test => 2.44%
4 Problems found by in-house normal use => 9.76%
How Resolved Statistics
Of 7 Problems resolved:
6 Problems resolved by not a bug => 85.71%
1 Problems resolved by unreproducible => 14.29%
When Caused Statistics
Of 9 Problems:
3 Problems caused during investigation => 33.33%
5 Problems caused during design => 55.56%
1 Problems caused during specification => 11.11%
When Found Statistics
Of 41 Problems found:
39 Problems found during investigation => 95.12%
2 Problems found during design => 4.88%
When Fixed Statistics
Of 7 Problems fixed:
6 Problems fixed during investigation => 85.71%
1 Problems fixed during specification => 14.29%
Severity Statistics
Number of severity 1 Problems = 1 => 2.44%
Number of severity 2 Problems = 0 => 0.00%
Number of severity 3 Problems = 40 => 97.56%
Number of severity 4 Problems = 0 => 0.00%
Number of severity 5 Problems = 0 => 0.00%
Status Statistics
Number of new Problems = 23 => 56.10%
Number of open Problems = 1 => 2.44%
Number of resolved Problems = 0 => 0.00%
Number of postponed Problems = 3 => 7.32%
Number of duplicate Problems = 4 => 9.76%
Number of verified Problems = 1 => 2.44%
Number of assigned Problems = 9 => 21.95%
Number of integrated Problems = 0 => 0.00%
Number of released Problems = 0 => 0.00%
Sample graph metrics
Graph - Problems by Severity, Problems by State, Problem
Arrival Rate (partial output)
Graph of Phase Metrics
Graph of Problems by Resolution Type
Graph of Overdue Problems
[Prev] [Next]
[TOC]
Copyright © 1999, Rational Software. All rights reserved.