Operator sees statistics about test execution

Story status
Reviewed
Implementation status
Available
Targetted user
Description

On top of the "test execution and logs" page, the operator shall see a Testing Dashboard panel that shows:

  • How many capabilities have to be tested for his SUT, how many are registered as supportive and how many are registered as thorough
  • How many network interfaces are defined for his SUT, how many are approved and how many are not (+ link to manage them)
  • How many test runs his SUT is involved in (excl. aborted test runs), how many are completed (final status = verified, failed, verified by vendor) and how many are ongoing (other statuses)
  • For each test type, a progress bar.
    • The total is the number of test runs (excl. aborted test runs)
    • Show a section for each status with different colors + percentage
  • A pie chart that shows the overall testing status of the capabilities
    • The total is the number of capabilities for the system 
    • One section per testing status: Not started, in progress, completed, awaiting evaluation, 
  • A pie chart that shows the overall status of the evaluation
    • The total is the number of capabilities for the system
    • One section per evaluation status: Passed, Did not complete, Withdrawn, No peer, Options not graded ...

Note: we need a testing status for the capabilities for which no test run are expected (eg. evaluation = Withdrawn or no peer, or no test case defined for this capability).

Acceptance criteria

The graphics are displayed to the operator and the figures reflect the status of the SUT.