Add dashboard for the TSM to follow-up with the registration and test execution

Submitted by abe on Thu, 12/16/2021 - 11:00
Status
Draft
Customer
Renovation
Business owner
Anne-Gaëlle BERGE
Description

During the registration and the execution of the event, the test session manager has to look into different places to find useful figures to manage the event. To ease the follow-up of the session, creating dashboard to quickly have a look to various indicators is necessary.

What is/are the targeted context(s)?
Who is the targeted audience?
Targetted goal(s)

Give an overview of the registration and the test execution to the test session manager.

Ease the report to the IHE T&T committee by provided the expected figures to the test session manager.

Expected benefit

Ease the work of the test session manager and save him time to support better the participants.

Documentation

For a specific testing session:

  • As a test session, I need to know how many profiles are offered for registration (overall, per domain)
  • As a test session manager, I need to know how many organisations have registered SUTs and how many of them have downloaded their contract, and how many have sent it back;
  • As a test session manager, I need to have an overview of the statuses of the SUTs (total + in progress, completed, dropped, accepted);
  • As a test session manager, I need to have an overview of the number of participants (total + monitor vs vendor) and when (which days) they intend to attend to the event;
  • As a test session manager, I need to have an overview of the status of the SUT network configurations (percentage of approved configurations, list of accepted systems with no approved configuration)
  • Before the event starts, as a test session manager, I need to have an overview of the status of the preparatory tests.
  • During the event, I need to have an overview of
    • the status of the test runs (running, waiting for validation, verified, passed etc)
    • list of organisations with no test
    • list of SUTs with no test
  • After the event, I need to have an overview of the test session results:
    • How many AIPOs have been marked as Passed?
    • How many different profiles have been marked as Passed for at least one system?
    • Top 5 profiles in terms of Passed AIPO
    • How many different actor/profile pairs have been marked as Passed for at least one system?
    • How many different tests have been executed (overall and per test types: no-peer, peer-to-peer, group)
    • Average of test runs (verified, partially verified, failed) per monitors
    • Average of test runs (verified, partially verified, failed) per SUT
    • Percentage of not verified tests (to be verified/critical) on the overall number of completed tests (excl. running, aborted, paused)
    • List of domains where tests have been executed
  • For each profile, the list of systems for each actor
    • Hide dropped systems
    • Highlight accepted systems
  • Indicators when
    • Each actor is covered by at least 3 differents systems
    • A system acts as all the actors
    • Only systems from the same organisation are registered for the profile
    • No registration at all

Features that cover this need

Title Specification status Implementation status Tool
Session process for test session managers Reviewed Available Gazelle Test Management