SUT Owner

Responsible for registering a system under test for a test session.

Evaluation summary during evaluation

As an operator, when I access a test session during the evaluation phase, I want to see a summary of the status of my evaluation for all the SUTs from my organisation to have an overview of the evaluation process.

That is to say, for each accepted system under test, a card displays information about the statuses of the SUT capabilities.
A shortcut allows the user to access the Evaluation page, filtered to display only the content related to the SUT.

Enhanced notifications

Submitted by abe on Fri, 12/17/2021 - 12:29
Status
Draft
Customer
Renovation
Business owner
Anne-Gaëlle BERGE
Description

A lot of information are shared with the test event participant through the tool and they are available in various places. As a consequence, the participant has to regularly consult the various pages to check if a status changed or if a new information is available.

To inform the information in a timely manner, a notification system should be put in place.

 

What is/are the targeted context(s)?
Targetted goal(s)

Inform the participant in a timely manner of any useful information through an instant messaging system.

Expected benefit

Improve the user experience;

Save time to the participant, he does not have to look in the tool to find the information.

Documentation

As a SUT Operator, I want to be notified when the status of a test instance changes.

As a SUT Operator, I want to be notified when my SUT is accepted to the session.

As a SUT Operator, I want to be informed when my SUT is graded.

As a SUT Operator, I want to be notified when someone posts a message in the chat window of a test run in which I am involved.

As a SUT Operator, I want to be notified when a milestone is reached: registration starts, registration ends, session starts...

SUT definition page

Submitted by abe on Thu, 12/16/2021 - 16:00
Status
Draft
Customer
Renovation
Business owner
Anne-Gaëlle BERGE
Description

The SUT edition page shall be reworked in order to make it clearer, and more complete, so that the participants to not have to jump in multiple locations to manage their systems.

Avoid using tabs and use a navigation bar instead.

What is/are the targeted context(s)?
Who is the targeted audience?
Targetted goal(s)

Centralize the information about the SUT for the participant

Expected benefit

Reduce the number of pages to maintain

Ease the work of the SUT operator

Documentation

As a SUT operator, I want to set the name of my SUT.

As a SUT operator, I want to give a type for my SUT (Gateway, Workstation, PACS).

As a SUT operator, I want to communicate to my partners the links to my capability statements (HL7, IHE, DICOM, FHIR).

Do we really need a keyword ? It brings confusion because there is no consistency in the tool (names and keywords are used in several places)

As a SUT operator, I want to list the capabilities of my SUT that I want to test.

As a SUT operator, I want to be aware of the testing status of each AIPO (testable, not testable, at risk) when it has already been decided by the test session manager.

As a SUT operator, I want to know when a profile is not testable:

  • If it is already selected for my system, I need to be warned so that I am free to remove it from the list of capabilities;
  • If it is not selected, I shall not be allowed to select it (but the reason why I cannot select shall be clearly stated)

As a SUT operator, I want to ask the test session manager to allow me to test a capability as supportive.

As a SUT operator, I want to filter out the list of capabilities my system is registered for (filter on actor, profile, domain, option, supportive, result).

As a SUT operator, I want to see the result for each capability.

As a SUT operator, I want to see the notes from the domain manager on a given capability (if any).

As a SUT operator, I want to see where I have to sit in the room.

As a SUT operator, I want to access the communication channel dedicated to my system.

Dashboard for organisations

Submitted by abe on Thu, 12/16/2021 - 11:41
Status
Draft
Customer
Renovation
Business owner
Anne-Gaëlle BERGE
Description

Give information to the users about their current/previous participations to the testing events.

What is/are the targeted context(s)?
Who is the targeted audience?
Targetted goal(s)

Help participants to promote their attendance to test events and to have an overview of their past results.

Expected benefit

not sure there's any...

Documentation

Dashboard

  • Number of system registered per session + average
  • Number of participants per session + average per system + average per AIPO
  • Number of tested AIPO + results + drawings + average
  • Number of different partners (organisation level / SUT level)

Use a standardized language

Submitted by abe on Thu, 12/16/2021 - 11:25
Status
Draft
Customer
Renovation
Business owner
Anne-Gaëlle BERGE
Description

In Gazelle, the wording is not always consistent with ISTQB and it is really Connectathon oriented. It leads to confusion to Gazelle users. The wording shall be adapted in several places to improve the user experience.

What is/are the targeted context(s)?
Targetted goal(s)

Adapt the wording to the event supported by Gazelle TM.

Use a common language.

Expected benefit

Improve the user experience.

Opportunities

Sharazone, Inter-AMC and EPD projects will directly take advantage of this update.

Documentation

As a first action, we should make the current Connectathon menu agnostic of the type of test session:

  • Use the "type" (from the testing session configuration) as display name in the menu bar where "Connectathon" is currently used.
  • In case we do not merge the preparatory tests and test session tests:
    • The "Pre-Connectathon" sub menu might be renamed into "Preparatory tests"
    • The "Pre-Connectathon Tests" sub menu might be renamed into "List of preparatory tests"
    • The "Pre-connectathon results" sub menu shall be renamed into "Preparatory test results"
  • The "Connectathon" sub menu might be renamed into "Testing"
  • The "Connectathon" menu entry (lower level) could be renamed "Execute tests" (as well as the short cut in the top menu bar)
  • The "Connectathon result" menu entry should be renamed "Test session results"
  • The "Download connectathon report" menu entry should be renamed "Download test session report"

Then, everywhere in the tool, we should use the following vocabulary:

Current term New (English) New (French)
TF Interoperability model  
Tests list Tests Tests
Test definition Test cases Cas de tests
MetaTest List    
Configuration SUT Configurations Configurations des SUT
Network Network details Informations réseau
All configurations SUT network configurations Configurations réseau des SUT
Connectathon    
PreConnectathon Preparatory tests  
Test instance Test run  
Testing session Test session  
system SUT  

 

Dashboards for the testing event participants

Submitted by abe on Thu, 12/16/2021 - 10:14
Status
Draft
Customer
Renovation
Business owner
Anne-Gaëlle BERGE
Description

In order to follow-up with their progresses during the event, the SUT operators need to access some graphics to show them their progresses in terms of:

  • SUT registration status (dropped, in progress, completed, accepted)
  • Approved vs unapproved network configuration (overall, per SUT)
  • Connectathon/Projectathon test statuses (overall, per SUT, per SUT per type: preparatory tests, group tests, no-peer, etc)
  • "AIPO" Results (overall, per SUT)

 

What is/are the targeted context(s)?
Who is the targeted audience?
Targetted goal(s)

Allow participants to move their focus to their remaining work

Expected benefit

Quickly see what to work on

Gain in efficiency

 

Document the event in one single place

Submitted by abe on Thu, 12/16/2021 - 10:00
Priority
Essential - Must have, it is essential for the use cases
Status
Under development
Customer
Renovation
Business owner
Anne-Gaëlle BERGE
Description

For the each Connectathon (Europe/NA), we maintain a documentation page for the participants to the event. Ex: https://gazelle.ihe.net/content/EU2021

Participants complain that the documentation is spread out several places and that it is complicated to understand where to find the relevant information. In addition, we have no placeholder for the documentation related to a given Projectathon.

It would be convenient to have an editable panel in Gazelle Test Management or, at least, to be able to define iframes so that, from the point of view of the user, all the documentation is available in Gazelle Test Management.

What is/are the targeted context(s)?
Who is the targeted audience?
Targetted goal(s)

Give a single pointer to the Connectathon/Projectathon participants for accessing both the documentation and the features they need to access.

Expected benefit

Improve the user experience and centralize all the documentation.

Opportunities

There is currently no placeholder for the Projectathon documentation (need to create a specific page somewhere), have the ability to create this page directly in TM would help the test session manager.

Documentation

As a test session manager, I want to give access to the documentation of the event on a landing page for the Connectathon/Projectathon. It also includes publishing the daily morning news during the Connectathon/Projectathon.

As a test session manager, I may want to send a notification to the participants to inform them that content has been added/updated.

As a participant to a testing event, I need to be driven through the workflow, from registration to the publication of the results

Submitted by abe on Thu, 12/16/2021 - 09:31
Priority
Essential - Must have, it is essential for the use cases
Status
Under development
Customer
Renovation
Business owner
Anne-Gaëlle BERGE
Description

Gazelle test bed and in particular Gazelle Test Management is a complex system offering a lot of features to the users. In the context of a testing event (Projectathon or Connectathon), a workflow has to be followed by participants but it is not reflected in the GUI. In the contrary, all the features are listed in menus (with sometimes meaningless names) with no particular order.

Based on the last years' Connectathon surveys, user are expecting more guidance in the tool itself. Walking through the Connectathon/Projectathon process should be smooth and should not require hours of trainings.

Milestones are available in the tool for each testing session, as well as a few other parameters that should be used to help the user understanding where to go and when.

What is/are the targeted context(s)?
Who is the targeted audience?
Targetted goal(s)

Make the navigation in Gazelle Test Management smooth enough that participants do not have to read the user manual or wait for webinars to understand where to go in the tool.

Expected benefit

Reduce the amount of work (training/support) for the test session manager.

Enhance the Connectathon/Projectathon experience for users.

Opportunities

More and more Projectathons are being held and, in most of the cases, participants are new to Gazelle. We can use those testing event as lab to test our developments. 

Documentation

One-click operations that shall be available to the user:

  • As a SUT Operator, I shall see what are the upcoming events and when the registration starts/ends + the dates of the event;
  • As a SUT Operator, I shall be able to access the results from the past events where my company attended, in Gazelle Test Management;
  • As a SUT Operator, I shall be able to access the results from the past events where my company attended, in the connectathon result matrix;
  • As a SUT Operator, I shall be able to download the test session report for a past event where my company attended.
  • As an organisation owner, I shall be able to add a user for my company;
  • As an organisation owner, I shall be able to grant access to the users who created an account by theirselves;
  • When the registration for an event is open, I shall be able to add a SUT;
  • When the registration for an event is open, I shall be able to update the SUTs owned by my organisation;
  • As soon as my SUT is accepted, as a SUT operator, I shall be able to access the preparatory tests;
  • As a company owner, I shall be able to review and download my contract (if needed for the event), until the contract is marked as received in the tool;
  • As soon as my SUT is accepted,as a SUT operator, I shall be requested to fill out the network configuration for my SUTs;
  • As soon as my SUT is accepted, as a SUT operator, I shall be able to access its test plan;
  • As soon as my SUT is accepted, as a SUT operator, I shall be able to start the no-peer tests;
  • As soon as the test event starts, as a SUT operator, I shall be able to access the list of peer-to-peer/group tests I have to execute;
  • As a SUT operator, I shall be able to access the Product Registry.
  • As a SUT operator, I shall be able to see the tools of interest with a link to access them (ie: this kind of page should be part of Gazelle TM: https://gazelle.ihe.net/connectathon.html).
  • For on-site events, as a SUT operator, I shall be able to access the details to configure my SUT with a static IP address;
  • As a SUT operator, I shall be able to access the network configuration of my potential partners.
  • As a SUT operator, I shall be able to access the communication tool (if any set up for the event)