Projectathon

Manage the test session scope within the tool

Submitted by abe on Thu, 12/16/2021 - 15:30
Status
Draft
Customer
Renovation
Business owner
Anne-Gaëlle BERGE
Description

When the registration to a test event is open, a list of profiles is offered to the participants. In most of the cases, not all the actors of all the profiles will be selected by the registrants. That means that the test session manager needs to assess whether it is possible to test each individual profile or not. 

Currently, Gazelle Test Management allows the test session manager to download a PDF file which gives, for each actor of each profile the names of the systems that claim to support it. Then, the test session manager has to maintain, outside of Gazelle, the list of testable profiles.

When time permits, the test session manager marks the SUT AIPO for non-testable profiles as "no peer". It is a manual action that should be avoided.

 

What is/are the targeted context(s)?
Who is the targeted audience?
Targetted goal(s)

Support better the test session manager and domain managers in decided whether a profile can be tested or not.

Expected benefit

Ease the registration process for the test session manager.

Give a better overview of the scope of the test session to the participants.

Documentation

As a test session manager, I want to see the list of profiles selected for the current test session and, for each profile, I need the following information:

  • What are the actors involved in the profile;
  • What are the (non-dropped) SUT registered for each actor of this profile;
  • Which ones of the SUT are already accepted to the session.

As a test session manager, I want to be able to give a status to each profile among: not testable, testable, at risk, not assessed yet.

As a test session manager, I want to decide when to make the list of profiles (along with their status) public to the test session participants.

As a test session manager, I want to be able to ask the tool to mark as "no peer" all the AIPOs when the profile's status is set to "not testable".

As a SUT operator, I shall not be able to add a "not testable" profile to my SUT. However, I want to see it in the list of profiles so that I understand why I cannot select it.

As a SUT operator, I shall not be able to start a test for a not testable profile also the actors appear in the test plan (with status = "no peer").

 

SUT management page for test session manager

Submitted by abe on Thu, 12/16/2021 - 12:52
Priority
Medium - Feature to be considered
Status
Draft
Customer
Renovation
Business owner
Anne-Gaëlle BERGE
Description

Especially during the registration period, the test session manager has to regularly access the list of registered SUT to perform several operations or simply to follow-up on the registration status.

Currently there are too many pages targetted to the test session manager that are redundant and none of them show a complete view. This need is aimed to simplify the SUT management pages for the test session manager.

What is/are the targeted context(s)?
Who is the targeted audience?
Targetted goal(s)

Offer to the test session manager a single page where to manage the SUT for the current test session.

Expected benefit

Ease the registration process for the test session manager and save him time.

Opportunities

Reduces the number of pages to be maintained in the future.

Documentation

As a test session manager, I want to access the list of registered systems and see the following information for each of them:

  • SUT name
  • Organisation's name (+ ability to link it to more organisations)
  • Main point of contact for the SUT (full name + link to send an email)
  • Number of AIPO the SUT is registered for (allow to quickly see the dummy systems)
  • Registration status (+ ability to change it)
  • Whether the SUT is accepted or not to the session (and have the ability to change it)
  • Whether a contract has been received for the organisation (when a contract is needed)
  • The table where the system sits (+ ability to update it)

Dashboard for organisations

Submitted by abe on Thu, 12/16/2021 - 11:41
Status
Draft
Customer
Renovation
Business owner
Anne-Gaëlle BERGE
Description

Give information to the users about their current/previous participations to the testing events.

What is/are the targeted context(s)?
Who is the targeted audience?
Targetted goal(s)

Help participants to promote their attendance to test events and to have an overview of their past results.

Expected benefit

not sure there's any...

Documentation

Dashboard

  • Number of system registered per session + average
  • Number of participants per session + average per system + average per AIPO
  • Number of tested AIPO + results + drawings + average
  • Number of different partners (organisation level / SUT level)

Use a standardized language

Submitted by abe on Thu, 12/16/2021 - 11:25
Status
Draft
Customer
Renovation
Business owner
Anne-Gaëlle BERGE
Description

In Gazelle, the wording is not always consistent with ISTQB and it is really Connectathon oriented. It leads to confusion to Gazelle users. The wording shall be adapted in several places to improve the user experience.

What is/are the targeted context(s)?
Targetted goal(s)

Adapt the wording to the event supported by Gazelle TM.

Use a common language.

Expected benefit

Improve the user experience.

Opportunities

Sharazone, Inter-AMC and EPD projects will directly take advantage of this update.

Documentation

As a first action, we should make the current Connectathon menu agnostic of the type of test session:

  • Use the "type" (from the testing session configuration) as display name in the menu bar where "Connectathon" is currently used.
  • In case we do not merge the preparatory tests and test session tests:
    • The "Pre-Connectathon" sub menu might be renamed into "Preparatory tests"
    • The "Pre-Connectathon Tests" sub menu might be renamed into "List of preparatory tests"
    • The "Pre-connectathon results" sub menu shall be renamed into "Preparatory test results"
  • The "Connectathon" sub menu might be renamed into "Testing"
  • The "Connectathon" menu entry (lower level) could be renamed "Execute tests" (as well as the short cut in the top menu bar)
  • The "Connectathon result" menu entry should be renamed "Test session results"
  • The "Download connectathon report" menu entry should be renamed "Download test session report"

Then, everywhere in the tool, we should use the following vocabulary:

Current term New (English) New (French)
TF Interoperability model  
Tests list Tests Tests
Test definition Test cases Cas de tests
MetaTest List    
Configuration SUT Configurations Configurations des SUT
Network Network details Informations réseau
All configurations SUT network configurations Configurations réseau des SUT
Connectathon    
PreConnectathon Preparatory tests  
Test instance Test run  
Testing session Test session  
system SUT  

 

Add dashboard for the TSM to follow-up with the registration and test execution

Submitted by abe on Thu, 12/16/2021 - 11:00
Status
Draft
Customer
Renovation
Business owner
Anne-Gaëlle BERGE
Description

During the registration and the execution of the event, the test session manager has to look into different places to find useful figures to manage the event. To ease the follow-up of the session, creating dashboard to quickly have a look to various indicators is necessary.

What is/are the targeted context(s)?
Who is the targeted audience?
Targetted goal(s)

Give an overview of the registration and the test execution to the test session manager.

Ease the report to the IHE T&T committee by provided the expected figures to the test session manager.

Expected benefit

Ease the work of the test session manager and save him time to support better the participants.

Documentation

For a specific testing session:

  • As a test session, I need to know how many profiles are offered for registration (overall, per domain)
  • As a test session manager, I need to know how many organisations have registered SUTs and how many of them have downloaded their contract, and how many have sent it back;
  • As a test session manager, I need to have an overview of the statuses of the SUTs (total + in progress, completed, dropped, accepted);
  • As a test session manager, I need to have an overview of the number of participants (total + monitor vs vendor) and when (which days) they intend to attend to the event;
  • As a test session manager, I need to have an overview of the status of the SUT network configurations (percentage of approved configurations, list of accepted systems with no approved configuration)
  • Before the event starts, as a test session manager, I need to have an overview of the status of the preparatory tests.
  • During the event, I need to have an overview of
    • the status of the test runs (running, waiting for validation, verified, passed etc)
    • list of organisations with no test
    • list of SUTs with no test
  • After the event, I need to have an overview of the test session results:
    • How many AIPOs have been marked as Passed?
    • How many different profiles have been marked as Passed for at least one system?
    • Top 5 profiles in terms of Passed AIPO
    • How many different actor/profile pairs have been marked as Passed for at least one system?
    • How many different tests have been executed (overall and per test types: no-peer, peer-to-peer, group)
    • Average of test runs (verified, partially verified, failed) per monitors
    • Average of test runs (verified, partially verified, failed) per SUT
    • Percentage of not verified tests (to be verified/critical) on the overall number of completed tests (excl. running, aborted, paused)
    • List of domains where tests have been executed
  • For each profile, the list of systems for each actor
    • Hide dropped systems
    • Highlight accepted systems
  • Indicators when
    • Each actor is covered by at least 3 differents systems
    • A system acts as all the actors
    • Only systems from the same organisation are registered for the profile
    • No registration at all

Dashboards for the testing event participants

Submitted by abe on Thu, 12/16/2021 - 10:14
Status
Draft
Customer
Renovation
Business owner
Anne-Gaëlle BERGE
Description

In order to follow-up with their progresses during the event, the SUT operators need to access some graphics to show them their progresses in terms of:

  • SUT registration status (dropped, in progress, completed, accepted)
  • Approved vs unapproved network configuration (overall, per SUT)
  • Connectathon/Projectathon test statuses (overall, per SUT, per SUT per type: preparatory tests, group tests, no-peer, etc)
  • "AIPO" Results (overall, per SUT)

 

What is/are the targeted context(s)?
Who is the targeted audience?
Targetted goal(s)

Allow participants to move their focus to their remaining work

Expected benefit

Quickly see what to work on

Gain in efficiency

 

Document the event in one single place

Submitted by abe on Thu, 12/16/2021 - 10:00
Priority
Essential - Must have, it is essential for the use cases
Status
Under development
Customer
Renovation
Business owner
Anne-Gaëlle BERGE
Description

For the each Connectathon (Europe/NA), we maintain a documentation page for the participants to the event. Ex: https://gazelle.ihe.net/content/EU2021

Participants complain that the documentation is spread out several places and that it is complicated to understand where to find the relevant information. In addition, we have no placeholder for the documentation related to a given Projectathon.

It would be convenient to have an editable panel in Gazelle Test Management or, at least, to be able to define iframes so that, from the point of view of the user, all the documentation is available in Gazelle Test Management.

What is/are the targeted context(s)?
Who is the targeted audience?
Targetted goal(s)

Give a single pointer to the Connectathon/Projectathon participants for accessing both the documentation and the features they need to access.

Expected benefit

Improve the user experience and centralize all the documentation.

Opportunities

There is currently no placeholder for the Projectathon documentation (need to create a specific page somewhere), have the ability to create this page directly in TM would help the test session manager.

Documentation

As a test session manager, I want to give access to the documentation of the event on a landing page for the Connectathon/Projectathon. It also includes publishing the daily morning news during the Connectathon/Projectathon.

As a test session manager, I may want to send a notification to the participants to inform them that content has been added/updated.

As a participant to a testing event, I need to be driven through the workflow, from registration to the publication of the results

Submitted by abe on Thu, 12/16/2021 - 09:31
Priority
Essential - Must have, it is essential for the use cases
Status
Under development
Customer
Renovation
Business owner
Anne-Gaëlle BERGE
Description

Gazelle test bed and in particular Gazelle Test Management is a complex system offering a lot of features to the users. In the context of a testing event (Projectathon or Connectathon), a workflow has to be followed by participants but it is not reflected in the GUI. In the contrary, all the features are listed in menus (with sometimes meaningless names) with no particular order.

Based on the last years' Connectathon surveys, user are expecting more guidance in the tool itself. Walking through the Connectathon/Projectathon process should be smooth and should not require hours of trainings.

Milestones are available in the tool for each testing session, as well as a few other parameters that should be used to help the user understanding where to go and when.

What is/are the targeted context(s)?
Who is the targeted audience?
Targetted goal(s)

Make the navigation in Gazelle Test Management smooth enough that participants do not have to read the user manual or wait for webinars to understand where to go in the tool.

Expected benefit

Reduce the amount of work (training/support) for the test session manager.

Enhance the Connectathon/Projectathon experience for users.

Opportunities

More and more Projectathons are being held and, in most of the cases, participants are new to Gazelle. We can use those testing event as lab to test our developments. 

Documentation

One-click operations that shall be available to the user:

  • As a SUT Operator, I shall see what are the upcoming events and when the registration starts/ends + the dates of the event;
  • As a SUT Operator, I shall be able to access the results from the past events where my company attended, in Gazelle Test Management;
  • As a SUT Operator, I shall be able to access the results from the past events where my company attended, in the connectathon result matrix;
  • As a SUT Operator, I shall be able to download the test session report for a past event where my company attended.
  • As an organisation owner, I shall be able to add a user for my company;
  • As an organisation owner, I shall be able to grant access to the users who created an account by theirselves;
  • When the registration for an event is open, I shall be able to add a SUT;
  • When the registration for an event is open, I shall be able to update the SUTs owned by my organisation;
  • As soon as my SUT is accepted, as a SUT operator, I shall be able to access the preparatory tests;
  • As a company owner, I shall be able to review and download my contract (if needed for the event), until the contract is marked as received in the tool;
  • As soon as my SUT is accepted,as a SUT operator, I shall be requested to fill out the network configuration for my SUTs;
  • As soon as my SUT is accepted, as a SUT operator, I shall be able to access its test plan;
  • As soon as my SUT is accepted, as a SUT operator, I shall be able to start the no-peer tests;
  • As soon as the test event starts, as a SUT operator, I shall be able to access the list of peer-to-peer/group tests I have to execute;
  • As a SUT operator, I shall be able to access the Product Registry.
  • As a SUT operator, I shall be able to see the tools of interest with a link to access them (ie: this kind of page should be part of Gazelle TM: https://gazelle.ihe.net/connectathon.html).
  • For on-site events, as a SUT operator, I shall be able to access the details to configure my SUT with a static IP address;
  • As a SUT operator, I shall be able to access the network configuration of my potential partners.
  • As a SUT operator, I shall be able to access the communication tool (if any set up for the event)

Change language

Submitted by abe on Tue, 10/26/2021 - 10:11
Description

The user can choose among several languages for the user interface.

Currently, users can choose

  • Between English and French in most of the application.
  • Japanese is also available in Gazelle Test Management - Translations provided by IHE Japan
  • Suomi (Finnish) and Svenska (Swedish) in EVSClient - Translations provided by Kela
Specification status
To be reviewed
Status
Available
Categories of users
Priority
Low - Nice to have it
Is specific to a project ?
No