SUT Operator

Shares the details about the network interfaces of his system under test.

Operates the system under test during the testing session.

Logs evidences in the tool.

Validation of XDM archives

Submitted by abe on Fri, 03/17/2023 - 12:06
Priority
High - Major feature, it achieves a lot of work
Status
Draft
Customer
ANS
Business owner
Marie Bruillard
Description

The IHE XDM (Cross-Enterprise Document Media interchange) Profile defines how data are exchanged on a media (USB stick, DVD, email). In particular, it specifies the content of the ZIP archive being exchange on those media.

ANS requires the XDM profile to be used when documents (for examples CDA) are exchanged over MS Santé (Messagerie Sécurisée en santé).

As of March 2022, the following conformance checker tools are used and involved in the verification of the XDM requirements:

  • Message Content Analyser (MCA) detects the various parts of the ZIP archive and allows to validate those parts independently the ones from the other
  • Schematron Validator is called to verify the conformance of the CDA files included in the XDM archive
  • XD* Client is called to verify the conformance of the XDS metadata
  • Gazelle X Validator is used to verify the consistency of the XDS metadata with the CDA file it describes.

Although this verification requires several clicks, it is integrated in EVSClient and achieves a lot of work.

However, there are several issues that needs to be considered:

  • The XDM archive might contain more than one CDA document; in that case the XDS metadata describes the submission set and each CDA file;
  • The X Validation is only specified/performed between the XDS medatada and a single CDA document
  • The output of the Message Content Analyser module reports failures to find optional content
  • For each CDA, the user has to select manually which validation profile (aka Schematron) to use whereas it could be selected based on the templateIds contained in the document;
  • There is no automation of the validation process; as a consequence, many clicks are required to obtain a comprehensive report about the conformance of the whole archives.

ANS expresses the need to review the workflow in EVSClient to perform the XDM archive validation in one-click.

This high level need implies the following:

  • As a SUT Operator, I want to see the results of the message content analyser, the analyses logs shall not be displayed since they content misleading level of details.
  • As a test designer, I want to link a given schematron with one or several CDA template Ids that shall be present in the file, to allow an automatic selection of the schematron to be applied.
  • As a SUT Operator, I want EVSClient to detect automatically the validator to use when validating a CDA document
  • As a test designer, when developing a X Validation profile for an XDS Submission set, I would like to tell the tool to iterate some of the rules with a different file each time
  • As a test designer, when developing a X validation profile for an XDS submission set, I would like to tell the tool to automatically select the file on which the rule applies based on the document the metadata describes.

For those last two points, it relates to the structure of the XDS submission set within the XDM archive. The XDS metadata are gathered in a file that has:

  • one section that describes the whole submission set;
  • one section per file within the submission set; this section contains a location attribute that gives the name of the file the metadata relates to

The number of files, as well as their names, are not known in advance when developing the X validation rules. Thus, the test designer need a way to tell the tool that rules A applies on element Metadata[f] of the metadata and on File f; and the X Validator will automatically iterate and choose the relevant file and element for each execution. 

What is/are the targeted context(s)?
Who is the targeted audience?
Targetted goal(s)

Offering an integrated validation workflow to the user for him to save time and clicks.

 

Expected benefit

Offering a better experience and a test report to the user, including:

  • One X Validation report per CDA
  • One conformance validation report per CDA
  • A report about the conformance of the structure of the ZIP archive

A SUT Operator checks the compliance of the implementation of TLS1.3 in his SUT, in regards to WHO specifications

Submitted by sthiam on Fri, 12/16/2022 - 11:46
Priority
High - Major feature, it achieves a lot of work
Status
Draft
Customer
WHO
Business owner
Souleymane THIAM
Description

In most of the architecture, the security layer makes use of TLS as an encryption protocol. In the last years, TLS 1.2 was enforced to improve the security of systems. WHO is going one step further, and expects the systems that claim support to the DDCC profile to support TLS 1.3.

The Gazelle test suite offers tools to test the compliance of systems under test against TLS up to version 1.2. In the context of the WHO specifications, the SUT operators wants to verify the implementation of TLS 1.3 in his system, acting either as client or server. It includes verifying that the system under test supports a restricted set of cipher suites.

 

 

What is/are the targeted context(s)?
Who is the targeted audience?
Targetted goal(s)

Improve the safety and security of systems under test by testing their compliance with the upper version of TLS.

Offer testing tools to the SUT operators in the context of conformity assessment and projectathons conducted  by WHO, for testing the DDCC specifications.

Expected benefit

Bring the testing one step further by covering more security requirements.

Gazelle test suite will be able to claim support to TLS 1.3, this protocol is more and more mandatory in interoperability specifications.

Opportunities

Renovate and improve the TLS simulators currently available in Gazelle Security Suite to allow support of TLS 1.3.

Have a look to the projects that make use of Gazelle Security Suite to test the compliance of SUTs in regards to TLS, and decide which prior version shall be kept and which one can be deprecated.

In peer-to-peer testing, SUT Operators shall be able to capture the messages when TLSv1.3 is used for securing the transaction

Submitted by sthiam on Fri, 12/16/2022 - 11:43
Priority
High - Major feature, it achieves a lot of work
Status
Draft
Customer
WHO
Business owner
Souleymane THIAM
Description

The DDCC specifications developed by WHO relies on TLSv1.2 and TLSv1.3 to secure the HTTP-based transactions.

During a testing event, when SUT operators are executing peer-to-peer tests, they want the test-bed to capture the messages they exchange, regardless of the TLS version used by their SUT.

What is/are the targeted context(s)?
Who is the targeted audience?
Targetted goal(s)

Allow participants to test through the Gazelle test bed for any version of TLS.

Expected benefit

Capture of the exchanged messages by a third-party tool is the best way to verify evidences, it fasten the validation process and is a trusted source of evidences. More and more projects are introducing TLSv1.3 in their interoperability specifications; the test bed shall be aligned in order to meet customers' needs.

Opportunities

The Sequoia project has the same need. Costs can be mutualised to develop the support of TLSv1.3 in the new product the soonest.

SUT Operator shall be able to verify the conformance of the FHIR Resources produced in the context of the DDCC project

Submitted by sthiam on Fri, 12/16/2022 - 11:40
Priority
High - Major feature, it achieves a lot of work
Status
Draft
Customer
WHO
Business owner
Souleymane THIAM
Description

The DDCC specifications published by WHO relies on the FHIR standard, and on IHE FHIR-based Profiles such as 

  • SVCM: Sharing Valuesets, Codes, and Maps
  • mCSD: Mobile Care Services Discovery
  • PMIR: Patient Master Identity Registry
  • MHD: Mobile access to Health Documents
  • DDCC: Digital Documentation of COVID-19 Certificates

In this context, the SUT Operators want to verify the compliance of the FHIR resources produced by their SUTs.

The SUT Operator might choose to

  • extract the message from his logs and validate it using Gazelle validation services (GUI or API)
  • validate a message captured by Gazelle Proxy
What is/are the targeted context(s)?
Who is the targeted audience?
Targetted goal(s)

Assess the compliance of the systems claiming support to the DDCC profile during Conformity assessment and Projectathon.

Expected benefit

SUT Operator will be able to see if their implementation are conformed with DDCC specification.

Documentation

SUT Operator checks the conformance of this system in regards to the FHIR SMART App Launch implementation guide

Submitted by sthiam on Fri, 12/16/2022 - 11:39
Priority
High - Major feature, it achieves a lot of work
Status
Draft
Customer
WHO
Business owner
Souleymane THIAM
Description

The DDCC specifications relies on FHIR Smart App Launch Implementation Guide for the user authorization feature. See http://hl7.org/fhir/smart-app-launch/index.html.

In this context, the SUT Operator shall have a mean to verify that his SUT is able to

  • Support OAuth v1.0 tokens when requesting resources from a REST server
  • Support OAuth v1.0 tokens when receiving requests from a REST client
  • Support OAuth v2.0 tokens when requesting resources from a REST server
  • Support OAuth v2.0 tokens when receiving requests from a REST client
  • Limit access to resources based on the authorization token it receives;
  • Get an authorization code by sending a request to an Authorization Server compliant with the SMART App Launch pattern
  • Get an access token sending a request with a JWT assertion to an Authorization Server based on SMART App Launch pattern
  • Get an access token sending a request with a client secret to an Authorization Server based on SMART App Launch pattern
  • Get an access token sending a request with a JWT assertion to an Authorization Server based on SMART Backend Services pattern
What is/are the targeted context(s)?
Who is the targeted audience?
Targetted goal(s)

Allow the SUT operator to verify the conformance of his SUT against the FHIR SMART App Launch specifications.

Expected benefit

SUT Operator will be able to see if their implementation conforms with DDCC specifications.

Documentation

SUT Operator verifies the conformance of the HTTP request against the DDCC specifications

Submitted by sthiam on Fri, 12/16/2022 - 11:28
Priority
High - Major feature, it achieves a lot of work
Status
Draft
Customer
WHO
Business owner
Souleymane THIAM
Description

The DDCC specifications published by WHO relies on the FHIR standard, and on IHE FHIR-based Profiles such as 

  • SVCM: Sharing Valuesets, Codes, and Maps
  • mCSD: Mobile Care Services Discovery
  • PMIR: Patient Master Identity Registry
  • MHD: Mobile access to Health Documents
  • DDCC: Digital Documentation of COVID-19 Certificates

In this context, the SUT Operators who develop the client side of those specifications want to verify the compliance of their system under test in regards to the specifications, in particular, whether the HTTP Header and Body of the HTTP requests are conform.

The SUT Operator might choose to

  • extract the message from his logs and validate it using Gazelle validation services (GUI or API)
  • validate a message captured by Gazelle Proxy
What is/are the targeted context(s)?
Who is the targeted audience?
Targetted goal(s)

Offer a validation tool for the HTTP requests produced by the SUT in the context of the DDCC specifications.

Expected benefit

SUT Operator will be able to see if their implementattion are conformed with DDCC specification

Opportunities

More and more HTTP-based profiles are being developed by our customers, thus, being able to validate the full HTTP payload, including the HTTP header is necessary to improve the coverage of the specifications by test tools.

Documentation

As a SUT Operator, I want to verify the conformance of the message sent by my SUT to the PS Directory Service provided by ANS

Submitted by abe on Mon, 12/12/2022 - 10:40
Priority
Medium - Feature to be considered
Status
Draft
Customer
ANS
Business owner
Aurélie CROUZET
Description

https://github.com/ansforge/annuaire-sante-fhir-documentation/tree/main/metadata

What is/are the targeted context(s)?
Who is the targeted audience?
Targetted goal(s)

tbd

Expected benefit

tbd