ISMRM23 - Standardized Measures & Benchmarks

ISMRM & ISMRT Annual Meeting & Exhibition • 03-08 June 2023 • Toronto, ON, Canada

Standardized Measures & Benchmarks

Weekday Course

Wednesday, 07 June 2023

718A

15:45 - 17:45

Moderators: Penny Hubbard Cristinacce & James Pipe

Session Number: W-06

CME Credit

Session Number: W-06

Overview
Bringing together speakers from the national measurement standards bodies, networks integrated with these bodies, and the phantom manufacturers, to present the current framework for traceability and standardisation of quantitative MR (qMR) imaging biomarkers. Investigating how we can standardise quantitative MR across multiple-centres and create imaging biomarkers that are useful and usable anywhere in the world.

Target Audience
Stakeholders creating traceability for qMR imaging biomarkers. Physicists and clinicians interested in the clinical translation of qMR imaging biomarkers.

Educational Objectives
As a result of attending this course, participants should be able to:
- Describe what the metrologists at the national measurement standards bodies – such as National Physical Laboratory (NPL), National Institute of Science and Technology (NIST), Istituto Nazionale di Ricerca Metrologica (INRiM), Physikalisch-Technische Bundesastalt (PTB) – do to trace of qMR imaging biomarkers back to SI units.

- Describe how phantom manufacturers – such as CaliberMR, Gold Standard Phantoms, Leeds Test Objects – create quantitative and reproducible scientific measurement and calibration devices to enable traceability

- Describe how networks who are integrated with these national measurement standards bodies – such as RSNA’s Quantitative Imaging Biomarkers Alliance (QIBA), NCI’s Quantitative Imaging Network (QIN), ESR’s European Imaging Biomarkers Alliance (EIBALL), ECOG-ACRIN Cancer Research Group, and CRUK’s National Cancer Imaging Translational Accelerator (NCITA) – create recommendations, pipelines and processes that enhance traceability.

15:45		Introduction to a New ISMRM Committee on Standardized Measures & Benchmarks No Video Available Scott Reeder Keywords: Transferable skills: Reproducible research In my role as ISMRM President, I have formed a new ad-hoc committee on Standardized Measures and Benchmarks, led by Jim Pipe, PhD. Dr. Pipe has since put together a blue-ribbon panel of experts to define the scope, purview, and governance structure of a new permanent ISMRM committee that will enable members and study groups to develop technical performance metrics and standardized procedures that will serve as the basis for improved communication to enhance scientific process and translation.
15:50		The Need for Measuring Gradient Performance from a User's Perspective View Presentation Video Scott Reeder Keywords: Transferable skills: Reproducible research In my role as ISMRM President, I have formed a new ad-hoc committee on Standardized Measures and Benchmarks, led by Jim Pipe, PhD. Dr. Pipe has since put together a blue-ribbon panel of experts to define the scope, purview, and governance structure of a new permanent ISMRM committee that will enable members and study groups to develop technical performance metrics and standardized procedures that will serve as the basis for improved communication to enhance scientific process and translation.
15:55		Opportunities, Challenges & Trends in Measuring Gradient Performance View Presentation Video Brian Rutt
16:10		Panel Discussion
16:15		The Need for Assessing the Quality & Reliability of AI-Based Image Reconstruction from a User's Perspective View Presentation Video Marion Smits
16:20		Opportunities, Challenges & Trends in Characterizing the Quality & Reliability of AI-Based Image Reconstruction View Presentation Video Mariya Doneva Keywords: Image acquisition: Machine learning This lecture will review some of the techniques to minimize the risk of unwanted artifacts in AI-based image reconstruction that can be embedded in the model development process. In addition, opportunities for automated testing of model robustness and image quality validation will be discussed.
16:35		Panel Discussion
16:40		The Landscape of Standards & Measures in MRI View Presentation Video Kathryn Keenan Keywords: Transferable skills: Metrology of MRI Several groups and organizations are working on standards and measures for MRI. This talk will cover the different types of groups and how they interact both within and across types (e.g., national metrology institutes, consensus standards groups, and societies and their expert committees). Additionally, while there are many efforts, certain needs are currently unmet. ISMRM has identified there is a need for measureable benchmarks that aren’t specific clinical diagnostics under the purview of QIBA, nor are these covered by the regulatory process. Enter the ISMRM Committee for Standardized Measures and Benchmarks!
17:00		Creating Reproducible Scientific Measurement & Calibration Devices to Enable Quantitative MRI: A Phantom Manufacturer's Perspective View Presentation Video Aaron Oliver-Taylor Keywords: Transferable skills: Commercialisation, Transferable skills: Metrology of MRI This talk discusses the importance and application of MRI phantoms for clinical and scientific research from the perspective of a phantom manufacturer. Phantoms enable evaluation of MRI performance, accuracy, and reproducibility. These are used in the development of new techniques, harmonisation across different systems, and validation of measurements. Commercial phantoms have expectations for stability, reproducibility, and longevity, making their design and manufacture complex. There are emerging standards for MRI phantoms involving traceable measurements to national measurement laboratories. The future of this field lies in addressing challenges like system standardisation, accommodating new MRI technologies, and integrating phantoms into routine radiological workflows.
17:40		Developing International Recommendations, Pipelines & Processes: An Imaging Network's Perspective View Presentation Video Daniel Sullivan Keywords: Image acquisition: Quantification, Transferable skills: Metrology of MRI, Transferable skills: Reproducible research For Standards documents to be accepted and widely implemented, the following concepts need to be adopted. (1) There needs to be a clear rationale as the basis for each standards document. (2) The developing committees or groups need to define their operating procedures. (3) Open process is important for consensus to be accepted. (4) Definitions and metrology concepts must be standardized. (5) Gaps in published knowledge must be addressed, often by performing the necessary experiments or data collection activities.
18:00		Panel Discussion