Health Canada paving the way for more AI/ML medical devices

Introduction
Health Canada's regulation of AI/ML medical devices
Guiding principles
AI/ML devices approved by Health Canada
Comment

Introduction

Since 2018, Health Canada has undertaken an initiative to adapt its regulatory approach to better support digital health technologies, specifically medical devices. Key focus areas include artificial intelligence, software as a medical device, cybersecurity, medical device interoperability, wireless medical devices, mobile medical apps and telemedicine. To meet this goal, Health Canada established the Digital Health Division under the Medical Devices Bureau and has been increasing its efforts to build in-house expertise.

On 27 October 2021, Health Canada, the US Food and Drug Administration and the United Kingdom's Medicines and Healthcare Products Regulatory Agency jointly published the Good Machine Learning Practice for Medical Device Development: Guiding Principles. The document consists of 10 guiding principles to help promote safe, effective and high-quality use of artificial intelligence and machine learning (AI/ML) in medical devices. "Artificial intelligence" is a field that combines computer science with data to enable machines to mimic human intelligence when solving problems. "Machine learning" is a sub-field of artificial intelligence where algorithms are designed to learn and improve a machine through experience (ie, new data). These algorithms can be "locked", so their function does not change, or "adaptive", meaning their behaviour can change over time.

Health Canada's regulation of AI/ML medical devices

AI/ML medical devices have the potential to revolutionise the healthcare sector, as they continuously learn from and improve on their performance using real-world data after deployment in the market. However, such medical devices are difficult to regulate, since Health Canada requires a mechanism to ensure safety and efficacy as the medical devices "adapt" over time.

The current regulatory approach used by Health Canada for approving medical devices is not suited for the iterative and data-driven nature of AI development. Health Canada faces a variety of challenges in developing an appropriate framework for AI/ML medical devices, including:

• fostering innovation without sacrificing safety and effectiveness;
• establishing manufacturer requirements for pre-market authorisation;
• ensuring data sets used during development are reliable and representative;
• setting ideal performance metrics to make proper assessments on algorithm performance;
• ensuring AI integration is done appropriately without unintended consequences;
• developing a framework for post-market regulation; and
• clarifying rules on accountability if mistakes are made by software.

The guiding principles mark a continuing effort by Health Canada to adjust its approach to better regulate and facilitate market access of adaptive AI/ML medical devices.

Guiding principles

The 10 guiding principles are:

• leveraging multi-disciplinary expertise throughout the total product life cycle to ensure safe and effective AI/ML medical devices;
• implementing good software engineering and security practices, including good data quality assurance, data management, cybersecurity, and methodical risk management and design processes;
• using clinical study participants and data sets that are representative of the intended patient population (factors include age, gender, sex, race and ethnicity);
• using training data sets that are independent of test data sets. "Training data sets" refers to the data used to train a medical device, whereas "testing data sets" refers to the data used to test a medical device after it has been trained to measure performance, accuracy and efficiency.
• developing reference data sets that are based upon best available methods to ensure that clinically relevant and well-characterised data is collected and limitations of the reference data sets are understood.
• tailoring the model design to the available data and ensuring the model design reflects the intended use of the device;
• if humans are involved in the model, paying particular focus on the human-AI performance rather than AI performance in isolation;
• developing and using sound testing plans that demonstrate device performance during clinically relevant conditions;
• making available and providing clear and contextually relevant information to users, including healthcare providers and patients; and
• monitoring the performance and managing retraining risks after models are deployed.

AI/ML devices approved by Health Canada

Although there are active AI/ML medical devices approved by Health Canada in the market today, these devices use locked, rather than adaptive, AI algorithms. Some of the AI/ML medical devices that have been approved by Health Canada can be seen here.

Comment

The guiding principles are the latest example of Health Canada taking steps to modernise its regulatory approach to dealing with emerging technologies such as AI/ML medical devices. These steps are critical for fostering AI innovation in the healthcare sector without sacrificing safety and effectiveness of the medical devices for its users. Although challenges remain, it is encouraging to see Health Canada taking a systematic approach and collaborating with its international counterparts.

For further information on this topic please contact Alice Tseng or Ryan Wong at Smart & Biggar by telephone (+1 416 593 5514) or email ([email protected] or [email protected]). The Smart & Biggar website can be accessed at www.smartbiggar.ca.