Standard Document
Fourth Edition
Method Evaluation

CLSI EP14

Evaluation of Commutability of Processed Samples

This document offers guidance on evaluating the commutability of processed samples. It helps determine whether these samples behave differently compared to unprocessed patient samples when using two different quantitative measurement procedures.

 

July 14, 2022
Jeffrey Budd, PhD, W. Greg Miller, PhD, and Karl DeVore

{{FormatPrice(currentPrice)}}

Free

{{FormatPrice(nonMemberPrice)}} List Price
This is your member pricing.
Notify Me About New Editions
Abstract

Clinical and Laboratory Standards Institute document EP14—Evaluation of Commutability of Processed Samples was developed for manufacturers and providers of proficiency testing or external quality assessment programs, although it is useful to clinical laboratories as well. The document helps users 1) determine whether noncommutability is the source of unexpected results that are sometimes observed with processed samples when two quantitative measurement procedures are compared, 2) display the magnitude of the effects, and 3) ensure that laboratory performance is evaluated fairly if noncommutability is present. The suggested protocol was developed using unprocessed patient samples as the standard of comparison.

Overview of Changes

This guideline was revised in 2022 under the Limited Revision Process and replaces the third edition of the guideline, which was published in 2014. Several changes were made in this edition, including: 
• Adding content focused on processed samples such as EQA samples, PT samples, QC samples, and altered patient samples 
• Adding an option for using preset commutability assessment criteria instead of prediction intervals 
• Clarifying that EP14 is not designed for use with IVD manufacturer–specific calibrators and that the assessment methods described in this guideline should not be used in product regulatory submissions from such manufacturers

Scope

This guideline provides protocols for evaluating commutability of processed samples when tested with quantitative measurement procedures. Such processed samples may be those created for proficiency testing/external quality assessment (PT/EQA), measuring interval verification sample sets, or QC samples. Processed samples can also be human specimens that are modified in a way that may change their measurement characteristics. In such cases, only a few processed samples (eg, three to five) should be evaluated to represent the behavior of the modification process being assessed. This restriction is suggested because the underlying analyses in this guideline do not account for the simultaneous assessment of many processed samples. CLSI document EP39 mentions the use of surrogate samples for measurement procedure performance testing, sometimes using many such samples, eg, for measurement procedure comparison studies. EP14 does not provide methods to screen a large number of samples in such cases. 

This guideline is intended for developers of commercial diagnostic tests as well as laboratory-developed tests. This guideline is also useful for manufacturers of measuring interval sample sets and QC samples, and for PT or EQA providers to determine whether their processed samples are commutable with patient samples when examined with specified measurement procedures. Other options for assessing the commutability of processed samples across multiple measurement procedures are covered in CLSI document EP30 and in the literature. 

This guideline may also be useful to all clinical laboratory professionals wishing to investigate the commutability of a processed sample analyzed with a specific in vitro diagnostic (IVD) device in their laboratory. 

EP14 is intended to assist in the education of clinical laboratorians and diagnostic manufacturers about the commutability of processed materials and how a sample’s matrix can affect some measurand values and their interpretation (referred to as matrix effects). For example, professionals may not be warned of a matrix effect caused by the interaction of processed PT/EQA material and the measurement procedure, and therefore the data may suggest to them that erroneous patient results are being generated, when in fact the results may be acceptable. Examples of a matrix effect due to the interaction of a processed QC and certain reagent lot(s) exist in the literature. Therefore, these types of effects should not be a surprise to experienced laboratory staff and should not lead to erroneous conclusions about the suitability of results for patient samples. This guideline should assist all interested parties in not only evaluating the presence or absence of a matrix effect, but also by increasing awareness that the intended use of a processed matrix potentially affects patient care. 

This guideline can also be used by laboratorians performing quantitative tests for a wide variety of measurands across various disciplines to understand the commutability of processed samples. 

Finally, an added benefit to following the protocol is that manufacturers and PT/EQA providers should be able to provide documentation to government or accrediting agencies on processed samples commutability to help avoid false conclusions about the adequacy of patient testing. 

It should be noted that although the protocol in this document is intended to help distinguish between effects caused by measurement procedure malfunctions and those caused by the use of artificial or human-based processed samples, it does not describe approaches that specifically establish the exact mechanism or reason for any observed noncommutability. This guideline does not apply to qualitative tests that supply only “yes/no” or “positive/negative” results. 

This guideline is not intended for validating a measurement procedure during the regulatory submission process when the types of processed samples mentioned above are not products of IVD device manufacturers. The most common use of this guideline by IVD device manufacturers is as a troubleshooting tool when independently created processed sample sets do not behave as expected. It may also be used during measurement procedure development to ensure that processes such as freezing, spiking, or diluting do not change the commutability of patient samples. See CLSI document EP34 for more information. 

Also, it should be noted that this document is not intended to be used to evaluate specimen type differences, such as serum vs plasma. Such comparisons are covered in CLSI document EP35.

Product Details
EP14Ed4E
978-1-68440-157-4
64
Authors
Karl De Vore, BA, SSBB
Yashpal Agrawal, MD, PhD
Todd D. Alspach, MT(ASCP), MOS
Jeffrey R. Budd, PhD
Ramon A. Durazo-Arvizu, PhD
John H. Eckfeldt, MD, PhD
Kathie Goodwin, RAC, MBA, MT(ASCP)BB
Abdel-Baset Halim, PharmD, PhD, DABCC
Thomas A. Long
W. Gregory Miller, PhD
Nisar Pampori, PhD
Justin Thomas
Jeffrey E. Vaks, PhD
Hubert W. Vesper, PhD
Supporting Resources
CLSI EP21IG
Evaluation of Total Analytical Error for Quantitative Medical Laboratory Measurement Procedures Implementation Guide
Companion
Method Evaluation
Free
Abstract

Clinical and Laboratory Standards Institute document EP14—Evaluation of Commutability of Processed Samples was developed for manufacturers and providers of proficiency testing or external quality assessment programs, although it is useful to clinical laboratories as well. The document helps users 1) determine whether noncommutability is the source of unexpected results that are sometimes observed with processed samples when two quantitative measurement procedures are compared, 2) display the magnitude of the effects, and 3) ensure that laboratory performance is evaluated fairly if noncommutability is present. The suggested protocol was developed using unprocessed patient samples as the standard of comparison.

Overview of Changes

This guideline was revised in 2022 under the Limited Revision Process and replaces the third edition of the guideline, which was published in 2014. Several changes were made in this edition, including: 
• Adding content focused on processed samples such as EQA samples, PT samples, QC samples, and altered patient samples 
• Adding an option for using preset commutability assessment criteria instead of prediction intervals 
• Clarifying that EP14 is not designed for use with IVD manufacturer–specific calibrators and that the assessment methods described in this guideline should not be used in product regulatory submissions from such manufacturers

Scope

This guideline provides protocols for evaluating commutability of processed samples when tested with quantitative measurement procedures. Such processed samples may be those created for proficiency testing/external quality assessment (PT/EQA), measuring interval verification sample sets, or QC samples. Processed samples can also be human specimens that are modified in a way that may change their measurement characteristics. In such cases, only a few processed samples (eg, three to five) should be evaluated to represent the behavior of the modification process being assessed. This restriction is suggested because the underlying analyses in this guideline do not account for the simultaneous assessment of many processed samples. CLSI document EP39 mentions the use of surrogate samples for measurement procedure performance testing, sometimes using many such samples, eg, for measurement procedure comparison studies. EP14 does not provide methods to screen a large number of samples in such cases. 

This guideline is intended for developers of commercial diagnostic tests as well as laboratory-developed tests. This guideline is also useful for manufacturers of measuring interval sample sets and QC samples, and for PT or EQA providers to determine whether their processed samples are commutable with patient samples when examined with specified measurement procedures. Other options for assessing the commutability of processed samples across multiple measurement procedures are covered in CLSI document EP30 and in the literature. 

This guideline may also be useful to all clinical laboratory professionals wishing to investigate the commutability of a processed sample analyzed with a specific in vitro diagnostic (IVD) device in their laboratory. 

EP14 is intended to assist in the education of clinical laboratorians and diagnostic manufacturers about the commutability of processed materials and how a sample’s matrix can affect some measurand values and their interpretation (referred to as matrix effects). For example, professionals may not be warned of a matrix effect caused by the interaction of processed PT/EQA material and the measurement procedure, and therefore the data may suggest to them that erroneous patient results are being generated, when in fact the results may be acceptable. Examples of a matrix effect due to the interaction of a processed QC and certain reagent lot(s) exist in the literature. Therefore, these types of effects should not be a surprise to experienced laboratory staff and should not lead to erroneous conclusions about the suitability of results for patient samples. This guideline should assist all interested parties in not only evaluating the presence or absence of a matrix effect, but also by increasing awareness that the intended use of a processed matrix potentially affects patient care. 

This guideline can also be used by laboratorians performing quantitative tests for a wide variety of measurands across various disciplines to understand the commutability of processed samples. 

Finally, an added benefit to following the protocol is that manufacturers and PT/EQA providers should be able to provide documentation to government or accrediting agencies on processed samples commutability to help avoid false conclusions about the adequacy of patient testing. 

It should be noted that although the protocol in this document is intended to help distinguish between effects caused by measurement procedure malfunctions and those caused by the use of artificial or human-based processed samples, it does not describe approaches that specifically establish the exact mechanism or reason for any observed noncommutability. This guideline does not apply to qualitative tests that supply only “yes/no” or “positive/negative” results. 

This guideline is not intended for validating a measurement procedure during the regulatory submission process when the types of processed samples mentioned above are not products of IVD device manufacturers. The most common use of this guideline by IVD device manufacturers is as a troubleshooting tool when independently created processed sample sets do not behave as expected. It may also be used during measurement procedure development to ensure that processes such as freezing, spiking, or diluting do not change the commutability of patient samples. See CLSI document EP34 for more information. 

Also, it should be noted that this document is not intended to be used to evaluate specimen type differences, such as serum vs plasma. Such comparisons are covered in CLSI document EP35.

EP14Ed4E
978-1-68440-157-4
64
Authors
Karl De Vore, BA, SSBB
Yashpal Agrawal, MD, PhD
Todd D. Alspach, MT(ASCP), MOS
Jeffrey R. Budd, PhD
Ramon A. Durazo-Arvizu, PhD
John H. Eckfeldt, MD, PhD
Kathie Goodwin, RAC, MBA, MT(ASCP)BB
Abdel-Baset Halim, PharmD, PhD, DABCC
Thomas A. Long
W. Gregory Miller, PhD
Nisar Pampori, PhD
Justin Thomas
Jeffrey E. Vaks, PhD
Hubert W. Vesper, PhD
Supporting Resources
CLSI EP21IG
Evaluation of Total Analytical Error for Quantitative Medical Laboratory Measurement Procedures Implementation Guide
Companion
Method Evaluation
Free