Veterinary Biologics Guideline 3.19:
Guideline for Licensing Veterinary Diagnostic Test Kits in Canada

Table of Contents

• I. Introduction
  • A. Legal Authority
  • B. Definitions
• II. Products Regulated as Veterinary Biologics
• III. Data Required from the Manufacturer to Support Product Licensing
  • A. Master Seed and Cell Line Quality Control
  • B. Reference Panel Selection and Potency Testing
  • C. Batch-to-Batch Consistency
  • D. Efficacy and Performance
    • 1) Minimum Detection Limit
    • 2) Cross-Reactivity
    • 3) Diagnostic Threshold
    • 4) Repeatability and Reproducibility
    • 5) Sensitivity and Specificity
    • 6) Suitability
  • E. Stability
  • F. Materials of Animal Origin
• IV. Pre-Licensing Testing by the Canadian Food Inspection Agency
  • A. Master Seeds and Cell Lines
  • B. Pre-License Serials
• V. Label Requirements
• VI. Post-Licensing Serial Release
• VII. Special Considerations for Test Kits Licensed in the United States
• VIII. Test Kits for Use in a Federal Disease Control Program
• IX. Diagnostic Test Kits Manufactured in Canada for Export Only
• Appendix I: Reference Panel Preparation

I. Introduction

The Canadian Centre for Veterinary Biologics (CCVB) of the Canadian Food Inspection Agency (CFIA) is responsible for licensing veterinary biologics in Canada and for regulating their manufacture, importation, release, and use.

The purpose of this document is to provide manufacturers of in vitro diagnostic test kits with guidance on the data requirements for licensing these products as veterinary biologics in Canada. In addition to the present guideline, manufacturers that intend to submit an application for regulatory approval of an in vitro diagnostic test kit as a veterinary biologic should review Veterinary Biologics Guideline 3.1E: Guidance for Preparation of New Product Licensing (Registration) Submissions for Veterinary Biologics, for additional information regarding licensing applications and a checklist of required material, and Guideline 3.7E: Guideline for Preparation of Outlines of Production, Special Outlines and Summary of Changes for Veterinary Biologics for guidance on preparing these essential documents.

This guideline is not intended to address in vivo diagnostic test kits, which would have additional data requirements. Manufacturers of in vivo diagnostic kits should consult the CCVB directly.

A. Legal Authority

The Canadian Health of Animals Act (section 64.[1][s]) and the Health of Animals Regulations (Part XI - Veterinary Biologics) confer the legislative and regulatory authority to regulate veterinary biologics, including diagnostic test kits, to ensure that these products are pure, potent, safe, and effective when used according to the label directions.

B. Definitions

The term "veterinary biologic" is defined in the Health of Animals Act as follows:

a. a helminth, protozoa, or micro-organism;
b. a substance or mixture of substances derived from animals, helminths, protozoa, or micro-organisms; or
c. a substance of synthetic origin

that is manufactured, sold or represented for use in restoring, correcting, or modifying organic functions in animals or for use in the diagnosis, treatment, mitigation or prevention of a disease, disorder, or abnormal physical state, or the symptoms thereof, in animals.

II. Products Regulated as Veterinary Biologics

As defined in the Health of Animals Act, veterinary biologics include any product that is manufactured, sold, or represented for use in the diagnosis of a disease, disorder, or abnormal physical state in animals. Consequently, diagnostic test kits that are intended for use in the diagnosis of infectious diseases in animals are regulated as veterinary biologics by the CCVB.

Regulated kits include those based on antibody–antigen interactions (e.g. enzyme-linked immunosorbent assays [ELISA], lateral flow assays), as well as diagnostic test kits based on other platforms, including the polymerase chain reaction (PCR), aptamers, and nanotechnology.

In vitro tests that are developed and used "in-house" by a diagnostic laboratory are considered veterinary biologics, and thus must conform to the principles and technical standards outlined in the Health of Animals Act and Regulations, and in CCVB guidance documents. The CCVB, however, does not typically review and approve in-house in vitro diagnostic tests, unless the diagnostic test is assembled into a kit for sale or distribution to other laboratories.

Microbial antigens, animal sera, antibodies, PCR primers, and other individual reagents that are sold without any claims regarding their potential use as a reagent in diagnostic tests are generally not considered veterinary biologics for regulatory purposes. However, individuals who wish to import these products should contact their CFIA Area Health Office for guidance on whether an import permit is required for other reasons.

Although in vitro diagnostic test kits for detecting physiological parameters (e.g. pregnancy tests), organ function, blood chemistry, hormone levels, or non-infectious diseases (e.g. cancer) might be considered to fit the definition of a veterinary biologic, they could also fit the definition of a veterinary drug under the Food and Drugs Act. According to the current Memorandum of Understanding between the CFIA and Health Canada regarding regulatory control of veterinary biologics and veterinary drugs, these types of veterinary diagnostic kits fall under Health Canada's regulatory jurisdiction.

III. Data Required from the Manufacturer to Support Product Licensing

The CCVB uses a risk-based approach to evaluate veterinary diagnostic test kits. The level of regulatory review depends on multiple factors, including the kit's intended purpose (e.g. herd surveillance versus individual animal certification), the disease being diagnosed (e.g. commonly occurring treatable indigenous diseases versus notifiable or reportable diseases subject to federal disease control programs), and the kit's final user (e.g. accredited diagnostic laboratory versus practising veterinarian). In general, to license a diagnostic kit in Canada, the manufacturer must demonstrate that the kit is pure and safe for use, and that it is sufficiently potent and efficacious to accurately detect its intended disease agent.

The manufacturer should compile and submit the following information to the CCVB as part of the licensing application for an in vitro veterinary diagnostic test kit:

A. Master Seed and Cell Line Quality Control

Master seeds and cell lines used in the production of a diagnostic test kit should be tested to confirm identity and purity (i.e. freedom from adventitious agents such as extraneous bacteria, fungi, mycoplasmas, and viruses). The manufacturer should submit the results of these analyses to the CCVB as part of the diagnostic kit licensing submission.

B. Reference Panel Selection and Potency Testing

During the development of a kit, the manufacturer must develop a reliable potency test for the product. Potency tests are performed on each batch (serial) of a kit to ensure that kit components are functioning as expected, and to qualify a serial as suitable for release. This is accomplished by testing a panel of well-characterized samples of varying reactivity (strong positive, weak positive, and negative) and verifying that the results meet some pre-defined acceptance criteria for a satisfactory serial.

Section V.C. of the Outline of Production (OP) for a kit must provide a description of the potency test, the identity of the reference panel members, and the criteria for a satisfactory potency test result.

The potency test should be performed, employing the test procedures recommended to end-users in the product labelling.

In addition to identifying the reference panel members in section V.C. of the OP, manufacturers should fully describe the history and attributes of individual reference panel members in either the OP or a separate Special Outline (SO) submitted to CCVB for review and approval. Appendix I of this guideline provides more information on reference panel selection.

The potency test criteria defined in the OP should be sufficiently stringent to reliably differentiate serials with satisfactory versus sub-standard potency. Whenever possible, manufacturers should develop objective, quantitative, or semi-quantitative methods to interpret the potency test results. For example, rather than simply interpreting the results of a lateral flow device as visually positive or negative, the intensity of coloured bands or spots should be measured, using a densitometer or given a value by comparison to a monochromatic colour scale. Within the OP, the manufacturer must define criteria for an acceptable result for each panel member (e.g. optical density between 0.80 and 1.00), as well as criteria for a satisfactory potency test for the serial, based on the proportion of reference panel members that achieve their acceptable result (100%, unless otherwise justified).

The potency test procedure, samples, and criteria should all be established prior to the production of the serials used in the key efficacy and performance studies.

C. Batch-to-Batch Consistency

The manufacturer must submit the results of the potency tests performed on at least three (3) pre-licensing serials of the kit, which were produced and tested according to the OP approved by the CCVB, to demonstrate the manufacturer's ability to maintain batch-to-batch (serial-to-serial) consistency in product quality.

D. Efficacy and Performance

Note: Whenever possible, test samples used in efficacy studies should be coded so that the individuals who perform the analyses are unaware of the identity of the samples.

1) Minimum Detection Limit – The manufacturer should conduct a study using test samples of varying concentration (e.g. serial dilutions of a sample of known concentration) to estimate the minimum amount of antibody, protein antigen, or nucleic acid template that the kit can detect.

Manufacturers should also consider conducting temporal studies to establish the kit's ability to detect a disease agent or an antibody response over a specified number of days post-infection.

2) Cross-Reactivity – When validating a new diagnostic test kit, manufacturers must consider the limitations of the assay and determine whether any factors exist that would lead to inaccurate results. For example, for kits that detect the presence of pathogen constituents, manufacturers should perform a database and/or literature search to identify any related antigenic proteins or homologous DNA/RNA sequences from other pathogens, which could yield false positives. The conclusions of such theoretical analyses should be communicated to the CCVB. If a related agent is identified, and there is a possibility of its presence in samples from Canada, experiments to examine whether the kit also detects the related agent should be conducted. The manufacturer should also test samples known to be positive for the most common pathogens affecting the target species in Canada.

Where appropriate, kits detecting the presence of antibody should similarly be tested against sera from animals exposed to, or vaccinated against, related pathogens in order to detect cross-reactivity.

In addition to demonstrating the absence of unwanted cross-reactivity, when distinct strains or serotypes of a pathogen exist (e.g. bovine viral diarrhea virus types 1 and 2, canine parvovirus types 2, 2a, 2b, and 2c), the manufacturer must determine which strains or serotypes that the test kit can accurately detect and present these data to the CCVB. If not all strains or serotypes can be detected by the kit, this information should be disclosed in the product labelling.

3) Diagnostic Threshold – For kits with a quantitative result, the manufacturer will need to define diagnostic threshold (cut-off) values to direct the interpretation of the results (e.g. categorize as negative, suspicious, or positive). An analysis, such as a receiver operating characteristic (ROC) curve analysis, should be performed to determine the optimal cut-off values for the kit. Consideration should be given to the intended purpose of the kit when selecting cut-off values. In some instances, it might be desirable to choose cut-off values that maximize sensitivity (when false negatives are especially undesirable) or maximize specificity (when false positives are especially undesirable), rather than simply picking the cut-off values that yield the highest overall accuracy (those corresponding to the upper-left corner of the ROC curve).

4) Repeatability/Reproducibility – Data must be provided that demonstrate the repeatability and reproducibility of a diagnostic test kit. Typically, this involves examining the consistency of reactivity of positive, weak positive, and negative samples when

i) samples are assayed in multiple wells of the same multi-sample apparatus (e.g. for an ELISA or quantitative PCR in plate format), or on a series of equivalent single-sample devices (e.g. multiple lateral flow devices from the same serial) in the same testing session;

ii) samples are tested separately on at least three (3) different days;

iii) samples are assayed independently by at least three (3) different operators; and

iv) samples are tested, using kits of different serials (typically at least three [3] pre-licensing serials).

For kits with quantitative results, the manufacturer should calculate the mean, standard deviation, and coefficient of variation for each sample. It is recommended that samples from the potency test reference panel be used in the repeatability/reproducibility evaluation.

5) Sensitivity and Specificity – A study must be performed to allow for an estimation of the sensitivity and specificity of the kit. If the product labelling indicates that multiple sample types (e.g. whole blood or serum) or samples from multiple animal species (e.g. chickens or turkeys) can be analyzed using the kit, sensitivity and specificity data should be provided for each combination.

Sensitivity – the proportion of diseased (or exposed) animals that test positive. This is calculated by dividing the number of true positive results by the sum of the true positive and false negative results.

Specificity – the proportion of non-diseased (or unexposed) animals that test negative. This is calculated by dividing the number of true negative results by the sum of the true negative plus false positive results.

As the above definitions suggest, samples must be tested by a reference method to determine the "true" positive or negative status of the samples. Ideally, this will be accomplished by using a pathognomonic test that is an absolute predictor of the disease state (e.g. culture of the micro-organism) or a widely accepted "gold standard" test as the reference test to which the results of the kit under evaluation are compared.

If a pathognomonic or gold standard test does not exist or is unavailable for use as a reference, the manufacturer may estimate the relative sensitivity (positive percent agreement) and the relative specificity (negative percent agreement) of the kit under evaluation by comparing the test kit results to those generated by another relevant test kit. In cases where potential comparison tests are known to be imperfect, it may be preferable to use a battery of tests as the reference test method. In this situation, the manufacturer must clearly pre-define the criteria that will be used for determining the positive/negative status of each sample by the reference method (e.g. only samples that test positive by all test methods are considered positive).

To accurately estimate the sensitivity of a kit, samples covering a range of reactivities, from strong positive to weak positive, should be evaluated. Similarly, samples should be obtained from uninfected animals originating from various sources, and should include animals that have received commonly used immunizing products to properly estimate the specificity.

When designing studies to estimate sensitivity and specificity, manufacturers should give consideration to minimizing bias and sources of error. Persons who interpret the test results should not be aware of the expected positive/negative result of the sample. Samples should be tested concurrently with the kit under evaluation and the reference test to eliminate differences in the storage and handling of samples as a potential factor for discrepant results. In addition, the study should employ at least some previously untested samples, rather than only samples that have been previously tested by the reference test. This helps avoid the exclusion of borderline positive samples from the sensitivity and specificity study, and inclusion of only samples that have been well-characterized to test strongly positive or clearly negative. Diseases with low prevalence will likely necessitate including samples based on a prior positive test result. If samples are being chosen from a bank of positive samples, samples of varying levels of positivity on the initial test should be selected.

The studies used to estimate the sensitivity and specificity of a kit should be performed, using kits at the minimum acceptable level of potency, as defined in the OP for the release of a kit serial for sale. The studies are usually performed with at least one of the pre-licensing serials.

6) Suitability (field performance) – The manufacturer must evaluate the suitability of the kit for use in typical laboratory settings outside of the manufacturer's establishment. Participating laboratories (usually at least two) should be independent from the manufacturer who has developed the kit, and should be experienced in using the proposed technology. They should follow only those instructions provided in the product labelling when testing samples. Samples for testing should include known positive and negative samples supplied by the manufacturer (typically including the reference panel members used for serial release potency testing), as well as samples provided by the participating laboratory, which have been characterized as positive or negative according to its preferred testing method. Suitability testing is arranged by the manufacturer and usually involves at least one of the pre-licensing serials.

E. Stability

Studies must be performed to establish the stability and to confirm the proposed expiration dating (shelf life) for a kit at its recommended storage temperature. This is typically achieved by repeating the serial release potency test at multiple time points post-release (post-manufacture) to document the level of reactivity of the kit over time.

Expiration dates for veterinary biologics are typically computed from the date that the first potency test is initiated for that serial. For multi-component diagnostic kits, the expiration date of the assembled kit shall not exceed the expiration date of the shortest-dated component.

In circumstances where real-time stability assays cannot be completed by the time all other licensing requirements have been met, the CCVB could license a diagnostic kit with an interim shelf life (typically no more than 12 months), provided a stability monitoring program is in place to detect whether the potency of any released serials drops below the minimum potency level required for a serial.

F. Materials of Animal Origin

To allow the CCVB to assess whether the manufacture or importation of a diagnostic kit would present a risk for the introduction and/or spread of foreign animal diseases, transmissible spongiform encephalopathy (TSE) agents, or other contaminants, the CCVB requires manufacturers to identify all materials of animal origin (MAO) used in the production of a kit. Manufacturers must submit a list with the name of each MAO, the supplier, the animal species, and tissue type from which the MAO is derived, and the country where the source animals originated. For each MAO, documentation from the supplier, confirming the animal origin of the MAO, a Certificate of Analysis for a recent lot, and a copy of the supplier's MAO policy statement, indicating the supplier's actions with respect to minimizing the risk of contamination of their products by animal TSE agents, are also required.

In addition, manufacturers must submit a signed Declaration of Compliance, certifying that all MAO used in the production of the kit originate from sources considered to be safe from animal TSE infection or contamination, and that the kit does not contain any ingredients defined as specified risk material originating from a country not considered free from bovine spongiform encephalopathy.

More information on MAO requirements, as well as sample text for the Declaration of Compliance, are provided in Veterinary Biologics Guideline 3.32: Guideline for Minimising the Risk of Introducing Transmissible Spongiform Encephalopathy Agents Through Veterinary Biologics.

IV. Pre-Licensing Testing by the Canadian Food Inspection Agency

A. Master Seeds and Cell Lines

The CCVB may require samples of master seeds and/or cell lines used in the production of a diagnostic test kit to be submitted for independent testing by a CFIA laboratory, or another laboratory selected by CCVB, to confirm the manufacturer's identity and purity testing of the master seed and cell stocks. These tests are not necessarily the same as those performed by the manufacturer. The CCVB notifies the manufacturer if such testing is required.

B. Pre-licensing Serials

The CCVB may require up to three pre-licensing serials of a diagnostic kit to be independently tested by a CFIA laboratory, or another laboratory selected by CCVB, to confirm the manufacturer's potency test results and to verify the absence of technical problems when the kit is used under typical laboratory conditions. The CCVB notifies the manufacturer if such testing is required, and if so, communicates the number of kits and volume of each potency test panel member sample for submission.

V. Label Requirements

Copies of the labels for each component of the kit and the product monograph (package insert) must be submitted to CCVB for approval prior to licensing, and if any changes are sought for the labels post-licensing. Refer to Veterinary Biologics Guideline 3.3E: Labelling of Veterinary Biologics for detailed information on labelling requirements for all veterinary biologics.

In addition to the standard information that must be present in the labelling of all veterinary biologics (serial number, expiration date, manufacturer identification, etc.), the labelling for diagnostic kits should include the following: 1) the principles of the test; 2) whether its use is to detect antibody, antigen, DNA, RNA, or another marker of the disease agent; 3) the sample types that can be used for testing (blood, serum, chicken, turkey, etc.); 4) the equipment and reagents making up the kit; 5) a list of materials required for the test but not included in the kit; 6) the number of samples (or animals) that can be tested; 7) a description of the test procedure and methods of interpretation; 8) a hypothetical example of the results and interpretation; 9) a list of any precautions and test limitations; and 10) instructions and precautions for the handling and disposal of the test kit.

Note: The CCVB allows the use of certain internationally recognized symbols in the labelling of diagnostic kits in situations wherein the use of text is impractical. The symbols, however, must be defined elsewhere in the product labelling. Please contact the CCVB for more details.

The CCVB strongly encourages manufacturers to include a summary of the results from sensitivity and specificity studies in product labelling, to give consumers an indication of the expected kit performance. Table 1 suggests a format for presenting this information.

CI = confidence interval

Study 1. Kit results compared with results from an in-house PCR assay for virus DNA.
Study 2. Kit results compared with results from a commercially available antigen detection ELISA.
Study 3. Kit results compared with results from a commercially available antigen detection ELISA.

VI. Post-Licensing Serial Release

Following licensure, Canadian manufacturers and manufacturers from foreign countries, other than those from the U.S., usually require the CCVB's authorization to release a serial of their kit for sale in Canada. To qualify a serial as suitable for release, the manufacturer must perform the serial release testing described in section V of the OP approved by CCVB. For diagnostic kits, this typically only involves a potency test. (Refer to section III.B. of the present guideline.) The manufacturer submits the results of its serial release testing to the CCVB by completing a Manufacturer's Serial Release Test Report (MSRTR). A sample template for the MSRTR is provided on the CCVB website. The CCVB examines the results of the manufacturer's testing of the serial, and then informs the manufacturer whether the submission of samples for confirmatory testing is necessary. The manufacturer may release the serial for sale in Canada only upon receipt of a copy of the MSRTR for the serial, bearing the CCVB's "Released" stamp and the signature of a CCVB reviewer.

VII. Special Considerations for Test Kits Licensed in the United States

U.S. manufacturers and "Permittees" in the U.S. may apply to license in Canada veterinary biologic products already licensed by the US Department of Agriculture (USDA) Center for Veterinary Biologics (CVB). Canadian licensing requirements for veterinary biologics are largely harmonized with those of the USDA-CVB. When assembling the validation information to include in the Canadian licensing application, the manufacturer or permittee should include all of the validation studies provided to the USDA-CVB to license the product in the U.S., as well as copies of all relevant correspondence between the manufacturer or permittee and the USDA-CVB. The CCVB will review this information, then notify the manufacturer if any additional information or data are required.

Master seeds and pre-licensing serials of in vitro diagnostic test kits tested by the USDA-CVB are not typically re-tested by the CFIA. However, under certain circumstances, the CCVB may require U.S. manufacturers or permittees to submit samples for confirmatory testing – for instance, to verify that the kit can diagnose Canadian strains of the infectious agent in question. Copies of the USDA-CVB Biologics Test Reports for the pre-licensing serials and any master seeds tested by the USDA should be included in the Canadian licensing application.

The CCVB generally waives the requirement for U.S. manufacturers and permittees to apply to release individual serials of their kits in Canada post-licensing, provided these serials are tested and released by the USDA-CVB in a manner that is acceptable to the CCVB. When such an exemption is granted, only serials released by the USDA-CVB may be shipped to Canada.

VIII. Test Kits for Use in a Federal Disease Control Program

Obtaining a Veterinary Biologics Product Licence or a Permit to Import Veterinary Biologics for a diagnostic test kit does not necessarily qualify a product for use in a CFIA federal disease control program. Approval for use in such a program is made by the groups within the CFIA who are responsible for administering the animal health diagnostic or surveillance program, and may necessitate the manufacturer submitting additional data, kits, and reference test samples.

IX. Diagnostic Test Kits Manufactured in Canada for Export Only

Manufacturers in Canada may decide to license a diagnostic kit for export only (FEO). As outlined in Veterinary Biologics Guideline 3.1-1E: Guideline for Preparation of New Product Licensing (Registration) Submissions for Veterinary Biologics Manufactured in Canada, the general requirements concerning facility, equipment, personnel, production, and testing are the same for FEO products as those for products manufactured for distribution in Canada. Any specific requirements or exceptions will be determined on a case-by-case basis. The licensing application for a FEO product should clearly indicate the name of the importing country and any specific requirements or exceptions for approving or distributing the diagnostic kit in that country. It is the responsibility of the Canadian manufacturer to ensure compliance with the regulatory requirements of each importing country.

Appendix I: Reference Panel Preparation

During the development of an in vitro diagnostic kit, the CCVB requires manufacturers to compile a reference panel of test samples for use in serial potency testing (among other tests). Details regarding the identification, history, and attributes of individual reference panel members should be fully described in the Outline of Production (OP) for the product or in a Special Outline (SO) submitted to CCVB. The samples making up a panel are generally not part of the kit. Addition or removal of test samples from a panel must be documented and approved by the CCVB, and would necessitate a revision to the OP or relevant SO. The information on panel members, which should be provided to the CCVB, and the factors for consideration in their preparation, are as follows:

A. Identification – In the OP or a SO, the following information concerning the test samples in the reference panel should be listed: identification, type of sample, source (e.g. geographical location, including country and province or state), disease status of the animal, specific method used to reach the diagnosis (clinical signs, post-mortem lesions, culture, serological tests), information on factors that could affect the outcome of the diagnostic test (e.g. vaccination status), information specifically relating to the label claim (e.g. age of the animal, species, clinical form of the disease, antibody titre), date the sample was collected, the sample storage history, and the date that the sample was prepared for the reference panel. Each panel member should be identified by a unique code and date of preparation.

B. Volume – Reference panel members must be of sufficient volume to be available over a sufficient period of time to evaluate the consistency of the kit from serial to serial, and through the end of stability testing. Samples from the reference panel must also be available for testing on request by CCVB.

C. Sample Size – The manufacturer should include in the panel a sufficient number of relevant samples to detect changes in the potency (level of reactivity) of the various components of the kit. Ideally, a reference panel should consist of at least twenty (20) samples.

D. Type – A separate reference panel of test samples should be prepared to evaluate each of the different types of samples (e.g. blood and serum) and animal species (e.g. chickens and turkey) described in the label claims.

E. Range of Reactivity – The reference panel should be made up of different samples that give "strong positive, "weak positive," and "negative" reactions. The "positive" samples should consistently give a reaction above a pre-established positive diagnostic threshold, and should cover the full range of positive reactions described by the manufacturer in the product monograph, including some representative "weak positive" samples. The "negative" samples should consistently give a reaction that falls below the pre-established negative threshold. Each sample should be tested using the kit, multiple times, by more than one analyst, on different days, to determine the limits of their range of reactivity.

F. Specificity – Reference panels should include samples produced from a) experimentally infected animals and/or culture positive and/or serologically confirmed positive or negative animals, b) animals infected with the relevant strains of the infectious disease agent from different geographical locations, c) animals harbouring related agents or antigens, and d) animals that have received commonly used immunizing products.

G. Method of Storing the Reference Panel – The method used to store the panel members (frozen, lyophilized, etc.) should be described. For frozen samples, a maximum permitted number of thaws per aliquot should also be specified.

H. Adding or Removing a Test Sample from the Reference Panel – The test procedures used to add or remove samples from the reference panel should be defined.