Consumer Mobile Health Application Functional Framework, Release 2
2.0.1 - CI build International flag

Consumer Mobile Health Application Functional Framework, Release 2, published by HL7 International / Mobile Health. This guide is not an authorized publication; it is the continuous build for version 2.0.1 built by the FHIR (HL7® FHIR® Standard) CI Build. This version is based on the current content of https://github.com/HL7/cmhaff-ig/ and changes regularly. See the Directory of published versions

: AIG.4 AI Validation, Performance, and Equity (Function)

Page standards status: Informative

Raw xml | Download


<Requirements xmlns="http://hl7.org/fhir">
  <id value="CMHAFFR2-AIG.4"/>
  <meta>
    <profile
             value="http://hl7.org/ehrs/uv/cmhaffr2/StructureDefinition/FMFunction"/>
  </meta>
  <text>
    <status value="extensions"/>
    <div xmlns="http://www.w3.org/1999/xhtml">
    
    
    
    
    <div id="requirements"><b>Criteria <a href="https://hl7.org/fhir/versions.html#std-process" title="Normative Content" class="normative-flag">N</a>:</b></div>
    <table id="statements" class="grid dict">
        
        <tr>
            <td style="padding-left: 4px;">
            AIG.4#01
            </td>
            <td style="padding-left: 4px;">
            SHALL
            
            
            <span style="border-radius: 999px;margin: 2px 2px;font-size: 10px;display: inline-block;padding: 3px 5px;letter-spacing: 0.5px;line-height: 1;white-space: nowrap;background-color: #f3e5ff;color: #7b1fa2;border: 1px solid #d1a3ff;">conditional</span>
            
            
            </td>
            <td style="padding-left: 4px;" class="requirement">
                <p>IF the system uses AI functionality THEN the system SHALL evaluate the AI function, before deployment, for performance, safety, reliability, and usability in the documented context of use and against pre-specified acceptance criteria.</p>

                
            </td>
        </tr>
        
        <tr>
            <td style="padding-left: 4px;">
            AIG.4#02
            </td>
            <td style="padding-left: 4px;">
            SHALL
            
            
            <span style="border-radius: 999px;margin: 2px 2px;font-size: 10px;display: inline-block;padding: 3px 5px;letter-spacing: 0.5px;line-height: 1;white-space: nowrap;background-color: #f3e5ff;color: #7b1fa2;border: 1px solid #d1a3ff;">conditional</span>
            
            
            </td>
            <td style="padding-left: 4px;" class="requirement">
                <p>IF the system uses AI functionality that can affect health, safety, access, or material wellbeing THEN the system SHALL evaluate whether performance differs materially across relevant subgroups, including populations defined by age, sex, language, disability, geography, device type, health condition, or other factors relevant to the intended use, and SHALL address identified unacceptable disparities.</p>

                
            </td>
        </tr>
        
        <tr>
            <td style="padding-left: 4px;">
            AIG.4#03
            </td>
            <td style="padding-left: 4px;">
            SHALL
            
            
            <span style="border-radius: 999px;margin: 2px 2px;font-size: 10px;display: inline-block;padding: 3px 5px;letter-spacing: 0.5px;line-height: 1;white-space: nowrap;background-color: #f3e5ff;color: #7b1fa2;border: 1px solid #d1a3ff;">conditional</span>
            
            
            </td>
            <td style="padding-left: 4px;" class="requirement">
                <p>IF the system uses AI functionality THEN the system SHALL document the performance measures used, their limitations, the evaluation dataset characteristics, and the conditions under which the AI function was not evaluated or did not meet acceptance criteria.</p>

                
            </td>
        </tr>
        
        <tr>
            <td style="padding-left: 4px;">
            AIG.4#04
            </td>
            <td style="padding-left: 4px;">
            SHOULD
            
            
            <span style="border-radius: 999px;margin: 2px 2px;font-size: 10px;display: inline-block;padding: 3px 5px;letter-spacing: 0.5px;line-height: 1;white-space: nowrap;background-color: #f3e5ff;color: #7b1fa2;border: 1px solid #d1a3ff;">conditional</span>
            
            
            </td>
            <td style="padding-left: 4px;" class="requirement">
                <p>IF the system uses AI functionality THEN the system SHOULD obtain external or independent validation when the risk assessment identifies elevated potential for health, safety, equity, or consumer-protection harm.</p>

                
            </td>
        </tr>
        
        <tr>
            <td style="padding-left: 4px;">
            AIG.4#05
            </td>
            <td style="padding-left: 4px;">
            MAY
            
            
            <span style="border-radius: 999px;margin: 2px 2px;font-size: 10px;display: inline-block;padding: 3px 5px;letter-spacing: 0.5px;line-height: 1;white-space: nowrap;background-color: #f3e5ff;color: #7b1fa2;border: 1px solid #d1a3ff;">conditional</span>
            
            
            </td>
            <td style="padding-left: 4px;" class="requirement">
                <p>IF the system uses AI functionality THEN the system MAY publish a performance dashboard or public validation summary that identifies the intended use, relevant performance metrics, and limitations.</p>

                
            </td>
        </tr>
        
    </table>
    
</div>
  </text>
  <extension
             url="http://hl7.org/fhir/StructureDefinition/structuredefinition-wg">
    <valueCode value="mobile"/>
  </extension>
  <url value="http://hl7.org/ehrs/uv/cmhaffr2/Requirements/CMHAFFR2-AIG.4"/>
  <version value="2.0.1"/>
  <name value="AIG_4_AI_Validation__Performance__and_Equity"/>
  <title value="AIG.4 AI Validation, Performance, and Equity (Function)"/>
  <status value="active"/>
  <date value="2026-11-18T11:24:54+00:00"/>
  <publisher value="HL7 International / Mobile Health"/>
  <contact>
    <telecom>
      <system value="url"/>
      <value value="http://www.hl7.org/Special/committees/mobile"/>
    </telecom>
  </contact>
  <description
               value="This category is about evaluating an AI function against its documented context of use before deployment, documenting what was and was not evaluated, and establishing whether performance differs materially across the populations the application serves."/>
  <jurisdiction>
    <coding>
      <system value="http://unstats.un.org/unsd/methods/m49/m49.htm"/>
      <code value="001"/>
      <display value="World"/>
    </coding>
  </jurisdiction>
  <statement>
    <extension
               url="http://hl7.org/ehrs/uv/cmhaffr2/StructureDefinition/requirements-dependent">
      <valueBoolean value="false"/>
    </extension>
    <key value="CMHAFFR2-AIG.4-01"/>
    <label value="AIG.4#01"/>
    <conformance value="SHALL"/>
    <conditionality value="true"/>
    <requirement
                 value="IF the system uses AI functionality THEN the system SHALL evaluate the AI function, before deployment, for performance, safety, reliability, and usability in the documented context of use and against pre-specified acceptance criteria."/>
  </statement>
  <statement>
    <extension
               url="http://hl7.org/ehrs/uv/cmhaffr2/StructureDefinition/requirements-dependent">
      <valueBoolean value="false"/>
    </extension>
    <key value="CMHAFFR2-AIG.4-02"/>
    <label value="AIG.4#02"/>
    <conformance value="SHALL"/>
    <conditionality value="true"/>
    <requirement
                 value="IF the system uses AI functionality that can affect health, safety, access, or material wellbeing THEN the system SHALL evaluate whether performance differs materially across relevant subgroups, including populations defined by age, sex, language, disability, geography, device type, health condition, or other factors relevant to the intended use, and SHALL address identified unacceptable disparities."/>
  </statement>
  <statement>
    <extension
               url="http://hl7.org/ehrs/uv/cmhaffr2/StructureDefinition/requirements-dependent">
      <valueBoolean value="false"/>
    </extension>
    <key value="CMHAFFR2-AIG.4-03"/>
    <label value="AIG.4#03"/>
    <conformance value="SHALL"/>
    <conditionality value="true"/>
    <requirement
                 value="IF the system uses AI functionality THEN the system SHALL document the performance measures used, their limitations, the evaluation dataset characteristics, and the conditions under which the AI function was not evaluated or did not meet acceptance criteria."/>
  </statement>
  <statement>
    <extension
               url="http://hl7.org/ehrs/uv/cmhaffr2/StructureDefinition/requirements-dependent">
      <valueBoolean value="false"/>
    </extension>
    <key value="CMHAFFR2-AIG.4-04"/>
    <label value="AIG.4#04"/>
    <conformance value="SHOULD"/>
    <conditionality value="true"/>
    <requirement
                 value="IF the system uses AI functionality THEN the system SHOULD obtain external or independent validation when the risk assessment identifies elevated potential for health, safety, equity, or consumer-protection harm."/>
  </statement>
  <statement>
    <extension
               url="http://hl7.org/ehrs/uv/cmhaffr2/StructureDefinition/requirements-dependent">
      <valueBoolean value="false"/>
    </extension>
    <key value="CMHAFFR2-AIG.4-05"/>
    <label value="AIG.4#05"/>
    <conformance value="MAY"/>
    <conditionality value="true"/>
    <requirement
                 value="IF the system uses AI functionality THEN the system MAY publish a performance dashboard or public validation summary that identifies the intended use, relevant performance metrics, and limitations."/>
  </statement>
</Requirements>