Evidence Based Medicine on FHIR Implementation Guide
1.0.0-ballot - ballot International flag

Evidence Based Medicine on FHIR Implementation Guide, published by HL7 International / Clinical Decision Support. This guide is not an authorized publication; it is the continuous build for version 1.0.0-ballot built by the FHIR (HL7® FHIR® Standard) CI Build. This version is based on the current content of https://github.com/HL7/ebm/ and changes regularly. See the Directory of published versions

: CIBIC+ EndpointAnalysisPlan from PHUSE Lilly Redacted Protocol - EBMonFHIR IG Version - XML Representation

Active as of 2024-05-16

Raw xml | Download



<Evidence xmlns="http://hl7.org/fhir">
  <id value="179690"/>
  <meta>
    <versionId value="7"/>
    <lastUpdated value="2023-12-04T16:00:28.632Z"/>
    <profile
             value="http://hl7.org/fhir/uv/ebm/StructureDefinition/endpoint-analysis-plan"/>
  </meta>
  <text>
    <status value="extensions"/>
    <div xmlns="http://www.w3.org/1999/xhtml"><p><b>Generated Narrative: Evidence</b><a name="179690"> </a><a name="hc179690"> </a></p><div style="display: inline-block; background-color: #d9e0e7; padding: 6px; margin: 4px; border: 1px solid #8da1b4; border-radius: 5px; line-height: 60%"><p style="margin-bottom: 0px">ResourceEvidence &quot;179690&quot; Version &quot;7&quot; Updated &quot;2023-12-04 16:00:28+0000&quot; </p><p style="margin-bottom: 0px">Profile: <a href="StructureDefinition-endpoint-analysis-plan.html">EndpointAnalysisPlan</a></p></div><p><b>url</b>: <code>https://fevir.net/resources/Evidence/179690</code></p><p><b>identifier</b>: FEvIR Object Identifier/179690</p><p><b>version</b>: 1.0.0-ballot</p><p><b>name</b>: CIBIC_EndpointAnalysisPlan_from_PHUSE_Lilly_Redacted_Protocol_EBMonFHIR_IG_Version</p><p><b>title</b>: CIBIC+ EndpointAnalysisPlan from PHUSE Lilly Redacted Protocol - EBMonFHIR IG Version</p><p><b>status</b>: active</p><p><b>date</b>: 2024-05-16 12:17:54+0000</p><p><b>publisher</b>: HL7 International / Clinical Decision Support</p><p><b>contact</b>: HL7 International / Clinical Decision Support: <a href="http://www.hl7.org/Special/committees/dss">http://www.hl7.org/Special/committees/dss</a></p><p><b>author</b>: Brian S. Alper: </p><h3>UseContexts</h3><table class="grid"><tr><td style="display: none">-</td><td><b>Code</b></td><td><b>Value[x]</b></td></tr><tr><td style="display: none">*</td><td>Evidence Communication (Details: Evidence Based Medicine on FHIR Implementation Guide Code System code evidence-communication = 'Evidence Communication', stated as 'Evidence Communication')</td><td>EndpointAnalysisPlan <span style="background: LightGoldenRodYellow; margin: 4px; border: 1px solid khaki"> (<a href="CodeSystem-179423.html">Evidence Based Medicine on FHIR Implementation Guide Code System</a>#EndpointAnalysisPlan)</span></td></tr></table><p><b>copyright</b>: https://creativecommons.org/licenses/by-nc-sa/4.0/</p><h3>RelatedArtifacts</h3><table class="grid"><tr><td style="display: none">-</td><td><b>Type</b></td><td><b>Display</b></td><td><b>Citation</b></td><td><b>ResourceReference</b></td></tr><tr><td style="display: none">*</td><td>cite-as</td><td> </td><td>CIBIC+ EndpointAnalysisPlan from PHUSE Lilly Redacted Protocol - EBMonFHIR IG Version [Evidence]. Contributors: Brian S. Alper [Authors/Creators]. In: Fast Evidence Interoperability Resources (FEvIR) Platform, FOI 179690. Revised 2023-12-04. Available at: https://fevir.net/resources/Evidence/179690. Computable resource at: https://fevir.net/resources/Evidence/179690.</td><td> </td></tr><tr><td style="display: none">*</td><td>supported-with</td><td>Protocol attachment in associated Evidence Resource</td><td> </td><td><a href="Evidence-179691.html">Evidence/179691: Example EndpointAnalysisPlan from PHUSE Lilly Redacted Protocol - EBMonFHIR IG Version</a> &quot;Example_EndpointAnalysisPlan_from_PHUSE_Lilly_Redacted_Protocol_EBMonFHIR_IG_Version&quot;</td></tr></table><p><b>description</b>: An example of an EndpointAnalysisPlan Profile which uses intended='true' and include-if extensions within Evidence.statistic.modelCharacteristic elements.</p><p><b>note</b>: Approximately 100 patients will be randomized to each of the 3 treatment groups (high dose, low dose, and placebo). Previous experience with the oral formulation of xanomeline suggests that this sample size has 90% power to detect a 3.0 mean treatment difference in ADAS-Cog (p&lt;.05, twosided), based on a standard deviation of 6.5. Furthermore, this sample size has 80% power to detect a 0.36 mean treatment difference in CIBIC+ (p&lt;.05, two-sided), based on a standard deviation of 0.9

Group mean changes from baseline in the primary efficacy parameters will serve as efficacy criteria.

The primary analysis of efficacy will include only the data obtained up to and including the visit of discontinuation of study drug. Furthermore, the primary analysis will not include efficacy data obtained at any visit where the study drug was not administered in the preceding three days. Analyses that include the retrieved dropouts are considered secondary. In general, all patients will be included in all analyses of efficacy if they have a baseline measurement and at least one postrandomization measurement.

The primary analysis of ADAS-Cog (11) and CIBIC+ will be the 24-week endpoint, which is defined for each patient and variable as the last measurement obtained postrandomization (prior to protocol defined reduction in dose). a last-observation-carried-forward (LOCF). Note that the LOCF analysis at 24 weeks is the same as the endpoint analysis described previously. 

CIBIC+ will be analyzed by analysis of variance (ANOVA), with effects in the model being investigator and treatment. Investigator-by-treatment interaction will be tested in a full model prior to conducting the primary ANOVA (see description below). Because 3 treatment groups are involved, the primary analysis will be the test for linear dose response in the ANCOVA model described in the preceding paragraph. The result is then a single p-value for CIBIC+. 

Investigator-by-treatment interaction will be tested in a full ANOVA model, which takes the models described above, and adds the interaction term to the model. Interaction will be tested at α = .10 level. When the interaction is significant at this level, the data will be examined for each individual investigator to attempt to identify the source of the significant interaction. When the interaction is not significant, this term will be dropped from the model as described above, to test for investigator and treatment main effects. By doing so, all ANCOVA and ANOVA models will be able to validly test for treatment differences without weighting each investigator equally, which is what occurs when using Type III sums of squares (cell means model) with the interaction term present in the model. This equal weighting of investigators can become a serious problem when sample sizes are dramatically different between investigators. 

For all ANOVA and ANCOVA models, data collected from investigators who enrolled fewer than 3 patients in any one treatment group will be combined prior to analysis. If this combination still results in a treatment group having fewer than 3 patients in any one treatment group, then this group of patients will be combined with the next fewestenrolling investigator. In the event that there is a tie for fewest-enrolling investigator, one of these will be chosen at random by a random-number generator.

The inherent assumption of normally distributed data will be evaluated by generating output for the residuals from the full ANCOVA and ANOVA models, which include the interaction term, and by testing for normality using the Shapiro-Wilk test from PROC UNIVARIATE. In the event that the data are predominantly nonnormally distributed, analyses will also be conducted on the ranked data. This rank transformation will be applied by ranking all the data for a particular variable, across all investigators and treatments, from lowest to highest. Integer ranks will be assigned starting at 1; mean ranks will be assigned when ties occur. 

All comparisons between xanomeline and placebo with respect to efficacy variables should be one-sided. The null hypothesis is that the drug is equal or worse than placebo. The alternative
hypothesis is that the drug has greater efficacy than placebo. 

Different regulatory agencies require different type I error rates. Treatment differences that are significant at the .025 α-level will be declared to be “statistically significant.” When a computed p-value falls between .025 and .05, the differences will be described as “marginally statistically significant.” This approach satisfies regulatory agencies who have accepted a one-sided test at the .05 level, and other regulatory agencies who have requested a two-sided test at the .05 level, or equivalently, a one-sided test at the .025 level. In order to facilitate the review of the final study report, two-sided p-values will be presented in addition to the one-sided p-values.</p><blockquote><p><b>variableDefinition</b></p><p><b>VariableDefinitionVariableRoleCode</b>: exposure</p><p><b>VariableDefinitionComparatorCategory</b>: placebo</p><p><b>description</b>: high dose xanomeline vs. low dose xanomeline vs. placebo</p><p><b>note</b>: exposure</p><p><b>variableRole</b>: Use extension:variableRoleCode instead. <span style="background: LightGoldenRodYellow; margin: 4px; border: 1px solid khaki"> (<a href="http://terminology.hl7.org/5.5.0/CodeSystem-variable-role.html">EvidenceVariableRole</a>#exposure &quot;exposure&quot;)</span></p><p><b>observed</b>: <a href="EvidenceVariable-179689.html">EvidenceVariable/179689: GroupAssignment: high dose xanomeline vs. low dose xanomeline vs. placebo</a> &quot;GroupAssignment_high_dose_xanomeline_vs_low_dose_xanomeline_vs_placebo&quot;</p></blockquote><blockquote><p><b>variableDefinition</b></p><p><b>VariableDefinitionVariableRoleCode</b>: outcome</p><p><b>description</b>: CIBIC+ at 24 weeks</p><p><b>note</b>: outcome</p><p><b>variableRole</b>: Use extension:variableRoleCode instead. <span style="background: LightGoldenRodYellow; margin: 4px; border: 1px solid khaki"> (<a href="http://terminology.hl7.org/5.5.0/CodeSystem-variable-role.html">EvidenceVariableRole</a>#measuredVariable &quot;measured variable&quot;)</span></p></blockquote><blockquote><p><b>statistic</b></p><p><b>statisticType</b>: (mean treatment difference) <span style="background: LightGoldenRodYellow; margin: 4px; border: 1px solid khaki"> (<a href="http://terminology.hl7.org/5.5.0/CodeSystem-statistic-type.html">StatisticStatisticType</a>#0000457 &quot;Mean Difference&quot;)</span></p><blockquote><p><b>attributeEstimate</b></p><p><b>description</b>: p value for one-sided test</p><p><b>type</b>: p value for one-sided test <span style="background: LightGoldenRodYellow; margin: 4px; border: 1px solid khaki"> (<a href="CodeSystem-181513.html">Scientific Evidence Code System (SEVCO) -- EXAMPLE VERSION for EBMonFHIR Implementation Guide</a>#TBD:p-value-one-sided)</span></p></blockquote><blockquote><p><b>attributeEstimate</b></p><p><b>description</b>: p value for two-sided test</p><p><b>type</b>: p value for two-sided test <span style="background: LightGoldenRodYellow; margin: 4px; border: 1px solid khaki"> (<a href="CodeSystem-181513.html">Scientific Evidence Code System (SEVCO) -- EXAMPLE VERSION for EBMonFHIR Implementation Guide</a>#TBD:p-value-two-sided)</span></p></blockquote><blockquote><p><b>modelCharacteristic</b></p><p><b>StatisticModelIntended</b>: true</p><p><b>StatisticModelValueCodeableConcept</b>: In general, all patients will be included in all analyses of efficacy if they have a baseline measurement and at least one postrandomization measurement. <span style="background: LightGoldenRodYellow; margin: 4px; border: 1px solid khaki"> ()</span></p><p><b>code</b>: participant inclusion criteria for analysis <span style="background: LightGoldenRodYellow; margin: 4px; border: 1px solid khaki"> (<a href="CodeSystem-181513.html">Scientific Evidence Code System (SEVCO) -- EXAMPLE VERSION for EBMonFHIR Implementation Guide</a>#TBD:participant-inclusion-criteria-for-analysis)</span></p></blockquote><blockquote><p><b>modelCharacteristic</b></p><p><b>StatisticModelIntended</b>: true</p><p><b>StatisticModelValueCodeableConcept</b>: The primary analysis of efficacy will include only the data obtained up to and including the visit of discontinuation of study drug. Furthermore, the primary analysis will not include efficacy data obtained at any visit where the study drug was not administered in the preceding three days. <span style="background: LightGoldenRodYellow; margin: 4px; border: 1px solid khaki"> ()</span></p><p><b>code</b>: data inclusion criteria for analysis <span style="background: LightGoldenRodYellow; margin: 4px; border: 1px solid khaki"> (<a href="CodeSystem-181513.html">Scientific Evidence Code System (SEVCO) -- EXAMPLE VERSION for EBMonFHIR Implementation Guide</a>#TBD:data-inclusion-criteria-for-analysis)</span></p></blockquote><blockquote><p><b>modelCharacteristic</b></p><p><b>StatisticModelIntended</b>: true</p><p><b>StatisticModelValueCodeableConcept</b>: single imputation by last-observation-carried-forward (LOCF) <span style="background: LightGoldenRodYellow; margin: 4px; border: 1px solid khaki"> (<a href="CodeSystem-181513.html">Scientific Evidence Code System (SEVCO) -- EXAMPLE VERSION for EBMonFHIR Implementation Guide</a>#TBD:single-imputation-by-LOCF)</span></p><p><b>code</b>: handling of missing endpoint data <span style="background: LightGoldenRodYellow; margin: 4px; border: 1px solid khaki"> (<a href="CodeSystem-181513.html">Scientific Evidence Code System (SEVCO) -- EXAMPLE VERSION for EBMonFHIR Implementation Guide</a>#TBD:handling-of-missing-endpoint-data)</span></p></blockquote><blockquote><p><b>modelCharacteristic</b></p><p><b>StatisticModelIntended</b>: true</p><p><b>StatisticModelValueCodeableConcept</b>: The primary analysis of efficacy will include only the data obtained up to and including the visit of discontinuation of study drug. Furthermore, the primary analysis will not include efficacy data obtained at any visit where the study drug was not administered in the preceding three days. Analyses that include the retrieved dropouts are considered secondary. <span style="background: LightGoldenRodYellow; margin: 4px; border: 1px solid khaki"> ()</span></p><p><b>code</b>: data inclusion criteria for secondary analysis <span style="background: LightGoldenRodYellow; margin: 4px; border: 1px solid khaki"> (<a href="CodeSystem-181513.html">Scientific Evidence Code System (SEVCO) -- EXAMPLE VERSION for EBMonFHIR Implementation Guide</a>#TBD:data-inclusion-criteria-for-secondary-analysis)</span></p></blockquote><blockquote><p><b>modelCharacteristic</b></p><p><b>StatisticModelIntended</b>: true</p><p><b>code</b>: one-tailed test <span style="background: LightGoldenRodYellow; margin: 4px; border: 1px solid khaki"> (<a href="CodeSystem-181513.html">Scientific Evidence Code System (SEVCO) -- EXAMPLE VERSION for EBMonFHIR Implementation Guide</a>#STATO:0000286)</span></p></blockquote><blockquote><p><b>modelCharacteristic</b></p><p><b>StatisticModelIntended</b>: true</p><p><b>StatisticModelValueQuantity</b>: 0.025</p><p><b>code</b>: alpha setting <span style="background: LightGoldenRodYellow; margin: 4px; border: 1px solid khaki"> (<a href="CodeSystem-181513.html">Scientific Evidence Code System (SEVCO) -- EXAMPLE VERSION for EBMonFHIR Implementation Guide</a>#TBD:0000081)</span></p></blockquote><blockquote><p><b>modelCharacteristic</b></p><p><b>StatisticModelIntended</b>: true</p><p><b>StatisticModelValueQuantity</b>: 0.05</p><p><b>code</b>: threshold for marginal statistical significance <span style="background: LightGoldenRodYellow; margin: 4px; border: 1px solid khaki"> (<a href="CodeSystem-179423.html">Evidence Based Medicine on FHIR Implementation Guide Code System</a>#defined-in-text &quot;defined in text&quot;)</span></p></blockquote><blockquote><p><b>modelCharacteristic</b></p><p><b>StatisticModelIntended</b>: true</p><p><b>StatisticModelValueCodeableConcept</b>: xanomeline is equal or worse than placebo <span style="background: LightGoldenRodYellow; margin: 4px; border: 1px solid khaki"> ()</span></p><p><b>code</b>: null hypothesis <span style="background: LightGoldenRodYellow; margin: 4px; border: 1px solid khaki"> (<a href="CodeSystem-181513.html">Scientific Evidence Code System (SEVCO) -- EXAMPLE VERSION for EBMonFHIR Implementation Guide</a>#TBD:null-hypothesis)</span></p></blockquote><blockquote><p><b>modelCharacteristic</b></p><p><b>StatisticModelIntended</b>: true</p><p><b>StatisticModelValueCodeableConcept</b>: xanomeline has greater efficacy than placebo <span style="background: LightGoldenRodYellow; margin: 4px; border: 1px solid khaki"> ()</span></p><p><b>code</b>: alternative hypothesis <span style="background: LightGoldenRodYellow; margin: 4px; border: 1px solid khaki"> (<a href="CodeSystem-181513.html">Scientific Evidence Code System (SEVCO) -- EXAMPLE VERSION for EBMonFHIR Implementation Guide</a>#TBD:alternative-hypothesis)</span></p></blockquote><blockquote><p><b>modelCharacteristic</b></p><p><b>StatisticModelIntended</b>: true</p><p><b>StatisticModelValueCodeableConcept</b>: SAS <span style="background: LightGoldenRodYellow; margin: 4px; border: 1px solid khaki"> ()</span></p><p><b>code</b>: statistical software package <span style="background: LightGoldenRodYellow; margin: 4px; border: 1px solid khaki"> (<a href="CodeSystem-181513.html">Scientific Evidence Code System (SEVCO) -- EXAMPLE VERSION for EBMonFHIR Implementation Guide</a>#TBD:statistical-software-package)</span></p></blockquote><blockquote><p><b>modelCharacteristic</b></p><p><b>StatisticModelIntended</b>: true</p><p><b>code</b>: Sample Size/Power Calculation ~ 80% power to detect a 0.36 mean treatment difference in CIBIC+ (p&lt;.05, two-sided), based on a standard deviation of 0.9 and sample size of 100 patients in each of 3 groups <span style="background: LightGoldenRodYellow; margin: 4px; border: 1px solid khaki"> (<a href="CodeSystem-181513.html">Scientific Evidence Code System (SEVCO) -- EXAMPLE VERSION for EBMonFHIR Implementation Guide</a>#TBD:sample-size &quot;Sample size estimation&quot;)</span></p><blockquote><p><b>attributeEstimate</b></p><p><b>description</b>: 80% power</p><p><b>type</b>: power <span style="background: LightGoldenRodYellow; margin: 4px; border: 1px solid khaki"> (<a href="CodeSystem-181513.html">Scientific Evidence Code System (SEVCO) -- EXAMPLE VERSION for EBMonFHIR Implementation Guide</a>#TBD:power &quot;Power&quot;)</span></p><p><b>quantity</b>: 80 %<span style="background: LightGoldenRodYellow"> (Details: UCUM code % = '%')</span></p></blockquote><blockquote><p><b>attributeEstimate</b></p><p><b>description</b>: minimally detectable threshold value 0.36</p><p><b>type</b>: minimally detectable threshold value <span style="background: LightGoldenRodYellow; margin: 4px; border: 1px solid khaki"> (<a href="CodeSystem-181513.html">Scientific Evidence Code System (SEVCO) -- EXAMPLE VERSION for EBMonFHIR Implementation Guide</a>#TBD:checkIfInSTATOtesting-margin &quot;Hypothesis testing margin&quot;)</span></p><p><b>quantity</b>: 0.36</p></blockquote><blockquote><p><b>attributeEstimate</b></p><p><b>description</b>: p&lt;.05</p><p><b>type</b>: alpha setting <span style="background: LightGoldenRodYellow; margin: 4px; border: 1px solid khaki"> (<a href="CodeSystem-181513.html">Scientific Evidence Code System (SEVCO) -- EXAMPLE VERSION for EBMonFHIR Implementation Guide</a>#TBD:0000081)</span></p><p><b>quantity</b>: 0.05</p></blockquote><blockquote><p><b>attributeEstimate</b></p><p><b>description</b>: standard deviation of 0.9</p><p><b>type</b>: Standard deviation <span style="background: LightGoldenRodYellow; margin: 4px; border: 1px solid khaki"> (<a href="CodeSystem-181513.html">Scientific Evidence Code System (SEVCO) -- EXAMPLE VERSION for EBMonFHIR Implementation Guide</a>#STATO:0000237)</span></p><p><b>quantity</b>: 0.9</p></blockquote><blockquote><p><b>attributeEstimate</b></p><p><b>description</b>: sample size of 100 patients in each of 3 groups</p><p><b>type</b>: sample size per group <span style="background: LightGoldenRodYellow; margin: 4px; border: 1px solid khaki"> (<a href="CodeSystem-181513.html">Scientific Evidence Code System (SEVCO) -- EXAMPLE VERSION for EBMonFHIR Implementation Guide</a>#TBD:sample-size-per-group)</span></p><p><b>quantity</b>: 100</p></blockquote><blockquote><p><b>attributeEstimate</b></p><p><b>description</b>: two-tailed test</p><p><b>type</b>: two-tailed test <span style="background: LightGoldenRodYellow; margin: 4px; border: 1px solid khaki"> (<a href="CodeSystem-181513.html">Scientific Evidence Code System (SEVCO) -- EXAMPLE VERSION for EBMonFHIR Implementation Guide</a>#STATO:0000287)</span></p></blockquote><blockquote><p><b>attributeEstimate</b></p><p><b>description</b>: sample permutation testing - Because there will be roughly 300!/(3 * 100!) possible permutations of the data, random data permutations will be sampled (10,000 random permutations).  -- distribution assumption for comparison if random</p><p><b>type</b>: prospective sample permutation testing <span style="background: LightGoldenRodYellow; margin: 4px; border: 1px solid khaki"> (<a href="CodeSystem-181513.html">Scientific Evidence Code System (SEVCO) -- EXAMPLE VERSION for EBMonFHIR Implementation Guide</a>#TBD:prospective-sample-permutation-testing)</span></p><blockquote><p><b>attributeEstimate</b></p></blockquote><blockquote><p><b>attributeEstimate</b></p></blockquote></blockquote></blockquote><blockquote><p><b>modelCharacteristic</b></p><p><b>StatisticModelIntended</b>: true</p><p><b>StatisticModelValueCodeableConcept</b>: analysis of variance (ANOVA) <span style="background: LightGoldenRodYellow; margin: 4px; border: 1px solid khaki"> (<a href="CodeSystem-181513.html">Scientific Evidence Code System (SEVCO) -- EXAMPLE VERSION for EBMonFHIR Implementation Guide</a>#TBD:0000146 &quot;ANOVA&quot;)</span></p><p><b>code</b>: Primary analytic method <span style="background: LightGoldenRodYellow; margin: 4px; border: 1px solid khaki"> (<a href="CodeSystem-181513.html">Scientific Evidence Code System (SEVCO) -- EXAMPLE VERSION for EBMonFHIR Implementation Guide</a>#TBD:primary-analytic-method &quot;primary analytic method&quot;)</span></p><blockquote><p><b>variable</b></p><p><b>variableDefinition</b>: <a href="EvidenceVariable-159673.html">EvidenceVariable/159673: investigator</a> &quot;Investigator&quot;</p><p><b>handling</b>: polychotomous</p></blockquote><blockquote><p><b>variable</b></p><p><b>variableDefinition</b>: <span>: treatment</span></p><p><b>handling</b>: ordinal</p><p><b>valueCategory</b>: high dose xanomeline <span style="background: LightGoldenRodYellow; margin: 4px; border: 1px solid khaki"> ()</span>, low dose xanomeline <span style="background: LightGoldenRodYellow; margin: 4px; border: 1px solid khaki"> ()</span>, placebo <span style="background: LightGoldenRodYellow; margin: 4px; border: 1px solid khaki"> ()</span></p></blockquote><blockquote><p><b>variable</b></p><blockquote><p><b>StatisticModelIncludeIf</b></p><blockquote><p><b>url</b></p><code>attribute</code></blockquote><p><b>value</b>: p value for F test <span style="background: LightGoldenRodYellow; margin: 4px; border: 1px solid khaki"> ()</span></p><blockquote><p><b>url</b></p><code>value</code></blockquote><p><b>value</b>: &lt;0.1</p></blockquote><p><b>variableDefinition</b>: <a href="EvidenceVariable-156673.html">EvidenceVariable/156673: Investigator-by-treatment interaction</a> &quot;Investigator_by_treatment_interaction_for_ADAS_Cog11_ANCOVA&quot;</p><p><b>handling</b>: polychotomous</p></blockquote></blockquote><blockquote><p><b>modelCharacteristic</b></p><blockquote><p><b>StatisticModelIncludeIf</b></p><blockquote><p><b>url</b></p><code>attribute</code></blockquote><p><b>value</b>: Defined by Expression <span style="background: LightGoldenRodYellow; margin: 4px; border: 1px solid khaki"> ()</span></p><blockquote><p><b>url</b></p><code>value</code></blockquote><p><b>value</b>: <span title="TBD-rewrite in CQL or FHIRPath"><code>Evidence[id='171171'].statistic[statisticType='F test'].attributeEstimate[type='p value'].quantity &lt; 0.1</code></span>(&quot;When the Investigator-by-treatment interaction (p value for F test) is significant at the 0.1 level&quot;)</p></blockquote><p><b>StatisticModelIntended</b>: true</p><p><b>StatisticModelValueCodeableConcept</b>: the data will be examined for each individual investigator [EvidenceVariable/159673] to attempt to identify the source of the significant interaction. <span style="background: LightGoldenRodYellow; margin: 4px; border: 1px solid khaki"> (<a href="CodeSystem-181513.html">Scientific Evidence Code System (SEVCO) -- EXAMPLE VERSION for EBMonFHIR Implementation Guide</a>#TBD:identify-source-of-interaction &quot;identify source(s) of significant interaction&quot;)</span></p><p><b>code</b>: additional investigation <span style="background: LightGoldenRodYellow; margin: 4px; border: 1px solid khaki"> (<a href="CodeSystem-179423.html">Evidence Based Medicine on FHIR Implementation Guide Code System</a>#defined-in-text &quot;defined in text&quot;)</span></p><h3>Variables</h3><table class="grid"><tr><td style="display: none">-</td><td><b>VariableDefinition</b></td><td><b>Handling</b></td></tr><tr><td style="display: none">*</td><td><a href="EvidenceVariable-159673.html">EvidenceVariable/159673: investigator</a> &quot;Investigator&quot;</td><td>polychotomous</td></tr></table></blockquote><blockquote><p><b>modelCharacteristic</b></p><blockquote><p><b>StatisticModelIncludeIf</b></p><blockquote><p><b>url</b></p><code>attribute</code></blockquote><p><b>value</b>: Defined by Expression <span style="background: LightGoldenRodYellow; margin: 4px; border: 1px solid khaki"> ()</span></p><blockquote><p><b>url</b></p><code>value</code></blockquote><p><b>value</b>: <span title="TBD-rewrite in CQL or FHIRPath"><code>(Evidence[id='171172'].statistic[statisticType='Shapiro-Wilk test'].attributeEstimate[type='p value'].quantity &lt; 0.05), using SAS PROC UNIVARIATE</code></span>(&quot;residuals are nonnormally distributed using the Shapiro-Wilk test from PROC UNIVARIATE&quot;)</p></blockquote><p><b>StatisticModelIntended</b>: true</p><p><b>StatisticModelValueCodeableConcept</b>: Analyses will also be conducted on the ranked data. This rank transformation will be applied by ranking all the data for a particular variable, across all investigators and treatments, from lowest to highest. Integer ranks will be assigned starting at 1; mean ranks will be assigned when ties occur.. <span style="background: LightGoldenRodYellow; margin: 4px; border: 1px solid khaki"> ()</span></p><p><b>code</b>: rank-based analytic method <span style="background: LightGoldenRodYellow; margin: 4px; border: 1px solid khaki"> (<a href="CodeSystem-181513.html">Scientific Evidence Code System (SEVCO) -- EXAMPLE VERSION for EBMonFHIR Implementation Guide</a>#TBD:rank-based-analytic-method)</span></p></blockquote></blockquote></div>
  </text>
  <url value="https://fevir.net/resources/Evidence/179690"/>
  <identifier>
    <type>
      <coding>
        <system value="http://terminology.hl7.org/CodeSystem/v2-0203"/>
        <code value="ACSN"/>
        <display value="Accession ID"/>
      </coding>
      <text value="FEvIR Object Identifier"/>
    </type>
    <system value="https://fevir.net"/>
    <value value="179690"/>
    <assigner>
      <display value="Computable Publishing LLC"/>
    </assigner>
  </identifier>
  <version value="1.0.0-ballot"/>
  <name
        value="CIBIC_EndpointAnalysisPlan_from_PHUSE_Lilly_Redacted_Protocol_EBMonFHIR_IG_Version"/>
  <title
         value="CIBIC+ EndpointAnalysisPlan from PHUSE Lilly Redacted Protocol - EBMonFHIR IG Version"/>
  <status value="active"/>
  <date value="2024-05-16T12:17:54+00:00"/>
  <publisher value="HL7 International / Clinical Decision Support"/>
  <contact>
    <name value="HL7 International / Clinical Decision Support"/>
    <telecom>
      <system value="url"/>
      <value value="http://www.hl7.org/Special/committees/dss"/>
    </telecom>
  </contact>
  <author>
    <name value="Brian S. Alper"/>
  </author>
  <useContext>
    <code>
      <system value="https://fevir.net/resources/CodeSystem/179423"/>
      <code value="evidence-communication"/>
      <display value="Evidence Communication"/>
    </code>
    <valueCodeableConcept>
      <coding>
        <system value="https://fevir.net/resources/CodeSystem/179423"/>
        <code value="EndpointAnalysisPlan"/>
        <display value="EndpointAnalysisPlan"/>
      </coding>
    </valueCodeableConcept>
  </useContext>
  <copyright value="https://creativecommons.org/licenses/by-nc-sa/4.0/"/>
  <relatedArtifact>
    <type value="cite-as"/>
    <citation
              value="CIBIC+ EndpointAnalysisPlan from PHUSE Lilly Redacted Protocol - EBMonFHIR IG Version [Evidence]. Contributors: Brian S. Alper [Authors/Creators]. In: Fast Evidence Interoperability Resources (FEvIR) Platform, FOI 179690. Revised 2023-12-04. Available at: https://fevir.net/resources/Evidence/179690. Computable resource at: https://fevir.net/resources/Evidence/179690."/>
  </relatedArtifact>
  <relatedArtifact>
    <type value="supported-with"/>
    <display value="Protocol attachment in associated Evidence Resource"/>
    <resourceReference>🔗 
      <reference value="Evidence/179691"/>
      <type value="Evidence"/>
      <display
               value="Example EndpointAnalysisPlan from PHUSE Lilly Redacted Protocol - EBMonFHIR IG Version"/>
    </resourceReference>
  </relatedArtifact>
  <description
               value="An example of an EndpointAnalysisPlan Profile which uses intended='true' and include-if extensions within Evidence.statistic.modelCharacteristic elements."/>
  <note>
    <text
          value="Approximately 100 patients will be randomized to each of the 3 treatment groups (high dose, low dose, and placebo). Previous experience with the oral formulation of xanomeline suggests that this sample size has 90% power to detect a 3.0 mean treatment difference in ADAS-Cog (p&lt;.05, twosided), based on a standard deviation of 6.5. Furthermore, this sample size has 80% power to detect a 0.36 mean treatment difference in CIBIC+ (p&lt;.05, two-sided), based on a standard deviation of 0.9

Group mean changes from baseline in the primary efficacy parameters will serve as efficacy criteria.

The primary analysis of efficacy will include only the data obtained up to and including the visit of discontinuation of study drug. Furthermore, the primary analysis will not include efficacy data obtained at any visit where the study drug was not administered in the preceding three days. Analyses that include the retrieved dropouts are considered secondary. In general, all patients will be included in all analyses of efficacy if they have a baseline measurement and at least one postrandomization measurement.

The primary analysis of ADAS-Cog (11) and CIBIC+ will be the 24-week endpoint, which is defined for each patient and variable as the last measurement obtained postrandomization (prior to protocol defined reduction in dose). a last-observation-carried-forward (LOCF). Note that the LOCF analysis at 24 weeks is the same as the endpoint analysis described previously. 

CIBIC+ will be analyzed by analysis of variance (ANOVA), with effects in the model being investigator and treatment. Investigator-by-treatment interaction will be tested in a full model prior to conducting the primary ANOVA (see description below). Because 3 treatment groups are involved, the primary analysis will be the test for linear dose response in the ANCOVA model described in the preceding paragraph. The result is then a single p-value for CIBIC+. 

Investigator-by-treatment interaction will be tested in a full ANOVA model, which takes the models described above, and adds the interaction term to the model. Interaction will be tested at α = .10 level. When the interaction is significant at this level, the data will be examined for each individual investigator to attempt to identify the source of the significant interaction. When the interaction is not significant, this term will be dropped from the model as described above, to test for investigator and treatment main effects. By doing so, all ANCOVA and ANOVA models will be able to validly test for treatment differences without weighting each investigator equally, which is what occurs when using Type III sums of squares (cell means model) with the interaction term present in the model. This equal weighting of investigators can become a serious problem when sample sizes are dramatically different between investigators. 

For all ANOVA and ANCOVA models, data collected from investigators who enrolled fewer than 3 patients in any one treatment group will be combined prior to analysis. If this combination still results in a treatment group having fewer than 3 patients in any one treatment group, then this group of patients will be combined with the next fewestenrolling investigator. In the event that there is a tie for fewest-enrolling investigator, one of these will be chosen at random by a random-number generator.

The inherent assumption of normally distributed data will be evaluated by generating output for the residuals from the full ANCOVA and ANOVA models, which include the interaction term, and by testing for normality using the Shapiro-Wilk test from PROC UNIVARIATE. In the event that the data are predominantly nonnormally distributed, analyses will also be conducted on the ranked data. This rank transformation will be applied by ranking all the data for a particular variable, across all investigators and treatments, from lowest to highest. Integer ranks will be assigned starting at 1; mean ranks will be assigned when ties occur. 

All comparisons between xanomeline and placebo with respect to efficacy variables should be one-sided. The null hypothesis is that the drug is equal or worse than placebo. The alternative
hypothesis is that the drug has greater efficacy than placebo. 

Different regulatory agencies require different type I error rates. Treatment differences that are significant at the .025 α-level will be declared to be “statistically significant.” When a computed p-value falls between .025 and .05, the differences will be described as “marginally statistically significant.” This approach satisfies regulatory agencies who have accepted a one-sided test at the .05 level, and other regulatory agencies who have requested a two-sided test at the .05 level, or equivalently, a one-sided test at the .025 level. In order to facilitate the review of the final study report, two-sided p-values will be presented in addition to the one-sided p-values."/>
  </note>
  <variableDefinition>
    <extension
               url="http://hl7.org/fhir/uv/ebm/StructureDefinition/variable-definition-variable-role-code">
      <valueCode value="exposure"/>
    </extension>
    <extension
               url="http://hl7.org/fhir/uv/ebm/StructureDefinition/variable-definition-comparator-category">
      <valueString value="placebo"/>
    </extension>
    <description
                 value="high dose xanomeline vs. low dose xanomeline vs. placebo"/>
    <note>
      <text value="exposure"/>
    </note>
    <variableRole>
      <coding>
        <system value="http://terminology.hl7.org/CodeSystem/variable-role"/>
        <code value="exposure"/>
        <display value="exposure"/>
      </coding>
      <text value="Use extension:variableRoleCode instead."/>
    </variableRole>
    <observed>🔗 
      <reference value="EvidenceVariable/179689"/>
      <type value="EvidenceVariable"/>
      <display
               value="GroupAssignment: high dose xanomeline vs. low dose xanomeline vs. placebo"/>
    </observed>
  </variableDefinition>
  <variableDefinition>
    <extension
               url="http://hl7.org/fhir/uv/ebm/StructureDefinition/variable-definition-variable-role-code">
      <valueCode value="outcome"/>
    </extension>
    <description value="CIBIC+ at 24 weeks"/>
    <note>
      <text value="outcome"/>
    </note>
    <variableRole>
      <coding>
        <system value="http://terminology.hl7.org/CodeSystem/variable-role"/>
        <code value="measuredVariable"/>
        <display value="measured variable"/>
      </coding>
      <text value="Use extension:variableRoleCode instead."/>
    </variableRole>
  </variableDefinition>
  <statistic>
    <statisticType>
      <coding>
        <system value="http://terminology.hl7.org/CodeSystem/statistic-type"/>
        <code value="0000457"/>
        <display value="Mean Difference"/>
      </coding>
      <text value="(mean treatment difference)"/>
    </statisticType>
    <attributeEstimate>
      <description value="p value for one-sided test"/>
      <type>
        <coding>
          <system value="https://fevir.net/resources/CodeSystem/181513"/>
          <code value="TBD:p-value-one-sided"/>
          <display value="p value for one-sided test"/>
        </coding>
        <text value="p value for one-sided test"/>
      </type>
    </attributeEstimate>
    <attributeEstimate>
      <description value="p value for two-sided test"/>
      <type>
        <coding>
          <system value="https://fevir.net/resources/CodeSystem/181513"/>
          <code value="TBD:p-value-two-sided"/>
          <display value="p value for two-sided test"/>
        </coding>
        <text value="p value for two-sided test"/>
      </type>
    </attributeEstimate>
    <modelCharacteristic>
      <extension
                 url="http://hl7.org/fhir/uv/ebm/StructureDefinition/statistic-model-intended">
        <valueBoolean value="true"/>
      </extension>
      <extension
                 url="http://hl7.org/fhir/uv/ebm/StructureDefinition/statistic-model-value-codeableconcept">
        <valueCodeableConcept>
          <text
                value="In general, all patients will be included in all analyses of efficacy if they have a baseline measurement and at least one postrandomization measurement."/>
        </valueCodeableConcept>
      </extension>
      <code>
        <coding>
          <system value="https://fevir.net/resources/CodeSystem/181513"/>
          <code value="TBD:participant-inclusion-criteria-for-analysis"/>
          <display value="participant inclusion criteria for analysis"/>
        </coding>
        <text value="participant inclusion criteria for analysis"/>
      </code>
    </modelCharacteristic>
    <modelCharacteristic>
      <extension
                 url="http://hl7.org/fhir/uv/ebm/StructureDefinition/statistic-model-intended">
        <valueBoolean value="true"/>
      </extension>
      <extension
                 url="http://hl7.org/fhir/uv/ebm/StructureDefinition/statistic-model-value-codeableconcept">
        <valueCodeableConcept>
          <text
                value="The primary analysis of efficacy will include only the data obtained up to and including the visit of discontinuation of study drug. Furthermore, the primary analysis will not include efficacy data obtained at any visit where the study drug was not administered in the preceding three days."/>
        </valueCodeableConcept>
      </extension>
      <code>
        <coding>
          <system value="https://fevir.net/resources/CodeSystem/181513"/>
          <code value="TBD:data-inclusion-criteria-for-analysis"/>
          <display value="data inclusion criteria for analysis"/>
        </coding>
        <text value="data inclusion criteria for analysis"/>
      </code>
    </modelCharacteristic>
    <modelCharacteristic>
      <extension
                 url="http://hl7.org/fhir/uv/ebm/StructureDefinition/statistic-model-intended">
        <valueBoolean value="true"/>
      </extension>
      <extension
                 url="http://hl7.org/fhir/uv/ebm/StructureDefinition/statistic-model-value-codeableconcept">
        <valueCodeableConcept>
          <coding>
            <system value="https://fevir.net/resources/CodeSystem/181513"/>
            <code value="TBD:single-imputation-by-LOCF"/>
            <display
                     value="single imputation by last-observation-carried-forward (LOCF)"/>
          </coding>
          <text
                value="single imputation by last-observation-carried-forward (LOCF)"/>
        </valueCodeableConcept>
      </extension>
      <code>
        <coding>
          <system value="https://fevir.net/resources/CodeSystem/181513"/>
          <code value="TBD:handling-of-missing-endpoint-data"/>
          <display value="handling of missing endpoint data"/>
        </coding>
        <text value="handling of missing endpoint data"/>
      </code>
    </modelCharacteristic>
    <modelCharacteristic>
      <extension
                 url="http://hl7.org/fhir/uv/ebm/StructureDefinition/statistic-model-intended">
        <valueBoolean value="true"/>
      </extension>
      <extension
                 url="http://hl7.org/fhir/uv/ebm/StructureDefinition/statistic-model-value-codeableconcept">
        <valueCodeableConcept>
          <text
                value="The primary analysis of efficacy will include only the data obtained up to and including the visit of discontinuation of study drug. Furthermore, the primary analysis will not include efficacy data obtained at any visit where the study drug was not administered in the preceding three days. Analyses that include the retrieved dropouts are considered secondary."/>
        </valueCodeableConcept>
      </extension>
      <code>
        <coding>
          <system value="https://fevir.net/resources/CodeSystem/181513"/>
          <code value="TBD:data-inclusion-criteria-for-secondary-analysis"/>
          <display value="data inclusion criteria for secondary analysis"/>
        </coding>
        <text value="data inclusion criteria for secondary analysis"/>
      </code>
    </modelCharacteristic>
    <modelCharacteristic>
      <extension
                 url="http://hl7.org/fhir/uv/ebm/StructureDefinition/statistic-model-intended">
        <valueBoolean value="true"/>
      </extension>
      <code>
        <coding>
          <system value="https://fevir.net/resources/CodeSystem/181513"/>
          <code value="STATO:0000286"/>
          <display value="one-tailed test"/>
        </coding>
      </code>
    </modelCharacteristic>
    <modelCharacteristic>
      <extension
                 url="http://hl7.org/fhir/uv/ebm/StructureDefinition/statistic-model-intended">
        <valueBoolean value="true"/>
      </extension>
      <extension
                 url="http://hl7.org/fhir/uv/ebm/StructureDefinition/statistic-model-value-quantity">
        <valueQuantity>
          <value value="0.025"/>
        </valueQuantity>
      </extension>
      <code>
        <coding>
          <system value="https://fevir.net/resources/CodeSystem/181513"/>
          <code value="TBD:0000081"/>
          <display value="alpha setting"/>
        </coding>
      </code>
    </modelCharacteristic>
    <modelCharacteristic>
      <extension
                 url="http://hl7.org/fhir/uv/ebm/StructureDefinition/statistic-model-intended">
        <valueBoolean value="true"/>
      </extension>
      <extension
                 url="http://hl7.org/fhir/uv/ebm/StructureDefinition/statistic-model-value-quantity">
        <valueQuantity>
          <value value="0.05"/>
        </valueQuantity>
      </extension>
      <code>
        <coding>
          <system value="https://fevir.net/resources/CodeSystem/179423"/>
          <code value="defined-in-text"/>
          <display value="defined in text"/>
        </coding>
        <text value="threshold for marginal statistical significance"/>
      </code>
    </modelCharacteristic>
    <modelCharacteristic>
      <extension
                 url="http://hl7.org/fhir/uv/ebm/StructureDefinition/statistic-model-intended">
        <valueBoolean value="true"/>
      </extension>
      <extension
                 url="http://hl7.org/fhir/uv/ebm/StructureDefinition/statistic-model-value-codeableconcept">
        <valueCodeableConcept>
          <text value="xanomeline is equal or worse than placebo"/>
        </valueCodeableConcept>
      </extension>
      <code>
        <coding>
          <system value="https://fevir.net/resources/CodeSystem/181513"/>
          <code value="TBD:null-hypothesis"/>
          <display value="null hypothesis"/>
        </coding>
        <text value="null hypothesis"/>
      </code>
    </modelCharacteristic>
    <modelCharacteristic>
      <extension
                 url="http://hl7.org/fhir/uv/ebm/StructureDefinition/statistic-model-intended">
        <valueBoolean value="true"/>
      </extension>
      <extension
                 url="http://hl7.org/fhir/uv/ebm/StructureDefinition/statistic-model-value-codeableconcept">
        <valueCodeableConcept>
          <text value="xanomeline has greater efficacy than placebo"/>
        </valueCodeableConcept>
      </extension>
      <code>
        <coding>
          <system value="https://fevir.net/resources/CodeSystem/181513"/>
          <code value="TBD:alternative-hypothesis"/>
          <display value="alternative hypothesis"/>
        </coding>
        <text value="alternative hypothesis"/>
      </code>
    </modelCharacteristic>
    <modelCharacteristic>
      <extension
                 url="http://hl7.org/fhir/uv/ebm/StructureDefinition/statistic-model-intended">
        <valueBoolean value="true"/>
      </extension>
      <extension
                 url="http://hl7.org/fhir/uv/ebm/StructureDefinition/statistic-model-value-codeableconcept">
        <valueCodeableConcept>
          <text value="SAS"/>
        </valueCodeableConcept>
      </extension>
      <code>
        <coding>
          <system value="https://fevir.net/resources/CodeSystem/181513"/>
          <code value="TBD:statistical-software-package"/>
          <display value="statistical software package"/>
        </coding>
        <text value="statistical software package"/>
      </code>
    </modelCharacteristic>
    <modelCharacteristic>
      <extension
                 url="http://hl7.org/fhir/uv/ebm/StructureDefinition/statistic-model-intended">
        <valueBoolean value="true"/>
      </extension>
      <code>
        <coding>
          <system value="https://fevir.net/resources/CodeSystem/181513"/>
          <code value="TBD:sample-size"/>
          <display value="Sample size estimation"/>
        </coding>
        <text
              value="Sample Size/Power Calculation ~ 80% power to detect a 0.36 mean treatment difference in CIBIC+ (p&lt;.05, two-sided), based on a standard deviation of 0.9 and sample size of 100 patients in each of 3 groups"/>
      </code>
      <attributeEstimate>
        <description value="80% power"/>
        <type>
          <coding>
            <system value="https://fevir.net/resources/CodeSystem/181513"/>
            <code value="TBD:power"/>
            <display value="Power"/>
          </coding>
          <text value="power"/>
        </type>
        <quantity>
          <value value="80"/>
          <unit value="%"/>
          <system value="http://unitsofmeasure.org"/>
          <code value="%"/>
        </quantity>
      </attributeEstimate>
      <attributeEstimate>
        <description value="minimally detectable threshold value 0.36"/>
        <type>
          <coding>
            <system value="https://fevir.net/resources/CodeSystem/181513"/>
            <code value="TBD:checkIfInSTATOtesting-margin"/>
            <display value="Hypothesis testing margin"/>
          </coding>
          <text value="minimally detectable threshold value"/>
        </type>
        <quantity>
          <value value="0.36"/>
        </quantity>
      </attributeEstimate>
      <attributeEstimate>
        <description value="p&lt;.05"/>
        <type>
          <coding>
            <system value="https://fevir.net/resources/CodeSystem/181513"/>
            <code value="TBD:0000081"/>
            <display value="alpha setting"/>
          </coding>
        </type>
        <quantity>
          <value value="0.05"/>
        </quantity>
      </attributeEstimate>
      <attributeEstimate>
        <description value="standard deviation of 0.9"/>
        <type>
          <coding>
            <system value="https://fevir.net/resources/CodeSystem/181513"/>
            <code value="STATO:0000237"/>
            <display value="Standard deviation"/>
          </coding>
        </type>
        <quantity>
          <value value="0.9"/>
        </quantity>
      </attributeEstimate>
      <attributeEstimate>
        <description value="sample size of 100 patients in each of 3 groups"/>
        <type>
          <coding>
            <system value="https://fevir.net/resources/CodeSystem/181513"/>
            <code value="TBD:sample-size-per-group"/>
            <display value="sample size per group"/>
          </coding>
        </type>
        <quantity>
          <value value="100"/>
        </quantity>
      </attributeEstimate>
      <attributeEstimate>
        <description value="two-tailed test"/>
        <type>
          <coding>
            <system value="https://fevir.net/resources/CodeSystem/181513"/>
            <code value="STATO:0000287"/>
            <display value="two-tailed test"/>
          </coding>
        </type>
      </attributeEstimate>
      <attributeEstimate>
        <description
                     value="sample permutation testing - Because there will be roughly 300!/(3 * 100!) possible permutations of the data, random data permutations will be sampled (10,000 random permutations).  -- distribution assumption for comparison if random"/>
        <type>
          <coding>
            <system value="https://fevir.net/resources/CodeSystem/181513"/>
            <code value="TBD:prospective-sample-permutation-testing"/>
            <display value="prospective sample permutation testing"/>
          </coding>
          <text value="prospective sample permutation testing"/>
        </type>
        <attributeEstimate>
          <type>
            <coding>
              <system value="https://fevir.net/resources/CodeSystem/181513"/>
              <code value="TBD:number-of-permutations-sampled"/>
              <display value="number of permutations sampled"/>
            </coding>
            <text value="number of permutations sampled"/>
          </type>
          <quantity>
            <value value="10000"/>
          </quantity>
        </attributeEstimate>
        <attributeEstimate>
          <type>
            <coding>
              <system value="https://fevir.net/resources/CodeSystem/179423"/>
              <code value="defined-in-text"/>
              <display value="defined in text"/>
            </coding>
            <text value="allocation ratio 1:1:1"/>
          </type>
        </attributeEstimate>
      </attributeEstimate>
    </modelCharacteristic>
    <modelCharacteristic>
      <extension
                 url="http://hl7.org/fhir/uv/ebm/StructureDefinition/statistic-model-intended">
        <valueBoolean value="true"/>
      </extension>
      <extension
                 url="http://hl7.org/fhir/uv/ebm/StructureDefinition/statistic-model-value-codeableconcept">
        <valueCodeableConcept>
          <coding>
            <system value="https://fevir.net/resources/CodeSystem/181513"/>
            <code value="TBD:0000146"/>
            <display value="ANOVA"/>
          </coding>
          <text value="analysis of variance (ANOVA)"/>
        </valueCodeableConcept>
      </extension>
      <code>
        <coding>
          <system value="https://fevir.net/resources/CodeSystem/181513"/>
          <code value="TBD:primary-analytic-method"/>
          <display value="primary analytic method"/>
        </coding>
        <text value="Primary analytic method"/>
      </code>
      <variable>
        <variableDefinition>🔗 
          <reference value="EvidenceVariable/159673"/>
          <type value="EvidenceVariable"/>
          <display value="investigator"/>
        </variableDefinition>
        <handling value="polychotomous"/>
      </variable>
      <variable>
        <variableDefinition>
          <display value="treatment"/>
        </variableDefinition>
        <handling value="ordinal"/>
        <valueCategory>
          <text value="high dose xanomeline"/>
        </valueCategory>
        <valueCategory>
          <text value="low dose xanomeline"/>
        </valueCategory>
        <valueCategory>
          <text value="placebo"/>
        </valueCategory>
      </variable>
      <variable>
        <extension
                   url="http://hl7.org/fhir/uv/ebm/StructureDefinition/statistic-model-include-if">
          <extension url="attribute">
            <valueCodeableConcept>
              <text value="p value for F test"/>
            </valueCodeableConcept>
          </extension>
          <extension url="value">
            <valueQuantity>
              <value value="0.1"/>
              <comparator value="&lt;"/>
            </valueQuantity>
          </extension>
        </extension>
        <variableDefinition>🔗 
          <reference value="EvidenceVariable/156673"/>
          <type value="EvidenceVariable"/>
          <display value="Investigator-by-treatment interaction"/>
        </variableDefinition>
        <handling value="polychotomous"/>
      </variable>
    </modelCharacteristic>
    <modelCharacteristic>
      <extension
                 url="http://hl7.org/fhir/uv/ebm/StructureDefinition/statistic-model-include-if">
        <extension url="attribute">
          <valueCodeableConcept>
            <text value="Defined by Expression"/>
          </valueCodeableConcept>
        </extension>
        <extension url="value">
          <valueExpression>
            <description
                         value="When the Investigator-by-treatment interaction (p value for F test) is significant at the 0.1 level"/>
            <language value="TBD-rewrite in CQL or FHIRPath"/>
            <expression
                        value="Evidence[id='171171'].statistic[statisticType='F test'].attributeEstimate[type='p value'].quantity &lt; 0.1"/>
          </valueExpression>
        </extension>
      </extension>
      <extension
                 url="http://hl7.org/fhir/uv/ebm/StructureDefinition/statistic-model-intended">
        <valueBoolean value="true"/>
      </extension>
      <extension
                 url="http://hl7.org/fhir/uv/ebm/StructureDefinition/statistic-model-value-codeableconcept">
        <valueCodeableConcept>
          <coding>
            <system value="https://fevir.net/resources/CodeSystem/181513"/>
            <code value="TBD:identify-source-of-interaction"/>
            <display value="identify source(s) of significant interaction"/>
          </coding>
          <text
                value="the data will be examined for each individual investigator [EvidenceVariable/159673] to attempt to identify the source of the significant interaction."/>
        </valueCodeableConcept>
      </extension>
      <code>
        <coding>
          <system value="https://fevir.net/resources/CodeSystem/179423"/>
          <code value="defined-in-text"/>
          <display value="defined in text"/>
        </coding>
        <text value="additional investigation"/>
      </code>
      <variable>
        <variableDefinition>🔗 
          <reference value="EvidenceVariable/159673"/>
          <type value="EvidenceVariable"/>
          <display value="investigator"/>
        </variableDefinition>
        <handling value="polychotomous"/>
      </variable>
    </modelCharacteristic>
    <modelCharacteristic>
      <extension
                 url="http://hl7.org/fhir/uv/ebm/StructureDefinition/statistic-model-include-if">
        <extension url="attribute">
          <valueCodeableConcept>
            <text value="Defined by Expression"/>
          </valueCodeableConcept>
        </extension>
        <extension url="value">
          <valueExpression>
            <description
                         value="residuals are nonnormally distributed using the Shapiro-Wilk test from PROC UNIVARIATE"/>
            <language value="TBD-rewrite in CQL or FHIRPath"/>
            <expression
                        value="(Evidence[id='171172'].statistic[statisticType='Shapiro-Wilk test'].attributeEstimate[type='p value'].quantity &lt; 0.05), using SAS PROC UNIVARIATE"/>
          </valueExpression>
        </extension>
      </extension>
      <extension
                 url="http://hl7.org/fhir/uv/ebm/StructureDefinition/statistic-model-intended">
        <valueBoolean value="true"/>
      </extension>
      <extension
                 url="http://hl7.org/fhir/uv/ebm/StructureDefinition/statistic-model-value-codeableconcept">
        <valueCodeableConcept>
          <text
                value="Analyses will also be conducted on the ranked data. This rank transformation will be applied by ranking all the data for a particular variable, across all investigators and treatments, from lowest to highest. Integer ranks will be assigned starting at 1; mean ranks will be assigned when ties occur.."/>
        </valueCodeableConcept>
      </extension>
      <code>
        <coding>
          <system value="https://fevir.net/resources/CodeSystem/181513"/>
          <code value="TBD:rank-based-analytic-method"/>
          <display value="rank-based analytic method"/>
        </coding>
      </code>
    </modelCharacteristic>
  </statistic>
</Evidence>