Evidence Based Medicine on FHIR Implementation Guide
2.0.0-ballot - ballot
Evidence Based Medicine on FHIR Implementation Guide
2.0.0-ballot - ballot
Evidence Based Medicine on FHIR Implementation Guide, published by HL7 International / Clinical Decision Support. This guide is not an authorized publication; it is the continuous build for version 2.0.0-ballot built by the FHIR (HL7® FHIR® Standard) CI Build. This version is based on the current content of https://github.com/HL7/ebm/ and changes regularly. See the Directory of published versions
<ArtifactAssessment xmlns="http://hl7.org/fhir">
<id value="179692"/>
<meta>
<versionId value="5"/>
<lastUpdated value="2023-12-08T00:46:44.190Z"/>
<profile
value="http://hl7.org/fhir/uv/ebm/StructureDefinition/risk-of-bias"/>
</meta>
<text>
<status value="extensions"/>
<div xmlns="http://www.w3.org/1999/xhtml"><p class="res-header-id"><b>Generated Narrative: ArtifactAssessment 179692</b></p><a name="179692"> </a><a name="hc179692"> </a><a name="179692-en-US"> </a><div style="display: inline-block; background-color: #d9e0e7; padding: 6px; margin: 4px; border: 1px solid #8da1b4; border-radius: 5px; line-height: 60%"><p style="margin-bottom: 0px">version: 5; Last updated: 2023-12-08 00:46:44+0000</p><p style="margin-bottom: 0px">Profile: <a href="StructureDefinition-risk-of-bias.html">RiskOfBias</a></p></div><p><b>Artifact URL</b>: <a href="https://fevir.net/resources/ArtifactAssessment/179692">https://fevir.net/resources/ArtifactAssessment/179692</a></p><p><b>Artifact Description</b>: </p><div><p>The ArtifactAssessment Resource is used here to show a complex risk of bias assessment with multiple recursive components.</p>
</div><p><b>identifier</b>: FEvIR Object Identifier/179692</p><p><b>title</b>: Risk of Bias Assessment of Critically appraised summary of primary outcome of multi-platform RCT of anticoagulation for non-critically ill patients with COVID-19</p><p><b>date</b>: 2021-12-29 22:35:49+0000</p><p><b>copyright</b>: </p><div><p>https://creativecommons.org/licenses/by-nc-sa/4.0/</p>
</div><p><b>artifact</b>: <a href="Evidence-7637.html">Critically appraised summary of primary outcome of multi-platform RCT of anticoagulation for non-critically ill patients with COVID-19</a></p><blockquote><p><b>content</b></p><p><b>informationType</b>: Rating</p><p><b>type</b>: <span title="Codes:{https://fevir.net/resources/CodeSystem/181513 SEVCO:00001}">Bias</span></p><p><b>classifier</b>: <span title="Codes:{https://fevir.net/resources/CodeSystem/181513 SEVCO:00190}">Critical risk of bias</span></p><p><b>author</b>: Brian S. Alper, Harold Lehmann, Ahmad Sofi-Mahmudi, Joanne Dehnbostel, Ilkka Kunnamo, Alfonso Iorio</p><p><b>freeToShare</b>: true</p><blockquote><p><b>component</b></p><p><b>informationType</b>: Rating</p><p><b>summary</b>: </p><div><p>Inclusion of suspected COVID-19 in 1 of 3 trials may introduce selection bias, but the impact appears limited.</p>
</div><p><b>type</b>: <span title="Codes:{https://fevir.net/resources/CodeSystem/181513 SEVCO:00003}">Participant Selection Bias</span></p><p><b>classifier</b>: <span title="Codes:{https://fevir.net/resources/CodeSystem/181513 SEVCO:00209}">Factor likely does not have potential to impact results</span>, <span title="Codes:{https://fevir.net/resources/CodeSystem/181513 SEVCO:00186}">Low risk of bias</span></p><h3>Components</h3><table class="grid"><tr><td style="display: none">-</td><td><b>InformationType</b></td><td><b>Summary</b></td></tr><tr><td style="display: none">*</td><td>Comment</td><td><div><p>Participant Selection Bias Definition: A selection bias resulting from methods used to select participating subjects, factors that influence initial study participation, or differences between the study participants and the population of interest.</p>
</div></td></tr></table></blockquote><blockquote><p><b>component</b></p><p><b>informationType</b>: Rating</p><p><b>summary</b>: </p><div><p>The study design used response-adaptive randomization in which group assignment ratios could be modified during the trial on the basis of response-adaptive interim analyses to favor the assignment of patients to the treatment group showing greater benefit. The confounding by time (imbalanced randomization with time period) is not adequately reported to determine the potential influence on results or adequacy of adjusted analyses.</p>
</div><p><b>type</b>: <span title="Codes:{https://fevir.net/resources/CodeSystem/181513 SEVCO:00016}">Confounding Covariate Bias</span></p><p><b>classifier</b>: <span title="Codes:{https://fevir.net/resources/CodeSystem/181513 SEVCO:00189}">Serious risk of bias</span></p><blockquote><p><b>component</b></p><p><b>informationType</b>: Rating</p><p><b>summary</b>: </p><div><p>Response-adaptive randomization led to imbalanced randomization.</p>
</div><p><b>type</b>: <span title="Codes:{https://fevir.net/resources/CodeSystem/181513 SEVCO:00032}">Allocation Bias</span></p><h3>Components</h3><table class="grid"><tr><td style="display: none">-</td><td><b>InformationType</b></td><td><b>Summary</b></td></tr><tr><td style="display: none">*</td><td>Comment</td><td><div><p>Adaptive randomization is not a concern by itself, only if it results in a confounding difference.</p>
</div></td></tr><tr><td style="display: none">*</td><td>Comment</td><td><div><p>Definition of Allocation Bias = A confounding covariate bias resulting from methods for assignment of the independent variable by the investigator to evaluate a response or outcome.</p>
</div></td></tr><tr><td style="display: none">*</td><td>Comment</td><td><div><p>ATTACC implemented response-adaptive randomization on December 15, 2020, which led to imbalanced randomization.</p>
</div></td></tr></table></blockquote><blockquote><p><b>component</b></p><p><b>informationType</b>: Rating</p><p><b>summary</b>: </p><div><p>There is an unequal distribution of calendar time between the groups being compared.</p>
</div><p><b>type</b>: <span title="Codes:{https://fevir.net/resources/CodeSystem/181513 SEVCO:00034}">Confounding difference</span></p><p><b>classifier</b>: <span title="Codes:{https://fevir.net/resources/CodeSystem/181513 SEVCO:00194}">Factor present</span>, <span title="Codes:{https://fevir.net/resources/CodeSystem/181513 SEVCO:00207}">Factor has potential to impact results</span>, <span title="Codes:{https://fevir.net/resources/CodeSystem/181513 SEVCO:00201}">Risk of bias favoring experimental</span>, <span title="Codes:{https://fevir.net/resources/CodeSystem/181513 SEVCO:00189}">Serious risk of bias</span></p><h3>Components</h3><table class="grid"><tr><td style="display: none">-</td><td><b>InformationType</b></td><td><b>Summary</b></td></tr><tr><td style="display: none">*</td><td>Comment</td><td><div><p>Definition of Confounding difference = A confounding covariate bias in which the unequal distribution of a potentially distorting variable is recognized.</p>
</div></td></tr><tr><td style="display: none">*</td><td>Comment</td><td><div><p>Incomplete reporting limits the determination of the potential degree of influence of calendar time.</p>
</div></td></tr><tr><td style="display: none">*</td><td>Comment</td><td><div><p>There is evidence of potential for calendar time to influence the results: In an observational study of 18,508 adults with laboratory-confirmed, COVID-19 associated hospitalization 'The percentage of hospitalized patients admitted to the ICU decreased from 37.8% in March to 20.5% in December' (Ann Intern Med 2021 Aug 10 https://www.acpjournals.org/doi/10.7326/M21-1991).</p>
</div></td></tr></table></blockquote><blockquote><p><b>component</b></p><p><b>informationType</b>: Comment</p><p><b>summary</b>: </p><div><p>Definition of Confounding Covariate Bias = A situation in which the effect or association between an exposure and outcome is distorted by another variable. For confounding covariate bias to occur the distorting variable must be (1) associated with the exposure and the outcome, (2) not in the causal pathway between exposure and outcome, and (3) unequally distributed between the groups being compared.</p>
</div></blockquote><blockquote><p><b>component</b></p><p><b>informationType</b>: Comment</p><p><b>summary</b>: </p><div><p>ATTACC implemented response-adaptive randomization on December 15, 2020, which led to imbalanced randomization. No data reported to determine if intervention-specific outcome rates were similar or different before and after December 15, 2020 in the ATTACC cohort.</p>
</div></blockquote><blockquote><p><b>component</b></p><p><b>informationType</b>: Comment</p><p><b>summary</b>: </p><div><p>Insufficient details reported to judge whether there is an imbalance in outcomes related to the adaptive randomization which in turn could be used to judge the validity of adjustment methods in the statistical model for this concern and the appropriateness of any sensitivity analyses.</p>
</div></blockquote></blockquote><blockquote><p><b>component</b></p><p><b>informationType</b>: Rating</p><p><b>summary</b>: </p><div><p>Awareness of treatment assignment may reduce clinical decision to initiate some types of "organ support" in patients with higher risk of major bleeding.</p>
</div><p><b>type</b>: <span title="Codes:{https://fevir.net/resources/CodeSystem/181513 SEVCO:00017}">Performance Bias</span></p><p><b>classifier</b>: <span title="Codes:{https://fevir.net/resources/CodeSystem/181513 SEVCO:00207}">Factor has potential to impact results</span>, <span title="Codes:{https://fevir.net/resources/CodeSystem/181513 SEVCO:00201}">Risk of bias favoring experimental</span>, <span title="Codes:{https://fevir.net/resources/CodeSystem/181513 SEVCO:00190}">Critical risk of bias</span></p><blockquote><p><b>component</b></p><p><b>informationType</b>: Rating</p><p><b>summary</b>: </p><div><p>Lack of blinding may explain reported differences in the primary outcome.</p>
</div><p><b>type</b>: <span title="Codes:{https://fevir.net/resources/CodeSystem/181513 SEVCO:00036}">Inadequate blinding of intervention deliverers</span></p><p><b>classifier</b>: <span title="Codes:{https://fevir.net/resources/CodeSystem/181513 SEVCO:00190}">Critical risk of bias</span></p><h3>Components</h3><table class="grid"><tr><td style="display: none">-</td><td><b>InformationType</b></td><td><b>Summary</b></td></tr><tr><td style="display: none">*</td><td>Comment</td><td><div><p>The absolute difference in survival without intubation was 1%, so 3% of the 4% absolute difference in the primary outcome can be considered "organ support without intubation".</p>
</div></td></tr><tr><td style="display: none">*</td><td>Comment</td><td><div><p>The specific "organ support without intubation" was not reported. The methods for one of the included trials stated "Organ Support is defined as receipt of invasive or non-invasive mechanical ventilation, high flow nasal oxygen, vasopressor therapy, or ECMO support"</p>
</div></td></tr><tr><td style="display: none">*</td><td>Comment</td><td><div><p>Awareness of treatment assignment may reduce clinical decision to initiate "organ support without intubation" in patients with higher risk of major bleeding.</p>
</div></td></tr></table></blockquote><blockquote><p><b>component</b></p><p><b>informationType</b>: Rating</p><p><b>summary</b>: </p><div><p>Crossover to other intervention in 20%</p>
</div><p><b>type</b>: <span title="Codes:{https://fevir.net/resources/CodeSystem/181513 SEVCO:00037}">Deviation from study intervention protocol</span></p><p><b>classifier</b>: <span title="Codes:{https://fevir.net/resources/CodeSystem/181513 SEVCO:00192}">Unclear risk of bias</span></p><h3>Components</h3><table class="grid"><tr><td style="display: none">-</td><td><b>InformationType</b></td><td><b>Summary</b></td></tr><tr><td style="display: none">*</td><td>Comment</td><td><div><p>Therapeutic dose anticoagulation (in the first 24-48 hours following randomization) was reported in 79.6% of the therapeutic arm and 0.9% of the usual care arm. (Table S3)</p>
</div></td></tr><tr><td style="display: none">*</td><td>Comment</td><td><div><p>Definition of Deviation from study intervention protocol = A performance bias in which the intervention received differs from the intervention specified in the study protocol.</p>
</div></td></tr></table></blockquote><blockquote><p><b>component</b></p><p><b>informationType</b>: Rating</p><p><b>summary</b>: </p><div><p>We discussed whether they may be a bias related to limited adherence to anticoagulation. Because this was an inpatient population, we did not expect adherence problems that are more common with outpatient thromboprophylaxis.</p>
</div><p><b>type</b>: <span title="Codes:{https://fevir.net/resources/CodeSystem/181513 SEVCO:00039}">Nonadherence of implementation</span></p><p><b>classifier</b>: <span title="Codes:{https://fevir.net/resources/CodeSystem/181513 SEVCO:00196}">Factor likely absent</span>, <span title="Codes:{https://fevir.net/resources/CodeSystem/181513 SEVCO:00186}">Low risk of bias</span></p><h3>Components</h3><table class="grid"><tr><td style="display: none">-</td><td><b>InformationType</b></td><td><b>Summary</b></td></tr><tr><td style="display: none">*</td><td>Comment</td><td><div><p>Initial adherence to the protocol-assigned anticoagulation dose after randomization was 88.3% in the therapeutic-dose anticoagulation group and 98.3% in the thromboprophylaxis group (Table S3).</p>
</div></td></tr></table></blockquote><blockquote><p><b>component</b></p><p><b>informationType</b>: Comment</p><p><b>summary</b>: </p><div><p>Definition of Performance Bias = A bias resulting from differences between the received exposure and the intended exposure.</p>
</div></blockquote></blockquote><blockquote><p><b>component</b></p><p><b>informationType</b>: Rating</p><p><b>summary</b>: </p><div><p>The influence of awareness of treatment assignment by the treating clinicians on the initiation of organ support (which is the primary outcome) was already addressed as Performance Bias so is not repeated here as a bias in detecting the outcome.</p>
</div><p><b>type</b>: <span title="Codes:{https://fevir.net/resources/CodeSystem/181513 SEVCO:00020}">Detection Bias</span></p><p><b>classifier</b>: <span title="Codes:{https://fevir.net/resources/CodeSystem/181513 SEVCO:00186}">Low risk of bias</span></p></blockquote><blockquote><p><b>component</b></p><p><b>informationType</b>: Rating</p><p><b>summary</b>: </p><div><p>Only 19 of 1190 (1.6%) therapeutic group and 6 of 1054 (0.6%) prophylactic group were excluded after randomization.</p>
</div><p><b>type</b>: <span title="Codes:{https://fevir.net/resources/CodeSystem/181513 SEVCO:00019}">Attrition Bias</span></p><p><b>classifier</b>: <span title="Codes:{https://fevir.net/resources/CodeSystem/181513 SEVCO:00186}">Low risk of bias</span></p></blockquote><blockquote><p><b>component</b></p><p><b>informationType</b>: Rating</p><p><b>summary</b>: </p><div><p>It is unknown if the results are sensitive to the analytic method, and the stopping criteria were based on statistical significance and not magnitude of effect.</p>
</div><p><b>type</b>: <span title="Codes:{https://fevir.net/resources/CodeSystem/181513 SEVCO:00021}">Analysis Bias</span></p><p><b>classifier</b>: <span title="Codes:{https://fevir.net/resources/CodeSystem/181513 SEVCO:00190}">Critical risk of bias</span></p><blockquote><p><b>component</b></p><p><b>informationType</b>: Rating</p><p><b>summary</b>: </p><div><p>A frequentist analysis is not reported so we cannot determine if the results are sensitive to the analytic method</p>
</div><p><b>type</b>: <span title="Codes:{https://fevir.net/resources/CodeSystem/181513 SEVCO:00022}">Bias related to selection of the analysis</span></p><p><b>classifier</b>: <span title="Codes:{https://fevir.net/resources/CodeSystem/181513 SEVCO:00195}">Factor likely present</span>, <span title="Codes:{https://fevir.net/resources/CodeSystem/181513 SEVCO:00207}">Factor has potential to impact results</span>, <span title="Codes:{https://fevir.net/resources/CodeSystem/181513 SEVCO:00201}">Risk of bias favoring experimental</span>, <span title="Codes:{https://fevir.net/resources/CodeSystem/181513 SEVCO:00192}">Unclear risk of bias</span></p><blockquote><p><b>component</b></p><p><b>informationType</b>: Rating</p><p><b>summary</b>: </p><div><p>The stopping criteria were based on statistical significance and not magnitude of effect.</p>
</div><p><b>type</b>: <span title="Codes:{https://fevir.net/resources/CodeSystem/181513 SEVCO:00212}">Early termination bias affecting enrollment</span></p><p><b>classifier</b>: <span title="Codes:{https://fevir.net/resources/CodeSystem/181513 SEVCO:00194}">Factor present</span>, <span title="Codes:{https://fevir.net/resources/CodeSystem/181513 SEVCO:00207}">Factor has potential to impact results</span>, <span title="Codes:{https://fevir.net/resources/CodeSystem/181513 SEVCO:00201}">Risk of bias favoring experimental</span>, <span title="Codes:{https://fevir.net/resources/CodeSystem/181513 SEVCO:00190}">Critical risk of bias</span></p><h3>Components</h3><table class="grid"><tr><td style="display: none">-</td><td><b>InformationType</b></td><td><b>Summary</b></td></tr><tr><td style="display: none">*</td><td>Comment</td><td><div><p>There was no “minimally important difference”. So a 99% probability of having an odds ratio > 1 (even if the magnitude of effect is infinitesimal) was used to decide it was time to stop the trial.</p>
</div></td></tr></table></blockquote><blockquote><p><b>component</b></p><p><b>informationType</b>: Comment</p><p><b>summary</b>: </p><div><p>Definition of Bias related to selection of the analysis = An analysis bias due to inappropriate choice of analysis methods before the analysis is applied.</p>
</div></blockquote><blockquote><p><b>component</b></p><p><b>informationType</b>: Comment</p><p><b>summary</b>: </p><div><p>There was no pre-specified frequentist analysis. There was no posthoc frequentist analysis reported.</p>
</div></blockquote><blockquote><p><b>component</b></p><p><b>informationType</b>: Comment</p><p><b>summary</b>: </p><div><p>It is uncertain what a frequentist analysis would show and uncertain whether the choice of Bayesian analysis or frequentist analysis has a substantial influence on the results.</p>
</div></blockquote></blockquote></blockquote></blockquote><blockquote><p><b>content</b></p><p><b>informationType</b>: Classifier</p><p><b>type</b>: <span title="Codes:{https://fevir.net/resources/CodeSystem/179423 defined-in-text}">Profile for use with Risk of Bias Assessment Tool</span></p><p><b>classifier</b>: <span title="Codes:{https://fevir.net/resources/CodeSystem/179423 defined-in-text}">Randomized trial</span></p></blockquote></div>
</text>
<extension url="http://hl7.org/fhir/StructureDefinition/artifact-url">
<valueUri value="https://fevir.net/resources/ArtifactAssessment/179692"/>
</extension>
<extension
url="http://hl7.org/fhir/StructureDefinition/artifact-description">
<valueMarkdown
value="The ArtifactAssessment Resource is used here to show a complex risk of bias assessment with multiple recursive components."/>
</extension>
<identifier>
<type>
<coding>
<system value="http://terminology.hl7.org/CodeSystem/v2-0203"/>
<code value="ACSN"/>
<display value="Accession ID"/>
</coding>
<text value="FEvIR Object Identifier"/>
</type>
<system value="https://fevir.net"/>
<value value="179692"/>
<assigner>
<display value="Computable Publishing LLC"/>
</assigner>
</identifier>
<title
value="Risk of Bias Assessment of Critically appraised summary of primary outcome of multi-platform RCT of anticoagulation for non-critically ill patients with COVID-19"/>
<date value="2021-12-29T22:35:49.782Z"/>
<copyright value="https://creativecommons.org/licenses/by-nc-sa/4.0/"/>
<artifactReference>🔗
<reference value="Evidence/7637"/>
<type value="Evidence"/>
<display
value="Critically appraised summary of primary outcome of multi-platform RCT of anticoagulation for non-critically ill patients with COVID-19"/>
</artifactReference>
<content>
<informationType value="rating"/>
<type>
<coding>
<system value="https://fevir.net/resources/CodeSystem/181513"/>
<code value="SEVCO:00001"/>
<display value="Bias"/>
</coding>
</type>
<classifier>
<coding>
<system value="https://fevir.net/resources/CodeSystem/181513"/>
<code value="SEVCO:00190"/>
<display value="Critical risk of bias"/>
</coding>
</classifier>
<author>
<display
value="Brian S. Alper, Harold Lehmann, Ahmad Sofi-Mahmudi, Joanne Dehnbostel, Ilkka Kunnamo, Alfonso Iorio"/>
</author>
<freeToShare value="true"/>
<component>
<informationType value="rating"/>
<summary
value="Inclusion of suspected COVID-19 in 1 of 3 trials may introduce selection bias, but the impact appears limited."/>
<type>
<coding>
<system value="https://fevir.net/resources/CodeSystem/181513"/>
<code value="SEVCO:00003"/>
<display value="Participant Selection Bias"/>
</coding>
</type>
<classifier>
<coding>
<system value="https://fevir.net/resources/CodeSystem/181513"/>
<code value="SEVCO:00209"/>
<display
value="Factor likely does not have potential to impact results"/>
</coding>
</classifier>
<classifier>
<coding>
<system value="https://fevir.net/resources/CodeSystem/181513"/>
<code value="SEVCO:00186"/>
<display value="Low risk of bias"/>
</coding>
</classifier>
<component>
<informationType value="comment"/>
<summary
value="Participant Selection Bias Definition: A selection bias resulting from methods used to select participating subjects, factors that influence initial study participation, or differences between the study participants and the population of interest."/>
</component>
</component>
<component>
<informationType value="rating"/>
<summary
value="The study design used response-adaptive randomization in which group assignment ratios could be modified during the trial on the basis of response-adaptive interim analyses to favor the assignment of patients to the treatment group showing greater benefit. The confounding by time (imbalanced randomization with time period) is not adequately reported to determine the potential influence on results or adequacy of adjusted analyses."/>
<type>
<coding>
<system value="https://fevir.net/resources/CodeSystem/181513"/>
<code value="SEVCO:00016"/>
<display value="Confounding Covariate Bias"/>
</coding>
</type>
<classifier>
<coding>
<system value="https://fevir.net/resources/CodeSystem/181513"/>
<code value="SEVCO:00189"/>
<display value="Serious risk of bias"/>
</coding>
</classifier>
<component>
<informationType value="rating"/>
<summary
value="Response-adaptive randomization led to imbalanced randomization."/>
<type>
<coding>
<system value="https://fevir.net/resources/CodeSystem/181513"/>
<code value="SEVCO:00032"/>
<display value="Allocation Bias"/>
</coding>
</type>
<component>
<informationType value="comment"/>
<summary
value="Adaptive randomization is not a concern by itself, only if it results in a confounding difference."/>
</component>
<component>
<informationType value="comment"/>
<summary
value="Definition of Allocation Bias = A confounding covariate bias resulting from methods for assignment of the independent variable by the investigator to evaluate a response or outcome."/>
</component>
<component>
<informationType value="comment"/>
<summary
value="ATTACC implemented response-adaptive randomization on December 15, 2020, which led to imbalanced randomization."/>
</component>
</component>
<component>
<informationType value="rating"/>
<summary
value="There is an unequal distribution of calendar time between the groups being compared."/>
<type>
<coding>
<system value="https://fevir.net/resources/CodeSystem/181513"/>
<code value="SEVCO:00034"/>
<display value="Confounding difference"/>
</coding>
</type>
<classifier>
<coding>
<system value="https://fevir.net/resources/CodeSystem/181513"/>
<code value="SEVCO:00194"/>
<display value="Factor present"/>
</coding>
</classifier>
<classifier>
<coding>
<system value="https://fevir.net/resources/CodeSystem/181513"/>
<code value="SEVCO:00207"/>
<display value="Factor has potential to impact results"/>
</coding>
</classifier>
<classifier>
<coding>
<system value="https://fevir.net/resources/CodeSystem/181513"/>
<code value="SEVCO:00201"/>
<display value="Risk of bias favoring experimental"/>
</coding>
</classifier>
<classifier>
<coding>
<system value="https://fevir.net/resources/CodeSystem/181513"/>
<code value="SEVCO:00189"/>
<display value="Serious risk of bias"/>
</coding>
</classifier>
<component>
<informationType value="comment"/>
<summary
value="Definition of Confounding difference = A confounding covariate bias in which the unequal distribution of a potentially distorting variable is recognized."/>
</component>
<component>
<informationType value="comment"/>
<summary
value="Incomplete reporting limits the determination of the potential degree of influence of calendar time."/>
</component>
<component>
<informationType value="comment"/>
<summary
value="There is evidence of potential for calendar time to influence the results: In an observational study of 18,508 adults with laboratory-confirmed, COVID-19 associated hospitalization 'The percentage of hospitalized patients admitted to the ICU decreased from 37.8% in March to 20.5% in December' (Ann Intern Med 2021 Aug 10 https://www.acpjournals.org/doi/10.7326/M21-1991)."/>
</component>
</component>
<component>
<informationType value="comment"/>
<summary
value="Definition of Confounding Covariate Bias = A situation in which the effect or association between an exposure and outcome is distorted by another variable. For confounding covariate bias to occur the distorting variable must be (1) associated with the exposure and the outcome, (2) not in the causal pathway between exposure and outcome, and (3) unequally distributed between the groups being compared."/>
</component>
<component>
<informationType value="comment"/>
<summary
value="ATTACC implemented response-adaptive randomization on December 15, 2020, which led to imbalanced randomization. No data reported to determine if intervention-specific outcome rates were similar or different before and after December 15, 2020 in the ATTACC cohort."/>
</component>
<component>
<informationType value="comment"/>
<summary
value="Insufficient details reported to judge whether there is an imbalance in outcomes related to the adaptive randomization which in turn could be used to judge the validity of adjustment methods in the statistical model for this concern and the appropriateness of any sensitivity analyses."/>
</component>
</component>
<component>
<informationType value="rating"/>
<summary
value="Awareness of treatment assignment may reduce clinical decision to initiate some types of "organ support" in patients with higher risk of major bleeding."/>
<type>
<coding>
<system value="https://fevir.net/resources/CodeSystem/181513"/>
<code value="SEVCO:00017"/>
<display value="Performance Bias"/>
</coding>
</type>
<classifier>
<coding>
<system value="https://fevir.net/resources/CodeSystem/181513"/>
<code value="SEVCO:00207"/>
<display value="Factor has potential to impact results"/>
</coding>
</classifier>
<classifier>
<coding>
<system value="https://fevir.net/resources/CodeSystem/181513"/>
<code value="SEVCO:00201"/>
<display value="Risk of bias favoring experimental"/>
</coding>
</classifier>
<classifier>
<coding>
<system value="https://fevir.net/resources/CodeSystem/181513"/>
<code value="SEVCO:00190"/>
<display value="Critical risk of bias"/>
</coding>
</classifier>
<component>
<informationType value="rating"/>
<summary
value="Lack of blinding may explain reported differences in the primary outcome."/>
<type>
<coding>
<system value="https://fevir.net/resources/CodeSystem/181513"/>
<code value="SEVCO:00036"/>
<display value="Inadequate blinding of intervention deliverers"/>
</coding>
</type>
<classifier>
<coding>
<system value="https://fevir.net/resources/CodeSystem/181513"/>
<code value="SEVCO:00190"/>
<display value="Critical risk of bias"/>
</coding>
</classifier>
<component>
<informationType value="comment"/>
<summary
value="The absolute difference in survival without intubation was 1%, so 3% of the 4% absolute difference in the primary outcome can be considered "organ support without intubation"."/>
</component>
<component>
<informationType value="comment"/>
<summary
value="The specific "organ support without intubation" was not reported. The methods for one of the included trials stated "Organ Support is defined as receipt of invasive or non-invasive mechanical ventilation, high flow nasal oxygen, vasopressor therapy, or ECMO support""/>
</component>
<component>
<informationType value="comment"/>
<summary
value="Awareness of treatment assignment may reduce clinical decision to initiate "organ support without intubation" in patients with higher risk of major bleeding."/>
</component>
</component>
<component>
<informationType value="rating"/>
<summary value="Crossover to other intervention in 20%"/>
<type>
<coding>
<system value="https://fevir.net/resources/CodeSystem/181513"/>
<code value="SEVCO:00037"/>
<display value="Deviation from study intervention protocol"/>
</coding>
</type>
<classifier>
<coding>
<system value="https://fevir.net/resources/CodeSystem/181513"/>
<code value="SEVCO:00192"/>
<display value="Unclear risk of bias"/>
</coding>
</classifier>
<component>
<informationType value="comment"/>
<summary
value="Therapeutic dose anticoagulation (in the first 24-48 hours following randomization) was reported in 79.6% of the therapeutic arm and 0.9% of the usual care arm. (Table S3)"/>
</component>
<component>
<informationType value="comment"/>
<summary
value="Definition of Deviation from study intervention protocol = A performance bias in which the intervention received differs from the intervention specified in the study protocol."/>
</component>
</component>
<component>
<informationType value="rating"/>
<summary
value="We discussed whether they may be a bias related to limited adherence to anticoagulation. Because this was an inpatient population, we did not expect adherence problems that are more common with outpatient thromboprophylaxis."/>
<type>
<coding>
<system value="https://fevir.net/resources/CodeSystem/181513"/>
<code value="SEVCO:00039"/>
<display value="Nonadherence of implementation"/>
</coding>
</type>
<classifier>
<coding>
<system value="https://fevir.net/resources/CodeSystem/181513"/>
<code value="SEVCO:00196"/>
<display value="Factor likely absent"/>
</coding>
</classifier>
<classifier>
<coding>
<system value="https://fevir.net/resources/CodeSystem/181513"/>
<code value="SEVCO:00186"/>
<display value="Low risk of bias"/>
</coding>
</classifier>
<component>
<informationType value="comment"/>
<summary
value="Initial adherence to the protocol-assigned anticoagulation dose after randomization was 88.3% in the therapeutic-dose anticoagulation group and 98.3% in the thromboprophylaxis group (Table S3)."/>
</component>
</component>
<component>
<informationType value="comment"/>
<summary
value="Definition of Performance Bias = A bias resulting from differences between the received exposure and the intended exposure."/>
</component>
</component>
<component>
<informationType value="rating"/>
<summary
value="The influence of awareness of treatment assignment by the treating clinicians on the initiation of organ support (which is the primary outcome) was already addressed as Performance Bias so is not repeated here as a bias in detecting the outcome."/>
<type>
<coding>
<system value="https://fevir.net/resources/CodeSystem/181513"/>
<code value="SEVCO:00020"/>
<display value="Detection Bias"/>
</coding>
</type>
<classifier>
<coding>
<system value="https://fevir.net/resources/CodeSystem/181513"/>
<code value="SEVCO:00186"/>
<display value="Low risk of bias"/>
</coding>
</classifier>
</component>
<component>
<informationType value="rating"/>
<summary
value="Only 19 of 1190 (1.6%) therapeutic group and 6 of 1054 (0.6%) prophylactic group were excluded after randomization."/>
<type>
<coding>
<system value="https://fevir.net/resources/CodeSystem/181513"/>
<code value="SEVCO:00019"/>
<display value="Attrition Bias"/>
</coding>
</type>
<classifier>
<coding>
<system value="https://fevir.net/resources/CodeSystem/181513"/>
<code value="SEVCO:00186"/>
<display value="Low risk of bias"/>
</coding>
</classifier>
</component>
<component>
<informationType value="rating"/>
<summary
value="It is unknown if the results are sensitive to the analytic method, and the stopping criteria were based on statistical significance and not magnitude of effect."/>
<type>
<coding>
<system value="https://fevir.net/resources/CodeSystem/181513"/>
<code value="SEVCO:00021"/>
<display value="Analysis Bias"/>
</coding>
</type>
<classifier>
<coding>
<system value="https://fevir.net/resources/CodeSystem/181513"/>
<code value="SEVCO:00190"/>
<display value="Critical risk of bias"/>
</coding>
</classifier>
<component>
<informationType value="rating"/>
<summary
value="A frequentist analysis is not reported so we cannot determine if the results are sensitive to the analytic method"/>
<type>
<coding>
<system value="https://fevir.net/resources/CodeSystem/181513"/>
<code value="SEVCO:00022"/>
<display value="Bias related to selection of the analysis"/>
</coding>
</type>
<classifier>
<coding>
<system value="https://fevir.net/resources/CodeSystem/181513"/>
<code value="SEVCO:00195"/>
<display value="Factor likely present"/>
</coding>
</classifier>
<classifier>
<coding>
<system value="https://fevir.net/resources/CodeSystem/181513"/>
<code value="SEVCO:00207"/>
<display value="Factor has potential to impact results"/>
</coding>
</classifier>
<classifier>
<coding>
<system value="https://fevir.net/resources/CodeSystem/181513"/>
<code value="SEVCO:00201"/>
<display value="Risk of bias favoring experimental"/>
</coding>
</classifier>
<classifier>
<coding>
<system value="https://fevir.net/resources/CodeSystem/181513"/>
<code value="SEVCO:00192"/>
<display value="Unclear risk of bias"/>
</coding>
</classifier>
<component>
<informationType value="rating"/>
<summary
value="The stopping criteria were based on statistical significance and not magnitude of effect."/>
<type>
<coding>
<system value="https://fevir.net/resources/CodeSystem/181513"/>
<code value="SEVCO:00212"/>
<display value="Early termination bias affecting enrollment"/>
</coding>
</type>
<classifier>
<coding>
<system value="https://fevir.net/resources/CodeSystem/181513"/>
<code value="SEVCO:00194"/>
<display value="Factor present"/>
</coding>
</classifier>
<classifier>
<coding>
<system value="https://fevir.net/resources/CodeSystem/181513"/>
<code value="SEVCO:00207"/>
<display value="Factor has potential to impact results"/>
</coding>
</classifier>
<classifier>
<coding>
<system value="https://fevir.net/resources/CodeSystem/181513"/>
<code value="SEVCO:00201"/>
<display value="Risk of bias favoring experimental"/>
</coding>
</classifier>
<classifier>
<coding>
<system value="https://fevir.net/resources/CodeSystem/181513"/>
<code value="SEVCO:00190"/>
<display value="Critical risk of bias"/>
</coding>
</classifier>
<component>
<informationType value="comment"/>
<summary
value="There was no “minimally important difference”. So a 99% probability of having an odds ratio > 1 (even if the magnitude of effect is infinitesimal) was used to decide it was time to stop the trial."/>
</component>
</component>
<component>
<informationType value="comment"/>
<summary
value="Definition of Bias related to selection of the analysis = An analysis bias due to inappropriate choice of analysis methods before the analysis is applied."/>
</component>
<component>
<informationType value="comment"/>
<summary
value="There was no pre-specified frequentist analysis. There was no posthoc frequentist analysis reported."/>
</component>
<component>
<informationType value="comment"/>
<summary
value="It is uncertain what a frequentist analysis would show and uncertain whether the choice of Bayesian analysis or frequentist analysis has a substantial influence on the results."/>
</component>
</component>
</component>
</content>
<content>
<informationType value="classifier"/>
<type>
<coding>
<system value="https://fevir.net/resources/CodeSystem/179423"/>
<code value="defined-in-text"/>
<display value="Defined in text"/>
</coding>
<text value="Profile for use with Risk of Bias Assessment Tool"/>
</type>
<classifier>
<coding>
<system value="https://fevir.net/resources/CodeSystem/179423"/>
<code value="defined-in-text"/>
<display value="Defined in text"/>
</coding>
<text value="Randomized trial"/>
</classifier>
</content>
</ArtifactAssessment>
IG © 2024+ HL7 International / Clinical Decision Support. Package hl7.fhir.uv.ebm#2.0.0-ballot based on FHIR 6.0.0-ballot2. Generated 2024-11-21
Links: Table of Contents |
QA Report
| Version History |
|
Propose a change