HL7 Informative Document: Patient Information Quality Improvement (PIQI) Framework, Edition 1, published by HL7 Cross-Group Projects Work Group. This guide is not an authorized publication; it is the continuous build for version 1.0.0 built by the FHIR (HL7® FHIR® Standard) CI Build. This version is based on the current content of https://github.com/HL7/piqi/ and changes regularly. See the Directory of published versions
PIQI Evaluation Rubric
The Patient Information Quality Improvement (PIQI) Framework assesses patient data in the PIQI Data Model using an Evaluation Rubric.
The Evaluation Rubric is a sequenced collection of Evaluation Criteria.
Each Evaluation Criterion is comprised of a specific PIQI Model Entity an assigned Evaluation an optional Condition and the Scoring Effect.
The PIQI Model Entity can be an attribute, element, data class or the entire patient.
The Evaluation and Condition are both configured Simple Assessment Modules (SAMs).
If the Condition is configured, the Evaluation is only processed if the conditional SAM passes.
Each Evaluation that is processed triggers the Scoring Effect based upon the pass or fail result of the underlying SAM. If the SAM returns an indeterminant result (skip) the Evaluation is skipped. This implies a condition within the implementation of the SAM itself was not met.
A SAM is a logical test that measures a specific data quality dimension for a model element or characteristic, following a defined pattern. The inputs depend on the pattern, but the output is always a simple result: pass, fail, or skip. SAMs can be grouped into hierarchical collections, allowing multiple checks to be combined in order to provide a broader picture of data quality for a given use case. Given that interaction with a PIQI evaluation endpoint is at the Rubric level, and not at the SAM level, the actual format for conveying these responses (e.g., "pass/fail" vs. "true/false" vs. "1/0") is an implementation decision that is outside the scope of this standard. For detailed information see SAMS
Evaluation Rubrics represent a collection of sequenced SAM evaluations of specific entities in the PIQI Model along with the desired scoring effect.
An Evaluation Rubric is comprised of the following components:
The Rubric Mnemonic is a mnemonic identifier that is used to identify a unique Evaluation Rubric. This is the primary identifier to reference a given Evaluation Rubric.
The name of the Evaluation Rubric.
The description of the scope and purpose of the Evaluation Rubric.
The version of the Evaluation Rubric is an optional field to support versioned rubrics.
The authoritative source or reference for the Evaluation Rubric. This should contain both any organizations that have endorsed the rubric (to convey trustworthiness) as well as context on known production usage of the rubric.
This is the PIQI Data Model required for the rubric. It is envisioned that there may be many versions of a given model, as well as extensions based upon those versions. Given the tight relationship between the model and the rubric, all of these sub-attributes are necessary to uniquely identify the specific model required.
Rubric Model version mnemonic
Rubric Model mnemonic
Rubric Model Version
Rubric Model Extension mnemonic
This is the original source of the Evaluation Rubric content, containing both a unique identifier as well as a human readable name for the organization.
PIQI Organization UID
PIQI Organization Name
The date and time the Evaluation Rubric was originally created.
The date and time the Evaluation Rubric was most recently modified.
Each Evaluation Rubric contains a collection of criteria that are used for assessing and scoring patient messages. Each criterion has the following attributes:
This is the sequence order for the criteria in the collection. The criteria sequence is assigned automatically based on the data class and entity being assessed by the criteria.
This is a human readable description of the purpose or rationale for the criteria.
This is the Data Class in the PIQI model that is being assessed. This can be any data class in the PIQI information model or ‘Patient’ which indicates a complete patient
This is the entity (element or attribute) being assessed by the criteria,
This is the SAM that is being assigned in the criteria.
This is a profile specific override for the success alias for the SAM.
This is a profile specific override for the Failure alias for the SAM.
This field contains a collection of the parameters necessary to properly configure the SAM.
This field contains the name for a SAM parameter being configured.
This field contains the value for a SAM parameter being configured.
This contains the SAM mnemonic for a conditional SAM If the criteria should only be run under a certain condition. If the criteria is not conditional, this field should be empty.
If there is a conditional SAM and it requires a parameter, this is where that parameter collection can be populated.
This field contains the name for a SAM parameter being configured.
This field contains the value for a SAM parameter being configured.
This field indicates if this criterion is ‘scoring’ or ‘informational’.
This field has the weight for scoring criteria. For informational criteria it is set to ‘0’. For Scoring criteria, it defaults to ‘1’.
This field identifies a criterion as critical, meaning that if this criterion fails, the entire patient message is considered to have failed the rubric regardless of the scores from all other criteria. Informational criteria cannot be critical and this value is always ‘false’ for them. For Scoring criteria, this value defaults to ‘false’; set it to ‘true’ only for criteria whose failure must disqualify the message as a whole.
{
"evaluationRubric": [
{
"mnemonic": "Rubric_001",
"name": "Sample Evaluation Rubric",
"description": "This evaluation rubric assesses patient data quality based on specific criteria.",
"version": "1.0",
"source": "PIQI Alliance",
"model": "PIQI_DataModel_ExtensionX",
"modelVersion": "2.5",
"criteria": [
{
"sequence": 1,
"description": "Check if patient birth date is a valid date.",
"dataClass": "Patient",
"entity": "birthDate",
"SAMMnemonic": "Attr_IsValidDate",
"SAMShortName": "ValidDate",
"successNameOverride": "Valid Birth Date",
"failureNameOverride": "Invalid Birth Date",
"SAMParameters": [],
"conditionalSAM": "Attr_IsPopulated",
"conditionalSAMParameters": [
{
"parameterName": "FieldRequired",
"parameterValue": "true"
}
],
"scoringEffect": "scoring",
"scoringWeight": 1,
"criticalityIndicator": false
},
{
"sequence": 2,
"description": "Verify if patient gender is populated.",
"dataClass": "Patient",
"entity": "gender",
"SAMMnemonic": "Attr_IsPopulated",
"SAMShortName": "GenderPopulated",
"successNameOverride": "Gender Present",
"failureNameOverride": "Gender Missing",
"SAMParameters": [],
"conditionalSAM": "",
"conditionalSAMParameters": [],
"scoringEffect": "informational",
"scoringWeight": 0,
"criticalityIndicator": false
}
]
}
]
}