A portable mnemonic to facilitate checking for cognitive errors

BMC Research Notes

Table 3 CVI-Relevance and the modified kappa statistics (κ*) of item relevance

Quadrant and item	CVI-relevance	p_c	Modified κ*	Evaluation of κ*
Quadrant 1: T = life or limb threat (What are the life or limb threatening conditions in this patient?)
Item 1: cognitive errors due to failure to consider life or limb threatening conditions	1.0	0.008	1.0	Excellent
Quadrant 2: W = wrong? (What if i am wrong? what else could it be?)
Item 2: cognitive errors due to overattachment to a particular diagnosis	1.0	0.008	1.0	Excellent
Item 3: cognitive errors due to failure to consider alternative diagnoses	1.0	0.008	1.0	Excellent
Quadrant 3: E = evidences (Do i have sufficient evidences for or against this diagnose?)
Item 4: cognitive errors due to inheriting someone else’s thinking	0.86	0.055	0.85	Excellent
Item 5: cognitive errors due to erroneous estimation or perception of prevalence	0.57	0.273	0.41	Fair
Quadrant 4: D = dispositional factors (What are the environmental & emotional (2Es) dispositions influencing my decision?)
Item 6: Cognitive errors associated with patient characteristics (‘emotive’ influence of patient)	0.71	0.164	0.65	Good
Item 7: Cognitive errors associated with doctor’s affect or personality (‘emotive’ influence of doctor)	0.86	0.055	0.86	Excellent
Item 8: Cognitive errors caused by impact of the workplace environment (‘environmental’)	0.86	0.055	0.86	Excellent

The formula for modified kappa statistic (κ*) = (CVI-Relevance − pc)/(1 − pc), where pc represents probability of a chance occurrence [18]
p_c is the probability of chance of occurrence. The formula for p_c is: N!/[A!*(N−A)!]*0.5 ^N where N = the number of judges, A = the number agreeing on good relevance [18]
Evaluation criteria for modified kappa (κ*): κ* = fair (0.40–0.59), κ* = good (0.60–0.74) and κ* = excellent (>0.74)
CVI should be 0.88 and above to establish validity with a p < 0.05

ISSN: 1756-0500