1% of the cases as either probable or possible, RUCAM attributed 69.5% of the cases to the equivalent probable or possible categories. These comparative results are displayed in a box and whisker plot (Fig. 2). There was considerable variability in the comparison of the RUCAM score to each level of the DILIN structured expert opinion scores, with RUCAM displaying lower levels of causality (Spearman’s MK0683 datasheet correlation, r = 0.42 in absolute value; P = 0.0001). A comparison of the agreement among the reviewers in

causality assessment between the structured expert opinion and RUCAM methods, restricted to the 187 patients who had received only a single drug, is shown in Table 6. Complete agreement (MAD = 0) was reached in 27% with expert opinion versus 19% with RUCAM (P = 0.08). The average MAD was 1.12 with the DILIN strategy and 1.18 with the RUCAM strategy. In order to adequately assess the relationship between the conclusions of the DILIN process and RUCAM, it should be possible to directly compare the results of the two different

assessment methods. Such a comparison is, however, compromised by the fact that, even though both systems use five levels of likelihood, the terminological differences hinder a direct comparison. In an effort to circumvent this problem, two different types of comparisons were undertaken. The first consisted of directly comparing the results of the two learn more approaches in a 5 × 5 table with the established terms for each of them, even though an individual term, such as possible, might not have the identical weight. Nevertheless, the comparison is based on the relative ranking on PtdIns(3,4)P2 the two ordinal scales. As shown in cross-tabulation (diagonal box) in Table 7, there was agreement in the relative ranking in 230 of the 557 reviews (41.3%). Moreover, scores fell within one category of each other in 479 reviews (86.0%). The majority of cases scored at DILIN’s highest causality category (definite) were scored at lower levels by RUCAM. Similarly, disagreements at DILIN’s second causality level (very likely)

were scored more often at lower causality levels by RUCAM. In contrast, disagreements at DILIN’s third and fourth causality levels (probable and possible) were scored more often at higher causality levels by RUCAM. Thus, RUCAM graded more cases in the middle ranges, whereas the DILIN process scored a greater number of cases in higher and lower likelihood categories. A second analysis took into account the fact that a score of probable or higher in both systems would probably signify a valid case of DILI. Thus, the comparison was collapsed into a 2 × 2 table, and the outcomes for both were separated into “yes = DILI” and “no = not DILI” (Table 8). Even at this most basic level, there was agreement in only 384 of the reviews (68.9%), as displayed in the cross-tabulation. In this analysis, the DILIN expert opinion process was more likely than RUCAM to ascribe the case to DILI [DILIN, 495/557 (88.