Interobserver variability in the characterization of giant intracranial aneurysms with special emphasis on aneurysm diameter and shape

Background: The Giant Intracranial Aneurysm Registry is a multicenter observational trial exclusively focusing on giant intracranial aneurysms (GIA). As no data exist on the interobserver variability in the radiological description of GIA, there is some uncertainty concerning the reliability of the GIA characteristics included in the registry. We have therefore designed a study to test the interobserver variability in the description of the specific GIA characteristics that are examined in the GIA registry. Methods: Six different raters analyzed imaging of five GIA concerning GIA location, GIA size, GIA shape, GIA thrombosis, and the presence of perianeurysmal edema. Interobserver variability was examined using intraclass correlation and Fleiss’ kappa analysis. Results: The intraclass correlation coefficient was 0.99 (95 % CI 0.97–1.0) for the largest GIA diameter and 0.98 (95 % CI 0.94–1.0) for the largest GIA diameter in an axial imaging slice. We found perfect interobserver agreement (Fleiss’ kappa 1.00) in the characterization of GIA location and the presence of perianeurysmal edema and almost perfect interobserver agreement for GIA thrombosis (Fleiss’ kappa 0.86, 95 % CI 0.63–1.00). Only moderate interobserver agreement was found in the description of GIA shape (Fleiss’ kappa 0.50, 95 % CI 0.27–0.73). Conclusions: While GIA size, location, thrombosis, and the presence of perianeurysmal edema showed excellent interobserver agreement, the description of GIA shape was achieved with only moderate agreement. Data on GIA shape in multicenter studies, like the GIA registry, should therefore be discussed with caution and potentially reassessed in a centralized fashion.