Ultrasound Obstet Gynecol. 2017 Jul 17.

doi: 10.1002/uog.18813.

Sladkevicius P¹, Installé A^2,3, Van den Bosch T⁴, Timmerman D^4,5, Benacerraf B⁶, Jokubkiene L¹, di Legge A⁷, Votino A⁸, Zannoni L⁹, De Moor B^2,3, De Cock B⁵, Van Calster B⁵, Valentin L¹.

Author information

Abstract

OBJECTIVES:

To estimate intra- and inter-rater agreement and reliability with regard to describing ultrasound images of the endometrium using the International Endometrial Tumor Analysis (IETA) terminology.

METHODS:

Four expert and four non-expert raters assessed video clips of transvaginal ultrasound examinations of the endometrium from 99 women with postmenopausal bleeding and sonographic endometrial thickness ≥4.5 mm and no fluid in the uterine cavity. The following features were rated: endometrial echogenicity (nine categories), endometrial midline (four categories), bright edge (yes, no), endometrial-myometrial junction (four categories), color score (1 to 4), vascular pattern (seven categories), irregularly branching vessels (yes, no), color splashes (yes, no). The color content of the endometrial scan was estimated using a visual analogue scale (VAS) graded from 0 to 100. The clips were assessed twice > 2 months apart. The raters were blinded to their own results and to those of the others.

RESULTS:

Inter-rater differences in the prevalence of most IETA variables were substantial, and some variable categories were rare. Specific agreement was poor for variables with many categories. For binary variables, specific agreement was better for absence than presence of a category. For variables with more than two outcome categories specific agreement was best for undefined endometrial midline (93% and 96% for expert and non-expert raters), regular endometrial-myometrial junction (72% and 70%), and three-layer endometrial pattern (67% and 56%). The most reliable gray scale ultrasound variable was uniform versus non-uniform echogenicity (multirater Kappa, κ, 0.55 and 0.52 for expert and non-expert raters), the least reliable were appearance of the endometrial-myometrial junction (κ 0.25 and 0.16) and the nine-category endometrial echogenicity variable (κ 0.29 and 0.28). The most reliable color Doppler variable was color score (mean weighted κ 0.77 and 0.69). Intra- and inter-rater agreement and reliability were similar for experts and non-experts.

CONCLUSIONS:

Agreement and reliability when using IETA terminology was limited. This may have implications when assessing the association between a particular ultrasound feature and a specific histological diagnosis, because lack of reproducibility reduces the relationship of a feature with the outcome. Future studies should investigate if using fewer variable categories or offering practical training could improve agreement and reliability.

This article is protected by copyright. All rights reserved.

KEYWORDS:

Doppler; endometrium; observer variation; reproducibility of results; ultrasonography

資料來源：PubMed