Testing of the assisting software for radiologists analysing head CT images : lessons learned
Martynov, Petr; Mitropolskii, Nikolai; Kukkola, Katri; Gretsch, Monika; Koivisto, Vesa-Matti; Lindgren, Ilkka; Saunavaara, Jani; Reponen, Jarmo; Mäkynen, Anssi (2017-12-11)
Martynov, P., Mitropolskii, N., Kukkola, K., Gretsch, M., Koivisto, V., Lindgren, I., Saunavaara, J., Reponen, J., Mäkynen, A. (2017) Testing of the assisting software for radiologists analysing head CT images: lessons learned. BMC Medical Imaging, 17 (1). doi:10.1186/s12880-017-0229-1
© The Author(s) 2017. This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
https://creativecommons.org/licenses/by/4.0/
https://urn.fi/URN:NBN:fi-fe2017121555869
Tiivistelmä
Abstract
Background: Assessing a plan for user testing and evaluation of the assisting software developed for radiologists.
Methods: Test plan was assessed in experimental testing, where users performed reporting on head computed tomography studies with the aid of the software developed. The user testing included usability tests, questionnaires, and interviews. In addition, search relevance was assessed on the basis of user opinions.
Results: The testing demonstrated weaknesses in the initial plan and enabled improvements. Results showed that the software has acceptable usability level but some minor fixes are needed before larger-scale pilot testing. The research also proved that it is possible even for radiologists with under a year’s experience to perform reporting of non-obvious cases when assisted by the software developed. Due to the small number of test users, it was impossible to assess effects on diagnosis quality.
Conclusions: The results of the tests performed showed that the test plan designed is useful, and answers to the key research questions should be forthcoming after testing with more radiologists. The preliminary testing revealed opportunities to improve test plan and flow, thereby illustrating that arranging preliminary test sessions prior to any complex scenarios is beneficial.
Kokoelmat
- Avoin saatavuus [34186]
