testing, software, load testing, polling, software usability.


The article deals with the issues of testing the software usability. Usability evaluation is an urgent problem nowadays as it is a determinative factor of software success among its users. This problem should be solved during the whole software development lifecycle in order to create the best product for consumers. Also, usability evaluation should be conducted after software delivering to the end users in order to estimate the degree of their satisfaction and to notice what has to be changed in the next product‟s version. A test plan was developed for load testing in the paper. The results of load testing showed that the developed software works stably with a hundred of simultaneously working users; it was confirmed by a zero percentage error and a small response time of the system to user‟s inquiries. The survey method was used to study the convenience of using the developed software within the real-world strategy. This decision was taken due to the low cost of research and the unobtrusive nature of this method. The survey provides the ability to process a large amount of statistical data, which increases the reliability of the measurement. The Software Usability Measurement Inventory (SUMI) survey method was used to measure the usability of the developed software. In order to study the usability of the developed software, it was performed the usability comparing of the developed system with similar systems. The plurality of software products was compared. Then several users evaluated the usability of the proposed software implementing the SUMI method. Based on individual assessments a group of experts estimated each product and compared its usability. The survey measured the following aspects of user satisfaction: efficiency; emotional reaction; ability to help; control; accessibility. In order to receive the reliable results, 12 users were polled using the SUMI questionnaire. Their responses were interpreted and processed on the basis of the Rash model. As a result, usability estimates were obtained. The consistency of expert judgments is determined with the help of the coefficient of variation.


ISO/IEC 9126–1:2001 Software engineering – Product quality. Part 1 : Quality model. Available at: http://www.iso.org/iso/ catalogue_detail.htm?csnumber=22749 (accessed 20.12.2017).

Kaner C. Testing computer software. Thomson, 2001.

Fitzpatrick R. Strategies for evaluating software usability. Available at: http://www.comp.dit.ie/rfitzpatrick/papers/chi99%20-strategies.pdf (accessed 21.12.2017).

Jerz D. G. Usability Testing: What Is It? Available at : https://jerz.setonhill. edu/writing/technical-writing/usability-testing (accessed 23.12.2017).

Andreasen M. S., Nielsen H. V., Schroder S. O. Stage. What happened to remote usability testing? Proceedings of the SIGCHI conference on Human factors in computing systems. CHI, 2007, pp. 1405–1410.

Kapil C. M., Greenstein J. S. Synchronous remote usability testing: a new approach facilitated by virtual worlds. Proceedings of the 2011 annual conference on Human factors in computing systems. CHI, 2011, pp. 2225–2234.

Kirakowski J. The Use of Questionnaire Methods for Usability Assessment. Available at: http://sumi.ucc.ie/sumipapp.html (accessed 20.12.2017).

Arh T., Blazic B. A Case Study of Usability Testing – the SUMI Evaluation Approach of the Educa Next Portal. Available at : http://www.wseas.us/e-library/transactions/information/2008/25-191.pdf (accessed 22.12.2017).

Bevan N., Curson I. Methods for Measuring Usability. Available at : http://www. nigelbevan.com/papers/meatut97.pdf (accessed 21.12.2017).

ISO 9241–11 Ergonomic requirements for office work with visual display terminals (VDTs) Part 11 : Guidance on usability.

Zhao Y., Hambleton R. Software for IRT analysis: description and features. Available at : http://www.umass.edu/remp/ software/CEA-652.ZH-IRTSoftware.pdf (accessed 15.112017).

Sick J. Rasch analysis software programs. JALT Testing & Evaluation SIG Newsletter. 2005, no. 13 (3), pp. 13–16.





Сборник научных статей