Search results

The purpose of this research is to compare the results of two different usability techniques in evaluating the Web of Science interface.

At first three human factors experts conducted a heuristic evaluation with the interface. Then, usability testing was conducted with 22 students recruited from various departments at Loughborough University, UK.

A comparison of these techniques showed that heuristic evaluation revealed qualitative information whereas usability testing uncovered mostly quantitative data about usability of the interface. Although heuristic evaluation found more problems than usability testing, it also identified complementary information.

This paper recommends applying multiple usability techniques to ensure comprehensiveness in evaluating IR interfaces.

This paper shows that using multiple usability techniques resulted in a high degree of comprehensiveness in evaluating IR user interfaces.

The main objective of this paper is to review work on the usability and impact of digital libraries.

Work on the usability and impact of digital libraries is reviewed. Specific studies on the usability and impact of digital libraries in specific domains are also discussed in order to identify general and specific usability and impact measures.

The usability studies reviewed in this paper show that a number of approaches have been used to assess usability. In addition to the technical aspects of digital library design (e.g. architecture, interfaces and search tools), there are a number of usability issues such as globalisation, localisation, language, culture issues, content and human information behaviour. Digital libraries should, however, be evaluated primarily with respect to their target users, applications and contexts.

Although a digital library evaluation study may have several objectives, ranging from the evaluation of its design and architecture to the evaluation of its usability and its impact on the target users, this paper focuses on usability and impact.

This paper provides insights into the state‐of‐the art in relation to the usability and impact of digital libraries.

The purpose of this paper is to improve and facilitate the work of developers and usability evaluators by providing an adaptable and effective support. A well-defined set of criteria and a range of evaluation values for each criterion as well as a complete websites classification, will guide evaluators. A usability percentage and a list of prioritized criteria, adapted to the type of website by a new usability metric, will help developers to improve the website. This improvement will increase the degree of web user satisfaction.

Having established and validated a new usability evaluation framework, several usability tools have been analyzed. None of them totally fulfills the requirements of the evaluation framework. As a result of being unable to customize any of them, a new one has been developed. A study of 42 enterprise websites in an economically depressed region of Europe was performed using the new tool. This study involved 42 evaluators and 118 web users. Users have evaluated the websites before and after the redesign. A end-user computing satisfaction model-based questionary was used to collect data about end-user satisfaction. The results validate the proposal.

The study confirms that the proposed tool provides valuable information during the process of web development, evaluation and redesign. In adittion, it reveals that improving websites usability by ensuring criteria compliance has a positive effect on web users satisfaction.

Unlike previous purposes, the proposed tool allows to evaluate any type of website with a well-defined set of evaluation criteria and specific criteria values. As outcomes, the tool provides the website usability degree and a list of criteria ordered by priority repair. These results are adapted to the specific type of website. This makes easier and more effective the redesign of the evaluated website.

The purpose of this paper is to provide an integrated list of heuristics and an information architecture (IA) framework for the heuristic evaluation of the IA of academic library websites as well as an evaluation framework with practical steps on how to conduct the evaluation.

A set of 14 heuristics resulted from an integration of existing usability principles from authorities in the field of usability. A review of IA literature resulted in a framework for dividing academic library websites into six dialogue elements. The resulting heuristics were made applicable to academic library websites through the addition of recommendations based on a review of 20 related studies.

This study provides heuristics, a framework and workflow guidelines that can be used by the various evaluators of academic library websites, i.e. library staff, web developers and usability experts, to provide recommendations for improving its usability.

The focus of the usability principles is the evaluation of the IA aspects of websites and therefore does not provide insights into accessibility or visual design aspects.

The main problem that is addressed by this study is that there are no clear guidelines on how to apply existing usability principles for the evaluation of the IA of academic library websites.

The objective of this research was to develop a new and highly accurate approach based on a fuzzy inference system (FIS) for the evaluation of usability based on ISO 9241-210:2019. In this study, a fully automated method of usability evaluation is used for interactive systems with a special look at interactive social robots.

Fuzzy logic uses as an intelligent computing technique to deal with uncertainty and incomplete data. Here this system is implemented using MATLAB fuzzy toolbox. This system attempted to quantify four criteria that correlate highly with ISO 9241-210:2019 criteria for the evaluation of interactive systems with maximum usability. Also, the system was evaluated with standard cases of computer interactive systems usability evaluation. The system did not need to train various data and to check the rules. Just small data were used to fine-tune the fuzzy sets. The results were compared against experimental usability evaluation with the statistical analysis.

It is found that there was a high strong linear relation between the FIS usability assessment and System Usability Scale (SUS) based usability assessment, and authors’ new method provides reliable results in the estimation of the usability.

In human-robot systems, human performance plays an important role in the performance of social interactive systems. In the present study, the proposed system has considered all the necessary criteria for designing an interactive system with a high level of user because it is based on ISO 9241-210:2019.

For future research, the system could be expanded with the training of historical data and the production of rules through integrating FIS and neural networks.

This system considered all essential criteria for designing an interactive system with a high level of usability because it is based on ISO 9241-210:2019. For future research, the system could be expanded with the training of historical data and the production of rules through integrating FIS and neural networks.

The objective of this paper is to evaluate the usability of the recently developed IREON – International Relations and Area Studies Gateway – with the aid of an anthropological motivated research design. Within such an approach, the work environment and subject experiences of the test subjects become a crucial part of the observation.

The objectives are achieved by contextualisation of the digital library under examination. Furthermore, previous evaluation models of digital libraries are discussed from an anthropological point of view. As a result, a multi‐method approach that is context‐relative and self‐reflexive is applied to assess the usability of IREON.

The structural and cultural complexity of people involved in the development, operation and usage of IREON justifies a multi‐method approach. Whereas information specialists and web designers tend to focus on different kind of problems, there is a high degree of common discoverability between political science students and researchers.

Because of the contingent nature of digital library usage, evaluation methods and findings have to be always reassessed.

Anthropologically motivated usability evaluations are an inexpensive but efficient way to improve design activities.

This paper provides librarians with basic knowledge of anthropological methods to evaluate digital library services.

The purpose of this paper is to present a methodology combining experimental and inquiry methods used for software usability evaluation. The software product of LeViS project funded by the European Commission (Socrates/Lingua II) is used as an evaluation paradigm. The aim of the paper is twofold: to present the results of the usability evaluation using this software as an example and to suggest a number of improvements for the next version of the software tool; and to portray the advantages of combining methods from different evaluation approaches and the experiences from their application.

The evaluation for this experiment combined different usability methods, both experimental and inquiry ones. More specifically, the methods employed were the Thinking Aloud Protocol and the User Logging, which were performed in a usability evaluation laboratory, as well as the inquiry methods of Interview and Focus Group.

In this study, usability problems regarding the Learning via Subtitling (LvS) educational software were revealed as well as issues regarding the use of Thinking Aloud Protocol method and involving users with a specific profile. The research findings presented in this paper constitute an innovative and effective methodology for software usability evaluation and are useful for laboratories aiming to conduct similar evaluations.

Although this methodology has been successfully applied for over 20 software products, due to practical purposes related to this paper's extent, only one software is used as an example.

Through the evaluation process, apart from discovering certain usability problems related to the software, there are a number of important conclusions drawn, regarding the methods used and the methodology followed in software usability evaluation.

The purpose of the paper is to present usability heuristics for the evaluation of public library web services.

Heuristics for library services are based on Nielsen's classical list of heuristics and results of previous usability research of library web services. A total of 15 public library web sites were evaluated on the basis of these applied heuristics. One part of the study was supported through usability tests. The results of these studies were utilized to evaluate the applied heuristics.

The applied heuristics are divided into three categories: heuristics critical from the usability viewpoint; heuristics concerning major problems; and heuristics connected to minor usability problems but still important and concerning conventions of web design. The use of the heuristics and the results they give are evaluated to provide a basis for their use in future.

The applied heuristics lists have been tested in two different studies, and the combined list based on them has so far been utilized in practical evaluation, but has not been formally tested.

The heuristics for library web services presented in this paper can be applied to usability evaluation of public library web services.

Library web sites should be user friendly, because the services are meant for all citizens. The applied heuristics for public library web services provide a starting point for usability evaluation that can be continued with other methods.

The purpose of this paper is to discuss heuristic evaluation as a method for evaluating e‐learning courses and applications and more specifically to investigate the applicability and empirical use of two customized e‐learning heuristic protocols.

Two representative e‐learning heuristic protocols were chosen for the comparative analysis. These protocols augment the “traditional” heuristic sets so as to cover technology‐enhanced learning properties. Two reviewers that have considerable experience in usability evaluation as well as in e‐learning were involved in this comparative analysis. Coverage, distribution and redundancy were employed as three basic criteria for conducting the evaluation

The main results of the study indicate that both heuristic protocols exhibit wide coverage of potential usability problems. The distribution of usability problems is uneven to a large number of heuristics for both heuristic sets, which reveals that some heuristics are more general than others.

This study shows the empirical application of two heuristic protocols in a usability evaluation of e‐learning applications. Furthermore, it provides a comparison of the two heuristic sets according to a set of criteria and provides a first set of suggestions regarding further development and validation of these heuristic sets.

The purpose of this paper is to develop a methodological usability evaluation approach for e‐commerce websites in developing countries.

A multi‐faceted usability evaluation of three Jordanian e‐commerce websites was used, where three usability methods (user testing, heuristic evaluation and web analytics) were applied to the sites.

A four‐step approach was developed to facilitate the evaluation of e‐commerce sites, mindful of the advantages and disadvantages of the methods used in identifying specific usability problems.

The approach was developed and tested using Jordanian users, experts and e‐commerce sites. The study compared the ability of the methods to detect problems that were present, however, usability issues not present on any of the sites could not be considered when creating the approach.

The approach helps e‐commerce retailers evaluate the usability of their websites and understand which usability method(s) best matches their need.

This research proposes a new approach for evaluating the usability of e‐commerce sites. A novel aspect is the use of web analytics (Google Analytics software) as a component in the usability evaluation in conjunction with heuristics and user testing.