Exploring and Comparing the Performance of Design Methods Used for Information Intensive Websites

Tarannum Zaki; Zinia  Sultana; S M Anisur  Rahman; Muhammad Nazrul Islam

doi:10.47981/j.mijst.08(01)2020.165(49-60)

Tarannum Zaki Military Institute of Science and Technology (MIST), Dhaka, Bangladesh
Zinia Sultana Military Institute of Science and Technology (MIST), Dhaka, Bangladesh
S M Anisur Rahman Military Institute of Science and Technology (MIST), Dhaka, Bangladesh
Muhammad Nazrul Islam Military Institute of Science and Technology (MIST), Dhaka, Bangladesh

DOI: https://doi.org/10.47981/j.mijst.08(01)2020.165(49-60)

Keywords: Human-computer interaction (HCI), Interactive dialogue model (IDM), User experience (UX), Card sorting, Usability

Abstract

At present, web applications are one of the most widely used software applications in different organizations. A website is a virtual representation of the structure of any organization. Good user experience of a website is highly dependent on the content organization or design of a website. Thus, the design is a very important factor to develop a high usability standard website. Different types of design techniques are used to develop different types of websites. It is a very challenging task to develop information-intensive websites using a suitable design technique so that the website can serve its intended purpose with enhanced usability and user experience. Therefore, the objective of this research is to compare the performance of two alternate design techniques for developing an information-intensive website. To achieve this objective, the existing design techniques were explored; and selected the Card Sorting and Interactive Dialogue Model (IDM) techniques to design two websites for an orphanage system. Later, the developed orphanage web systems were evaluated with ten participants through a user study; and found that the IDM design technique performs better than the Card Sorting technique in terms of the system’s usability and user experience.

Downloads

Download data is not yet available.

References

Abran, A., Khelifi, A., Suryn, W., & Seffah, A. (2003). Usability meanings and interpretations in ISO standards. Software Quality Journal, 11(4), 325-338.

Al-Fadhli, S. (1997). Critical success factors influencing E-Commerce in Kuwait. Journal of Internet Banking and Commerce, 16(1), 1–7.

Bolchini, D. & Garzotto, F. (2008). Designing multichannel web applications as “Dialogue Systems”: The IDM Model. In: Rossi G., Pastor O., Schwabe D., Olsina L. (Eds.), Web Engineering: Modelling and Implementing Web Applications. (pp. 193–219). London, United Kingdom: Springer-Verlag.

Bolchini, D., & Garzotto, F. (2007, December 3-7). Quality of web usability evaluation methods: An empirical study on MiLE+. Proceedings of the International Conference on Web Information Systems Engineering (WISE’07), Berlin, Heidelberg. (pp. 481-492).

Bolchini, D., & Paolini, P. (2006). Interactive dialogue model: A design technique for multichannel applications. Journal of IEEE Transactions on Multimedia, 8(3), 529-541.

Brejcha, J., & Marcus, A. (2013, July 21-26). Semiotics of interaction: Towards a UI alphabet. Proceedings of the 15th International Conference on Human-Computer Interaction (HCII’13), Las Vegas, Nevada, USA. (pp. 13–21).

Conte, T., Massollar, J., Mendes, E., & Travassos, G. H. (2007, September 20-21). Usability evaluation based on web design perspectives. Proceedings of the 1st international symposium on Empirical Software Engineering and Measurement (ESEM ’07), Madrid, Spain. (pp. 146–155).

Coppola, G., Fiore, A., Mainetti, L. & Pandurino, A. (2015, June 23-26). Mobile-IDM: A design method for modeling the new interaction style of mobile applications. Proceedings of the 15th International Conference on Web Engineering (ICWE’15), Rotterdam, Netherlands. (pp. 101–115).

Craske, D. J. (2010). Conceptual, logical & page designs for a proposed website for golf courses of Central Indiana and Indiana Microbrews [Technical report], Indiana University School of Informatics, Indiana, USA.

Duncan, J., & Holliday, W. (2008). The role of information architecture in designing a third-generation library website. Journal of College and Research Libraries, 69(4), 301–318.

Ebenezer, C. (2003). Usability evaluation of an NHS library website. Health Information and Libraries Journal, 20(3), 134-142.

Faiks, A., & Hyland, N. (2000). Gaining user insight: A case study illustrating the card sort technique. Journal of College and Research Libraries, 61(4), 350–357.

French, T., Liu, K., & Springett, M. (2007, September 3-7). A card-sorting probe of E-Banking trust perceptions. Proceedings of the 21st British HCI Group Annual Conference on People and Computers (BCS-HCI’07), University of Lancaster, United Kingdom. (pp. 45–83).

Garzotto, F., Paolini, P., & Schwabe, D. (1993). HDM-a model-based approach to hypertext application design. Journal of ACM Transactions on Information Systems (TOIS), 11(1), 1-26.

Gray, W. D., & Salzman, M. C. (1998). Damaged merchandise? a review of experiments that compare usability evaluation methods. Journal of Human-Computer Interaction, 13(3), 203–261.

Islam, M. N., & Bouwman, H. (2016). Towards user–intuitive web interface sign design and evaluation: A semiotic framework. International Journal of Human-Computer Studies, 86, 121-137.

Islam, M. N., Oishwee, S. J., Mayem, S. Z., Mokarrom, A. S. M. N., Razzak, M. A., & Kabir, A. B. M. H. (2017, December 7-9). Developing a multi-channel military application using Interactive Dialogue Model (IDM). Proceedings of the 3rd International Conference on Electrical Information and Communication Technology (EICT’17), Khulna, Bangladesh. (pp. 1–6).

Islam, M. N., Bouwman, H. & Islam, A. K. M. N. (2020). Evaluating Web and Mobile User Interfaces with Semiotics: An Empirical Study. IEEE Access, 8(1), 84396-84414. DOI: 10.1109/ACCESS.2020.2991840

Jeffries, R., Miller, J. R., Wharton, C., & Uyeda, K. (1991, April 27-May 2). User interface evaluation in the real world: A comparison of four techniques. Proceedings of the SIGCHI Conference on Human factors in Computing Systems (CHI’91), New Orleans, Louisiana, USA. (pp. 119–124).

Karat, C. M., Campbell, R., & Fiegel, T. (1992, June 3-7). Comparison of empirical testing and walkthrough methods in user interface evaluation. Proceedings of the SIGCHI Conference on Human factors in Computing Systems (CHI’92), Monterey, California, USA. (pp. 397–404).

Kumar, B. A., & Goundar, M. S. (2019). Usability heuristics for mobile learning applications. Education and Information Technologies, 24(2), 1819-1833.

Kurniawan, S., & Zaphiris, P. (2005, October 9-12). Research-derived web design guidelines for older people. Proceedings of the 7th International ACM SIGACCESS Conference on Computers and Accessibility (Assets’05), Baltimore, Maryland. (pp. 129–135).

Marcus, A. (Ed.) (2015). Design, User Experience, and Usability: Users and Interactions. Proceedings of the 4th International Conference, DUXU 2015, Held as Part of HCI International 2015, Los Angeles, CA, USA, August 2-7, 2015, Proceedings (Vol. 9187), Springer.

Matera, M., Costabile, M. F., Garzotto, F., & Paolini, P. (2002). SUE inspection: An effective method for systematic usability evaluation of hypermedia. Journal of IEEE Transactions on Systems, Man, and Cybernetics-Part A: Systems and Humans, 32(1), 93–103.

Mubin, S. A., Jantan, A. H. Jantan, & R. Abdullah (2015, December 16-17). UML-based navigational design approach for modeling complex interactions in web applications. Proceedings of the 9th Malaysian Software Engineering Conference (MySEC’15), Kuala Lumpur, Malaysia. (pp. 60–63).

Nielsen, J. (1995). 10 usability heuristics for user interface design. (Extracted on Apr. 23, 2020). Source: https://www.nngroup.com/articles/ten-usability-heuristics.

Park, K., Jeong, M., & Kim, K. (2020). Usability evaluation of menu interfaces for smartwatches. Journal of Computer Information Systems, 60(2), 156-165.

Palmer, J. W. (2002). Web site usability, design, and performance metrics. Journal of Information Systems Research, 13(2), 151–167.

Perrone, V., Bolchini, D., & Paolini, P. (2005, September 21-23). A stakeholders centered approach for conceptual modeling of communication-intensive applications. Proceedings of the 23rd Annual International Conference on Design of Communication: Documenting & Designing for Pervasive Information (SIGDOC’05), Coventry, United Kingdom. (pp. 25–33).

Petrie, H., Power, C., Cairns, P., & Seneler, C. (2011, September 5-9). Using card sorts for understanding website information architectures: Technological, methodological and cultural issues. Proceedings of the 13th IFIPTC13 International Conference on Human-Computer Interaction (INTERACT’11), Lisbon, Portugal. (pp. 309–322).

Preece, J., Rogers, Y., & Sharp, H. (2004). What is interaction design? In S. Kurniawan (Ed.), Interaction design: Beyond human-computer interaction (Vol. 3, pp. 1-18). Sussex, United Kingdom: John Wiley & Sons Ltd.

Razzak, M. A., & Islam, M. N. (2020). Exploring and Evaluating the Usability Factors for Military Application: A Road Map for HCI in Military Applications. Human Factors and Mechanical Engineering for Defense and Safety, 4(4), 1-18.

Rabi'u, S., Ayobami, A. S., & Hector, O. (2012, November 2). Usability characteristics of mobile applications. Proceedings of First International Conference on Behavioural & Social Science Research (ICBSSR), Kampar, Malaysia. (pp. 1-5).

Rugg, G. & McGeorge, P. (2005). The sorting techniques: A tutorial paper on card sorts, picture sorts and item sorts. Journal of Expert Systems, 22(3), 94–107.

Sagar, K., & Saha, A. (2017). A systematic review of software usability studies. International Journal of Information Technology, 9 (4), 1-24. DOI: 10.1007/s41870-017-0048-1

Spagnolo, L., Bolchini, D., Paolini, P., & Blas, N.D. (2010). Search-enhanced information architecture for content-intensive rich internet applications. Journal of Information Architecture, 2(1), 19–36.

Spencer, D. (2009). Card sorting: Designing usable categories. Rosenfeld Media, Brooklyn, New York.

Ternauciuc, A., &Vasiu, R. (2015). Integrated usability testing. TEM Journal, 4(4), 388 -395.

Tullis, T. S. (2007). Using closed card-sorting to evaluate information architectures. Proceedings of the Usability Professionals Association (2007) Conference, Austin, TX. (pp. 11-15).

Troyer, O. D., & Leune, C. J. (1998). WSDM: A user-centered design method for web sites. Journal of Computer Networks and ISDN Systems, 30 (1–7), 85–94.

Wentzel, J., Müller, F., Beerlage-de Jong, N., & van Gemert-Pijnen, J. E. W. C. (2016). Card sorting to evaluate the robustness of the information architecture of a protocol website. International Journal of Medical Informatics, 86, 71-81.

Zhang, T., Rau, P. L. P., & Salvendy, G. (2010). Exploring critical usability factors for handsets. Behaviour & Information Technology, 29(1), 45-55.

Zimmerman, D. E., & Akerelrea, C. (2002, September 17-20). A group card sorting methodology for developing informational websites. Proceedings of the International Professional Communication Conference (IPCC’02), Portland, Oregon, USA. (pp. 437–445).