Expanding the criteria for evaluating socio-technical software

Brian Whitworth, Victor Bañuls, Cheickna Sylla, Edward Mahinda

Research output: Contribution to journalArticlepeer-review

18 Scopus citations

Abstract

This paper compares two evaluation criterion frameworks for sociotechnical software. Research on the technology acceptance model (TAM) confirms that perceived usefulness and perceived ease of use are relevant criteria for users evaluating organizational software. However, information technology has changed considerably since TAM's 1989 inception, so an upgraded evaluation framework may apply. The web of system performance (WOSP) model suggests eight evaluation criteria, based on a systems theory definition of performance. This paper compares WOSP and TAM criterion frameworks in a performance evaluation experiment using the analytic hierarchy process method. Subjects who used both TAM and WOSP criteria preferred the WOSP criteria, were more satisfied with its decision outcomes, and found the WOSP evaluation more accurate and complete. As sociotechnical software becomes more complex, users may need (or prefer) more comprehensive evaluation criterion frameworks.

Original languageEnglish (US)
Pages (from-to)777-790
Number of pages14
JournalIEEE Transactions on Systems, Man, and Cybernetics Part A:Systems and Humans
Volume38
Issue number4
DOIs
StatePublished - Jul 2008

All Science Journal Classification (ASJC) codes

  • Software
  • Control and Systems Engineering
  • Human-Computer Interaction
  • Computer Science Applications
  • Electrical and Electronic Engineering

Keywords

  • Sociotechnical
  • Software requirements
  • System performance
  • Technology assessment

Fingerprint Dive into the research topics of 'Expanding the criteria for evaluating socio-technical software'. Together they form a unique fingerprint.

Cite this