Expanding the criteria for evaluating socio-technical software

Brian Whitworth, Victor Bañuls, Cheickna Sylla, Edward Mahinda

Research output: Contribution to journalArticlepeer-review

20 Scopus citations


This paper compares two evaluation criterion frameworks for sociotechnical software. Research on the technology acceptance model (TAM) confirms that perceived usefulness and perceived ease of use are relevant criteria for users evaluating organizational software. However, information technology has changed considerably since TAM's 1989 inception, so an upgraded evaluation framework may apply. The web of system performance (WOSP) model suggests eight evaluation criteria, based on a systems theory definition of performance. This paper compares WOSP and TAM criterion frameworks in a performance evaluation experiment using the analytic hierarchy process method. Subjects who used both TAM and WOSP criteria preferred the WOSP criteria, were more satisfied with its decision outcomes, and found the WOSP evaluation more accurate and complete. As sociotechnical software becomes more complex, users may need (or prefer) more comprehensive evaluation criterion frameworks.

Original languageEnglish (US)
Pages (from-to)777-790
Number of pages14
JournalIEEE Transactions on Systems, Man, and Cybernetics Part A:Systems and Humans
Issue number4
StatePublished - Jul 2008

All Science Journal Classification (ASJC) codes

  • Software
  • Information Systems
  • Human-Computer Interaction
  • Electrical and Electronic Engineering
  • Control and Systems Engineering
  • Computer Science Applications


  • Sociotechnical
  • Software requirements
  • System performance
  • Technology assessment


Dive into the research topics of 'Expanding the criteria for evaluating socio-technical software'. Together they form a unique fingerprint.

Cite this