TY - JOUR
T1 - Expanding the criteria for evaluating socio-technical software
AU - Whitworth, Brian
AU - Bañuls, Victor
AU - Sylla, Cheickna
AU - Mahinda, Edward
N1 - Funding Information:
Manuscript received November 25, 2005; revised January 14, 2007. This work was supported in part by grants from the Fulbright Foundation, Washington, D.C., and by NJIT Research Office. This paper was recommended by Associate Editor L. Rothrock. B. Whitworth is with the Institute of Information and Mathematical Sciences, Massey University, Albany, Auckland 0745, New Zealand (e-mail: [email protected]). V. Bañuls is with the Management Department, Pablo de Olavide University, 41013 Seville, Spain (e-mail: [email protected]). C. Sylla is with the School of Management, New Jersey Institute of Technology, Newark, NJ 07102-1982 USA (e-mail: [email protected]). E. Mahinda is with the Department of Information Systems, New Jersey Institute of Technology, Newark, NJ 07102-1982 USA. Color versions of one or more of the figures in this paper are available online at http://ieeexplore.ieee.org. Digital Object Identifier 10.1109/TSMCA.2008.923038
PY - 2008/7
Y1 - 2008/7
N2 - This paper compares two evaluation criterion frameworks for sociotechnical software. Research on the technology acceptance model (TAM) confirms that perceived usefulness and perceived ease of use are relevant criteria for users evaluating organizational software. However, information technology has changed considerably since TAM's 1989 inception, so an upgraded evaluation framework may apply. The web of system performance (WOSP) model suggests eight evaluation criteria, based on a systems theory definition of performance. This paper compares WOSP and TAM criterion frameworks in a performance evaluation experiment using the analytic hierarchy process method. Subjects who used both TAM and WOSP criteria preferred the WOSP criteria, were more satisfied with its decision outcomes, and found the WOSP evaluation more accurate and complete. As sociotechnical software becomes more complex, users may need (or prefer) more comprehensive evaluation criterion frameworks.
AB - This paper compares two evaluation criterion frameworks for sociotechnical software. Research on the technology acceptance model (TAM) confirms that perceived usefulness and perceived ease of use are relevant criteria for users evaluating organizational software. However, information technology has changed considerably since TAM's 1989 inception, so an upgraded evaluation framework may apply. The web of system performance (WOSP) model suggests eight evaluation criteria, based on a systems theory definition of performance. This paper compares WOSP and TAM criterion frameworks in a performance evaluation experiment using the analytic hierarchy process method. Subjects who used both TAM and WOSP criteria preferred the WOSP criteria, were more satisfied with its decision outcomes, and found the WOSP evaluation more accurate and complete. As sociotechnical software becomes more complex, users may need (or prefer) more comprehensive evaluation criterion frameworks.
KW - Sociotechnical
KW - Software requirements
KW - System performance
KW - Technology assessment
UR - http://www.scopus.com/inward/record.url?scp=46649107716&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=46649107716&partnerID=8YFLogxK
U2 - 10.1109/TSMCA.2008.923038
DO - 10.1109/TSMCA.2008.923038
M3 - Article
AN - SCOPUS:46649107716
SN - 1083-4427
VL - 38
SP - 777
EP - 790
JO - IEEE Transactions on Systems, Man, and Cybernetics Part A:Systems and Humans
JF - IEEE Transactions on Systems, Man, and Cybernetics Part A:Systems and Humans
IS - 4
ER -