Académique Documents
Professionnel Documents
Culture Documents
and
Abstract
mhussain@unbsj.ca
The Impact of Information Technology on Performance Evaluation:
Experience with Developing Countries
1. INTRODUCTION
Effective utilization of IT innovations has been a major theme in most of the recent
management practices. Not all organizations can easily incorporate necessary changes to
benefit from IT innovations. Along the way, IT has evolved from organizational problem
solving tool to a social- technical network (Kling and Lamb 2000) of technology,
concepts, and new theories have enriched the domain of research in the field.
Relationships between various aspects of organization and IT have been studied using
different empirical and theoretical perspectives (e.g., (Eason 1988); (Kling and Lamb
2000); (Abecker, Bernardi et al. 1998); (Leavitt and Whisler 1958); (Markus and Robey
1988); (Orlikowski 1992); (Aldrich 1972); (Pfeffer and Leblebici 1977); (Davis and
Taylor 1986); and (Kling 1978). Leavitt and Whisler (1958), in their seminal article,
managerial jobs and organizational structures. In this study I intend to explore some
organizational change and information systems. They analyzed the causal structure of
theoretical models on three dimensions: 1) causal agency, 2) logical structure and 3) level
of analysis. This paper links its theoretical underpinning to Markus and Robey’s
information systems to the choices made by the organization and individual managers.
satisfy organizational needs. Within this context, (Rahman and McCosh 1976) showed
that managers’ choose IS based on their decision making styles and organizational
subunit characteristics. Process theory, unlike deterministic variance theory, does not
emphasizes user choice and stipulates different levels of use of IS by managers within the
same organization. The process theory supports the argument that, the availability of
technology is a necessary condition but not the sufficient condition for the use of
The process theory provides the basis for the research model in this study.
From the above discussions one may conclude that studies in IT and organizational
process theory. We have incorporated the concept of drivers of change (DC) to these
concepts to extend the research domain. Drivers of change include three factors:
technology only. Influence of globalization and competition has been reported elsewhere
(Rahman, 2006). We have observed in the process theory that technological imperatives
are necessary but not sufficient conditions for change. This opens the possibility of
The DC effect is a fusion of social and economic transitions that are characterized by
rapid turnaround of ideas, actions, and products. To manage the constant organizational
and global changes, organizations develop new theories, systems, rules, policies, and
new industry and organization structures, innovative strategies, and global networking
using technologies.
institutions requires organic organization structures and new human capital development.
No single structure and strategy model can answer all questions for global enterprises
RESEARCH METHODOLOGY
Research questions
measures.
To address these research questions, the paper first examines the surrounding theoretical
Theoretical Perspectives
The formulation of the research questions and the construction and measurement of the
modernists look at the present, considering both the past and the future. Their critically
interpretive theories are conceived with input from different disciplines. Similarly, the
framework.
In an interpretive framework the main focus is on the questions asked and analytical
definition of dependent and independent variables is a strategy of analysis and not based
interdependent and complex social system is less of an assertion about reality than a
strategy of analysis.” This means that no one model can be the best fit for post-
modernization.
common themes: global enterprise, rapid change, access to global resources, and concern
for people (Gustafson 1995) . This paper poses research questions based on the concept
The support for the use of technology as independent variable stems from a postmodern
condition.
Because IT integrates ideas and actions from various fields, this paper assumes that these
communication), dynamic and complex systems, and multiple roles for individuals.
In this paper, organization structure is viewed as a construct of ideas, beliefs, and values
research focus on managers’ jobs and PEs at the organizational level, inherently deals
Organizational PE includes financial and non-financial measures. This paper finds that
financial measures (FM) and non-financial measures (NFM) meet the postmodern
expectations at varying levels. NFM are more amenable to post modernism than FM. In
our study we included measures in both areas. The following table illustrates post
There are strong arguments in favor of including NFM with FM in organizational PE For
example, (Kaplan and Norton 1996)have found that the inclusion of non-financial
measures has the potential to improve the long-term effectiveness of the organization.
However, some scholars have argued that NFM inclusion is not compatible with the
(Otley 1999). Most recently, (Hussain and Hoque 2002) discussed that decisions to
done for Deloitte Touche Tohmatsu surveyed 249 executives and board members from
around the globe and found that most executives expressed the need for non-financial
information. In 92% of the companies surveyed, the boards of directors stated that they
feel responsible for monitoring both the financial and non-financial measures of their
concern for finding reliable NFM. Saliemo found that only a third of the surveyed
The theoretical model for this research has been derived from the model reported by
While the focus of the base model is of global context, the one presented in this paper is
organizational focused. The current research extends the base model to explore how
technology effects are perceived within organizations. This extended model assumes that
defined by rules, roles, and relationships. Managers are key players in these processes.
Their perceptions of their jobs and performance measures are integral in the design and
postulates that, managers’ perceptions of their jobs and PEs are influenced by technology
adoption. The extended model identifies managers’ jobs and PEs as dependent variables
technology (IT). IT helps solve global management problems (Neo 1991). The study
In line with the research model, this paper develops two sets of variables for technology
to measure their influence on managers’ jobs and PEs. The banking industry was chosen
as the context for this study because it is a service industry where IT plays an important
role. Furthermore, banking penetrates global and local markets easily and faces global
was developed, of which 15 variables were used in this paper (Appendix A). The
technology variable set includes nine variables and PE set includes six variables. The PE
variables include both financial and non-financial measures. Descriptive statistics for
each construct are shown with the results and discussion section in the following pages.
The study results are based on data from the sections of the questionnaire relevant to
technology and PE measures. To ensure content validity and face validity several steps
additional content validity, face-to-face interviews were conducted with two managers.
The questionnaire was modified incorporating information from the pre-test and face-to-
face interviews to fit with bank managers’ conceptual domain and improve the quality of
consistency. Usually, large number of items in the questionnaire and high average inter-
correlation produce high Cornbach’s α. In this study both of these conditions were
present.
Data collection
With the help of senior bank administrators in these four countries questionnaires were
circulated via email (web-based) and in print form to mid-level managers of Bangladesh
(Bangla), Saudi Arabia, Oman and the United Arab Emirates (UAE) banks. The banks
selected we major private sector banks. In each country these banks are aggressively
managed due to intense competition from many foreign and local banks in these
countries. A total of 106 completed questionnaires were received from all four countries.
Twenty-nine completed questionnaires were received from UAE bank manager, 30 from
Bangladesh managers, 27 Oman Bank managers and 20 Saudi Bank managers . Short
Descriptions for the banking systems in each country along with the demographic data of
Measurement of variables
Technology Orientation
The questionnaire items, used to measure IT influence on jobs and performance PE were
selected after a careful consideration of their content and relevance. The internal validity
one country are listed in Appendix C. All correlations except three are significant at 5%
or lower ( 2-tailed). A composite variable was computed by adding values of all items
their technology orientations. The clustering techniques are heuristic algorithms. The size
and number of clusters are not inferred from any sampling theory. Therefore, this study
tests the invariance of clusters in various ways: 1) changing the number of variables and
the number of clusters and 2) inter-techniques validation (Roscoe 1974) with data from
one country. The paper used (a) Ward Method, (b) Average Linkage Method, and (c) K-
Means Cluster Analysis. The multiple methods provide comparable results. Using the
Ward Method, for each country three clusters were extracted for further analyses.
organizational variables (in this study PE measures) was designed using Likert’s
interaction - influence model (Foreland and Gilmer 1954) which assigns central
lead to three technology orientation clusters in most significantly different from each
other. Three clusters and number of cases are in all four countries are shown below:
Med-tech 10 7 10 10
Lo-tech 8 5 8 11
Total 30 21 28 30
each country. Test shows that the groups are significantly different except one. (Table
II).
It is not surprising to note that managers from the same bank in all four countries vary as
to their perception of technology adoption and its influence on jobs. Not only do they
perceive varying influences of technology but also they differ in their emphasis on
technology adoption across the organization. Using average scores, the nine business
application technologies included in the survey are ranked in Table III for each of the
four countries.
each country.
applications influence their jobs in different countries. One technology that is perceived
as having most influence on managers’ jobs in all four countries is the communication.
Web applications appear to be the next important technology in two countries. These
information technologies are recognized as having profound influences in the work place.
It is not surprising to note that IT emphasis in business has shifted from office
processing needs. This shift is partly driven by globalization and competition. Imaging,
database, and data processing are at the bottom of the list. I think it is because these are
back-office technologies and managers’ interactions with them are increasingly becoming
organizations.
We asked the managers to indicate on a 5-point scale the extent to which IT adoption and
I looked at the data at two levels. First, I looked at the aggregated PE data for all
countries and then at each PE measure for each country. Table IVa shows the descriptive
statistics for each country and the pair wise t-test significance level. Means of three pairs
These are (a) Bangla vs. Saudi Arabia, (b) Oman vs. Saudi, and (c) UAE vs. Saudi.
This leads us to conclude that Saudi managers perceive the influence on technology on
their PE differently than managers in other three countries. Saudi managers perceive
higher influence of IT in PE than the managers in other three countries. Their top ranked
technologies are communication, web applications, and speed. This matches with their
countries, higher technology oriented managers see more influence of technology on their
PE than the lower technology orientated managers. One may note that IT adoption by
managers has differentiated influence on PE and may observe that managers enjoy
flexibility in choosing the level of IT use. It may be noted that managerial levels IT
Association of technology adoption with productivity and revenue measures indicate that
banks use both financial and non-financial measures to evaluate the performance of its
managers. In other words, though not at the same level, technology -based information
system contributes to cost control, revenue improvement, and over all productivity in
these countries, where revenues and costs are financial measures and productivity
We see in the table, the top three ranked PE measures for the four countries are:
A. Bangladesh
1. Customer related measures, 2. Service quality measures, and 3. Cost related measures
B. Saudi
1. Over all Productivity, 2. Service quality and 3. Customers related measures
C. Oman
1. Overall productivity 2. Customer related measures and 3. Market ration
D. UAE
1. Revenue related measures 2. Overall productivity and 3. Customer related measures.
The above list shows that PEs in these countries emphasize overall productivity and
customer service. Bangladesh ranked cost related measures and UAE ranked revenue
different results. Table VIb shows the average scores and ranks for each cluster.
To see the relative importance of the influence on PE measures we have listed below the
top two ranked PE measures for three tech-clusters in all four countries. As shown
Following is a summary of the results for four countries grouped by tech-orientations for
managers.
measures.
As an alternative way of analysis, the results have been grouped by countries to observe
variation of the choice of PE measures within each country for each technology
orientation.
Bangladesh
It can be seen that Bangladeshi managers do not think accounting measures are among
the top two performance measures which are influenced by technology implementations.
Saudi Arabia
Saudi managers also do not perceive the accounting related measures as significantly
Oman
Among the Omani managers the hi-tech and lo-tech managers perceive accounting
overall productivity measure as one of the top two measures. To the med-tech managers
the service quality and market ratio are the top two PE measures.
UAE
Among the UAE managers the Hi-tech and Med-tech managers perceive accounting
perceive that overall productivity measure as one of the top two measures. To the Med-
tech managers the Revenue related measures and the . Overall productivity is top PE.
Hi: 1. Revenue related measures, 2. Overall productivity and customer related measures
organizations flexible and transparent, and enables organizations to respond quickly. The
accounting measures are inclined towards more structures, rule orientations, and time
lagged response. The results of this study indirectly confirm this apparent incongruity of
2. Managers in all countries agree that overall productivity measures are influenced
by technology implementations.
perceived as influenced by IT, the cost related measures are perceived as of low
or no influence.
management practices. Not all organizations can easily incorporate necessary changes to
benefit from IT innovations. Adoption of IT is necessary but not a sufficient condition for
its effective utilization. Organizations use new tools, techniques, and strategies to cope
structures as organizations implement processes to cope with the ensuing changes. This
study has investigated the influence of technology on managers’ jobs and PEs. Data were
collected from mid-level managers from major banks of four developing countries.
This study has shown that IT adoption has significant influence on managers’ jobs and
PEs. The research sample provided three significantly different clusters of managers
based on their perceptions of the influence of IT adoption on their jobs in four developing
influences revenue and overall productivity-related performance measures more than the
cost-related measures. This paper concludes that technology use influences managers’
jobs and PEs in banking in developing countries. Managers vary in their use of
than managers with a low technology orientation in two countries. To some degree,
managers choose to use a level of technology that they are comfortable with. Managers
Whereas, the accounting measures are inclined towards more structures, rule orientations,
This is an exploratory study based on data from four countries and one industry. In spite
generalization from this study. Future research could include data from developing
countries and developed countries to compare and contrast the influence of IT use in
various settings. Comparison between developing and developed countries may expose
many interesting and opposing perspectives. Furthermore, cross industry data analyses
would give interesting information on the influence of drivers of change in different types
of organizations. Results from future studies of this kind would allow global
industries and would help them in implementing structural and strategic changes due to
REFERENCES
Barret, C. A. and S. Goshal (1997). Managing Across the Borders: The Transnational
solutions, in Globalization, Technology, and Competition S. P. Bradley, J. A.
Hausman and R. L. Nolan. Boston, Harvard University Press.
Eason, K. (1988). Information Technology and Organization Change. London, Taylor &
Francis.
Ely, D. P. (1999). "Toward a philosophy of instructional technology: Thirty years on."
British Journal of Educational Technology 30(4): 305-10.
Kling, R. (1978). The Impacts of Computing on the Work of Managers, Data Analysts,
and Clerks. Irvine, Public Policy Research Organization, University of California.
Vicente, A., L. A. Bravo, et al. (2004). "A Comparison of the Shear Bond Strength of a
Resin Cement and Two Orthodontic Resin Adhesive Systems." The Angle
Orthodontist 75(1): 109-113.
Willmott, R. (2001). Structure, culture and agency: Rejecting the current orthodoxy of
organisation theory. Realist Perspectives on Management & Organizations. A.
Dtephen. Florence, KY, Goutledge: 66-86.
Figure 1. Base Model: Drivers of Change Model by Bradley, Hausman, and Nolan
(1999)
Globalization
Organizational
New Industry Strategy Structure
Structures
Technology
Managers’ jobs
Technology
Performance measurement
Driver of Change
Results were analyzed using the Mann-Whitney U-test for two independent samples.
Paired clusters within each country differ significantly from one another, p≤ .05 for
asymptotic and exact probability except Lo vs. Med pairs for Bangla and Saudi.
Bangladesh Oman
Ranks Scores Ranks Scores
1.5 Software application 3.6 1 3.68 Communication
1.5 Communication 3.6 2 3.54 Imaging
3 Storage 3.43 3 3.46 Storage
4 Data base 3.37 4 3.43 Data processing
5 Speed 3.27 5 3.25 Web application
6 Data processing 3.17 6.5 3.21 Software application
7 Message 3.03 6.5 3.21 Speed
8 Imaging 2.37 8 3.18 Message
9 Web application 2.1 9 3.07 Data base
Saudi U.A.E.
Ranks Scores Ranks Scores
1 Communication 4.25 1 3.9 Web application
2.5 Web application 3.95 2.5 3.86 Communication
2.5 Speed 3.95 2.5 3.86 Message
4.5 Software application 3.8 4 3.79 Speed
4.5 Message 3.8 5 3.72 Software application
6 Data base 3.6 6 3.48 Storage
7 Storage 3.55 7 3.14 Data processing
8 Data processing 3.4 8 3 Imaging
9 Imaging 2.9 9 2.9 Data base
Results were analyzed using the t-test for two independent samples. Paired clusters of
four countries differ significantly from one another, p≤ .05 except for three pairs such as
Bangla vs. Oman, Oman Vs. UAE and Bangla Vs. UAE.