Académique Documents
Professionnel Documents
Culture Documents
Informatics Institute
Department of Information Systems
Dissertation Review
Report
Fall 2010
This report has seven clauses, namely General Information, Introduction of the Dissertation,
In General Information clause, Title, Author, Location, Time, Intended Purpose of the
Completion of the Dissertation, Contributors, and the Citation of the Dissertation are provided.
and Summary of the Dissertation clauses, each of these special chapters of the dissertation are
reviewed. Additionally, the outlines of the each chapter of the dissertation are provided and the
information provided in each chapter is summarized and commented. In this context, main
purpose or outcome of the study (as stated by the author), methodology that is used in the
literature review part (inductive vs. deductive or both), research design model (single linear or
multi method), and data collection methods and instruments (self developed or adopted or
standardized) of the study, and the quality of the last chapter in terms of answering research
In Adoption for My Study clause, potential of any data collection/analysis techniques that I
think I can adopt for my own study and other sorts of adoptions and benefits that I am to take
1
Table of Contents
Preface ..............................................................................................................................................1
Table of Contents ...............................................................................................................................2
1 General Information ...................................................................................................................5
1.1 Title ..................................................................................................................................................... 5
1.2 Author ................................................................................................................................................. 5
1.3 Where ................................................................................................................................................. 5
1.4 When ................................................................................................................................................... 5
1.5 For ....................................................................................................................................................... 5
1.6 With..................................................................................................................................................... 5
1.7 Citation ................................................................................................................................................ 6
2 Introduction of the Dissertation ..................................................................................................7
2.1 Outline of the Chapter ........................................................................................................................ 7
2.2 Problem Statement ............................................................................................................................. 7
2.3 Goal ..................................................................................................................................................... 8
2.4 Hypotheses and Research Questions.................................................................................................. 8
Hypothesis 1 (H1) .................................................................................................................................. 8
Research Question 1 (RQ1) ................................................................................................................... 9
Research Question 2 (RQ2) ................................................................................................................... 9
Hypothesis 2 (H2) .................................................................................................................................. 9
Research Question 3 (RQ3) ................................................................................................................... 9
Research Question 4 (RQ4) ................................................................................................................... 9
2.5 Assumptions, Barriers and Issues ....................................................................................................... 9
Assumptions .......................................................................................................................................... 9
Barriers and Issues .............................................................................................................................. 10
2.5 Overall Evaluation of the Chapter ..................................................................................................... 10
Table 1: Maturity Table for the 1st Chapter of the Dissertation ..................................................... 10
3 Literature Review of the Dissertation ........................................................................................ 11
3.1 Outline of the Chapter ...................................................................................................................... 11
3.1 Defining IS/IT ..................................................................................................................................... 11
2
3.2 Methodology used in the Literature Review .................................................................................... 12
Figure 1: Literature Review – Deductive Methodology Flow ......................................................... 12
Figure 2: Literature Review – Inductive Methodology Flow ........................................................... 13
3.3 Overall Evaluation of the Chapter ..................................................................................................... 13
Table 2: Maturity Table for the 2nd Chapter of the Dissertation..................................................... 14
4 Methodology of the Dissertation .............................................................................................. 15
4.1 Outline of the Chapter ...................................................................................................................... 15
4.2 Research Design Model..................................................................................................................... 15
Figure 3: Phases of the Research Design ........................................................................................ 16
4.3 Overall Evaluation of the Chapter ..................................................................................................... 16
Table 3: Maturity Table for the 3rd Chapter of the Dissertation ..................................................... 17
5 Results of the Dissertation ........................................................................................................ 18
5.1 Outline of the Chapter ...................................................................................................................... 18
5.2 Results ............................................................................................................................................... 18
Figure 4: Model Development ........................................................................................................ 19
Table 4: Content-analytic Summary................................................................................................ 20
5.3 Overall Evaluation of the Chapter ..................................................................................................... 20
Table 5: Maturity Table for the 4th Chapter of the Dissertation ..................................................... 21
6 Conclusions, Implications, Recommendations, and Summary of the Dissertation ....................... 22
6.1 Outline of the Chapter ...................................................................................................................... 22
6.2 Summary and Evaluation of the Last Chapter of Dissertation .......................................................... 23
Table 6: Constructs, Descriptions and Sub-classifications .............................................................. 24
Figure 5: Developed Conceptual Model ......................................................................................... 25
Table 7: Checklist for Conducting IS/IT Evaluations ........................................................................ 26
6.3 Quality of the Last Chapter Concerning Answers for Research Questions ....................................... 27
Hypothesis 1 (H1) ................................................................................................................................ 27
Research Question 1 (RQ1) ................................................................................................................. 27
Research Question 2 (RQ2) ................................................................................................................. 27
Hypothesis 2 (H2) ................................................................................................................................ 27
Research Question 3 (RQ3) ................................................................................................................. 27
Research Question 4 (RQ4) ................................................................................................................. 27
Answer for Research Question #1: ..................................................................................................... 28
3
Answer for Research Question #2: ..................................................................................................... 28
Conclusion for Hypothesis #1: ............................................................................................................ 28
Answer for Research Question #3: ..................................................................................................... 29
Answer for Research Question #4: ..................................................................................................... 29
Conclusion for Hypothesis #2: ............................................................................................................ 30
Table 8: Maturity Table for the 5th Chapter of the Dissertation ..................................................... 30
7 Adoption for My Study ............................................................................................................. 31
7.1 My Study’s Title and Abstract ........................................................................................................... 31
Title ..................................................................................................................................................... 31
Abstract ............................................................................................................................................... 31
7.2 Adoptions .......................................................................................................................................... 32
4
1 General Information
1.1 Title
The title of the reviewed dissertation is “A Model for the Evaluation of IS/IT Investments.”
1.2 Author
1.3 Where
1.4 When
1.5 For
1.6 With
The reviewed dissertation is completed by Paul M. Tuten with the following academic staff:
5
1.7 Citation
Tuten, P. M. A model for the evaluation of IS/IT investments. Ph.D. dissertation, Nova
Southeastern University, United States - Florida. Retrieved October 31, 2010, from
6
2 Introduction of the Dissertation
The “Introduction” part of the reviewed dissertation has the following parts:
Problem Statement,
Goal,
Resource Requirements,
Summary, and
Definition of Terms.
The problem investigated in the study was the complexity and difficulty faced by practitioners in
The researcher tries to criticize that evaluation of the investments in IS/IT by practitioners is a
7
2.3 Goal
to examine IS/IT evaluation, together with its approaches, techniques, and methods, as
The researcher proposed two hypotheses and two research questions for each of these
hypotheses. Specifically, there are two hypotheses and four research questions in the related
reviewed dissertation.
Hypothesis 1 (H1)
Existing models of IS/IT evaluation are inadequate because they fail to include all of the relevant
constructs:
the individuals involved in, or affected by, the evaluation (who); and
the external and internal environmental conditions under which the organization operates
(where).
8
Research Question 1 (RQ1)
What models of the IS/IT evaluation process are presented in the literature?
How do the constructs (identified in H1) relate to the process of IS/IT evaluation?
Hypothesis 2 (H2)
An improved conceptual model of IS/IT evaluation provides an effective tool for describing and
Is the researcher’s conceptual model valid for describing IS/IT evaluation practices?
What guidelines may be derived from using the researcher’s conceptual model as an analytical
Assumptions
1. Putting on one side philosophical and epistemological arguments about the “true” nature
2. The researcher believes that the conceptual model of IS/IT evaluation should be. That is,
it should be able to describe equally well the activities of individuals regardless of the
9
3. Despite the need for contextual appropriateness in IS/IT evaluation, the researcher
assumes that practitioners require a sufficient degree of methodological guidance with the
Purposely, the following barriers and issues were identified by the researcher.
contributions.
As this chapter of the dissertation explicitly and clearly provides information about the problem
statement, goal, hypotheses, research questions & assumptions, relevance & significance,
barriers and issues, limitations and delimitations, and the resource requirements of the
Implemented
Implemented
Implemented
Partially
Fully
Not
Chapter
1
Introduction X
10
3 Literature Review of the Dissertation
The “Literature Review” part of the reviewed dissertation has the following parts:
Summary.
The researcher first acknowledges distinction between information systems (IS) and information
infrastructure, and IS is referred as the design of information flows that attempt to meet an
organization’s informational needs. Additionally, the researcher notes that in theory, IS may or
may not be primarily based on information technology, in practice, however, IS -especially ones
subjected to a formal evaluation process- contain some IT element. For the purpose of this study,
11
the researcher generally used the terms interchangeably and noted any particular instances in
The researcher used both deductive and inductive methodology in the literature review part of
the dissertation. From the deductive perspective, the researcher explored IS/IT evaluation by
examining the underlying assumptions, professional practices, and continuing concerns of both
practitioners and academicians. For this purpose, the researcher deconstructed IS/IT evaluation
into a mass of contextual elements. In this context, each of these elements was considered
independently and then, in relation to each other. Subsequently, the researcher identified themes
that span this varied body of literature with the purpose of drawing provisional conclusions about
Deconstruction Drawing
IT/IS Evaluation
Provisional
Contextual Elements
Conclusions
Mostly, the researcher demonstrated that the contextual elements of IS/IT evaluation must be
better understood in order to advance the field’s effectiveness and significance. Eventually, as
12
the researcher note, this improved understanding should take the form of a conceptual model of
IS/IT evaluation, which may be utilized for both descriptive and normative purposes.
From the inductive perspective, the researcher synthesized the fragmented, disjointed, and
Fragmented Insights
Disjointed Insights
Synthesize
Unified-whole Themes
Contradictory Insights
In the literature review, the researcher established that IS/IT evaluations are comprised of
13
These elements, as noted by the researcher, include:
the individuals involved in, or affected by, the evaluation (who); and
the external and internal environmental conditions under which the organization operates
(where).
Each of these constructs was examined in detail by the researcher in the literature review part of
the dissertation, including special emphasis on the specific criteria or measures of evaluation
Additionally, the researcher reviewed existing models which depicted the process of IS/IT
evaluation, as he note down the limitations and differences found in each example.
Implemented
Implemented
Implemented
Partially
Fully
Not
Chapter
1
Introduction X
Chapter
2
Literature Review X
14
4 Methodology of the Dissertation
The “Methodology” part of the reviewed dissertation has the following parts:
Summary
The researcher utilized a multiphase approach in the study. There are four main stages for the
These are:
The validation of the conceptual model via a meta-analysis of multiple case studies and
organizations, and
15
Comprehensive Development of
Literature Review Conceptual Model Validation of Reporting of
Conceptual Model the Results
The researcher conducted a comprehensive literature review to address Hypothesis 1 and endow
After this, by using the literature review findings the researcher developed the conceptual model
in the study.
The researcher’s conceptual model represents the innermost work of art of the study, to provide
Subsequently, the researcher validated the conceptual model based upon case studies and then
utilized it to develop normative guidelines meant for conducting evaluations, in that way
16
addressing Hypothesis 2 by means of answering Research Question 3 and Research Question 4
correspondingly.
After all, the researcher reported the findings associated with each of the hypotheses and
research questions and discussed implications for both future academic research and professional
practices.
As seen above, in four steps the researcher is done. That is to say, the research is completed in
these four steps by justifying two hypotheses with reference to four research questions. Please
see Sub-clause 2.4 of this document for hypotheses and research questions.
Implemented
Implemented
Implemented
Partially
Fully
Not
Chapter
1
Introduction X
Chapter
Literature Review X
2
Chapter
Methodology X
3
17
5 Results of the Dissertation
The “Results” part of the reviewed dissertation has the following parts:
Summary
5.2 Results
Throughout the Results chapter, the researcher reported the results using a sequence of events
style. The reason for the researcher to do this is to reflect the iterative and cyclical processes
associated with analyzing, writing, and reflecting throughout this study. Furthermore, the
researcher selected this sort of reporting structure in response to Yin’s (2003) call to use the
writing and editing process as an analytical tool and mechanism to clarify thoughts.
In the chapter, the researcher described the construction of a conceptual model of the process of
IS/IT evaluation based on the findings from the literature review. The researcher began by
describing the limitations associated with existing conceptual models. Next, the researcher
18
identified seven constructs associated with the context of an evaluation. Finally, the researcher
developed these constructs into a conceptual model, which resulted after multiple iterations of
model development.
Identify Constructs
of Evaluation
After developing conceptual model, the researcher validated it using a multi-case study analysis.
In this context, the researcher followed the steps explained in Methodology part, and reviewed
The researcher confirmed that the conceptual model that is developed represented a “good”
theoretical contribution based on Whetten’s (2002) standard, which required the conceptual
In conclusion, the researcher performed a cross-case analysis to identify elements that could
serve as the basis for methodological guidelines for conducting more contextually appropriate
IS/IT evaluations.
19
In this context, the researcher described similarities and differences among the narratives of the
case studies. Likewise, the researcher also identified four “drivers” of contextual evaluations, as
well as at least two examples of how each driver was implemented in practice, Table 4. Based
upon these findings, the researcher constructed IS/IT evaluation guidelines that are described in
the last chapter o the dissertation, including a checklist for practitioners support.
Using the procedures explained in Methodology chapter of the dissertation, the researcher
resented a proposed conceptual model of the process of IS/IT evaluation based on the
20
validated the proposed model using a multi-case study analysis, and
The above steps are satisfactorily done with enough information. Therefore, this chapter is
Implemented
Implemented
Implemented
Implemented
Partially
Clauses vs. Implementations
Largely
Fully
Not
Chapter
1
Introduction X
Chapter
Literature Review X
2
Chapter
Methodology X
3
Chapter
Results X
4
21
6 Conclusions, Implications, Recommendations, and Summary of the
Dissertation
Conclusions
Research Question #4: What Guidelines May Be Derived from the Model?
Implications
Recommendations
Summary
22
6.2 Summary and Evaluation of the Last Chapter of Dissertation
Having
the researcher finalized the study by drawing a number of conclusions and recommendations.
Additionally, the researcher considered the implications of the study’s outcomes for practitioners
and researchers.
The researcher utilized the model to develop a series of guidelines and a checklist to aid
In addition to providing guidelines for improved professional practice, the researcher set forth a
a call for further validating the conceptual model, making additional refinements and/or
extensions to it, developing a comprehensive theory of IS/IT evaluation rooted in the conceptual
model, and the exploring the implications for pedagogy of the researcher’s findings.
23
To summarize the literature review findings, the researcher developed a summary including
description of each construct and any relevant sub-classifications available in the literature. See
The researcher’s conceptual model describes the interactions between the unique conceptual
elements above comprising the process of IS/IT evaluation. See Figure 5 for the developed
conceptual model.
24
Figure 5: Developed Conceptual Model
The researcher believes that the development of a holistic and full-bodied conceptual model that
resulted from the study serves as a significant step in advancing of IS/IT evaluation theory.
context-based IS/IT evaluation offers a significant contribution to industrial practice. See Table 7
for checklist for conducting better IS/IT evaluations developed in the scope of the dissertation.
25
Table 7: Checklist for Conducting IS/IT Evaluations
26
6.3 Quality of the Last Chapter Concerning Answers for Research Questions
Hypothesis 1 (H1)
Existing models of IS/IT evaluation are inadequate because they fail to include all of the relevant
constructs: the purpose of conducting the evaluation (why); the subject of the evaluation (what);
the specific aspects to be evaluated (which); the particular evaluation methods and techniques
used (how); the timing of the evaluation (when); the individuals involved in, or affected by, the
evaluation (who); and the external and internal environmental conditions under which the
What models of the IS/IT evaluation process are presented in the literature?
How do the constructs (identified in H1) relate to the process of IS/IT evaluation?
Hypothesis 2 (H2)
An improved conceptual model of IS/IT evaluation provides an effective tool for describing and
Is the researcher’s conceptual model valid for describing IS/IT evaluation practices?
What guidelines may be derived from using the researcher’s conceptual model as an analytical
27
Answer for Research Question #1:
For this purpose, the researcher wanted to identify conceptual models of the context and process
of IS/IT evaluation and the researcher distinguished between these meta-models of evaluation
versus more specific models of a particular evaluation method. Set this limitation, the researcher
found a few instances. Moreover, the vast majority of the examples were rooted in the work of
Symons (1990. Overall, the researcher found five meta-models of the process of IS/IT
evaluation. In each of these models, one or more of the seven evaluation constructs identified in
In Methodology chapter of the dissertation, the researcher presented underlying principles for
including each of the seven identified conceptual elements of IS/IT evaluation, and a
comprehensive literature review specific to each construct. Based upon these findings, the
such as conceptual models. Following numerous iterations and revisions, the researcher created
the conceptual model of IS/IT evaluation that appeared consistent with the findings of the
literature review.
The researcher concluded that the results support the first hypothesis in this study. The process of
IS/IT evaluation consists of seven contextual elements. Although there are number of existing
models of IS/IT evaluation in the literature, these models mostly failed to explicitly include all of
these relevant constructs. For that reason, the existing models have not either sufficient or
28
researcher in this study utilized these existing models, and the findings of the literature review in
order to develop an alternative conceptual model of IS/IT evaluation that included all seven
In the study, the researcher wanted to ensure that the proposed conceptual model represented a
“good” theoretical contribution. To that end, the researcher applied Whetten’s (2002) standard
for strong theoretical contributions. To assess whether or not the proposed model of IS/IT
evaluation represented a good theoretical contribution, the researcher explored its descriptive
ability with respect to the previously published case studies. In all of the examined cases, the
researcher established that the conceptual model’s constructs were valid and relevant. Thus, the
researcher concluded that the conceptual model did not contain superfluous constructs.
Therefore, the researcher concluded that the conceptual model was sufficiently complete. The
researcher provided that the model provides a systematic description of the process of IS/IT
evaluation.
Having established the descriptive validity of the conceptual model, the researcher investigated
its application as an investigative tool. In order to accomplish this task, the researcher performed
comparisons across the various instances. In doing so, the researcher found clear evidence
29
Conclusion for Hypothesis #2:
The researcher noted that there is adequate evidence supporting the second hypothesis in the
study. The researcher’s conceptual model represents an effective tool for both describing and
analyzing evaluation practices. The researcher’s application of the conceptual model to the cases
examined in this study yielded a number of normative guidelines for contextually appropriate
As the main research questions receive explicit answers and the whole study is well-summarized
Implemented
Implemented
Implemented
Implemented
Clauses vs. Implementations Partially
Largely
Fully
Not
Chapter
Introduction X
1
Chapter
Literature Review X
2
Chapter
Methodology X
3
Chapter
Results X
4
Conclusions,
Chapter
Implications, Recom., X
5
and Summary
30
7 Adoption for My Study
Title
Abstract
Today, organizations greatly spend money on hardware and software systems or more precisely
on information technologies (IT), grown in power and ubiquity recently. The fundamental reason
for this is that organizations view IT as more and more decisive to their success in the sector. IT
organizations’ chief executive officers (CEOs) and senior managers persistently note that they
interpret IT as a strategic asset to be successful and thereby leader in the sector. However, this is
something problematic. For a business asset to be interpreted as strategic it has to be scarce and it
ought to require exceptional and grounded interpretation and application. Given that IT ubiquity
so for the management of IT. Today’s organizations may create a sustained competitive
This thesis aims to identify the CEOs’ and senior managers’ consciousness about the importance
of management of IT and its relation to the organizations’ success in the sector. In this context,
first the 50 IT organizations’ CEOs and senior managers are provided and asked to complete a
questionnaire to know their consciousness about the importance of management of IT and their
organizations’ culture and success. After this, results of these questionnaires are analyzed and
interpreted. In addition, theoretical and practical evidences for this consciousness and its impacts
31
to success are provided and exemplified. As a result, a consciousness frame is proposed for the
7.2 Adoptions
As my study also requires contextual and conceptual analysis and comparisons, just like
similar way that the dissertation’s owner followed in the development of the conceptual
For the validation of my framework, I will follow the similar way that the dissertation’s
owner followed the validation of the conceptual model via a meta-analysis and cross-
analysis of multiple case studies and the development of guidelines for conducting
This dissertation, both in content and context will let me continue my study as I also plan
I also will use the outcome of this study as an input for my thesis as I am to investigate
32