Evaluation Theory, Models, and Applications


Author: Daniel L. Stufflebeam,Chris L. S. Coryn
Publisher: John Wiley & Sons
ISBN: 111807405X
Category: Education
Page: 800
View: 3649

Continue Reading →

Coryn, widely considered experts in the evaluation field, introduce and describe 23 program evaluation approaches, including, new to this edition, transformative evaluation, participatory evaluation, consumer feedback, and meta-analysis. Evaluation Theory, Models, and Applications, Second Edition facilitates the process of planning, conducting, and assessing program evaluations. The highlighted evaluation approaches include: Experimental and quasi-experimental design evaluations Daniel L. Stufflebeam's CIPP Model Michael Scriven's Consumer-Oriented Evaluation Michael Patton's Utilization-Focused Evaluation Robert Stake's Responsive/Stakeholder-Centered Evaluation Case Study Evaluation Key readings listed at the end of each chapter direct readers to the most important references for each topic. Learning objectives, review questions, student exercises, and instructor support materials complete the collection of tools.

Evaluation Models

Viewpoints on Educational and Human Services Evaluation
Author: D.L. Stufflebeam,George F. Madaus,T. Kellaghan
Publisher: Springer Science & Business Media
ISBN: 0306475596
Category: Education
Page: 509
View: 3389

Continue Reading →

This is an up-to-date revision of the classic text first published in 1983. It includes a historical perspective on the growth of evaluation theory and practice and two comparative analyses of the various alternative perspectives on evaluation. It also includes articles representing the major schools of thought about evaluation written by the leaders who have developed these schools and models. The final section describes and discusses the Standards for Program Evaluation and the reformation of program evaluation.

The CIPP Evaluation Model

How to Evaluate for Improvement and Accountability
Author: Daniel L. Stufflebeam,Guili Zhang
Publisher: Guilford Publications
ISBN: 1462529232
Category: Social Science
Page: 384
View: 3091

Continue Reading →

"The book's chapters provide background on how and why the CIPP (Context, Input, Process, Product) Model was developed; a detailed presentation of the model; an explanation of the key role of an evaluation-oriented leader, who can decide what and when to evaluate; detailed presentations on evaluation design, budgeting, and contracting; procedures and tools for collecting, analyzing, and reporting evaluation information; and procedures for conducting standards-based meta-evaluations (evaluations of evaluations). These topics are interspersed with illustrative evaluation cases in such areas as education, housing, and military personnel evaluation"--

Encyclopedia of Evaluation


Author: Sandra Mathison
Publisher: SAGE
ISBN: 9780761926092
Category: Social Science
Page: 481
View: 3171

Continue Reading →

The Encyclopedia of Evaluation is an authoritative, first-of-its-kind who, what, where, why, and how of the field of evaluation. Covering professional practice as well as academia, this volume chronicles the development of the field—its history, key figures, theories, approaches, and goals. From the leading publisher in the field of evaluation, this work is a must-have for all social science libraries, departments that offer courses in evaluation, and students and professional evaluators around the world. The entries in this Encyclopedia capture the essence of evaluation as a practice (methods, techniques, roles, people), as a profession (professional obligations, shared knowledge, ethical imperatives, events, places) and as a discipline (theories and models of evaluation, ontological and epistemological issues).

Applied Ethics for Program Evaluation


Author: Dianna L. Newman,Robert D. Brown
Publisher: SAGE
ISBN: 9780803951860
Category: Political Science
Page: 228
View: 7275

Continue Reading →

From the moment evaluators begin the consultation process to the time when they respond to the last reaction to the evaluation report, ethical choices are being made. This thoughtful book explores a set of principles which can serve as foundational guidelines for making ethical decisions. Using vignettes, the authors provide ethical dilemmas and questions to stimulate thinking about the positive and negative consequences of each option. After an introduction to ethical theories and principles, a framework is proposed that can be used in weighing these options. The book concludes with suggestions for ways in which evaluators can make informed ethical decisions.

Diagnostic Measurement

Theory, Methods, and Applications
Author: Andr? A. Rupp,Jonathan Templin,Robert A. Henson
Publisher: Guilford Press
ISBN: 1606235281
Category: Psychology
Page: 348
View: 2807

Continue Reading →

This book provides a comprehensive introduction to the theory and practice of diagnostic classification models (DCMs), which are useful for statistically driven diagnostic decision making. DCMs can be employed in a wide range of disciplines, including educational assessment and clinical psychology. For the first time in a single volume, the authors present the key conceptual underpinnings and methodological foundations for applying these models in practice. Specifically, they discuss a unified approach to DCMs, the mathematical structure of DCMs and their relationship to other latent variable models, and the implementation and estimation of DCMs using Mplus. The book's highly accessible language, real-world applications, numerous examples, and clearly annotated equations will encourage professionals and students to explore the utility and statistical properties of DCMs in their own projects. This book will appeal to professionals in the testing industry; professors and students in educational, school, clinical, and cognitive psychology. It will also serve as a useful text in doctoral-level courses in diagnostic testing, cognitive diagnostic assessment, test validity, diagnostic assessment, advanced educational measurement, psychometrics, and item response theory

The Theory and Practice of Item Response Theory


Author: R. J. de Ayala
Publisher: Guilford Publications
ISBN: 1462514693
Category: Education
Page: 448
View: 6820

Continue Reading →

Item response theory (IRT) is a latent variable modeling approach used to minimize bias and optimize the measurement power of educational and psychological tests and other psychometric applications. Designed for researchers, psychometric professionals, and advanced students, this book clearly presents both the "how-to" and the "why" of IRT. It describes simple and more complex IRT models and shows how they are applied with the help of widely available software packages. Chapters follow a consistent format and build sequentially, taking the reader from model development through the fit analysis and interpretation phases that one would perform in practice. The use of common empirical data sets across the chapters facilitates understanding of the various models and how they relate to one another.

Purposeful Program Theory

Effective Use of Theories of Change and Logic Models
Author: Sue C. Funnell,Patricia J. Rogers
Publisher: John Wiley & Sons
ISBN: 9780470939895
Category: Education
Page: 576
View: 454

Continue Reading →

Between good intentions and great results lies a program theory—not just a list of tasks but a vision of what needs to happen, and how. Now widely used in government and not-for-profit organizations, program theory provides a coherent picture of how change occurs and how to improve performance. Purposeful Program Theory shows how to develop, represent, and use program theory thoughtfully and strategically to suit your particular situation, drawing on the fifty-year history of program theory and the authors' experiences over more than twenty-five years. "From needs assessment to intervention design, from implementation to outcomes evaluation, from policy formulation to policy execution and evaluation, program theory is paramount. But until now no book has examined these multiple uses of program theory in a comprehensive, understandable, and integrated way. This promises to be a breakthrough book, valuable to practitioners, program designers, evaluators, policy analysts, funders, and scholars who care about understanding why an intervention works or doesn't work." —Michael Quinn Patton, author, Utilization-Focused Evaluation "Finally, the definitive guide to evaluation using program theory! Far from the narrow 'one true way' approaches to program theory, this book provides numerous practical options for applying program theory to fulfill different purposes and constraints, and guides the reader through the sound critical thinking required to select from among the options. The tour de force of the history and use of program theory is a truly global view, with examples from around the world and across the full range of content domains. A must-have for any serious evaluator." —E. Jane Davidson, PhD, Real Evaluation Ltd. Companion Web site: josseybass.com/go/funnellrogers

Theory Construction and Model-building Skills

A Practical Guide for Social Scientists
Author: James Jaccard,Jacob Jacoby
Publisher: Guilford Press
ISBN: 1606233408
Category: Psychology
Page: 391
View: 7698

Continue Reading →

Meeting a crucial need for graduate students and newly minted researchers, this innovative text provides hands-on tools for generating ideas and translating them into formal theories. It is illustrated with numerous practical examples drawn from multiple social science disciplines and research settings. The authors offer clear guidance for defining constructs, thinking through relationships and processes that link constructs, and deriving new theoretical models (or building on existing ones) based on those relationships. Step by step, they show readers how to use causal analysis, mathematical modeling, simulations, and grounded and emergent approaches to theory construction. A chapter on writing about theories contains invaluable advice on crafting effective papers and grant applications. Useful pedagogical features in every chapter include: Application exercises and concept exercises Lists of key terms and engaging topical boxes Annotated suggestions for further reading. This book is intended for graduate students in a range of disciplines, including psychology, education, sociology, health, and management, as well as social scientists pursing research careers in academic or other settings. It can serve as a primary text in graduate-level courses in theory construction or as a supplemental text in courses on research methodology, theories of a particular discipline, grant writing, or the dissertation.

Program Theory-Driven Evaluation Science

Strategies and Applications
Author: Stewart I. Donaldson
Publisher: Routledge
ISBN: 1136677321
Category: Business & Economics
Page: 280
View: 5084

Continue Reading →

Program Theory-Driven Evaluation Science fills the gap between 21st century literature on evaluation and what is happening in practice. It features detailed examples of how evaluations actually unfold in practice to develop people, programs, and organizations. Commonly accepted strategies for practicing evaluation are outlined, followed by comprehensive accounts of how those strategies have played out in the face of the complexities and challenges of “real world” settings. In so doing, the book illustrates the authentic challenges of implementing an evaluation approach in practice. Author Stewart Donaldson provides a state-of-the-art treatment of the practice of program theory-driven evaluation science. Each case follows a three-step model: developing program impact theory; formulating and prioritizing evaluation questions; and answering evaluation questions. Initial chapters discuss the emergence of program theory-driven evaluation science and specific strategies for carrying out each of the three steps. Succeeding chapters address recent applications and practical implications of evaluation science. The challenges and lessons learned from the cases are then reviewed. This volume is of significant value to evaluation practitioners, professors and trainers of evaluation, evaluation researchers, and advanced undergraduate and graduate students, and serves as a text for courses in evaluation and applied research methods. It is also of great interest to those interested in the connections between work and health, career development, human service organizations, and organizational improvement and effectiveness.

Collaborative, Participatory, and Empowerment Evaluation

Stakeholder Involvement Approaches
Author: David M. Fetterman,Liliana Rodríguez-Campos,Ann P. Zukoski
Publisher: Guilford Publications
ISBN: 1462532829
Category: Business & Economics
Page: 172
View: 9070

Continue Reading →

From pioneering leaders in the field, this is the first book to provide a solid foundation for three major stakeholder involvement approaches: collaborative, participatory, and empowerment evaluation. Highlighting differences among the approaches, the authors focus on the role of the evaluator, who may be in charge of the evaluation, share control, or serve as a "critical friend," leaving stakeholders in control. Practitioners are guided to select and implement the most appropriate framework for the purpose and scope of a given evaluation and the needs of community members and funders. For each approach, a chapter on essential features is followed by two chapters presenting actual sample evaluations--for example, early childhood and community health initiatives, an aquarium, a project with Google, and more. The concluding chapter discusses similarities and circumstances in which the approaches can be combined.

Handbook of Improving Performance in the Workplace, Measurement and Evaluation


Author: James L. Moseley,Joan C. Dessinger
Publisher: John Wiley & Sons
ISBN: 0470190671
Category: Business & Economics
Page: 448
View: 5056

Continue Reading →

Each volume in this set provides a current review of all information available for the three core areas of improving performance in the workplace: instructional design and training delivery, intervention selection and implementation, measurement and evaluation.

The Program Evaluation Standards

A Guide for Evaluators and Evaluation Users
Author: Donald B. Yarbrough
Publisher: SAGE
ISBN: 1412986567
Category: Education
Page: 334
View: 5270

Continue Reading →

Including a new section on evaluation accountability, this Third Edition details 30 standards which give advice to those interested in planning, implementing and using program evaluations.

Fundamentals of Item Response Theory


Author: Ronald K. Hambleton,Hariharan Swaminathan,H. Jane Rogers
Publisher: SAGE
ISBN: 9780803936478
Category: Psychology
Page: 174
View: 7227

Continue Reading →

By using familiar concepts from classical measurement methods and basic statistics, this book introduces the basics of item response theory (IRT) and explains the application of IRT methods to problems in test construction, identification of potentially biased test items, test equating and computerized-adaptive testing. The book also includes a thorough discussion of alternative procedures for estimating IRT parameters and concludes with an exploration of new directions in IRT research and development.

Intensive Longitudinal Methods

An Introduction to Diary and Experience Sampling Research
Author: Niall Bolger,Jean-Philippe Laurenceau
Publisher: Guilford Press
ISBN: 1462506925
Category: Psychology
Page: 256
View: 3679

Continue Reading →

This book offers a complete, practical guide to doing an intensive longitudinal study with individuals, dyads, or groups. It provides the tools for studying social, psychological, and physiological processes in everyday contexts, using methods such as diary and experience sampling. A range of engaging, worked-through research examples with datasets are featured. Coverage includes how to: select the best intensive longitudinal design for a particular research question, apply multilevel models to within-subject designs, model within-subject change processes for continuous and categorical outcomes, assess the reliability of within-subject changes, assure sufficient statistical power, and more. Several end-of-chapter write-ups illustrate effective ways to present study findings for publication. Datasets and output in SPSS, SAS, Mplus, HLM, MLwiN, and R for the examples are available on the companion website (www.intensivelongitudinal.com).

Models and Methods in Social Network Analysis


Author: Peter J. Carrington,John Scott,Stanley Wasserman
Publisher: N.A
ISBN: 9780521809597
Category: Psychology
Page: 328
View: 2495

Continue Reading →

Models and Methods in Social Network Analysis presents the most important developments in quantitative models and methods for analyzing social network data that have appeared during the 1990s. Intended as a complement to Wasserman and Faust's Social Network Analysis: Methods and Applications, it is a collection of articles by leading methodologists reviewing advances in their particular areas of network methods. Reviewed are advances in network measurement, network sampling, the analysis of centrality, positional analysis or blockmodelling, the analysis of diffusion through networks, the analysis of affiliation or 'two-mode' networks, the theory of random graphs, dependence graphs, exponential families of random graphs, the analysis of longitudinal network data, graphical techniques for exploring network data, and software for the analysis of social networks.

Monte Carlo Simulation and Resampling Methods for Social Science


Author: Thomas M. Carsey,Jeffrey J. Harden
Publisher: SAGE Publications
ISBN: 1483324923
Category: Social Science
Page: 304
View: 7399

Continue Reading →

Taking the topics of a quantitative methodology course and illustrating them through Monte Carlo simulation, Monte Carlo Simulation and Resampling Methods for Social Science, by Thomas M. Carsey and Jeffrey J. Harden, examines abstract principles, such as bias, efficiency, and measures of uncertainty in an intuitive, visual way. Instead of thinking in the abstract about what would happen to a particular estimator "in repeated samples," the book uses simulation to actually create those repeated samples and summarize the results. The book includes basic examples appropriate for readers learning the material for the first time, as well as more advanced examples that a researcher might use to evaluate an estimator he or she was using in an actual research project. The book also covers a wide range of topics related to Monte Carlo simulation, such as resampling methods, simulations of substantive theory, simulation of quantities of interest (QI) from model results, and cross-validation. Complete R code from all examples is provided so readers can replicate every analysis presented using R.

Handbook of Research Methods in Complexity Science

Theory and Applications
Author: Eve Mitleton-Kelly,Alexandros Paraskevas,Christopher Day
Publisher: Edward Elgar Publishing
ISBN: 1785364421
Category:
Page: N.A
View: 2624

Continue Reading →

This comprehensive Handbook is aimed at both academic researchers and practitioners in the field of complexity science. The book’s 26 chapters, specially written by leading experts, provide in-depth coverage of research methods based on the sciences of complexity. The research methods presented are illustratively applied to practical cases and are readily accessible to researchers and decision makers alike.

Using Complexity Theory for Research and Program Evaluation


Author: Michael Wolf-Branigin
Publisher: Oxford University Press
ISBN: 0199829462
Category: Social Science
Page: 196
View: 9700

Continue Reading →

Complexity theory provides a promising framework for conducting social work research and evaluation. Readers will gain an understanding of the background, current applications, and agent-based modeling as a new approach for creating simulations. To advance this line of inquiry a complexity research agenda for social work is developed.

Continuing the Journey to Reposition Culture and Cultural Context in Evaluation Theory and Practice


Author: Stafford Hood,Rodney Hopson,Henry Frierson
Publisher: IAP
ISBN: 1623969379
Category: Education
Page: 405
View: 2717

Continue Reading →

Racial, ethnic, linguistic, and cultural diversity has become of global importance in places where many never would have imagined. Increasing diversity in the U.S., Europe, Africa, New Zealand, and Asia strongly suggests that a homogeneitybased focus is rapidly becoming an historical artifact. Therefore, culturally responsive evaluation (CRE) should no longer be viewed as a luxury or an option in our work as evaluators. The continued amplification of racial, ethnic, linguistic, and cultural diversity and awareness among the populations of the U.S. and other western nations insists that social science researchers and evaluators inextricably engage culturally responsive approaches in their work. It is unacceptable for most mainstream university evaluation programs, philanthropic agencies, training institutes sponsored by federal agencies, professional associations, and other entities to promote professional evaluation practices that do not attend to CRE. Our global demographics are a reality that can be appropriately described and studied within the context of complexity theory and theory of change (e.g., Stewart, 1991; Battram, 1999). And this perspective requires a distinct shift from “simple” linear causeeffect models and reductionist thinking to include more holistic and culturally responsive approaches. The development of policy that is meaningfully responsive to the needs of traditionally disenfranchised stakeholders and that also optimizes the use of limited resources (human, natural, and financial) is an extremely complex process. Fortunately, we are presently witnessing developments in methods, instruments, and statistical techniques that are mixed methods in their paradigm/designs and likely to be more effective in informing policymaking and decisionmaking. Culturally responsive evaluation is one such phenomenon that positions itself to be relevant in the context of dynamic international and national settings where policy and program decisions take place. One example of a response to address this dynamic and need is the newly established Center for Culturally Responsive Evaluation and Assessment (CREA) in the College of Education at the University of Illinois at UrbanaChampaign. CREA is an outgrowth of the collective work and commitments of a global community of scholars and practitioners who have contributed chapters to this edited volume. It is an international and interdisciplinary evaluation center that is grounded in the need for designing and conducting evaluations and assessments that embody cognitive, cultural, and interdisciplinary diversity so as to be actively responsive to culturally diverse communities and their aspirations. The Center’s purpose is to address questions, issues, theories, and practices related to CRE and culturally responsive educational assessment. Therefore, CREA can serve as a vehicle for our continuing discourse on culture and cultural context in evaluation and also as a point of dissemination for not only the work that is included in this edited volume, but for the subsequent work it will encourage.