Evaluating Public and Community Health Programs provides a comprehensive introduction to the theory and practice of evaluation, with a participatory model that brings stakeholders together for the good of the program. Linking community assessment, program implementation, and program evaluation, this book emphasizes practical, ongoing evaluation strategies that connect theory with application. This updated second edition includes new discussion on planning policy change programs using logic models and theory of change, plus expanded coverage of processes, outcomes, data collection, and more. Each chapter includes classroom activities and group discussion prompts, and the companion website provides worksheets, lecture slides, and a test bank for instructors. Mini cases help illustrate the real-world applications of the methods described, and expanded case studies allow students to dig deeper into practice and apply what they've learned.
Accurate and effective evaluation is the key to a successful program. This book provides a thorough introduction to all aspects of this critical function, with a wealth of opportunities to apply new concepts.
- Learn evaluation strategies that involve all program stakeholders
- Link theory to practice with new mini cases and examples
- Understand the uses, processes, and approaches to evaluation
- Discover how ongoing evaluation increases program effectiveness
Public and community health programs are a vital part of our social infrastructure, and the more effective they are, the more people they can serve. Proper planning is important, but continued evaluation is what keeps a program on track for the long term. Evaluating Public and Community Health Programs provides clear instruction and insightful discussion on the many facets of evaluation, with a central focus on real-world service.
Table of Contents
Preface xiii
Acknowledgments xv
1 An Introduction To Public and Community Health Evaluation 1
Overview of Evaluation 3
Levels of Evaluation 5
Preassessment Evaluations 6
The Participatory Approach to Evaluation 8
The Participatory Model for Evaluation 10
The Precursors to Program Evaluation 12
Cultural Considerations in Evaluation 17
Summary 21
Discussion Questions and Activities 22
Key Terms 22
2 The Community Assessment: An Overview 23
Theoretical Considerations 26
The Ecological Model 29
Data Collection 31
Data Sources 42
Reviewing the Scientific Literature 49
The Report 50
Stakeholders’ Participation in Community Assessments 52
Summary 53
Discussion Questions and Activities 54
Key Terms 54
3 Developing Initiatives: An Overview 55
The Organization’s Mission 58
Planning the Initiative 59
Incorporate Theory 60
Goals and Objectives 64
The Initiative’s Activities 71
Use Existing Evidence-Based Programs 75
The Program’s Theory of Change 77
The Logic Model Depicting the Theory of Change 77
Criteria for Successful Initiatives 81
Stakeholders’ Participation in Planning and Developing Initiatives 82
Summary 82
Discussion Questions and Activities 83
Key Terms 84
4 Planning For Evaluation: Purpose and Processes 85
The Timing of the Evaluation 86
The Purpose of Evaluation 87
The Contract for Evaluation 90
The Evaluation Team 91
Evaluation Standards 93
Managing the Evaluation Process 94
Factors That Influence the Evaluation Process 100
Planning for Ethical Program Evaluation 103
Involving Stakeholders 104
Creating and Maintaining Effective Partnerships 105
Summary 109
Discussion Questions and Activities 110
Key Terms 110
5 Designing the Evaluation: Part 1: Describing the Program or Policy 111
The Context of the Initiative 114
The Social, Political, and Economic Environment 116
The Organizational Structure and Resources 117
The Initiative and Its Relationship to the Organization 118
The Stage of Development of the Initiative 118
Data Access and Availability 119
The Program Initiative 119
The Policy Initiatives 125
Summary 131
Discussion Questions and Activities 132
Key Terms 132
6 Designing the Evaluation: Part 2a: Process Evaluation 133
Purposes of Process Evaluation 135
Key Issues in Process Evaluation 137
Selecting Questions for Process Evaluation 146
Resources for Evaluation 152
Measuring Resources, Processes, and Outputs 153
Tools for Process Evaluation 155
Ethical and Cultural Considerations 157
Summary 168
Discussion Questions and Activities 169
Key Terms 169
7 Designing the Evaluation: Part 2b: Outcome Evaluation 171
The Relationship Between Process and Outcome Evaluation 172
Sorting and Selecting Evaluation Questions 176
Summary 191
Discussion Questions and Activities 192
Key Terms 192
8 Collecting the Data: Quantitative 193
Quantitative Data 194
Factors Influencing Data Collection 195
Using Surveys 200
Designing Survey Instruments 206
Pilot Testing 209
Triangulation 210
Institutional Review and Ethics Boards 211
The Data Collection Team 212
Managing and Storing Data 213
Stakeholder Involvement 213
Summary 214
Discussion Questions and Activities 215
Key Terms 215
9 Collecting the Data: Qualitative 217
Qualitative Data 218
Ensuring Validity and Reliability 219
Interview-Format Approaches 221
Document and Record Review 231
Observational Approaches 233
Case Reviews 235
Digital Approaches 236
Geographic Information Systems 237
Training Data Collectors 238
Managing and Storing Qualitative Data 239
Stakeholder Involvement 239
The Data Collection Team 240
Summary 241
Discussion Questions and Activities 242
Key Terms 242
10 Analyzing and Interpreting Quantitative and Qualitative Data: Quantitative (Part 1) 243
Analyzing and Reporting Quantitative Data 244
Reaching Conclusions 249
Stakeholder Involvement 250
Summary 257
Discussion Questions and Activities 257
QUALITATIVE (PART 2) 258
Analyzing Qualitative Data 258
Interpreting the Data and Reaching Conclusions 264
The Role of Stakeholders 267
Summary 268
Discussion Questions and Activities 269
Key Terms 269
11 Reporting Evaluation Findings 271
The Content of the Report 274
The Audience for the Report 280
The Timing of the Report 281
The Format of the Report 282
Summary 286
Discussion Questions and Activities 287
Key Terms 287
12 Case Study: The Community Assessment 289
Background 289
Establish a Team 289
Determine the Availability of Data 291
Decide on the Data-Collection Approaches and Methods 292
Training 293
Resource Procurement 294
Analysis and Interpretation of the Data 294
Summary of Findings 294
The Intervention 295
Design the Evaluation 298
Collect the Data 306
Analyze and Interpret the Data 310
Report the Results 313
Discussion Questions and Activities 315
13 Case Study: Process Evaluation 317
Background 317
Theoretical Framework 318
Community Assessment Findings 319
The Evaluation Plan 326
Answering the Evaluation Question 328
Reporting the Results 338
Discussion Questions and Activities 340
A Model Agreement Between Evaluation Consultant and Team Members 341
B Model Preamble For Adult Individual Interviews 345
C Model Demographic Sheet 347
D Model Field Notes Report 349
E Model Interview Refusal Report 351
F Data Collection Training Manual Template 353
Conducting the Interview 355
G Guidelines For Completing An Evaluation Report 363
Methodology 364
References 367
Index 373
