Checklist provides a step-by-step visual for navigating and completing each of the sections and their corresponding steps throughout the evaluation guide
Created by Safe States Alliance (2017). Evaluation Guide for Pedestrian Safety: Summary of Evaluation Step
Table shows example evaluation roles for pedestrian safety professionals and relevant partners
Adapted from: U.S. Department of Transportation National Highway Traffic Safety Administration. 2014 Pedestrian Safety Enforcement Operations: A How-To Guide
Boston Department of Transportation. 2001 Access Boston 2000-2010 Pedestrian Safety Guidelines for Residential Streets: Safety Guidelines for Residential Streets.
World Health Organization 2010 Pedestrian safety A road safety manual for decision-makers and practitioners.
Table shows characteristics of each approach and highlights noteworthy difference
U.S. Department of Health and Human Services Centers for Disease Control and Prevention. Office of the Director, Office of Strategy and Innovation. Introduction to program evaluation for public health programs: A self-study guide. Atlanta, GA: Centers for Disease Control and Prevention, 2011.
Presents a framework for organizing pedestrian safety intervention strategies across seven domains: Collaboration, Advocacy, Encouragement, Education, Land Use & Planning, Engineering, and Enforcement
Safe States Alliance, The Evaluation Group, Transtria (2017). Pedestrian Safety Intervention Strategies and Doma
Congress HR 22 Fixing America’s Surface Transportation Act’ or the "FAST Act" (See page 29.)
National Highway and Transportation Administration’s (NHTSA) Section 405 National Priority Safety Program Fixing America’s Surface (FAST) Act Authorization of the Transportation Program Safety Grant (January 2015).
A reference to assist traffic safety and other professionals in selecting effective, evidence-based countermeasures for traffic safety problem areas
National Highway Traffic Safety Administration. (2016, January). Countermeasures That Work, Eighth Edition. (Traffic Tech Technology Transfer Series. Report No. DOT HS 812 239). Washington,
Website provides helpful resources to support the implementation of the Safety Performance Management Final Rule that establishes the process for State DOTs and MPOs to establish and report their safety targets, and the process that FHWA will use to assess whether State DOTs have met or made significant progress toward meeting their safety targets
US Department of Transportation Federal Highway Administration. Highway Safety Improvement Program - Safety Performance Management Website
Report presents an overview and framework for state and local agencies to develop and implement a Pedestrian Safety Action Plan tailored to their specific problems and needs
Federal Highway Administration Office of Highway Safety. How to Develop a Pedestrian Safety Action Plan. FHWA-SA-05-12. Revised March 2009
Report documents a comprehensive analysis of pedestrian crash data trends and factors, a detailed review of more than 200 publications on pedestrian safety, and input from more than 25 expert stakeholder members
US Department of Transportation Federal Highway Administration. Pedestrian Safety Strategic Plan: Recommendations for Research and Product Development. October 2010. FHWA-SA-10-035
Provides guidance on developing a governance structure and process for partnerships
Z. Simon, S. Radovich. Governing Collaborative Governance: Enhancing development outcomes by improving partnership governance and accountability. Accountability and the Corporate Responsibility Initiative, Working Paper No. 23. Cambridge, MA: John F. Kennedy School of Government, Harvard University.
Provides background on equity, inequity, and disparity
CSDH (2008). Closing the gap in a generation: health equity through action on the social determinants of health. Final Report of the Commission on Social Determinants of Health. Geneva, World Health Organization.
Provides background on equity, inequity, and disparity
Unnatural Causes. Changing the way America thinks about health. (Dec 2009). PBS documentary series. a production of California Newsreel with Vital Pictures, Inc. Presented for public television by the National Minority Consortia. Impact campaign in association with the Joint Center for Political and Economic Studies Health Policy Institute.
Provides background on equity, inequity, and disparity
National Association of County and City Health Officials.
Provides background on equity, inequity, and disparity
Beyond Health Care: New Directions to a Healthier America. (April 2009) The Robert Wood Johnson Foundation Commission to Build a Healthier America
Provides guidelines for developing a budget
National Criminal Justice Reference Service
Presents a framework for organizing pedestrian safety intervention strategies across seven domains: Collaboration, Advocacy, Encouragement, Education, Land Use & Planning, Engineering, and Enforcement.
Safe States Alliance, The Evaluation Group, Transtria (2017). Pedestrian Safety Intervention Strategies and Domains.
Presents an overview and framework for state and local agencies to implement a Pedestrian Safety Action Plan
Zegger, C. V., Sandt, L., & Scully, M. (2006, February). How to Develop a Pedestrian Safety Action Plan [PDF]. Chapel Hill
A reference guide for an integrated and comprehensive effort to improve pedestrian and bicycle safety
Brookshire, K., Sandt, L., Sundstrom, C., Thomas, L., & Blomberg, R. (2016, April). Advancing pedestrian and bicyclist safety: A primer for highway safety professionals (Report No. DOT HS 812 258). Washington, DC: National Highway Traffic Safety Administration
A technical assistance guide for roadway reconfiguration
Road Diet Information Guide. (2014, November 24). Retrieved May 20, 2017
An article that reviews street polices and discusses how to make the transportation system more accessible for all travelers
Street Design: Part 1-Complete Streets. (n.d.). Retrieved May 20, 2017
An online guide to support planning, designing, and operating of roadways efforts
Complete Streets. (2015, August 24). Retrieved May 20, 2017.
The National Complete Streets Coalition’s list of complete street polices
Complete Streets Policies. (2015, August 24). Retrieved May 20, 2017.
A section of a larger online tool aimed to support public health professional conduct needs assessment and design health interventions
Section 2. Understanding Risk and Protective Factors: Their Use in Selecting Potential Targets and Promising Strategies for Intervention. (n.d.). Retrieved May 20, 2017
Worksheet that discusses the components of a logic model
Identifying the Components of a Logic Model [Worksheet that discusses the components of a logic model]. (n.d.).
A digital PDF that is a self-guide tutorial of how develop a program evaluation
U.S. Department of Health and Human Services Centers for Disease Control and Prevention. Office of the Director, Office of Strategy and Innovation. Introduction to program evaluation for public health programs: A self-study guide. Atlanta, GA: Centers for Disease Control and Prevention, 2011.
A “do-it-yourself guide” to the concepts and use of a logic model that describes the steps necessary for you to create logic models for your own interventions.
Innovation Network. Retrieved July 11, 2017 from: http://www.gnof.org/wp-content/uploads/2013/07/eval-logic_workbook.pdf
This table shows descriptions, examples, and graphic depictions of each evaluation design along with causality and strength of attribution
Adapted from: Measurement, Learning & Evaluation (MLE) Project (evaluation component of the Urban Reproductive Health Initiative).
This table shows strengths and weaknesses of each design, along with a description and example pedestrian safety intervention evaluations for each design
Adapted from: University of Albany Center for Problem-Oriented Policing. Assessing Responses to Problems: An Introductory Guide for Police Problem-Solver. Appendix D: Summary of Evaluation Designs’ Strengths and Weaknesses.
Lyons, R. A., D., Kendrick, E. M. L.,Towner, C., Coupland, M., Hayes, M, et al. The Advocacy for Pedestrian Safety Study: Cluster Randomised Trial Evaluating a Political Advocacy Approach to Reduce Pedestrian Injuries in Deprived Communities. 2013. PLoS ONE, 8(4), e60158.
Zegeer, C., D Henderson, R Blomberg, L Marchetti, S Masten, Y Fan, L Sandt, A Brown, J Stutts, and L Thomas. Evaluation of the Miami-Dade Pedestrian Safety Demonstration Project. National Highway Traffic Safety Administration. Washington, DC, 2008.
Pennsylvania Department of Transportation Bureau of Planning and Research. C. Strong, M. Kumar. Western Transportation Institute College of Engineering Montana State University. Safety Evaluation of Yield-to-Pedestrian Channelizing Devices: Final Report. 2006
O'Connor, E., J. Bellamy, B. Spring. Evidence-Based Behavioral Practice Online Training Course. Critical Appraisal: Time Series Designs.
Huitema, RV Houten, H Manal. Time-series intervention analysis of pedestrian countdown timer effects. Accident Analysis & Prevention 2014. 72:23–31.
Compiled from Federal Highway Administration Office of Natural and Human Environment 2005. Pedestrian and Bicycle Data Collection in United States Communities: Quantifying Use, Surveying Users, and Documenting Facility Extent.
This table shows descriptions of sampling methods along with strengths, weaknesses, and examples
A tool to compute statistical power analyses for many different t tests, F tests, χ2 tests, z tests and some exact tests. G*Power can also be used to compute effect sizes and to display graphically the results of power analyses.
Faul, F., Erdfelder, E., Lang, A.-G., & Buchner, A. (2007). G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior Research Methods, 39, 175-191
Free and open source online calculators
Power and Sample Size . Com. 2013-2017 HyLown Consulting LLC. Atlanta, GA
An interactive computer program for performing statistical power and sample size calculations
William D. Dupont and Walton D. Plummer, Jr. (2014) PS: Power and Sample Size Calculation version 3.1.2.
A tool that provides convenient excel-based functions to determine minimum detectable effect size and minimum required sample size for various experimental and quasi-experimental designs
Nianbo Dong, Benjamin M Kelcey, Jessaca Spybrook, Rebecca Maynard. Designing and analyzing multilevel experiments and quasi-experiments for causal evaluation. Funded by: National Science Foundation [DGE-1437679, DGE-1437692, DGE-1437745], and Institute of Education Sciences [R305B090015].
R package version of PowerUp! and additionally includes functions to determine sample size for various multilevel randomized experiments with or without budgetary constraints
Bulus, M., & Dong, N. (2017). PowerUpR: Power Analysis Tools for Multilevel Randomized Experiments. R package version 0.1.3.
A package of tools with functions for basic power calculations using effect sizes and notations from Cohen (1988).
Stephane Champely, Claus Ekstrom, Peter Dalgaard, Jeffrey Gill, Stephan Weibelzahl, Aditya Anandkumar, Clay Ford, Robert Volcic, Helios De Rosario. (2017). pwr: Basic Functions for Power Analysis 1.2-1.
Software is intended to be useful in planning statistical studies.
Lenth, R. V. (2006-9). Java Applets for Power and Sample Size [Computer software].
A free collection of tools for conducting statistical power analysis online
Zhiyong Johnny Zhang, Ke-Hai Yuan et al. WebPower: Statistical power analysis online. Supported by a grant from the Department of Education (R305D140037).
An application to assist in the design of clinical trials by calculating the sample size using inputs provided by the user
SampSize. epiGenesys. Developed in cooperation with Steven A Julious, Medical Statistics Group, School of Health and Related Research, The University of Sheffield.
A PowerPoint presentation that discusses the components of conducting a mixed methods study
Creswell, John W., "Steps in Conducting a Scholarly Mixed Methods Study" ( 13). DBER Speaker Series. Paper 48.
A PowerPoint presentation that discusses the components of conducting a mixed methods study
Tucker-Brown, A. ( 12, July 10). CDC Coffee Break: Using Mixed Methods in Program Evaluation.
Issue brief that discusses how to analyze quantitative data for an evaluation
Analyzing Quantitative Data for Evaluations. (2009, July).
Book on mixed methods research
Creswell, J. W., & Plano, C. V. L. (2007). Designing and conducting mixed methods research. Thousand Oaks, Calif: SAGE Publications.
Visit your local library to find this book.
Book on qualitative research methods
Hennink, M. M., Hutter, I., & Bailey, A. 2011). Qualitative research methods. London: SAGE.
Visit your local library to find this book.
A PowerPoint presentation on mixed method evaluations
Chapel, T. (n.d.). Mixed Methods in Program Evaluation.
A website discusses the components of mixed methods
Ltd, W. O. (n.d.). FoodRisc Resource Centre. Retrieved May 20, 2017.
An online module that provides an overview of mixed method research
(n.d.). Retrieved May 20, 2017, from https://cirt.gcu.edu/research/developmentresources/research_ready/mixed_methods/overview
Provide detailed guidance on how to conduct a pedestrian and bicycle count
National Bicycle and Pedestrian Documentation Project.
Provides information on how to collect data for pedestrian safety programs
Schneider, R., Patton, R., Toole, J., & Reborn, C. (2005, January). Pedestrian and Bicycle Data Collection in United States Communities: Quantifying Use, Surveying Users, Documenting Facility Extent. Pedestrian and Bicycle Information Center University of North Carolina at Chapel Hill Highway Safety Research Center, Chapel Hill.
A tip sheet that guides users through the process of developing survey questions
Program Evaluation Tip Sheet: Constructing Survey Questions. (2011, October).
A journal article that reviews potential sampling methodologies for pedestrian and bicycle surveys
Forsyth, Ann, Asha Weinstein Agrawal, and Kevin J. Krizek. (2012). Simple, Inexpensive Approach to Sampling for Pedestrian and Bicycle Surveys. Transportation Research Record: Journal of the Transportation Research Board 2299: 22–30.
A comprehensive online report that provides information on pedestrian safety surveillance
Injury Surveillance Workgroup 8 (ISW8). Consensus Recommendations for Pedestrian Injury Surveillance. Atlanta (GA): Safe States Alliance, 2017.
Provides information on how to conduct an In-depth Interview or a Focus Group Discussion
Steps for Conducting Focus Groups or Individual In-depth Interviews. (n.d.).
A step-by-step guide on how to write a case study
(n.d.). Retrieved May 20, 2017, from https://awc.ashford.edu/tocw-guidelines-for-writing-a-case-study.html
An online tool that provides guidance on how to analyze a case study
(n.d.). Retrieved May 20, 2017, from http://wps.prenhall.com/bp_laudon_essmis_6/21/5555/1422312.cw/content/index.html
Provides information on the guidelines for informed consent
Informed Consent FAQs. (n.d.). Retrieved May 20, 2017, from https://www.hhs.gov/ohrp/regulations-and-policy/guidance/faq/informed-consent/
Provides greater detail on specific quantitative data collection methods that can be used to inform pedestrian safety interventions
Bryan S., Yeager D., and Barnwell L. Pedestrian Safety Evaluation: Quantitative Data Collection Methods. Atlanta (GA): Research and Evaluation Group, 2017.
Provides greater detail on specific qualitative data collection methods that can be used to inform pedestrian safety interventions
Bryan S., Yeager D., and Barnwell L. Pedestrian Safety Evaluation: Quantitative Data Collection Methods. Atlanta (GA): Research and Evaluation Group, 2017.
Provides general guidance on indicators
Pencheon, D. The Good Indicators Guide: Understanding how to use and choose indicators. NHS Institute for Innovation and Improvement, Association of Public Health Observatories. Retrieved May 1, 2017.
Tool to determine the appropriate statistical test for variable types
http://stats.idre.ucla.edu/other/mult-pkg/whatstat/
A comprehensive checklist of what should be included in an evaluation report
Miron, G. (2004, September). Evaluation Report Checklist.
Provides detailed information on how to construct a data matrix
Wingate, L. (2015, June). Data Collection Planning.
Glossary
Tips for Success
Examples from the Field
Helpful Tools & Resources
Templates