Accurate field evaluations are critical in determining paramedic students' competency to provide patient care. The [U.S.] National Paramedic Curriculum does not address the skills needed by evaluators, and requirements to be a preceptor/evaluator vary from state to state. Therefore, it is imperative that educational programs develop an evaluation process that ...

Evaluation fellows from the George Washington University School of Public Health and Health Services conducted an evaluation of the Road to Recovery program of the Mid-Atlantic division of the American Cancer Society. The evaluation included qualitative analysis of program operation, mailed surveys, in-depth interviews with patients and drivers, and interviews ...

In this article, we describe how different conceptual frameworks contributed to the design, development, and implementation of the Collaborative Evaluation Fellows Project (CEFP). These frameworks are the following: utilization-focused evaluation (Patton, 1997); evaluative inquiry for learning in organizations (Preskill & Torres, 1999); and collaboration for a change (Himmelman, 1994). In ...

Tell A Friend (TAF) is the nationwide program of the American Cancer Society that aims to decrease breast cancer mortality by encouraging unscreened women to have mammograms using a peer-to-peer approach. An evaluation via the Collaborative Evaluation Fellows Project attempted to identify barriers and facilitators to successful implementation of TAF ...

Triple Touch is a breast health education program developed by the Florida Division of the American Cancer Society in 1994. The program reaches more Florida women each year, and has a larger group of volunteers, than any other breast cancer program sponsored by this American Cancer Society division. The purpose ...

The Collaborative Evaluation Fellows Project (CEFP) of the American Cancer Society builds organizational capacity for evaluation by partnering with schools of public health to conduct local evaluation studies. This model was envisioned in response to the American Cancer Society's growing demand for program evaluation and the challenges of institutionalizing evaluation ...

Selecting continence products for an individual patient or hospital contract is often a daunting task. This article describes the evaluation process developed for a program of government-funded multicenter evaluations of continence products established in the United Kingdom to provide an evidence base for product selection. The essential requirements of an ...

The I Can Cope program is an educational program developed to provide information on how to promote physical and emotional well-being to individuals with cancer, their families, and friends. Through focus group and individual interviews and a mailed survey, the effectiveness of the selection, marketing, implementation, and support processes associated ...

OBJECTIVE: To examine the evaluation process for the CHAMPUS Reform Initiative (CRI) both to highlight issues that evaluators must consider when undertaking such projects and to provide policymakers with tools to better assess demonstration project evaluations. DATA SOURCES: The CRI evaluation. STUDY DESIGN: Case study. DATA COLLECTION: Review of CRI ...

"Au coeur de la vie" is a research project which aims to evaluate the impact of a heart health dissemination program on primary and secondary prevention practices in local community clinics in the province of Quebec, Canada. Because the project starts in 2001 and no data has been collected to ...

This paper chronicles a comprehensive evaluation of 6 residential facilities for young offenders located within the region of Waterloo. Two kinds of research methodologies were employed in the investigation. One was primarily quantitative in nature, involving the completion of standardized scales for each of the youths who participated in the ...

The purpose of this pilot study was to determine the efficacy of using a less costly, low-bandwidth telemedicine system to evaluate occupational therapy clients in rural areas. Four residents (aged 63 +/- 10.2 years) from rural Tillery, North Carolina, were evaluated via either The Kohlman Evaluation of Living Skills or ...

Presents the Hamilton Supervised Pastoral Evaluation Tool (HSET). HSET is a self-report that evaluates student learning in a basic SPE unit utilizing six areas: supervisory relationship, personal growth, professional growth, theological reflection, learning context, and overall growth. Reviews statistics involving seven regional units consisting of 18 SPE units with 101 ...

OBJECTIVES: To compare and contrast two rural cardiovascular community intervention programs (CCIP) in northern Sweden and the US by discussing the methods used to select and combine similar data from two separately designed and implemented CCIP in order to describe and evaluate their effectiveness in reducing cardiovascular risk. METHODS: Two ...

Implementation of interdisciplinary rehabilitation services and clinical training in community settings is a complex process. Documented methods for analyzing, evaluating and monitoring the process within federally funded grant projects are limited. This paper reports on the use of one proposed method, the Integration Matrix of Konrad, as a framework for ...

Comprehensive clinical programs for teenage mothers and their children, also known as teen-tot programs, have been a promising intervention to improve outcomes of teenage childbearing and parenting. However, much remains unknown regarding the efficacy of such programs. We reviewed four published evaluations of programs that provided medical care, counseling, contraception, ...

Evaluation and feedback are fundamental components of graduate medical education. Paper-based evaluation systems are inefficient and costly and the evaluation data they provide are difficult to retrieve and analyze. In view of these problems, in 1996-1997, the authors developed and implemented a World Wide Web-based electronic evaluation system for the ...

The aviation community has invested great amounts of money and effort into crew resource management (CRM) training. Using D. L. Kirkpatrick's (1976) framework for evaluating training, we reviewed 58 published accounts of CRM training to determine its effectiveness within aviation. Results indicated that CRM training generally produced positive reactions, enhanced ...

Previous literature on evaluation of computer-assisted learning (CAL) programs has generally not emphasized the importance of evaluation during the design and development phases. A tendency toward an objective model of evaluation rather than a naturalistic model has also meant that there is little consideration given to the context in which ...

In program evaluation, determining whether a program is reaching its goals is key to evaluating program success. Having an understanding of the stated goals of each organization within a system rather than simply knowing the formal system goals can aid in program development and inform policy making. Evaluability assessments were ...

Mental health practitioners are increasingly being called upon to evaluate the effectiveness of the treatment they provide. The partial hospitalization component of the mental health industry has also felt this call for outcome research. This article presents the results of assessments of treatment outcome at a child and adolescent partial ...

The medication use evaluation (MUE) Program at the University of Iowa Hospitals and Clinics (UIHC) is a dynamic program that is constantly changing to meet the needs of this tertiary care institution. This article will provide an overview of the MUE process at UIHC as well as provide an example ...

This article discusses the application of the ecological model to formative research in a practical setting of a training program developed for the Child Growth Monitoring Project of the New York State WIC program. The ecological model was selected to guide the formative research because it offered a concrete framework ...

The authors describe methods for work in progress to evaluate four workplace prevention and/or early intervention programs designed to change occupational norms and reduce substance abuse at a major U.S. transportation company. The four programs are an employee assistance program, random drug testing, managed behavioral health care, and a peer-led ...

Process evaluation is an important, but infrequently conducted, component of evaluating the impact of health promotion interventions. The process evaluation results from the nine 5-a-Day projects were overviewed. Process evaluation helped explain some of the weaker aspects of program performance, process indicators occasionally declined over time and varied by demographic ...

This paper is about an evaluation of training offered by the Finnish Institute of Occupational Health (FIOH). FIOH is a research organisation, which produces, collects and disseminates information about work and health and promotes the utilisation of this knowledge. The target groups of the training are occupational health physicians, occupational ...

British Columbia has funded a program for licensure for international medical graduates since 1992, providing 2 entry positions per year for postgraduate training. Each year 25-35 candidates are eligible for the program, 13-16 enter the evaluation process, 4 go on to a clinical evaluation and 2 are offered funding by ...

Participatory evaluation models that invite community coalitions to take an active role in developing evaluations of their programs are a natural fit with Healthy Communities initiatives. The author describes the development of a participatory evaluation model for New Mexico's Healthier Communities program. She describes evaluation principles, research questions, and baseline ...

Interprofessional exchanges such as workshops are common activities in international development programs. The authors describe processes used to select, implement, and evaluate six collaborative workshops held in Tianjin, China, between 1990 and 1995. These workshops targeted curricular change for a baccalaureate nursing program in Tianjin Medical University. Our experience highlights ...

This article reports on the theory-driven evaluation of a drop-in center for youth that incorporated a literature search, concept mapping with staff, and focus groups with youth. Findings revealed strong agreement among the three sources of data around specific elements identified as critical components of a program theory of global ...

For the past two years we have been implementing a program for the establishment of scientific time and frequency metrology in Brazil. The main objective of this program is to construct an atomic fountain and use it as a primary standard. As a first step toward this goal, we have ...

Between January and June 1998, postgraduate and undergraduate students from seven centres participated in a discussion of suicide from a public health perspective, using a listserver on the Internet. Most contributions were in English but a few were in Spanish with subsequent translation. Eighteen out of 32 students responding to ...

BACKGROUND: Fundamental to the development of educational programs and curricula is the evaluation of processes and outcomes. Unfortunately, many otherwise well-designed programs do not incorporate stringent evaluation methods and are limited in measuring program development and effectiveness. Using an advertising lesson in a school-based tobacco-use prevention curriculum as a case ...

In the paper we describe the function of the ExaMe program that serves for evaluation of students' knowledge using Internet. Evaluation is based on the knowledge base of a given course. Two types of evaluation tests are described. The fixed test is appropriate for examination of students by the teacher ...

This article summarizes the observations and lessons learned regarding the application of human immunodeficiency virus (HIV)/acquired immune deficiency syndrome (AIDS) prevention and reproductive health evaluation methodologies in the context of adolescent and young adult populations and discusses the use of peer network evaluation to understand the dynamics of peer promotion. ...

AIM: To examine immunisation projects undertaken by divisions of general practice through the Divisions and Project Grants Program in the period from 1993 to mid 1997. METHOD: A simple descriptive frequency analysis was conducted of information from the National Information Service Divisions Project database and evaluation reports of the project ...

Educators have devoted little attention to formal evaluation of educational administrative personnel. The authors surveyed the educational administrators working in McMaster University's Department of Medicine residency program and found they felt they were receiving little useful feedback. The authors also surveyed the colleagues, residents, and administrative staff with whom the ...

Progress in improving the credibility of teachers' descriptive evaluations of students and residents has not kept pace with the progress made in improving the credibility of more quantified methods, such as multiple-choice examinations and standardized patient examinations of clinical skills. This article addresses innovative approaches to making the ongoing in-training ...

This report describes the evaluation methodology of the Tri-Ministry Study--a school-based trial evaluating the effectiveness of three universal programs: (a) a classwide social skills program (SS), (b) a partner reading program (RE); and, (c) a combination of both (SS & RE), to reduce and prevent behavioural maladjustment among children in ...

Effective program evaluation is a systematic way to improve and account for public health actions by involving procedures that are useful, feasible, ethical, and accurate. The framework guides public health professionals in their use of program evaluation. It is a practical, nonprescriptive tool, designed to summarize and organize essential elements ...

Recent mergers and downsizing of health care agencies have made resources for continuing education (CE) increasingly scarce. Nurse educators must demonstrate the effectiveness and sustainability of CE programs and establish the link between nursing professionalism and positive patient outcomes. The Pyramid Evaluation Model expands and enhances previous evaluation frameworks. Simple ...

The evaluation literature often debates whether evaluators should be flexible in evaluation design and activities in order to collaborate with program directors and be responsive to programming needs. Two conditions are specified under which evaluation flexibility is not only desirable but essential. Two examples from the cluster evaluation of the ...

Readers are increasingly encountering articles dealing with health economic evaluations that compare various surgical strategies, leaving orthopaedists with the challenge of determining which program is cost-efficient and truly pertains to their setting. This study carries out a systematic review of the literature to appraise the quality, quantity, and type of ...

In this paper we present an intelligent search tool, which we developed in order to automate search and evaluation of websites. We used TFIDF heuristics to determine term frequency and decision trees to evaluate the quality of sites. Training set for the decision tree contained manually evaluated websites. Each website ...

This article constitutes a case study of the development and implementation of the "results framework," an innovative planning and evaluation tool that is rapidly becoming a standard requirement for United States Agency for International Development (USAID) projects. The framework is used in a USAID-funded regional initiative for HIV/AIDS prevention in ...

This article explores the application of empowerment strategies to program evaluation within a community health setting and presents a case study to examine the policy, direct practice, and research issues associated with the plan to evaluate a community-based HIV-prevention program. Empowerment evaluation strategies were used to develop an innovative street ...

The inspection certificate program consists of food establishments voluntarily posting a certificate to inform patrons that inspection reports can be accessed from operators or the public health department. A three-month pilot program was evaluated for program improvement purposes. Only 65% of the selected operators were willing to participate, which suggests ...

Unlike kindergartens for 5-year-old children, which are taken for granted, preschool programs for 3- and 4-year-old children are accepted tentatively in the United States, making them ideal candidates for evaluative research. Evaluative research compares the performance of program participants either with ideal performance, the performance of other children in general, ...

OBJECTIVES: The Consumer Assessment of Health Plans Study (CAHPS) was developed to provide an integrated set of tested, standardized surveys to obtain meaningful information from health plan enrollees and their experiences. Many organizations began to implement CAHPS in 1997. Formal evaluations of the experiences of three demonstration sites with implementing ...

This journal issue comprises reports concerning program evaluations of key national home visitation models. No single evaluation can answer all the questions of interest about a program, nor is any evaluation perfect, which means that readers must carefully weigh the intended purpose of the evaluation and the evaluation's strengths and ...