Increasingly complex methodological options, as well as growing sophistication of users, means that the formulation of a research design prior to conducting an evaluation study is likely to be more demanding and time-consucting than previously. In fact, one of the most difficult problems in the entire evaluation endeavor is the development of an appropriate design.. But the issue is not only one of complexity—it is also one of the appropriateness of the designs to the questions at hand. The (...) concern of this article is with tightening the linkage between questions asked and answers given—making sure that the design organizes and directs the evaluation efforts to provide relevant information germane to the needs of the policymakers. By tightening this linkage, it is presumed that the findings from evaluation studies can gain increased legitimacy and use. Appropriate uses and abuses of seven program evaluation designs are analyzed, stressing designs that are most appropriate to the types of informational questions asked by policymakers. (shrink)

In 2011, the Secretariat on Responsible Conduct of Research launched a set of educational opportunities to facilitate and enhance the dissemination of TCPS 2, the 2nd edition of the Tri-Council Policy Statement: Ethical Conduct for Research Involving Humans, which guides Canadian research ethics. Three educational modalities were implemented to aid participants in developing or refining their ethical understanding and practice: Regional Workshops, which brought together diverse disciplinary perspectives; the CORE tutorial, which enabled individuals to discover the various aspects and applications (...) of the Policy; and Webinars, which provided participants with the opportunity to explore deeper dimensions of research ethics. This article reports on the findings of a national program evaluation team which measured the effectiveness of the educational program and provided recommendations for future opportunities. (shrink)

This article aims to analyze the key strengths and limitations of secondary-level education programs related to multiculturalism in Malaysia, and their role in shaping a more harmonious and inclusive MADANI society. The term MADANI, derived from the Arabic word madaniyyah, refers to a civil, civilized, and values-based society. The concept of tasamuh, which emphasizes tolerance and acceptance among ethnic groups, is examined as a central ethical principle in efforts to strengthen unity within Malaysia’s multiethnic society. This study highlights the strengths (...) of education programs that integrate unity-related values into the national curriculum, as well as co-curricular activities that involve multiethnic participation and unity campaigns conducted in schools. However, the study also identifies areas requiring further development, including limitations in curriculum design, co-curricular implementation, and the depth and scope of programs addressing ethnic diversity. Challenges also exist in the effective teaching and practical translation of unity values. Through this analysis, several recommendations are proposed to strengthen education programs, such as enhancing curriculum content on cultural diversity, increasing teacher training, and broadening the involvement of parents and the community. The findings of this study are intended to serve as a guide for evaluating and improving inclusive and unity-oriented education within the MADANI framework. (shrink)

Although education in the responsible conduct of research is considered necessary, evidence bearing on the effectiveness of these programs in improving research ethics has indicated that, although some programs are successful, many fail. Accordingly, there is a need for systematic evaluation of ethics education programs. In the present effort, we examine procedures for evaluation of ethics education programs from a multilevel perspective: examining both within-program evaluation and cross-program evaluation. With regard to within-program (...) class='Hi'>evaluation, we note requisite designs and measures for conducting systematic program evaluation have been developed and multiple measures should be applied in program evaluation. With regard to cross-program evaluation, we argue that a meta-analytic framework should be employed where analyses are used to identify best practices in ethics education. The implications of this multilevel approach for improving responsible conduct of research educational programs are discussed. (shrink)

Although many organizations around the world have engaged in corporate social responsibility programing, there is little evidence of social impact. This is a problematic omission since many programs carry the stigma of marketing ploys used to bolster organizational image or reduce consumer skepticism. To address this issue and build on existing scholarship, the purpose of this study was to evaluate a socially responsible youth employability program in the United Kingdom. The program was developed through the foundation of a (...) professional British soccer team to bolster employability and life skills for marginalized London youth. Program funding was provided by a large multinational bank as part of their CSR agenda. This evaluation was undertaken to understand the beneficiary impacts associated with program deployment. Results from the pre-intervention/post-intervention, sequential mixed-method evaluation show statistically significant differences among several “soft” beneficiary outcomes. However, results are mixed regarding whether the “hard” outcome of employment was achieved by program participants. Qualitative findings buttress these results, indicating a high level of motivation for work, attitude enhancement, and satisfaction with program delivery. (shrink)

The Ethics Program at General Dynamics was evaluated relative to its stated objectives and its implied objectives. The program was found to have met its specific objectives which require employees to follow rules and standards of conduct. The program did not apparently meet its implied objectives which would have created a more humanistic work environment for employees. This result apparently stemmed from program planners' intentions to use the hope for better working conditions as a motivation for (...) employees to follow company standards. A substantial conflict was found between the philosophical bases for ethics programs and work environment improvement programs. (shrink)

The human dimensions involved in the operational objectives of Restorative Justice demand the highest quality of program design and staff training. In this paper, I argue that this desideratum has yet to be fully realized in existing Restorative Justice programs, in particular, with regard to the facilitation of reconciliation. I begin by presenting the chief problems associated with the concentration on reparation in Restorative Justice programs, to the neglect of reconciliation. I then argue that this phenomenon is, in part, (...) a consequence of (i) the almost universal use of service-delivery criteria in the evaluation of Restorative Justice programs, and (ii) the absence of research on the interactional processes involved within the victim-offender encounter itself, using suitably designed methodological tools. (shrink)

The Evaluation of Critical Thinking Programs: Dangers and Dogmas.

Expressivism - the sophisticated contemporary incarnation of the noncognitivist research program of Ayer, Stevenson, and Hare - is no longer the province of metaethicists alone. Its comprehensive view about the nature of both normative language and normative thought has also recently been applied to many topics elsewhere in philosophy - including logic, probability, mental and linguistic content, knowledge, epistemic modals, belief, the a priori, and even quantifiers. Yet the semantic commitments of expressivism are still poorly understood and have not (...) been very far developed. As argued within, expressivists have not yet even managed to solve the "negation problem" - to explain why atomic normative sentences are inconsistent with their negations. As a result, it is far from clear that expressivism even could be true, let alone whether it is. Being For seeks to evaluate the semantic commitments of expressivism, by showing how an expressivist semantics would work, what it can do, and what kind of assumptions would be required, in order for it to do it. Building on a highly general understanding of the basic ideas of expressivism, it argues that expressivists can solve the negation problem - but only in one kind of way. It shows how this insight paves the way for an explanatorily powerful, constructive expressivist semantics, which solves many of what have been taken to be the deepest problems for expressivism. But it also argues that no account with these advantages can be generalized to deal with constructions like tense, modals, or binary quantifiers. Expressivism, the book argues, is coherent and interesting, but false. (shrink)

Professor Jessica Utts and I were given the task of evaluating the program on "Anomalous Mental Phenomena" carried out at SRI International (formerly the Stanford Research Institute) from 1973 through 1989 and continued at SAIC (Science Applications International Corporation) from 1992 through 1994. We were asked to evaluate this research in terms of its scientific value. We were also asked to comment on its potential utility for intelligence applications.

Existing ethical frameworks for public health provide insufficient guidance on how to evaluate the risks of public health programs that compromise the best clinical interests of present patients for the benefit of others. Given the relevant similarity of such programs to clinical research, we suggest that insights from the long‐standing debate about acceptable risk in clinical research can helpfully inform and guide the evaluation of risks posed by public health programs that compromise patients’ best clinical interests. We discuss how (...) lessons learned regarding the ethics of risk in one context can be fruitfully transferred to the other, using the example of a so‐called ‘rational antibiotic use’ guideline that limits antimicrobial prescribing in order to curb antimicrobial resistance. (shrink)

The concrete insertion of nurses into the context of an inquiry contributes to empirical evaluation research of health promotion programs. As interveners and concrete actors in social movements, nurses are in a privileged position to give realism to a local understanding of the political and cultural context of evaluative research. Drawing on the practice of empirical evaluation research, this paper seeks to generate new methodological approaches in a way that broadens nursing inquiries in community health nursing. It explores (...) new ways of thinking about epistemology and knowledge production in nursing practice. For 5 months an evaluative research project adopting a participatory‐action research approach was conducted with local community actors in an AIDS prevention project in Amazonas (Brazil) in a prostitution setting. An auto‐ethnographic journal was used as a reflective approach for the critical analysis of nursing research activities. This paper calls for a closer relationship between scientific research settings and the sociopolitical and the sociocultural aspects of nursing practice. It increases an incorporation of popular, social and professional experiential learning and skill acquisition in embedded knowledge production. (shrink)

Introduction: Research has documented the prevalence of different HIV/AIDS prevention programs launched to reduce the spread of the virus. However, the extent to which the success or otherwise of these programs are achieved is rarely discussed. This study addresses this gap by analyzing the impact of three socioeconomic parameters on the evaluation of HIV/AIDS prevention programs in the Southern Senatorial District of Cross River State, Nigeria. Methods: A sample of 239 health care employees selected using the proportional stratified random (...) sampling technique participated in the study. A priori power analysis (using G*power) indicated that the sample size was large enough to achieve a 96.7% statistical power. Data was collected using a structured questionnaire. Exploratory factor analysis assessed the dimensionality of the instrument. Acceptable construct and discriminant validity and composite reliability coefficients were obtained. At the .05 alpha level, the null hypotheses were tested using a one-way analysis of variance. Findings: Findings indicated that the evaluation of HIV/AIDS prevention programs significantly varied with the level of funding provided (F[2, 236]=81.11, p<.001), human capacity available (F[2, 236]=40.91, p<.001), and stigmatization to people living with AIDS (F[2, 236]=40.79, p<.001). Health facilities with higher funding and human capacity successfully evaluated HIV/AIDS prevention programs. However, the evaluation of HIV/AIDS prevention programs was lower in areas with a high level of stigmatization. Conclusion and implication: This study’s findings provided evidence that funding, human capacity, and stigmatization affect how HIV/AIDS pandemic can be effectively evaluated. This study implies that additional responsibility is required for public health workers to promote quality service delivery across different health facilities. Keywords:. (shrink)

The epistemology and phenomenology of contemporary society tend to be deepened, and the philosophical challenges never are minimal that we may be called to face with the kind of post-modern chaos from the rapidly changing phenomena of the global community. The ballast held on the identity of faculty members as a teacher and researcher now turns due so as to be recast with our intrinsic of routine performance. I considered their quality as bent on the intellectual strife on the method (...) and the kind of attitude, say, evaluation and consultation. In this paper, the authors have presented some thought and implications that triangulated the triad, i.e., research methodology, program evaluation and consulting illustration on the college research program rankings. The author is hoped that the discourse can help the academicians to share the attribute of different methods as well as the dimension of evaluation and consulting, perhaps essentially related with their work role in terms of teaching and researching. Keywords: Research Method, Qualitative Studies, Mixed Method, Program Evaluation, Theory and Philosophy, Program Rankings, Consulting, Journal Writing. (shrink)

Although elementary schools are considered a fertile ground for promoting positive behaviors among students, to date, almost no study has examined the effectiveness of a cyberbullying prevention program among elementary school students of typical and non-typical development. The present study evaluated the effectiveness of such a school-based European funded preventive program among sixth graders with and without special educational needs. The study also examined the predictive role of self-esteem in students’ cyberbullying involvement. Overall, 240 students from randomly selected (...) Greek schools completed a self-report questionnaire, which included a scale on cyberbullying and self-esteem. Following an experimental longitudinal research design, the intervention was applied to the experimental but not to the control group of students. Each group consisted of both students with and without SEN. The evaluation was based on the completion of the self-report questionnaire before, immediately after, and 6 months after the intervention was completed by trained general and special education teachers. According to the findings, students’ cyberbullying engagement decreased significantly in the second and third phase, and especially for those with SEN. Additionally, self-esteem negatively predicted students’ involvement in cyberbullying in all three phases. The findings partially support the appropriateness of interventions within the elementary school context in order to enhance self-esteem and promote a safe online culture among students of typical as well as atypical development. (shrink)

Background Meaningfully evaluating the quality of institutional review boards (IRBs) and human research protection programs (HRPPs) is a long-recognized challenge. To be accredited by the Association for the Accreditation of Human Research Protection Programs (AAHRPP), organizations must demonstrate that they measure and improve HRPP “quality, effectiveness, and efficiency” (QEE). We sought to learn how AAHRPP-accredited organizations interpret and satisfy this standard, in order to assess strengths, weaknesses, and gaps in current approaches and to inform recommendations for improvement.Methods We conducted 3 (...) small-group interviews with a total of 19 participant representatives of accredited organizations at the 2019 AAHRPP annual meeting. Participants were eligible if they had familiarity with their organization’s approach to satisfying the relevant QEE standard.Results Participants reported lacking clear definitions for HRPP quality or effectiveness but described various approaches to assessing QEE, typically focused on turnaround time, compliance, and researcher satisfaction. Evaluation of IRB members was described as relatively superficial and information regarding research subject experience was not reported as central to QEE assessment, although participants described several efforts to improve consideration of patient, subject, and community perspectives in IRB review. Participants also described efforts to educate and build relationships with key stakeholders as important features of a high-quality HRPP. While generally satisfied with their approaches, participants expressed concern about resource and time constraints that pushed them to be reactive and automatic about QEE, rather than proactive and critical.Conclusions The relevant AAHRPP accreditation standard may obscure critical gaps in defining and measuring QEE elements. We recommend that AAHRPP: (1) offer a definition of QEE or require accredited organizations to provide their own, to help clarify the rationale and goals behind assessment and improvement efforts, and (2) require accredited organizations to establish QEE objectives and measures focused on participant outcomes and deliberative quality during protocol review. (shrink)

In this article we evaluate the BankXX program from several perspectives. BankXX is a case-based legal argument program that retrieves cases and other legal knowledge pertinent to a legal argument through a combination of heuristic search and knowledge-based indexing. The program is described in detail in a companion article in Artificial Intelligence and Law 4: 1--71, 1996. Three perspectives are used to evaluate BankXX:(1) classical information retrieval measures of precision and recall applied against a hand-coded baseline; (2) (...) knowledge-representation and case-based reasoning, where the baseline is provided by the functionality of a well-known case-based argument program, HYPO (Ashley, 1990); and (3) search, in which the performance of BankXX run with various parameter settings, for instance, resource limits, is compared. In this article we report on an extensive series of experiments performed to evaluate the program. We also describe two additional experiments concerning(1) the program's search behavior; and (2) the use of a modified form of precision and recall based on case similarity. Finally we offer some general conclusions that might be drawn from these particular experiments. (shrink)

A cost-benefit analysis of the AirCare program in the province of British Columbia on the basis of emissions cost factors from the literature showed a benefit outweighing the cost. Furthermore, a cost-effectiveness analysis comparing the AirCare program with a hybrid-car rebate program revealed that the AirCare program is more effective in reducing emissions of major air pollutants such as NOx, hydrocarbons, and CO. However, the hybrid-car rebate program contributes significantly to the reduction of greenhouse gas (...) emissions because of much greater fuel efficiency, although its contribution to reducing emissions of major air pollutants is small compared with that of the AirCare program. Both the AirCare program and the hybrid-car program are therefore essential to addressing both local air quality improvement and global warming issues, and the programs complement each other. (shrink)

The aim of this study is to examine gifted students' evaluations of their education programs in terms of their project production and management by considering the basic principles of gifted education and training programs. In evaluating the effectiveness of programs for gifted students, it is regarded as important to consider the evaluations of the individuals for whom the programs are implemented. Project production and management was taken as the basis for the principles and guidelines of the programs implemented for gifted (...) students. A mixed research design was used in the study. In the quantitative part of the research, the views of 300 randomly selected gifted students, who were attending the project production and management and special talent development programs at Science and Art Centers throughout Turkey, regarding their evaluation of the education programs, were analyzed. In the qualitative part of the research, the project production and management of the gifted individuals in the upper and lower groups according to their program evaluations were evaluated descriptively by examining the project proposals they developed. In the analysis of the quantitative data, it was determined that the participants had positive views about the effectiveness of the program, but that there was a significant difference between the upper and lower groups in terms of program evaluation scores. Considering this situation, the data of 10 participants in total were subjected to qualitative analysis in the second stage. As a result of the study, it was determined that all of the gifted students in the upper and lower groups were able to produce projects, but that in the categories specified in their projects, there were differences in favor of the upper group in terms of depth, originality, taking their talents into account, acting consciously, acting in accordance with the plan, participating in more prestigious competitions, and quality. (shrink)

Twenty-five social studies preservice teachers enrolled in 2 field based method courses and twenty- one social studies preservice teachers enrolled in 2 non-field based method courses were compared on knowledge of teaching skills, attitude about behaviors teachers should exhibit in class, and attitude about how well they can perform certain teaching skills. Analysis of covariance tests indicated no significant differences between field and non-field based methods courses. Implications of results for alterations in the field based method course and future (...) class='Hi'>evaluation procedures are discussed. (shrink)

The productive impacts of cash transfer (CT) programs have not been widely studied, though interest in this area is growing, with existing evidence generally pointing to rather positive findings. Notably, one key takeaway from the (limited) available research is the debunking of a common criticism drawn against cash transfers and social assistance, more in general – namely, the assumption that social programs disincentivize or discourage work. Even less is known about the sustainability of CT impacts, as these interventions are typically (...) designed as short-term programs. To address this gap, we conducted a quasi-experimental study of a universal unconditional cash transfer initiative in rural Uganda. Our study examined whether effects on savings, debt, investment, incomes, assets and labour allocation (if any) persisted after the end of the transfer. Despite the concurrent outbreak of COVID-19, our findings revealed several sustained impacts, particularly on savings, (agricultural) incomes and business ownership. (shrink)

This study analysis the Energy Efficiency Program of the Municipality of Brvenica, examining its budgetary aspects through the lens of gender-responsive measures. The program, spanning 2022-2024, allocates funds for diverse energy efficiency projects but falls short in addressing residential households and lacks ambitious renewable energy measures. The absence of gender-disaggregated data underscores a gap in understanding the impact on women and men. Recommendations urge aligning the program with gender equality policies, expanding goals, and consulting the Commission for (...) Equal Opportunities. The study advocates for gender-sensitive measures, citizen involvement, and increased funds for household energy efficiency. Budgetary analysis reveals a disconnection between the program and the municipal budget, emphasizing the need for better integration. Challenges include the absence of gender-specific data and limited consultation during program development. Recommendations stress enhanced budget transparency, increased financial allocations for gender-responsive initiatives, and collaboration for ecological heating awareness. The study underscores the imperative of comprehensive gender integration in energy policies for equitable outcomes and effective mitigation of energy poverty. (shrink)

Following an initial study of the needs of healthcare providers (HCP) regarding the introduction of Medical Assistance in Dying (MAiD), and the subsequent development of an assisted dying program, this study sought to determine the efficacy and impact of MAiD services following the first two years of implementation. The first of three aims of this research was to understand if the needs, concerns and hopes of stakeholders related to patient requests for MAiD were addressed appropriately. Assessing how HCPs and (...) families perceived the quality of MAiD services, and determining if the program successfully accommodated the diverse needs and perspectives of HCPs, rounded out this quality evaluation. This research implemented a mixed-methods design incorporative of an online survey with Likert scale and open-ended questions, as well as focus groups and interviews with staff and physicians, and interviews with MAiD-involved family members. There were 356 online surveys, as well as 39 participants in six focus groups with HCP, as well as fourteen interviews with MAiD-involved family members. Participants indicated that high-quality MAiD care could only be provided with enabling resources such as policies and guidelines to ensure safe, evidence-based, standardized care, as well as a specialized, trained MAiD team. Both focus group and survey data from HCPs suggest the infrastructure developed by the hospital was effective in delivering high-quality MAiD care that supports the diverse needs of various stakeholders. This study may serve as a model for evaluating the impact and quality of services when novel and ethically-contentious clinical practices are introduced to healthcare organizations. (shrink)

This study analyzed the monitoring and evaluation of HIV/AIDS prevention programs in Southern Senatorial District of Cross River State, Nigeria. The study considered different levels of care/support and tested for locational variations in the monitoring/evaluation of HIV/AIDs prevention programs. A descriptive survey research design was utilized. This study covered 596 public health employees (doctors, nurses, pharmacists, and laboratory employees) in the study area. A sample of 239 respondents was chosen using the proportional stratified random sampling procedure. Data was (...) collected using a questionnaire constructed by the researchers and validated by specialists. Data gathered were analyzed using descriptive and inferential statistics. Results indicated that HIV/AIDs programs have been successfully monitored/evaluated to a high extent. High rates of success in the monitoring/evaluation of HIV/AIDs prevention programs are attributable to high rates of care/support provided to people living with HIV/AIDs. There was a significant variation in the monitoring/evaluation of HIV/AIDs prevention programs based on the location of health facilities, with higher rates recorded for urban areas. Based on the findings, it was concluded that the monitoring/evaluation of HIV/AIDs prevention programs in the Southern Senatorial District of Cross River State had recorded a significant level of success. The study recommended, among others, that there should be even distribution of medical facilities, resources and personnel to both urban and rural areas to promote equity and access to materials needed to contain or mitigate the spread of the pandemic across all locations. (shrink)

A great need for systematic evaluation of ethics training programs exists. Those tasked with developing an ethics training program may be quick to dismiss the value of training evaluation in continuous process improvement. In the present effort, we use a case study approach to delineate how to leverage formative and summative evaluation measures to create a high-quality ethics education program. With regard to formative evaluation, information bearing on trainee reactions, qualitative data from the comments (...) of trainees, in addition to empirical findings, can ensure that the training program operates smoothly. Regarding summative evaluation, measures examining trainee cognition, behavior, and organization-level results provide information about how much trainees have changed as a result of taking the ethics training. The implications of effective training program evaluation are discussed. (shrink)

Male to male unprotected anal sex is the main route of HIV transmission in Australia. The Australian Study of Health and Relationships, a large, representative population survey of sexual health behaviors, found that six percent of males in the general population have engaged in homosexual activity. These findings were consistent with studies in Europeand North America. Condoms have been shown to reduce the transmission of HIV in the community. Barriers to the use of condoms include access,stigma,and cost? Nevertheless, increased condom (...) use has been reported among homosexual males, sex workers and injecting drug users although recent declines in condom use among homosexuals has presented new challenges in HIV prevention.The prevalence of male to male sexual activity may be higher in prison than in the general population. Sexual activity in prison can be consensual and non-consensual involving both homosexual / bisexual and heterosexual men. (shrink)