620 Matching Annotations
  1. Mar 2024
    1. We are at crossroads when it comes to evaluation, its purpose, and how it is used. Before the pandemic and into the recovery phase, evaluation has been largely used to artificially enforce “accountability” and maintain a transactional relationship between funders and non-profit organizations. Demand for “accountability”; expectation to do more with less; and reporting on impacts are phrases that keep leaders of non-profits, including B3s awake at night. These phrases are particularly disempowering in an environment of transactional relationship between funders and non-profits. You might ask, what does this have to do with evaluation? Everything!Let’s think and reflect deeply on these phrases: Demand for accountability – who is demanding accountability and whose interest is fulfilled by meeting that accountability? Expectation to do more with less – who is expecting or promising to do more with less? Reporting on impacts – who is defining impact and/or how is impact defined and understood?Evaluation is neither neutral nor objective and in a transactional relationship between funders and non-profit organizations, its sole purpose becomes keeping the transactional relationship in place.
    1. Without exaggeration, I believe that the majority of published works in my field (broadly defined as psychology) do not add value. Many papers draw conclusions that are not supported by evidence, which cascades through the literature, because these papers are cited for the conclusions, not the evidence. The majority of published works are not reproducible, in the sense that authors conduct science behind closed doors without sharing data or code. Many published works are not replicable, i.e., will not hold up to scrutiny over time. Theories are verbal and vague, which means they can never get properly rejected. Instead, as Paul Meehl famously wrote, they sort of just slowly fade away as people lose interest. Let me try to convince you that it is an entirely reasonable position, based on the evidence we have.
  2. Feb 2024
    1. To be clear, funders and funded organizations should emphatically not reflexively believe that existing communications and communications channels are addressing these issues – one of the findings of our previous national high-lights report (available via the link on the final page of this report) was that funded organizations regularly communicating with funders about evaluation results were equally likely to feel that funders were driving the evaluation process and not making consistent use of findings.
  3. Jan 2024
    1. Show Ponies are typically built with limited grant funding that is allocated on a project basis. Sometimes they’re created merely to be a proof of concept. In other cases, their funders hope that “if you build it, they will come.” But because Show Ponies are usually funded by governments or non-profit organizations, they rarely have a revenue model. So even if they do gain traction and users, a Show Pony’s continued existence depends on continued support from governments or philanthropy rather than their users. This is a fragile existence, and the Internet is littered with neglected Show Ponies that aren’t being maintained.
    1. Given the potential real-world benefits, why have decision makers within governments, aid agencies, multilateral organizations, and NGOs not yet fully harnessed the value of evidence—including from impact evaluations—for better public policies?

  4. Dec 2023
  5. Nov 2023
    1. The earlier a serious Manhattan-like project to develop nanotechnology is initiated, the longer it will take to complete, because the earlier you start, the lower the foundation from which you begin. The actual project will then run for longer, and that will then mean more time for preparation: serious preparation only starts when the project starts, and the sooner the project starts, the longer it will take, so the longer the preparation time will be. And that suggests that we should push as hard as we can to get this product launched immediately, to maximize time for preparation.

      for sure?

  6. Oct 2023
  7. Sep 2023
  8. Aug 2023
    1. However, one crucial question remains that has not yet been settled, and it is not a technical, but a social or political question: with everybody locked-in, who is to act in which way to ensure the redirection of funds from the legacy system to the replacement solution, i.e. an open scholarly infrastructure?
    2. interesting paper about replacing journals with more "modern" scholarly infrastructure

  9. Jul 2023
  10. Jun 2023
  11. May 2023
  12. Apr 2023
  13. Mar 2023
  14. Feb 2023
  15. Jan 2023
  16. Dec 2022
  17. Nov 2022
  18. Oct 2022
  19. Sep 2022
  20. Aug 2022
  21. Jul 2022