The example comes from the replication crisis in social psychology75
How to replicate the replication crisis
676 Matching Annotations
- Oct 2025
-
scienceplusplus.org scienceplusplus.org
-
- Sep 2025
- Aug 2025
-
www.theglobeandmail.com www.theglobeandmail.com
- Jul 2025
-
-
list of evidence clearinghouses
-
- Jun 2025
-
papers.ssrn.com papers.ssrn.com
-
www2.gov.bc.ca www2.gov.bc.ca
-
www.faithdriveninvestor.org www.faithdriveninvestor.org
-
academic.oup.com academic.oup.com
-
Stefan Dercon
-
-
scholarship.law.bu.edu scholarship.law.bu.edu
Tags
Annotators
URL
-
- May 2025
-
www.cgdev.org www.cgdev.org
-
-
Radical Simplification: A Practical Way to Get More Out of Limited Foreign Assistance Budgets
-
-
bellwether.org bellwether.org
-
nebraska case study of data sharing for court-involved youth
-
- Mar 2025
-
www.infoway-inforoute.ca www.infoway-inforoute.ca
-
www.benkuhn.net www.benkuhn.net
Tags
Annotators
URL
-
-
journals.sagepub.com journals.sagepub.com
-
Several nonprofit studies document the consequences of using evaluation to meet funder accountability requirements and also point to other reasons nonprofits may not use the data they collect. These reasons include limited capacity, inability to control the data they collect, and inadequate technology (Benjamin et al., 2017; Hoefer, 2000). For example, the nonprofit literature on accountability discussed earlier showed how goal displacement or overclaiming of results might be a natural consequence of using evaluation to meet funder demands. The organizational effectiveness literature shows how the ambiguity inherent in defining nonprofit effectiveness is often resolved in favor of meeting funder requirements, resulting in evidence that is neither useful for organizational-level decision-making nor for learning (Bryan et al., 2020; Carman & Fredericks, 2010). Consequently, evaluative data needed by internal audiences for learning and improvement are often not available (Gugerty & Karlan, 2014). As a result of these forces, managers and staff may ultimately see evaluation as symbolic and separate from their “real” work (Buckmaster, 1999; Mitchell & Berlan, 2016; Riddell, 1999
-
- Feb 2025
-
gcgh.grandchallenges.org gcgh.grandchallenges.org
-
toby-89881.medium.com toby-89881.medium.com
- Jan 2025
-
futurepolis.substack.com futurepolis.substack.com
- Nov 2024
-
go.ifrc.org go.ifrc.orgIFRC GO1
Tags
Annotators
URL
-
-
-
ment has catalyzed and I totally take her point. But I think one way to counter the backlash to the trust-based concept — and there definitely is one based on the discussions I have with funders, anyway — is to actually embrace the nuance just a bit more. Those advocating for funders to change will be more effective, in my view, if they are perhaps just a bit less dogmatic than what I sometimes read and hear — and a bit more inviting of an ongoing conversation and reasoned debate about effective (or whatever words we want to use) philanthropy. Because if ever there wa
-
-
osf.io osf.io
-
www.statcan.gc.ca www.statcan.gc.ca
-
www.canada.ca www.canada.ca
Tags
- admin data
- data strategy
- statscan
- mts
- data products
- data linkages
- health data
- health system
- recommendations
- homelessness
Annotators
URL
-
- Oct 2024
-
www.arabellaadvisors.com www.arabellaadvisors.com
Tags
Annotators
URL
-
- Sep 2024
-
www.utpjournals.press www.utpjournals.press
-
forum.effectivealtruism.org forum.effectivealtruism.org
-
asteriskmag.com asteriskmag.com
-
This revealed a more fundamental issue: programming to increase contraceptive uptake in the postpartum period likely produces little meaningful reduction in pregnancy risk
-
-
-
metaphorum.org metaphorum.org
-
www.centreforpublicimpact.org www.centreforpublicimpact.org
- Aug 2024
-
willbridge.io willbridge.io
-
-
theagencyfund.substack.com theagencyfund.substack.com
Tags
Annotators
URL
-
-
hypertext.niskanencenter.org hypertext.niskanencenter.org
-
www.benkuhn.net www.benkuhn.net
-
-
benjaminreinhardt.com benjaminreinhardt.com
-
DARPA is incredibly flexible with who it hires to be program managers.
-
DARPA is incredibly flexible with who it hires to be program managers.
-
-
www.cambridge.org www.cambridge.org
- Jul 2024
-
www.publicbooks.org www.publicbooks.org
Tags
Annotators
URL
-
-
www.nature.com www.nature.com
-
At the portfolio level, a focus on RCTs as a preferred evaluation methodology means that programmes that are amenable to RCTs are more likely to be evaluated than those that are not (Ravallion, 2015).
Tags
Annotators
URL
-
- Jun 2024
-
www.imaginecanada.ca www.imaginecanada.ca
-
-
history of impact measurement
-
- May 2024
-
www.justpeaceadvocates.ca www.justpeaceadvocates.ca
- Mar 2024
-
networkabc.ca networkabc.ca
-
We are at crossroads when it comes to evaluation, its purpose, and how it is used. Before the pandemic and into the recovery phase, evaluation has been largely used to artificially enforce “accountability” and maintain a transactional relationship between funders and non-profit organizations. Demand for “accountability”; expectation to do more with less; and reporting on impacts are phrases that keep leaders of non-profits, including B3s awake at night. These phrases are particularly disempowering in an environment of transactional relationship between funders and non-profits. You might ask, what does this have to do with evaluation? Everything!Let’s think and reflect deeply on these phrases: Demand for accountability – who is demanding accountability and whose interest is fulfilled by meeting that accountability? Expectation to do more with less – who is expecting or promising to do more with less? Reporting on impacts – who is defining impact and/or how is impact defined and understood?Evaluation is neither neutral nor objective and in a transactional relationship between funders and non-profit organizations, its sole purpose becomes keeping the transactional relationship in place.
Tags
Annotators
URL
-
-
nivadagrenchenofficial.com nivadagrenchenofficial.com
-
www.paulsmith.com www.paulsmith.com
-
timex.ca timex.ca
-
baltic-watches.com baltic-watches.com
Tags
Annotators
URL
-
-
www.brew-watches.com www.brew-watches.com
Tags
Annotators
URL
-
-
www.paulinwatches.com www.paulinwatches.com
Tags
Annotators
URL
-
-
www.gq.com www.gq.com
Tags
Annotators
URL
-
-
eiko-fried.com eiko-fried.com
-
Without exaggeration, I believe that the majority of published works in my field (broadly defined as psychology) do not add value. Many papers draw conclusions that are not supported by evidence, which cascades through the literature, because these papers are cited for the conclusions, not the evidence. The majority of published works are not reproducible, in the sense that authors conduct science behind closed doors without sharing data or code. Many published works are not replicable, i.e., will not hold up to scrutiny over time. Theories are verbal and vague, which means they can never get properly rejected. Instead, as Paul Meehl famously wrote, they sort of just slowly fade away as people lose interest. Let me try to convince you that it is an entirely reasonable position, based on the evidence we have.
Tags
Annotators
URL
-
-
www.csap.cam.ac.uk www.csap.cam.ac.uk
-
www.linkedin.com www.linkedin.com
-
Preserve All Cash Until Needed. Then Spend.
-
-
www.arnoldventures.org www.arnoldventures.org
-
www.socialscienceregistry.org www.socialscienceregistry.org
Tags
Annotators
URL
-
- Feb 2024
-
live-imagine-canada.pantheonsite.io live-imagine-canada.pantheonsite.io
-
To be clear, funders and funded organizations should emphatically not reflexively believe that existing communications and communications channels are addressing these issues – one of the findings of our previous national high-lights report (available via the link on the final page of this report) was that funded organizations regularly communicating with funders about evaluation results were equally likely to feel that funders were driving the evaluation process and not making consistent use of findings.
-
-
climatefieldview.ca climatefieldview.ca
Tags
Annotators
URL
-
-
climatetrace.org climatetrace.org
-
lareviewofbooks.org lareviewofbooks.org
-
npproduction.wpenginepowered.com npproduction.wpenginepowered.com
- Jan 2024
-
radiant.earth radiant.earth
-
Show Ponies are typically built with limited grant funding that is allocated on a project basis. Sometimes they’re created merely to be a proof of concept. In other cases, their funders hope that “if you build it, they will come.” But because Show Ponies are usually funded by governments or non-profit organizations, they rarely have a revenue model. So even if they do gain traction and users, a Show Pony’s continued existence depends on continued support from governments or philanthropy rather than their users. This is a fragile existence, and the Internet is littered with neglected Show Ponies that aren’t being maintained.
-
-
bcbasicincomepanel.ca bcbasicincomepanel.ca
-
-
sverhulst.medium.com sverhulst.medium.com
-
is open data dead
-
-
pubs.cgdev.org pubs.cgdev.org
-
Given the potential real-world benefits, why have decision makers within governments, aid agencies, multilateral organizations, and NGOs not yet fully harnessed the value of evidence—including from impact evaluations—for better public policies?
-
-
www.bu.edu www.bu.edu
-
www.jofreeman.com www.jofreeman.com
Tags
Annotators
URL
-
-
www.youtube.com www.youtube.com
-
-
gsh.cib.natixis.com gsh.cib.natixis.com
- Dec 2023
-
philanthrobotics.pubpub.org philanthrobotics.pubpub.org
-
How can we build an open community-led commons of grants data?
-
-
www.canadafit.ca www.canadafit.caHelp1
-
-
www.hks.harvard.edu www.hks.harvard.edu
-
www.cheltenham-tax-accountants.co.uk www.cheltenham-tax-accountants.co.uk
- Nov 2023
-
www.macauslandswoollenmills.com www.macauslandswoollenmills.com
Tags
Annotators
URL
-
-
www.effectivealtruism.org www.effectivealtruism.org
-
The earlier a serious Manhattan-like project to develop nanotechnology is initiated, the longer it will take to complete, because the earlier you start, the lower the foundation from which you begin. The actual project will then run for longer, and that will then mean more time for preparation: serious preparation only starts when the project starts, and the sooner the project starts, the longer it will take, so the longer the preparation time will be. And that suggests that we should push as hard as we can to get this product launched immediately, to maximize time for preparation.
for sure?
-
-
pages.qwilr.com pages.qwilr.com
- Oct 2023
-
www.spectrumnews.org www.spectrumnews.org
-
publications.iadb.org publications.iadb.org
-
sometimesimwrong.typepad.com sometimesimwrong.typepad.com
- Sep 2023
-
www.coar-repositories.org www.coar-repositories.org
-
www.journals.uchicago.edu www.journals.uchicago.edu
-
www.bgccan.com www.bgccan.com
-
- Aug 2023
-
goodscience.substack.com goodscience.substack.com
-
relevant for the nonprofit sector
-
-
royalsocietypublishing.org royalsocietypublishing.org
-
However, one crucial question remains that has not yet been settled, and it is not a technical, but a social or political question: with everybody locked-in, who is to act in which way to ensure the redirection of funds from the legacy system to the replacement solution, i.e. an open scholarly infrastructure?
-
interesting paper about replacing journals with more "modern" scholarly infrastructure
-
-
www.smithsonianmag.com www.smithsonianmag.com
-
peoplesaction.org peoplesaction.org
-
www.usaid.gov www.usaid.gov
- Jul 2023
-
marketshareassociates.com marketshareassociates.com
-
news.ycombinator.com news.ycombinator.com
Tags
Annotators
URL
-
- Jun 2023
-
marketshareassociates.com marketshareassociates.com
- May 2023
-
vimeo.com vimeo.com
Tags
Annotators
URL
-
-
www.youtube.com www.youtube.com
-
-
www.lesswrong.com www.lesswrong.com
-
comment.org comment.org
-
- Apr 2023
-
oecd-opsi.org oecd-opsi.org
-
en.wikipedia.org en.wikipedia.org
- Mar 2023
-
www.velasca.com www.velasca.com
-
-
newamerica.org newamerica.org
-
www.ncbi.nlm.nih.gov www.ncbi.nlm.nih.gov
-
-
Back to the basics: Identifying and addressing underlying challenges in achieving high quality and relevant health statistics for indigenous populations in Canada
-
-
scienceplusplus.org scienceplusplus.org
-
accidental-taxonomist.blogspot.com accidental-taxonomist.blogspot.com
-
journals.sagepub.com journals.sagepub.com
- Feb 2023
-
www.linkedin.com www.linkedin.com
-
using theory of change to create a roadmap
-
-
www.philanthropy.com www.philanthropy.com
- Jan 2023
-
ssha.org ssha.org
-
www.igi-global.com www.igi-global.com
- Dec 2022
-
www.theglobeandmail.com www.theglobeandmail.com
-
twitter.com twitter.com
Tags
Annotators
URL
-
-
carnegieendowment.org carnegieendowment.org
-
Information Environment
Information Environment
-
- Nov 2022
- Oct 2022
-
www.convivium.ca www.convivium.ca
-
www.climatefinancetracker.com www.climatefinancetracker.com
-
Local file Local file
-
- Sep 2022
-
www.idinsight.org www.idinsight.org
- Aug 2022
-
futureofgood.co futureofgood.co
-
www.ids.ac.uk www.ids.ac.uk
-
Knowledge Translation in the Global South
Knowledge Translation in the Global South
-
-
directory.doabooks.org directory.doabooks.org
-
www.youtube.com www.youtube.com
Tags
Annotators
URL
-
-
theamericanscholar.org theamericanscholar.org
-
visakanv.com visakanv.com
-
-
www.vox.com www.vox.com
-
www.datacoalition.org www.datacoalition.org
-
familyinequality.wordpress.com familyinequality.wordpress.com
-
openknowledge.worldbank.org openknowledge.worldbank.org
-
www.newyorker.com www.newyorker.com
- Jul 2022
-
www3.carleton.ca www3.carleton.ca
-
www.open-contracting.org www.open-contracting.org
-
pubs.cgdev.org pubs.cgdev.org
-
www.nber.org www.nber.org
-
drivendata.co drivendata.co
Tags
Annotators
URL
-
-
pubs.cgdev.org pubs.cgdev.org
-
www.zbw-mediatalk.eu www.zbw-mediatalk.eu
-
www.city-journal.org www.city-journal.org
Tags
Annotators
URL
-
-
www.gabestein.com www.gabestein.com
-
maytree.com maytree.com
Tags
Annotators
URL
-
-
www.nature.com www.nature.com
-
bristoluniversitypressdigital.com bristoluniversitypressdigital.com
-
www.frontiersin.org www.frontiersin.org
-
As a result, there has been an increased focus on understanding and identifying the institutional changes that can support a more dynamic and effective relationship between marine science, policy, and practice
As a result, there has been an increased focus on understanding and identifying the institutional changes that can support a more dynamic and effective relationship between marine science, policy, and practice
-
- Jun 2022
-
www.insidephilanthropy.com www.insidephilanthropy.com
-
www.cardus.ca www.cardus.ca
-
history of gambling in ontario
-
-
www.journals.uchicago.edu www.journals.uchicago.edu
-
www.cbc.ca www.cbc.ca
- May 2022
-
-
openknowledge.worldbank.org openknowledge.worldbank.org