@renebekkers@mastodon.social avatar

renebekkers

@renebekkers@mastodon.social

professor of philanthropy at the department of sociology at VU Amsterdam; open science advocate; chair of the faculty of social sciences research ethics review committee

This profile is from a federated server and may be incomplete. Browse more on the original instance.

renebekkers, to random Dutch
@renebekkers@mastodon.social avatar

"asking for data is not tantamount to accusing researchers of fraud: it should be accepted as normal scientific practice to make data available in order that others can check the reproducibility of findings. If someone treats such a request as an accusation, or deems it "unreasonable", then I'm afraid it just makes me suspicious" 100% agree!
#opendata #openscience #reproducibility #transparency
http://deevybee.blogspot.com/2024/05/are-commitments-to-open-data-policies.html

lakens, to random Dutch
@lakens@mastodon.social avatar

What are relatively simple things that you wish researchers would report, or would report better, that you have to keep pointing out in reviews?

renebekkers,
@renebekkers@mastodon.social avatar

@lakens a DOI for the data analyzed

renebekkers, to random Dutch
@renebekkers@mastodon.social avatar

“You should always, if you’re using text from someone else, say where it begins, where it ends, and where you got it from.”
https://www.science.org/content/article/embattled-harvard-honesty-professor-accused-plagiarism

ionica, to random
@ionica@mathstodon.xyz avatar

Subtle ways to spot AI might have written the introduction 😀
https://www.sciencedirect.com/science/article/abs/pii/S2468023024002402

renebekkers,
@renebekkers@mastodon.social avatar

@ionica

renebekkers, to ML Dutch
@renebekkers@mastodon.social avatar

Last week I attended the 6th Perspectives on Scientific Error Conference at @TUEindhoven
I learned so much! About #metascience #preregistration #replicability #qrp questionable research practices, methods to detect data fabrication, #peerreview, #poweranalysis artefacts in #ML machine learning...
I'm impressed by the commitment of participants to improve science through error detection & prevention. Thanks to the organizers Noah van Dongen, @lakens @annescheel Felipe Romero and @annaveer

renebekkers,
@renebekkers@mastodon.social avatar

@TUEindhoven @lakens @annescheel @annaveer
at the PSE6 meeting I wondered how often researchers in different disciplines attempt to replicate previous findings. Here's an overview of all studies I could find, with some surprising patterns. https://renebekkers.wordpress.com/2024/03/08/how-often-do-we-replicate-previous-research/
#metascience #replication

renebekkers, to random Dutch
@renebekkers@mastodon.social avatar

Each week a large number of 'cordial invitations' to contribute to shady 'journals' flow into my inbox such as this one. This one's hilarious. I'm not a dermatologist. Please beware these so-called 'predatory publishers' trying to make money off posting your research.

https://renebekkers.wordpress.com/2023/03/27/beware-of-predatory-publishers/

elduvelle, (edited ) to academia
@elduvelle@neuromatch.social avatar

People who write : do you write about

  1. projects that you’ve already almost completed (hiding the fact that they’re almost completed, so that you can use the funding for completely new projects), or
  2. new projects that you haven’t really started yet (for which you might just have some preliminary data)?

Do you think 1) is unethical? Do you think 1) is necessary? Do you think 1) has the highest chances of funding? Please comment :)

renebekkers,
@renebekkers@mastodon.social avatar

@elduvelle thanks for posting this question - so informative to see the diversity of responses! It's shocking to learn about the fraudulent practice #1. Grant proposals should fund new research, and identify work in progress as such. Mandatory public pre-registration could prevent #1.

renebekkers,
@renebekkers@mastodon.social avatar

@elduvelle indeed a lot of time and money is wasted on grant proposals and their evaluation. For a competition I entered once the waste was 40% of the total amount granted. https://renebekkers.wordpress.com/2020/02/19/cut-the-crap-fund-the-research/
A system with a basic income for research would be better, or lotteries among those with eligible proposals.

renebekkers,
@renebekkers@mastodon.social avatar

@LouZonca @elduvelle perhaps in grant applications we should also include a budget for developing preliminary evidence for the next application

lakens, to random Dutch
@lakens@mastodon.social avatar

I am writing a paper on the benefits of preregistration. In one section I will address what most people find the strongest criticisms on preregistration. So, which points do you feel I should discuss?

renebekkers,
@renebekkers@mastodon.social avatar

@tomstafford @lakens another issue I often encounter: that the prereg should be followed no matter what, and deviations are impossible

renebekkers,
@renebekkers@mastodon.social avatar

@tomstafford @lakens no... pre-registration is still very very rare in my department and discipline of sociology. In the multidisciplinary field of nonprofit and philanthropy research the situation is similar with the exception of some experimentalists in psychology, economics and decision making

renebekkers,
@renebekkers@mastodon.social avatar

@ingorohlfing @tomstafford @lakens on the other hand, the prereg does enhance the credibility of the experiments...

renebekkers,
@renebekkers@mastodon.social avatar

@lakens @tomstafford patience & persistence

renebekkers,
@renebekkers@mastodon.social avatar

@lakens @tomstafford great, thanks!

renebekkers,
@renebekkers@mastodon.social avatar

@lakens @ingorohlfing @tomstafford that's what I think as well. Moreover, the additional analyses are more convincing when they are pre-registered. When articles without prereg present some robustness tests (but not others) and all of them are supporting the main claim, a red flag should go up

lakens, to random
@lakens@mastodon.social avatar

Who do you think wrote this footnote? I think many people who only know of the work of this author second-hand would never associate this with the author.

renebekkers,
@renebekkers@mastodon.social avatar

@lakens @tomstafford this principle was explained in the first course in my sociology program. It caught on. https://betteracademicwriting.wordpress.com/2022/06/12/isnt-my-research-a-complete-failure-now-my-hypothesis-was-not-supported/

renebekkers, to random Dutch
@renebekkers@mastodon.social avatar

Q: "Is AI leading to a reproducibility crisis in science?"
Short answer: "Yes".
Long answer: “It’s hard to be completely transparent if you don’t fully understand what you are doing”
https://www.nature.com/articles/d41586-023-03817-6

renebekkers, to academia Dutch
@renebekkers@mastodon.social avatar

Female PhD students are less likely to graduate with honors (cum laude) than males.
When dissertations are evaluated by committees including a larger proportion of female scholars, the difference disappears. Great work by Tijs Bol @uva_amsterdam
https://www.nature.com/articles/s41598-023-46375-7
#inequality #academia #phd #phdlife

petersuber, to random

Odd sentence: "While research quality declines monotonically over the career, this decline is easily overlooked because higher 'ability' authors have longer publishing careers."
https://jhr.uwpress.org/content/58/4/1307

It seems false to me that "research quality declines monotonically over the career" & false that "higher 'ability' authors have longer publishing careers."

For those reasons & to be fair to the authors, I'd love to read the whole piece. Unfortunately it's #paywalled & I only read the abstract.

renebekkers,
@renebekkers@mastodon.social avatar

@petersuber
the article is not about research quality. Instead, it shows that the total number citations an article will ever receive is higher when researchers still have more time to go in their careers.

renebekkers, to random Dutch
@renebekkers@mastodon.social avatar

#silentsunday view from Gruyères, Switzerland

lakens, to random
@lakens@mastodon.social avatar

A plea from @dstephenlindsay to psychology professional societies that publish journals: Assess computational reproducibility https://open.lnu.se/index.php/metapsychology/article/view/4020

renebekkers,
@renebekkers@mastodon.social avatar

@emrinke @dstephenlindsay @lakens @paulralph No need to eat that coconut! In a different field I conducted the pilot study proposed. For Nonprofit & Voluntary Sector Quarterly, a multidisciplinary journal publishing research on nonprofit organizations, I've volunteered as a data editor, verifying computational reproducibility before articles were sent out for review. I found support for the predictions: here's a brief report https://renebekkers.files.wordpress.com/2023/04/experiences-with-the-data-and-code-submission-policy-at-nvsq.pdf

lakens, to random
@lakens@mastodon.social avatar

Regrettably my wife is back in the hospital. Her current treatment plan to figure out what is wrong is based on a test with a 90% Type 1 error rate, but that is still their best shot. So at least I am getting some good examples about how to #JustifyYourAlpha

renebekkers,
@renebekkers@mastodon.social avatar

@lakens oh no...I hope you will get an accurate test result and an effective treatment can be given

lakens, to random
@lakens@mastodon.social avatar

When the ego is involved, self-criticism may come hard.

Beck -1961 - Modern science and the nature of life

Read in full on the internet archive: https://archive.org/details/modernsciencenat00beck/page/218/mode/2up

renebekkers,
@renebekkers@mastodon.social avatar

@lakens not yet, and interested to do so., where can I find it?

renebekkers,
@renebekkers@mastodon.social avatar

@lakens thanks for the link. Indeed I enjoyed the paper. I did an internship at a department of social psychology in the interbellum (the year 2000), where I saw the reproducibility crisis avant la lettre. Failed experiments were discussed internally, but not written up or published. It's good to see changes in the business in the past years.
It's striking though that there is so little discussion on reproducibility in my own discipline of Sociology, and I don't think we will have it soon

  • All
  • Subscribed
  • Moderated
  • Favorites
  • •
  • JUstTest
  • mdbf
  • InstantRegret
  • ethstaker
  • magazineikmin
  • GTA5RPClips
  • rosin
  • modclub
  • Youngstown
  • ngwrru68w68
  • slotface
  • osvaldo12
  • kavyap
  • DreamBathrooms
  • Leos
  • thenastyranch
  • everett
  • cubers
  • cisconetworking
  • normalnudes
  • Durango
  • anitta
  • khanakhh
  • tacticalgear
  • tester
  • provamag3
  • megavids
  • lostlight
  • All magazines
    •