The opposite is more interesting, (and the author points it out too). SOTA agents can help run small experiments and help you do the writeup. Should you publish it? I'd personally want to keep a human at least partially in the loop, or have very solid checkers. But for one off personal research it's at the same point as one off personal code: make sure you have a way to test what's valid; but if you do, it often Just Works(tm) Now.
Save yourself a slog. The automated checks found that the citations didn't exist and flagged the "papers". A better title would have been "Automated Systems seem to hold back the AI Slop papers. For now." Sweet writing studio, though.
You can't build trust over science, that's just an error of category. You can only build trust in some people on some topic. One can measure reliability in a process, but if no specific human is involved, there is no literal trust engaged.
Now of course, to each its definition and metaphors are useful tools.
But when one starts a discussion on truth, trust or reality as core topic, it's better to start with what is meant with these words and in which context to which scoped boundaries.
Because of course, science can back a contemporary etnologic account that asserts there is no (longer) different races in homo sapiens, just as much as it can serve as frame for phrenology and whatever supremacism claim.
So no, we didn't build trust in science over centuries, and not even in any scientific person because we don't have that much humans to hold the role of such a trustable entity over such a long period of time.
Social institutions can carry unchanged names over centuries, but that tells nothing about how trustable are the people that inhabit them over time.
LLMs certainly come with their own challenges, but the erosion or scientific institutions with its bizarre scheme of publication process have been there basically as far as I can remember.
In other news people prompted a model to pick a problem to solve, solve it and write a paper about it. And it did and the paper contains novel contributions.
This experiment was agreed with the managing editor of the multidisciplinary and open-access journal IEEE Access, and IEEE itself - it was red teaming, essentially.
The opposite is more interesting, (and the author points it out too). SOTA agents can help run small experiments and help you do the writeup. Should you publish it? I'd personally want to keep a human at least partially in the loop, or have very solid checkers. But for one off personal research it's at the same point as one off personal code: make sure you have a way to test what's valid; but if you do, it often Just Works(tm) Now.
>When one model refuses or stalls, I switch models, rephrase prompts, and ask what the next step would look like “hypothetically.”
I wonder If the hypothetically criterion gives the models carte blanche to make up references.
Even though these experiments got rejected, I feel like if he had used better AI versions, they might have worked.
Also, kinda scary to think about how many scientific papers are probably written using AI these days. The system might have to change.
Sidenote: way to flex your "writing studio".
A shed, but a cool shed ig.
Save yourself a slog. The automated checks found that the citations didn't exist and flagged the "papers". A better title would have been "Automated Systems seem to hold back the AI Slop papers. For now." Sweet writing studio, though.
You can't build trust over science, that's just an error of category. You can only build trust in some people on some topic. One can measure reliability in a process, but if no specific human is involved, there is no literal trust engaged.
Now of course, to each its definition and metaphors are useful tools.
But when one starts a discussion on truth, trust or reality as core topic, it's better to start with what is meant with these words and in which context to which scoped boundaries.
Because of course, science can back a contemporary etnologic account that asserts there is no (longer) different races in homo sapiens, just as much as it can serve as frame for phrenology and whatever supremacism claim.
So no, we didn't build trust in science over centuries, and not even in any scientific person because we don't have that much humans to hold the role of such a trustable entity over such a long period of time.
Social institutions can carry unchanged names over centuries, but that tells nothing about how trustable are the people that inhabit them over time.
LLMs certainly come with their own challenges, but the erosion or scientific institutions with its bizarre scheme of publication process have been there basically as far as I can remember.
There is still no paper or notable result in gender studies published by an AI.
In other news people prompted a model to pick a problem to solve, solve it and write a paper about it. And it did and the paper contains novel contributions.
https://www.reddit.com/r/OpenAI/comments/1xgqv27/two_physici...
Please, even if it is an experiment, don't do this. We don't need more AI slop in the world.
This experiment was agreed with the managing editor of the multidisciplinary and open-access journal IEEE Access, and IEEE itself - it was red teaming, essentially.
TLDR - both papers got flagged and rejected by automated integrity checks.
The first paper (free-tier chatbots) due to fake references, the second paper (a specialized AI-research tool) due to overreliance on preprints.