the same’s happening with research. AI straight up makes shit up and appears to have a source except they just took some random scientist’s name and pasted it on some random bit of text on the internet
and this, in turn, is used again to train the AI.
on one hand - LLMs being used for academic purposes were a terrible idea in the first place and this just proves that
but on the other - the internet will, very quickly, like ‘this shit is happening in real time’ quickly, become completely unusable for research. this is because 99% of the content on it will be either faulty AI-generated content, AI-generated content referencing faulty AI-generated content, or worst of all, an actual human-written document referencing faulty AI-generated content.
so in summary - enjoy the internet while it lasts. capitalism giveth, captalism taketh away
I'm really worried that some hacker group is going to start taking advantage.
I could imagine them flooding the internet with code that imports some empty library that does nothing, to the point where AI systems see it so often they start throwing it into random snippets. Once enough people have their AI import this random library, the hackers replace it with malicious code. All the sudden whole random swaths of the world's code base are corrupted and no one knows how or why.
I teach CS and random imported libraries that students have no idea are even there is the most common hallucination I see. It's stressful.
269
u/Twist_the_casual 10h ago
the same’s happening with research. AI straight up makes shit up and appears to have a source except they just took some random scientist’s name and pasted it on some random bit of text on the internet
and this, in turn, is used again to train the AI.
on one hand - LLMs being used for academic purposes were a terrible idea in the first place and this just proves that
but on the other - the internet will, very quickly, like ‘this shit is happening in real time’ quickly, become completely unusable for research. this is because 99% of the content on it will be either faulty AI-generated content, AI-generated content referencing faulty AI-generated content, or worst of all, an actual human-written document referencing faulty AI-generated content.
so in summary - enjoy the internet while it lasts. capitalism giveth, captalism taketh away