Showing Me Your Amateur Breakthrough Is Evidence That It’s Wrong

Ok, people who read my post on the Anthropic science blog: we need to talk.

It’s understandable. You saw me write about AI being used to tackle a serious, publishable physics problem. Naturally, some of you want to share that you accomplished something even more impressive with AI, something the scientific journals and arXiv moderators won’t acknowledge. Maybe you’re hoping I’ll write about it, maybe you want me to check your math. Maybe you just think it’s neat.

But here’s the thing: most of the time, I’m not the right person to send those ideas to. And the fact that you didn’t figure that out is a bad sign.

Outside of the movies, scientists are specialists. Not just “physics” or “particle physics” or “theoretical particle physics”, but so specific that they often focus on particular methods, or are geared around particular goals. For any idea you propose, if it’s good, there will be a small list of people who will be excited to see it and able to evaluate it. They’ll be people who are trying to accomplish the same thing, or people who used the methods you’re using for other things. Those people aren’t hard to find, if your idea is in a field you’re actually interested in: they’re the people who write papers on the subject. If you find the topic interesting, you’ll have read their papers, and know who to reach out to.

So even back when I was active as a physicist, there was only a small list of ideas where I’d be the right person to talk to. Now, though, as I mentioned in the Anthropic post, I’m not a scientist anymore. I haven’t been following the field in enough detail to actually verify anything in detail, even on topics I used to research. Part of the punchline of the post was that I don’t have a clear idea of what’s possible in the field right now. So even if you’ve figured out something in scattering amplitudes, you should reach out to someone who’s still researching the subject, a few of whom were even mentioned in the post!

Now, it might be you’re not interested in someone checking your work, and instead you’re writing to me in my capacity as a science journalist, because you feel like you did something newsworthy. But as a science journalist, I’m not supposed to evaluate your work by myself. I’m supposed to reach out to an independent expert, and if I can’t find any who will speak positively about your result, then the editors won’t publish it. So if you think you did something big enough to merit news coverage, the first thing to do is once again, reach out to a scientist who actually has the expertise to evaluate your work, and get them excited about it. Then you two can contact me together!

If you don’t know who to contact, that’s a sign you don’t read papers in the field. It makes it more likely you managed to convince yourself of something nonsensical, because you don’t have the expertise to evaluate it. It’s a pretty clear sign that I shouldn’t trust you or your AI methods about the result.

It’s also just plain bad for you. If you produce a paper without ever wanting to read any, it suggests your priorities are in a dangerous place: that you’re trying to do something that sounds cool and important over doing something you actually care about.

I’m coming from personal experience here.

As an academic, I spent years telling myself that not enjoying reading papers or going to talks was just part of the job. Then it really cost me something, and I realized the job wasn’t worth my superficial desire to be a physicist. So I left.

Then, I spent a year trying to get a job in industry, and was told the same thing. They wanted to hire people who cared about the job. The finance guys wanted to hire people who read books about finance. The data scientists wanted to hire people who did projects in data science. They wanted, if not passion, then at least grace. Someone who could take to the job easily, and naturally.

Now, what I do for a living is something I was doing once a week, for no more incentive than a vague sense of personal obligation, for over a decade. And I’m doing a lot better.

You want to do something impressive with AI? You think you’re a whiz with Claude Code, that your custom workflow is immune to AI hallucinations?

Then use it for something else. Pick something you actually enjoy reading about, not just the pop news, but the real technical literature. Something you don’t need the AI to explain to you. Something that matters to you, in a way that actually counts.

At the very least, it’ll work out better than writing to me.

Leave a comment! If it's your first time, it will go into moderation.