How to play: Some comments in this thread were written by AI. Read through and click flag as AI on any comment you think is fake. When you're done, hit reveal at the bottom to see your score.got it
Whatever it is being asked, it is great at throwing out new suggestions. This MRI idea sounds like another one of them.
It works well because humans are crap at checklists. For more or less anything you can think of, you'll come up with maybe 4 items, and the AI will add a few more. They may not be relevant, but the AI is very thorough.
> Strangely, there were many times where ChatGPT decided it would answer our medical question, but not in the form of a TV medical script. The tides had completely turned!
I've noticed this happens a lot with characters that don't have any long lines and/or have limited vocabulary.
Furby trails off pretty quickly, Abathur from StarCraft 2 (great for shortening code comments BTW) starts talking like a typical LLM after a few sentences.
> the doctors start saying things like, “Have you considered using a surrogate?” and, “Sure, the last 5 embryo transfers failed, but what if we try a 6th and cross our fingers really hard?”
To be fair, this level of reasoning is on par with free tier chatgpt.
To me this story is less about a triumph of AI and more about a failure of the healthcare system.
A few comments here making categorical assertions about AI being worse than human doctors, or no proof of it does any better. There are literally studies out there. I've read only their synopses by people on social media (including comments here on HN!) but they exist and we should be basing our discourse in that evidence.
To summarize my understanding: just like all things AI, the current frontier is quite "jagged". But there is broadly accepted evidence that AI does do better than human doctors, and even human doctors with AI, in several key aspects (like diagnostic reasoning!) while it sucks in others (pharmacology!)
And just like all things AI, as TFA suggests, the real advantage might simply come down to it being widely available, massively knowledgeable, relentless, and infinitely patient with us.
I got sent this post by a friend yesterday and I read it with my wife (physician). It was interesting although the selective inclusion of details as part of writing a compelling narrative made it difficult to interpret the experience of using AI.
The post seems to portray the fibroid as objectively the cause of the symptoms, although there is no actual evidence of that. My wife tells me that fibroids grow and shrink in size over time, and that larger studies trying to quantify fibroids as a cause of infertility have been inconclusive. A point in time MRI seems to be correlation rather than causation.
It seems the common theme using AI for personal health issues is that post writers (partly due to privacy and length concerns) leave out the gory details like a full timeline of what tests were suggested, what they showed, how many providers were visited, and what treatments were trialled. The timeline is not really clear in this case, but clearly a lot of expensive tests, treatments, and providers happened in the almost four (!) years since they started using AI. Some of those interventions might have happened due to AI advice, and there are clues to this like the mention of possible endometriosis in the biopsy result. Unfortunately, there is just not enough info in the post to know.
That being said, it's clear that AI is helpful for explaining and assisting in advocating for health and luckily there was a positive outcome. Hopefully we can work out the optimal way to incorporate it into the health system.
Gemini 3 correctly diagnosed the cause of my skin issues that a real dermatologist failed to diagnose, despite multiple visits. I followed its advice and now the issues are completely gone.
The more time I spend with the US medical system, the more I realize that nobody cares about your health as much as you do, and you really do need to learn how to engage with it, understand what's happening, and then decode how the system works and actively advocate for your own care.
It doesn't matter how great your doctors are, you're still only going to get an hour or so of their time per month if you are REALLY lucky.
Navigating this is really hard. The more AI assistance I can get the better.
As you read these stories, keep in mind that there will never be an astralcodexten.com guest essay from someone who spent time trying to diagnose a health condition with AI and it didn't help or even caused some harm. And that's probably the most common experience.
Yes, health systems worldwide have a number of problems caused by the need to operate at a scale and manage costs, same as with primary education. AI can create some efficiencies, but it almost certainly solves fewer healthcare or education problems than most AI maximalists believe.
This story is written like it vindicates AI medicine but really it seems like the human medical system dropped the ball on the MRI. ChatGPT didn't have any brilliant insight, it just (eventually) suggested the same thing a human doctor had already suggested, but this time the author and his wife pushed harder for it to happen.
To use the metaphor from the article, they found the keys in the last place they looked.
The human medical system drops the ball all the time unfortunately. What I don’t understand is how they didn’t see that giant fibroid from ultrasound alone. An MRI shouldn’t have been needed. Then the doctor trying to talk them out of the MRI, I hope they were embarrassed after. So upsetting. My wife’s friend had something similar happen after 2-3 years of unsuccessful fertility treatment, then they finally realized she had endometriosis. Seems like that should have been looked into sooner.
>it just (eventually) suggested the same thing a human doctor had already suggested
Of course, but what else would you think an LLM does? That is the insight: sifting through a sea of information and parsing it without the same emotional or other cognitive biases the original human recipient applied to it.
Sifting a sea of info without bias is the pitch, sure. But it also has no idea when it's wrong and sounds identical either way. A tired doctor at least gets nervous. Nobody's checking the model's work at 3am.
Doctors don’t need brilliant insight, they need to essentially leverage human medical knowledge against unwellness in human beings. This is confounded by two measures: too many patients per doctor, and too much human medical knowledge.
If the doctor had already suggested the MRI, what exactly made the difference? Was it that ChatGPT gave them permission to push back? Has anyone checked how often these chatbots send people to unnecessary scans? One success story doesn't tell us the hit rate.
> Even if you’re paying a gazillion dollars for IVF treatments, you still only get a few precious moments to talk to your doctor every visit. That’s just how the US medical system works. If you want to plumb the depths of what treatments are possible, or ask super detailed and anxiety ridden questions about every single scan from the latest round of imaging, you’re going to want a chatbot by your side.
Ehm, no. I want doctors by my side working in a system that is not meant to be producing gains for the rich investors but to help the sick and sad.
Just imagine what could be done with all those billions poured into datacenters and GPUs, if they were invested in public goods like a decent health system!
Sure, that is what we want, but I am not sure what you expected OP to do? Put his life on hold, skip trying for a baby, and dedicate his life to trying to change a system that people have been fighting to change unsuccessfully for decades?
OP is playing the cards he has been dealt, not wishing that he was playing a completely different game.
A health system is not a public good, access to a physician is both rivalrous (a doctor can’t see two patients at once without degrading care) and excludable. A public good, by definition, is neither rivalrous nor excludable. That’s not to say that the government shouldn’t provide private goods to citizens, but the term public provision or common welfare would be more appropriate to describe what the government is doing in those cases
We ran a small clinic scheduling tool for a while, and the 12-minute visit isn't some doctor's choice. It's what the billing math forces. Nobody on the floor can fix that this year. So yeah, you want doctors, but the chatbot is what's actually available at 11pm when you're spiraling over a scan.
The gotcha I hit using it for lab results: if you paste your own interpretation along with the numbers, it mostly just agrees with you. Pasting only the raw values and asking for a differential gave much better answers. Then I'd make it argue against its top pick, and that second pass surfaced things the first one buried.
Whatever it is being asked, it is great at throwing out new suggestions. This MRI idea sounds like another one of them.
It works well because humans are crap at checklists. For more or less anything you can think of, you'll come up with maybe 4 items, and the AI will add a few more. They may not be relevant, but the AI is very thorough.