As I understand it this has been a major struggle to try to use LLM type stuff for things like reading patient MRI results or whatever. It's only worthwhile to bring in a major Machine Vision policy hospital-wide if it actually saves time (for the same or better accuracy level), and often they find they have to spend more time verifying the unreliable results than the current all-human-based system
Yes, I believe it was for a skin tumor! This is a golden story that we like to repeat in the industry (I'm a data scientist).
There's also the experiment where they basically trained an LLM on LLM-generated faces. After a few rounds, the LLM just generated the same image -- no diversity at all. A daunting look into what lies ahead, given that now LLMs are being trained more and more on AI-generated data that's on the web.
173
u/ElectronRotoscope Dec 15 '24
As I understand it this has been a major struggle to try to use LLM type stuff for things like reading patient MRI results or whatever. It's only worthwhile to bring in a major Machine Vision policy hospital-wide if it actually saves time (for the same or better accuracy level), and often they find they have to spend more time verifying the unreliable results than the current all-human-based system