If there was a book or website out there that described something poisonous as not poisonous, and someone believed what was written and became poisoned, I think most reasonable people would point the blame at whoever published the bad information.
Yet when the bad (potentially deadly in this case!) information comes from ChatGPT, OpenAI gets a pass (including by everyone so far in this comment section) and the blame is placed on the person who was poisoned!
the blame is placed on the person who was poisoned!
I think there’s a toxic mentality that has infected society that there’s only ever 1 person or entity or group or “side” to blame. It’s OpenAI’s fault for feeding him deadly information and it’s also his fault for not fact-checking said information. He has paid dearly for his mistake. Has OpenAI?
That said, if we can put aside blame for a second and just agree that OpenAI is feeding dangerous and unchecked information to the masses, and it should be OpenAI’s responsibility to either figure out how to fix it or (preferably) just stop doing it entirely. I’m not sure if it’s legal for a company to be giving out medical advice, or if they’re responsible for the ramifications of such advice, without a doctor involved, but it probably should be. They can’t just put a “you should fact check this info” at the bottom and absolve themselves of all responsibility.
Engineers, including for software and AI, have a literal moral duty to not make stuff that will kill people. Eg Hyatt Hotel collapse in Kansas City. This has long been established.
home depot type books on diy wiring have been forcably recalled for deadly information. That you can’t make something safe is reason not to do it at all.
If there was a book or website out there that described something poisonous as not poisonous, and someone believed what was written and became poisoned, I think most reasonable people would point the blame at whoever published the bad information.
Yet when the bad (potentially deadly in this case!) information comes from ChatGPT, OpenAI gets a pass (including by everyone so far in this comment section) and the blame is placed on the person who was poisoned!
I think there’s a toxic mentality that has infected society that there’s only ever 1 person or entity or group or “side” to blame. It’s OpenAI’s fault for feeding him deadly information and it’s also his fault for not fact-checking said information. He has paid dearly for his mistake. Has OpenAI?
That said, if we can put aside blame for a second and just agree that OpenAI is feeding dangerous and unchecked information to the masses, and it should be OpenAI’s responsibility to either figure out how to fix it or (preferably) just stop doing it entirely. I’m not sure if it’s legal for a company to be giving out medical advice, or if they’re responsible for the ramifications of such advice, without a doctor involved, but it probably should be. They can’t just put a “you should fact check this info” at the bottom and absolve themselves of all responsibility.
Well, thankfully it wasn’t deadly in this case, even if it was potentially.
Engineers, including for software and AI, have a literal moral duty to not make stuff that will kill people. Eg Hyatt Hotel collapse in Kansas City. This has long been established.
home depot type books on diy wiring have been forcably recalled for deadly information. That you can’t make something safe is reason not to do it at all.
Glad to hear they were recalled!
This is equivalent to seeing “poison is good for you” scribbled on a bathroom wall. If you believe that, it’s on you.