• 0 Posts
  • 34 Comments
Joined 1 month ago
cake
Cake day: July 28th, 2025

help-circle

  • I agree with the part about unintended use, yes an LLM is not and should never act as a therapist. However, concerning your example with search engines, they will catch the suicide keyword and put help sources before any search result. Google does it, DDG also. I believe ChatGPT will start with such resources also on the first mention, but as OpenAI themselves say, the safety features degrade with the length of the conversation.

    About this specific case, I need to find out more, but other comments on this thread say that not only the kid was in therapy, suggesting that the parents were not passive about it, but also that ChatGPT actually encouraged the kid to hide what he was going through. Considering what I was able to hide from my parents when I was a teenager, without such a tool available, I can only imagine how much harder it would be to notice the depth of what this kid was going through.

    In the end I strongly believe that the company should put much stronger safety features, and if they are unable to do so correctly, then my belief is that the product should just not be available to the public. People will misuse tools, especially a tool touted as AI when it is actually a glorified autocomplete.

    (Yes, I know that AI is a much larger term that also encompasses LLMs, but the actual limitations of LLMs are not well enough known by the public, and not communicated enough by the companies to the end users)









  • So in general, research on animals is a step before research on humans. That’s as simple as that. It costs more to do experimentation on humans, and it’s also more dangerous (to humans). But you didn’t need the article for that, any simple research online would have given you that answer.

    I maintain that you are not arguing in good faith here.

    Edit: There’s a bit more information on this article from the CBC, notably with the following:

    Other effective models don’t yet exist for this specific line of inquiry that connects the metabolic and cellular mechanisms that can lead to, or prevent, a heart attack or heart failure with non-invasive imaging techniques.