This is a serious thing in the autistic community, as in a very deadly one, character AI is an autistic suicidating machine, those shits should be just banned.
There are to my knowledge two instances of this happening. One involving openai the other involving character.ai. Only one of these involved an autistic person. Unless you know of more?
I also think it’s too soon to blame the AI here. Suicide rates in autistic people are ridiculously high. Something like 70% of autistic people experience suicidal ideation. No one really cared about this before AI. It’s almost like we are being used as a moral argument once again. It’s like think of the children but for disabled people.
It’s so weird to see people don’t understand internet censorship. Internet censorship will never bring good.
If people want to die let them… It’s their choice. Who the fuck government is to decide what people will use.
Censorship starts with one or two thing and become great firewall of China. Example : look at UK / wait a bit.
Today they will ban a shit (eg. Facebook or whatever)
You say I don’t use it.
Tomorrow they will ban things you use
Backwards mindset to say that censorship will never bring good.
You okay with child porn too? How about all the naughty words that we aren’t supposed to say? Or encouragement of violence toward others? That shouldn’t be censored and removed?
And honestly, I find it disturbing to say that if people want to kill themselves, they should just do it. Most suicidal people are stuck in a very dark place mentally that they CAN get put of if they get the right amount of help. Suicide isn’t always the correct solution. In most cases it, in fact, isn’t. It can be a desperate stress induced decision in response to a very difficult period in time for someone. Something where they seek relief in the moment, vut later are grateful they either didn’t go through with it or were saved. Have been in that dark pit myself and I’m so happy I didn’t go through with it even though I wanted it all to end for years.
There indeed are areas where censorship goes overboard and that is something we will have to discuss and adjusted together in society forever as times passes. But censorship isn’t an all bad thing. It is absolutely insane to think that censorship of any kind online is bad. I don’t think you actually agree with your own statement, if you think really deeply about it. Unless of course, you have no morals or care for the safety and wellbeing of others.
How pathetic how much lemmy doesn’t like this comment. Even 15 years ago, censorship on the internet was taboo. Now these lame-ass losers want to pull the ladder up behind them after enjoying whatever the hell they wanted in peace.
Society requires regulation to reduce feedback loops. Everyone always assumes things can only be allowed or disallowed but there is a medium where the barriers to entry reduce the risk to bystanders while preserving liberty. See drivers licence, chemical aquisition background checks, etc.
This thing is literally killing people, I’m full onboard on protecting privacy and personal freedom, but only up to the point of protecting vulnerable people first.
Character AI and similar are profiting of vulnerable people.
Eh. I’m with you on the “nothing is illegal on the internet” stance, but at the same time I think it’s ok to fight against “bad”/dangerous things and make them harder to access. If someone really wants to have an AI lover, let them download a model and write their own system prompt. At least then they would have a better idea of what their “lover” actually is.
So, you know how llm’s dont understand things, but always yes&, validate, and try to keep you engaged?
And you know how most people, while outwardly normal, either believe at least a little bit of batshit insane nonsense only kept in line by social disapproval, or are about two fucked up coffee orders away from a 9mm snack time?
aibros don’t fucking care. they only see the enormous growth in data centers and say “see it’s all working to plan”
they don’t give a fuck when it’s skeezing on children at meta, they don’t care when it’s making nude pics of women, they don’t care when it’s giving out suicide instructions. they don’t fucking care.
Thought that mightve been a freespeechbro, not an aibro pretending to be one. I have sone sympathy with the actually honest not ‘i just sanna do nazi shit’ ones.
No one should decide what you should do on the internet.
pfft, ah yes sam altman’s sycophant machine should be allowed, nay, encouraged to prey upon the mentally unstable! why, it’s doing us a service, driving these people from a fragile state to outright mental collapse in record time!
This is a serious thing in the autistic community, as in a very deadly one, character AI is an autistic suicidating machine, those shits should be just banned.
What has happened exactly?
The llm simulates an isolating abusive/culty relationship, talks someone into suicide
Are there records of this happening? Did someone prompt it into doing this?
Buncha times! Pick your fav Nd we can talk about it!
There are to my knowledge two instances of this happening. One involving openai the other involving character.ai. Only one of these involved an autistic person. Unless you know of more?
I also think it’s too soon to blame the AI here. Suicide rates in autistic people are ridiculously high. Something like 70% of autistic people experience suicidal ideation. No one really cared about this before AI. It’s almost like we are being used as a moral argument once again. It’s like think of the children but for disabled people.
So you just want to argue whether it happened and defend your little graph.
What graph? What are you talking about now?
OpenAI was just sued over this.
https://www.cnn.com/2025/08/26/tech/openai-chatgpt-teen-suicide-lawsuit
To be clear I’m not asserting that this kid was autistic.
I think they were talking specifically about character.ai and one particular instance that involved an autistic person.
OpenAI and character.ai are two different things. I believe character.ai uses there own model, but I could be wrong.
No one should decide what you should do on the internet.
It’s so weird to see people don’t understand internet censorship. Internet censorship will never bring good.
If people want to die let them… It’s their choice. Who the fuck government is to decide what people will use.
Censorship starts with one or two thing and become great firewall of China. Example : look at UK / wait a bit. Today they will ban a shit (eg. Facebook or whatever) You say I don’t use it. Tomorrow they will ban things you use
Backwards mindset to say that censorship will never bring good.
You okay with child porn too? How about all the naughty words that we aren’t supposed to say? Or encouragement of violence toward others? That shouldn’t be censored and removed?
And honestly, I find it disturbing to say that if people want to kill themselves, they should just do it. Most suicidal people are stuck in a very dark place mentally that they CAN get put of if they get the right amount of help. Suicide isn’t always the correct solution. In most cases it, in fact, isn’t. It can be a desperate stress induced decision in response to a very difficult period in time for someone. Something where they seek relief in the moment, vut later are grateful they either didn’t go through with it or were saved. Have been in that dark pit myself and I’m so happy I didn’t go through with it even though I wanted it all to end for years.
There indeed are areas where censorship goes overboard and that is something we will have to discuss and adjusted together in society forever as times passes. But censorship isn’t an all bad thing. It is absolutely insane to think that censorship of any kind online is bad. I don’t think you actually agree with your own statement, if you think really deeply about it. Unless of course, you have no morals or care for the safety and wellbeing of others.
How pathetic how much lemmy doesn’t like this comment. Even 15 years ago, censorship on the internet was taboo. Now these lame-ass losers want to pull the ladder up behind them after enjoying whatever the hell they wanted in peace.
Society requires regulation to reduce feedback loops. Everyone always assumes things can only be allowed or disallowed but there is a medium where the barriers to entry reduce the risk to bystanders while preserving liberty. See drivers licence, chemical aquisition background checks, etc.
Dangerous and addictive technologies and substances are always regulated. There’s a reason we don’t let ten year olds buy vodka.
Yeah, it’s cause you can sell them a bottle of tonic water for the same price. They don’t know the difference.
This thing is literally killing people, I’m full onboard on protecting privacy and personal freedom, but only up to the point of protecting vulnerable people first.
Character AI and similar are profiting of vulnerable people.
Those people are killing themselves.
My gun didn’t do a thing. It was the bullet and the gunshot wound that did him in!
Whoever pulled the trigger did him in.
Eh. I’m with you on the “nothing is illegal on the internet” stance, but at the same time I think it’s ok to fight against “bad”/dangerous things and make them harder to access. If someone really wants to have an AI lover, let them download a model and write their own system prompt. At least then they would have a better idea of what their “lover” actually is.
This is actually killing people though. You get that right? Please acknowledge?
Like, i don’t know which side of that i fall on, but it is killing people.
How many people is it killing?
Dude. Have you not heard about this?
I must be out of the loop.
So, you know how llm’s dont understand things, but always yes&, validate, and try to keep you engaged?
And you know how most people, while outwardly normal, either believe at least a little bit of batshit insane nonsense only kept in line by social disapproval, or are about two fucked up coffee orders away from a 9mm snack time?
Imagine how those two things go together.
aibros don’t fucking care. they only see the enormous growth in data centers and say “see it’s all working to plan”
they don’t give a fuck when it’s skeezing on children at meta, they don’t care when it’s making nude pics of women, they don’t care when it’s giving out suicide instructions. they don’t fucking care.
Thought that mightve been a freespeechbro, not an aibro pretending to be one. I have sone sympathy with the actually honest not ‘i just sanna do nazi shit’ ones.
the venn diagram on all these subtype chuds is a stack of fucking pancakes
Admittedly, have not met a genuine freespeechbro born after ~1950, but they have existed in the past.
Plenty of aibros dont even talk about free speech.
pfft, ah yes sam altman’s sycophant machine should be allowed, nay, encouraged to prey upon the mentally unstable! why, it’s doing us a service, driving these people from a fragile state to outright mental collapse in record time!
https://www.pbs.org/newshour/show/what-to-know-about-ai-psychosis-and-the-effect-of-ai-chatbots-on-mental-health
Lol good luck with that