ChatGPT spam

Post

Posted
Rating:
Item has a rating of 5 (Liked by Adam Edington)
#9215 (In Topic #3172)
Avatar
Site director
Chris Graham is in the usergroup ‘Administrators’
Seems we have a new problem here, spam by ChatGPT-like systems.

We have been low-key plagued by spam for a long time. I want to thank {{Adam}} for doing a great job dealing with it, especially while I have been gone. However, in the past spam has been easier to at least manually detect. Obvious spammy links, and text that has little bearing on anything or is directly copy and pasted.
ChatGPT-like spam changes like.

I wonder what the solution is. Here's what we probably cannot do:
  1. Invest a lot of thought into each post to work out who the poster is and why they posted.
  2. Just reflectively delete things or ban things if we're not reasonable sure.
  3. Put everything behind an algorithm, so you have to establish a presence before people see your topics and posts.
  4. Auto-detect what is and isn't the output of a LLM (large language model).

Here's what we probably can do, at least at some point:
  1. Identify patterns of behavior across time, people who seem to be repeatedly posting content that probably is not what a real human would be posting.
  2. Clamp-down heavily on people having link spam in their profiles.
  3. Auto-moderation with mass-flagging.

Would be interested in people's thoughts. Bear in mind that any non-trivial software solutions would require people to step up as contributors.


Become a fan of Composr on Facebook or add me as a friend. Add me on on Mastodon. Follow me on Minds (where I am most active). Support me on Patreon

Was I helpful?
  • If not, please let us know how we can do better (please try and propose any bigger ideas in such a way that they are fundable and scalable).
  • If so, please let others know about Composr whenever you see the opportunity or support me on Patreon.
  • If my reply is too Vulcan or expressed too much in business-strategy terms, and not particularly personal, I apologise. As a company & project maintainer, time is very limited to me, so usually when I write a reply I try and make it generic advice to all readers. I'm also naturally a joined-up thinker, so I always express my thoughts in combined business and technical terms. I recognise not everyone likes that, don't let my Vulcan-thinking stop you enjoying Composr on fun personal projects.
  • If my response can inspire a community tutorial, that's a great way of giving back to the project as a user.
Online now: No Back to the top

Post

Posted
Rating:
Item has a rating of 5 (Liked by Chris Graham)
#9222
Avatar
Standard member
sholzy is in the usergroup ‘Community saint’
My (rambling?) thought is, is AI good enough now to get through all the steps needed to create an account and start spamming? If not, how long?

Way back in the ocP days when I spent a large amount of time analyzing spammers through all the steps from the time they created the account to when they created their first forum post. The one thing that stood out to me the most was the names they used. It was very easy to spot a spammer, even up until today, before they even made their first post (maybe a 4/4.5 out of 5). The spammer's name/handle that I believe that was the trigger for this thread, without me writing it's name (hasn't been fully banned), was a little less noticeable (maybe a 2.5/3 out of 5).

I think as time goes on, spammers using AI will become more difficult to spot before the spam starts. But at the same time, I'm also wondering if posts (like this spammer) becomes easier to spot because they appear "too" perfect.

I think human intervention (eyes and hands) will always have to be a part of spam detection. How big a part?

Steve
Online now: No Back to the top
1 guest and 0 members have just viewed this.

Statistics

Forum statistics:
  • 2,052 topics, 7,195 posts, 10,830 members
  • Our newest member is Customcollective
Back to Top