Image Moderation
How are you filtering/moderating images that users upload when creating a post? I would like to do this automatically like with the word filter. Any ideas? I want to protect other users of the platform and mitigate risk.
Thomas, I've never heard of such a solution for WordPress, and there was no information about it in the community either.
I have often noticed that even on large social networks, all sorts of things slip through, and they only ban people after complaints are made. Most likely, it's the same here.
It's a shame not only for the users but for the liability of those who own and host the site. Laws vary but I think the some type of measure to handle such things needs to be in place. At the vary least reasonable action has to be taken to remove banned or illegal content.
Thomas As a temporary measure, you can configure posts in Fcom only through moderator approval.
Artur Abakarov I'm assuming you mean every post would be marked as pending? I would need to automate it more than that.
Thomas Yes, but you can also set it up so that only the first post needs to be moderated. That's the best way to do it.
This is another area that would need significant work before I would consider migrating over.
Can you describe it further? All posts that contain images should go into a moderation queue? How would you automate deciding the image is ok?
Ross FCA I was thinking that ai would do the filtering. Here's what ChatGPT said but it's above my understanding:
To add image filtering:
- Intercept the image upload request (FluentCommunity uses a custom REST endpoint).
- Send the uploaded image to an AI moderation service (Cloudflare AI recommended).
- Block the upload if unsafe, otherwise let it continue and upload to your Cloudflare R2 bucket.
You can now do the image moderation with Claude integration inside FlowMattic, using the action "Analyze Image with Vision" - https://flowmattic.com/integration/anthropic-claude/
Whenever, an image is uploaded to your media library, you can run a check against the image URL to see if if falls under NSFW category, and if it is - delete the image.
Nitin Yawalkar Would this work with Cloudflare AI?
https://developers.cloudflare.com/reference-architecture/diagrams/serverless/serverless-image-content-management/
Thomas Looks like the Cloudflare AI has built in content moderation. And, there's no API available that we can implement currently.