Set up nudity detection

When a member posts media, SfwBot goes through these checks in order:

1. Exemptions. Exempt channels and roles are skipped. So are age-restricted channels, unless you switch that off.
2. Image lists. A fingerprint of the media is compared with your allow list, your block list and the shared lists SfwBot maintains. A match is answered at once, without a scan.
3. AI scan. Everything else is rated by the model. A scan uses credits.
4. Decision. Media at or above your level is blocked.

There are three levels, and you pick the lowest one that is blocked:

Attachments, images in link previews and forwarded messages are checked. Stickers, custom emojis and media posted by other bots are checked only if you switch that on. Profile pictures and banners are not checked. For an overview of the feature see nudity detection.

• /settings, page Detection, switches detection on or off and changes the level, deletion, the age-restricted channel rule and the spoiler rule.
• /settings, page Exemptions and image lists, adds and removes exempt channels and roles, and adds an image to the allow list or block list by its link.
• The message menu Apps, Add to block list adds every image, GIF and video of a message to your block list.
• /standing shows a member their own recently removed images, with a button to report a wrong decision.

The first three need the Manage Server permission. See the command reference.

• The message is deleted, if deletion is on. A match on your block list is always deleted.
• A log entry is posted to your log channel, with buttons to flag the decision as inaccurate, delete the message if it is still there, or mute, kick or ban the member.
• The member is told, if the message was deleted. Members who opted in with /dms get a direct message with a button to report a mistake. Others get a short channel notice that deletes itself, unless you switched the notice off in General settings.
• Trust is deducted, if you use trust and strikes and the message was deleted. A match on your block list is a medium tier violation. A removal by the AI scan is a low tier violation that is off by default, because a model can be wrong; switch it on in the trust settings if you want it.

Data taken from the message, such as the media link and its fingerprint, is deleted after 30 days. See security and privacy.

Two options on the Nudity page come with Plus and Pro:

• Block adult toys and objects also removes adult toys and similar objects.
• Illustrations and art gives artwork its own level, or allows art entirely, while photos keep your normal level.

Two more come with Pro:

• Channel levels gives a channel or a whole category its own level, for up to 50 of them. A thread follows its channel, and a channel follows its category unless it has its own level. If the server leaves Pro, the levels are kept but paused.
• Deep video scan checks 30 frames of a video instead of 10, and 15 frames of a GIF instead of 5.

See pricing.

• The bot reports media but does not delete it. Either Delete blocked content is off, or the bot lacks Manage Messages in that channel. In the second case a permission error appears in your log channel.
• Nothing happens in one channel. The channel is age-restricted or on the exempt list. /status shows the state of the current channel.
• One member is never checked. The member has an exempt role.
• Stickers or emojis get through. Those checks are off until you switch them on.
• Scanning stopped everywhere. Your server is out of credits. Your lists keep working. See credits.
• An image was removed by mistake. Report it from the log entry and add it to your allow list.
• No log entries. No log channel is set, or the bot cannot post there.