Nudity Detection

FAQ / Video & Stream Moderation

Is it possible to customize the Video Moderation API to my needs?

There is no one-size-fits-all solution with Video Moderation. Expectations will vary between countries, cultures and applications.

This is why we have worked to make our API endpoints and models flexible and suitable to most needs.

You choose the models you want to apply

As you may know, we have multiple moderation models available. When you perform a request to the API, you get to choose what models to apply and how each model is used to then decide if a video should be approved, rejected or reviewed. See our Model Reference to learn more about each model output.

Each model returns fine-grained results

Our models do not return simple binary classifications (such as 'nudity' or 'no nudity'). They send you more information so that you can make a fine-grained decision on how to handle each case.

The Nudity Detection, for instance, will tell you what level of nudity it has encountered for each frame of the video. When faced with suggestive content, we tell you exactly what the video contains, so that you can take appropriate action - or simply accept the video.

In other words, you don't need to worry about how videos get handled when they are border-line nudity.

This applies to Nudity Detection but also to all the other available models.

Each moderation category is associated with a score

A score between 0 and 1 is returned for each moderation category and for each frame of the video. This value reflects the model’s confidence. A score closer to 1 indicates that the frame has a higher probability of containing what the model is looking for.

With these scores associated with each frame, you can define thresholds to help you make a decision about the video you submitted. If you need some help to decide which thresholds would match your needs, please reach out.

You can create custom disallow lists

Disallow Lists can help you blacklist some specific videos or clips by fingerprinting them and preventing them from (re)appearing on your site or app. This is useful to make sure known copyrighted videos, illegal videos, or previously removed videos do not get re-uploaded to your properties, either in full or in part.

Once you add a video to the list, any other video that has a common sequence with this video will be detected.

The steps to setup and use an Video Disallow List are the following:

  • Create a Video Disallow List from your dashboard.
  • Add Images to the disallow list (through the dashboard or through the API).
  • Check new and existing images against the disallow list.

To get more information on how to use Video Disallow Lists, check the documentation.

And send images to the feedback API

Our Image Moderation models have been trained to achieve best-in-class accuracy, yet you might want to report images you believe were misclassified. To do that, you can submit the image to the Feedback API.

Submitted images are used to improve the models on a continuous basis so your feedback is precious ! It can also be used to progressively train custom models adapted to your specific needs if you so wish.

To send an image to the Feedback API, you will need the image itself, the name of the model and the expected class (or the unknown label if the expected class is not available). Here are the available class:

ModelPossible classes
nuditysafe partial raw bikini chest cleavage lingerie unknown
nudity-2.0safe sexual_activity sexual_display erotica bikini male_chest cleavage lingerie miniskirt male_underwear miniskirt unknown
nudity-2.1safe sexual_activity sexual_display erotica bikini male_chest cleavage lingerie miniskirt male_underwear miniskirt unknown
goresafe gore unknown
gore-2.0safe gore unknown
typephoto illustration unknown
facenone single multiple unknown
wadno-weapons weapons no-alcohol alcohol no-drugs drugs unknown
weaponno-weapons weapons unknown
recreational_drugno-drugs drugs unknown
alcoholno-alcohol alcohol unknown
celebritiesno-celebrity celebrity unknown
textno-text text-artificial text-natural unknown
offensivenot-offensive offensive unknown
scamnot-scam scam unknown
minorno-minor minor unknown
gendermale female unknown
tobaccono-tobacco tobacco unknown
gamblingno-gambling gambling unknown
moneyno-money money unknown
text-contentsafe unsafe unknown
qr-contentsafe unsafe unknown
genaiai not-ai
unknownunknown miss safe

Sending a request to the Feedback API is very similar to requests sent to the Image Moderation API, see our documentation to get some code examples.

Please note that submitting an image to the Feedback API does not count as an operation and will not impact your billing.

Need more?

That said, if you believe you need more customization than provided out-of-the-box, for instance with new detection capacities or custom decision filters, please get in touch.

Was this page helpful?