Moderation & guard classifiers
Moderation & guard classifiers covers models and APIs that classify text, image, audio or video for harm, jailbreaks, prompt injection and policy violations.
In brief
Moderation & guard classifiers, in brief.
What it isModeration & guard classifiers covers models and APIs that classify text, image, audio or video for harm, jailbreaks, prompt injection and policy violations.
Where it sitsOne of 16 categories in the Safety and trust layer. Safety and trust covers the tools that check, test and control AI systems: evaluations, guardrails, security, red-teaming, monitoring, and the platforms that handle governance and compliance.
What we track33 products, including ActiveFence, Amazon Rekognition Content Moderation, Azure AI Content Safety, Checkstep and Clarifai moderation models.
The products
33 products in Moderation & guard classifiers.
Each name opens a search for that product in our index.
ProductMakerIts own site
From our census of 2026-11-08. A product listed here is one that belongs in this category; the search answer says whether we have checked it.
Questions
Moderation & guard classifiers, answered.
What is Moderation & guard classifiers in AI infrastructure?Moderation & guard classifiers covers models and APIs that classify text, image, audio or video for harm, jailbreaks, prompt injection and policy violations.
Which layer of AI infrastructure is Moderation & guard classifiers in?Moderation & guard classifiers is in the Safety and trust layer. Safety and trust covers the tools that check, test and control AI systems: evaluations, guardrails, security, red-teaming, monitoring, and the platforms that handle governance and compliance.
Which products are in Moderation & guard classifiers?We track 33 products in Moderation & guard classifiers, including ActiveFence, Amazon Rekognition Content Moderation, Azure AI Content Safety, Checkstep, Clarifai moderation models, Cloud Vision SafeSearch, Copyleaks AI Detector and deberta-v3-base-prompt-injection-v2. The full list is on this page.
Safety and trust
The other categories in Safety and trust.
AI agent management platformsAI governance & compliance platformsAI incident & risk databasesAI securityAI-generated content & deepfake detectionBias, fairness & explainabilityConfidential AI & private inferenceContent provenanceEvalsGuardrailsInterpretability & model internals toolingLLM & agent observabilityPrompt managementRed-teamingVoice & conversational agent simulation testing