Llamaguard
원문: llamaguard
Meta's 7-8B specialized moderation model for LLM input/output filtering. 6 safety categories - violence/hate, sexual content, weapons, substances, self-harm, criminal planning. 94-95% accuracy. Deploy with vLLM, HuggingFace, Sagemaker. Integrates with NeMo Guardrails.
무엇을 하나요
LlamaGuard AI Content Moderation Quick start LlamaGuard is a 7 8B parameter model specialized for content safety classification. Installation : Basic usage : Common workflows Workflow 1: Input filtering (prompt moderation) Check user prompts before LLM : Safety categories : S1 : Violence & Hate S2 : Sexual Content S3 : Guns & Illegal Weapons S4 : Regulated Substances S5 : Suicide & Self Harm S6 : Criminal Planning Workflow 2: Output filtering (response moderation) Check LLM responses before showing to user : Workflow 3: vLLM deployment (fast inference) Production ready serving : Throughput : ~50 100 requests/sec on single A100 Workflow 4: API endpoint (FastAPI) Serve as moderation API : Usag…
실행 시 본인 API 키(BYOK)로 동작하며, 모델 비용은 사용자 계정에서 직접 결제됩니다.