Important
You are viewing the NeMo 2.0 documentation. This release introduces significant changes to the API and a new library, NeMo Run. We are currently porting all features from NeMo 1.0 to 2.0. For documentation on previous versions or features not yet available in 2.0, please refer to the NeMo 24.07 documentation.
NSFW Content Filter#
NSFW Content filtering model offers vision based filtering solution to find explicit content. Its main use case is to check outputs of the generative models like Stable Diffusion. Model combines zero-shot capabilities of pretrained CLIP with a linear probing approach for fine tuning.
During fine-tuning, a light classification layer is trained on top of the frozen CLIP encoder, significantly improving the quality of detecting NSFW Content compared to just zero-shot classification.
Feature |
Training |
Inference |
|---|---|---|
Data parallelism |
Yes |
N/A |
Tensor parallelism |
N/A |
N/A |
Pipeline parallelism |
N/A |
N/A |
Sequence parallelism |
N/A |
N/A |
Activation checkpointing |
Yes (Uniform or Block) |
No |
FP32/TF32 |
Yes |
Yes (FP16 enabled by default) |
AMP/FP16 |
Yes |
Yes |
AMP/BF16 |
Yes |
Yes |
BF16 O2 |
Yes |
No |
TransformerEngine/FP8 |
No |
No |
Multi-GPU |
Yes |
Yes |
Multi-Node |
Yes |
Yes |
Inference deployment |
N/A |
|
SW stack support |
Slurm DeepOps/Base Command Manager/Base Command Platform |
Slurm DeepOps/Base Command Manager/Base Command Platform |
NVfuser |
No |
N/A |
Distributed Optimizer |
N/A |
N/A |
TorchInductor |
No |
N/A |
Flash Attention |
No |
N/A |