Skip to navigation
ReferencePython SDK ReferenceNemoguardrailsLibraryJailbreak Detection

nemoguardrails.library.jailbreak_detection.actions

View as Markdown

Module Contents

Functions

NameDescription
jailbreak_detection_heuristicsChecks the user’s prompt to determine if it is attempt to jailbreak the model.
jailbreak_detection_modelUses a trained classifier to determine if a user input is a jailbreak attempt

Data

log

API

nemoguardrails.library.jailbreak_detection.actions.jailbreak_detection_heuristics(
    llm_task_manager: nemoguardrails.llm.taskmanager.LLMTaskManager,
    context: typing.Optional[dict] = None,
    user_message: typing.Optional[str] = None,
    http_client: typing.Optional[nemoguardrails.http.HTTPClient] = None,
    kwargs = {}
) -> nemoguardrails.actions.rail_outcome.RailOutcome
async

Checks the user’s prompt to determine if it is attempt to jailbreak the model.

nemoguardrails.library.jailbreak_detection.actions.jailbreak_detection_model(
    llm_task_manager: nemoguardrails.llm.taskmanager.LLMTaskManager,
    context: typing.Optional[dict] = None,
    user_message: typing.Optional[str] = None,
    model_caches: typing.Optional[typing.Dict[str, nemoguardrails.llm.cache.CacheInterface]] = None,
    http_client: typing.Optional[nemoguardrails.http.HTTPClient] = None
) -> nemoguardrails.actions.rail_outcome.RailOutcome
async

Uses a trained classifier to determine if a user input is a jailbreak attempt

nemoguardrails.library.jailbreak_detection.actions.log = logging.getLogger(__name__)