Function nemo_relay_llm_request_new

View as Markdown

Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker.

#[unsafe(no_mangle)]pub unsafe extern "C" fn nemo_relay_llm_request_new(
    headers_json: *const c_char,
    content_json: *const c_char,
) -> *mut FfiLLMRequest

Create a new LLM request object. Returns a heap-allocated FfiLLMRequest that must be freed with nemo_relay_llm_request_free. Returns null on invalid input.

Parameters

  • headers_json: JSON object of headers/metadata, or null.
  • content_json: JSON request content payload, or null.

Safety

All string arguments must be valid null-terminated C strings or null.