Payload Modification

Adds, removes, or modifies request parameters before sending them to the model endpoint.

Configuration

CLI Configuration

--overrides 'target.api_endpoint.adapter_config.interceptors=[{"name":"payload_modifier","enabled":true,"config":{"params_to_add":{"temperature":0.7},"params_to_remove":["top_k"]}}]'

YAML Configuration

target:
  api_endpoint:
    adapter_config:
      interceptors:
        - name: "payload_modifier"
          enabled: true
          config:
            params_to_add:
              temperature: 0.7
              top_p: 0.9
            params_to_remove:
              - "top_k"
            params_to_rename:
              old_param: "new_param"

Configuration Options

Parameter	Type	Description	Example
params_to_add	dict	Dictionary of parameters to add to requests	{"temperature": 0.7, "top_p": 0.9}
params_to_remove	list	List of parameter names to remove from requests	["top_k", "frequency_penalty"]
params_to_rename	dict	Dictionary mapping old parameter names to new names	{"old_param": "new_param"}

Note

The interceptor applies operations in the following order: remove → add → rename. This means you can remove a parameter and then add a different value for the same parameter name.

Use Cases

Parameter Standardization

Ensure consistent parameters across evaluations by adding or removing parameters:

config:
  params_to_add:
    temperature: 0.7
    top_p: 0.9
  params_to_remove:
    - "frequency_penalty"
    - "presence_penalty"

Model-Specific Configuration

Add parameters required by specific model endpoints, such as chat template configuration:

config:
  params_to_add:
    extra_body:
      chat_template_kwargs:
        enable_thinking: false

API Compatibility

Rename parameters for compatibility with different API versions or endpoint specifications:

config:
  params_to_rename:
    max_new_tokens: "max_tokens"
    num_return_sequences: "n"