nemo_microservices.types.model_list_params

Module Contents

Classes

ModelListParams

API

class nemo_microservices.types.model_list_params.ModelListParams

Bases: typing_extensions.TypedDict

filter: nemo_microservices.types.model_filter_param.ModelFilterParam

None

Filter models on various criteria.

Where it makes sense, you can also filter on the existence of a property. For example:

• ?filter[peft]=true: would filter all models with peft attribute set.

page: int

None

Page number.

page_size: int

None

Page size.

search: nemo_microservices.types.model_search_param.ModelSearchParam

None

Search models using substring matching.

You can combine multiple search fields and filters.

For example:

• ?search[name]=llama: searches all models with ‘llama’ in the name.

• ?search[base_model]=mistral: searches all models with ‘mistral’ in the base_model.

• ?search[peft]=lora: searches all models with ‘lora’ in the peft field.

• ?search[custom_property][item]=adapter: searches all models where the custom_property’s item contains ‘adapter’.

• ?search[name]=llama&search[peft]=lora: searches all models with ‘llama’ in the name AND ‘lora’ in the peft field.

• ?search[name]=llama&search[name]=gpt: searches all models with ‘llama’ OR ‘gpt’ in the name.

• ?search[updated_at][start]=2024-01-01T00:00:00 finds all models updated on or after the start date

• ?search[created_at][start]=2022-01-01&search[updated_at][end]=2024-01-01 finds all models created from start date up to and including end date

sort: nemo_microservices.types.model_sort_field.ModelSortField

None

The field to sort by.

To sort in decreasing order, use - in front of the field name.