NVIDIA NIM for LLMs
- Introduction
- Release Notes
- Getting Started
- Configuring a NIM
- Support Matrix
- API Reference
- Observability
- Optimization
- Parameter-Efficient Fine-Tuning
- Acknowledgements
- accelerate
- aiohttp
- aiosignal
- annotated-types
- anyio
- apscheduler
- async-timeout
- attrs
- build
- certifi
- charset-normalizer
- click
- cmake
- coloredlogs
- datasets
- dill
- diskcache
- dnspython
- einops
- email_validator
- exceptiongroup
- fastapi
- fastapi-cli
- filelock
- flash-attn
- frozenlist
- fsspec
- h11
- h5py
- httpcore
- httptools
- httpx
- huggingface-hub
- humanfriendly
- idna
- importlib_metadata
- interegular
- jinja2
- joblib
- jsonschema
- jsonschema-specifications
- lark
- llvmlite
- lm-format-enforcer
- markdown-it-py
- markupsafe
- mdurl
- ml-dtypes
- mpi4py
- mpmath
- msgpack
- multidict
- multiprocess
- nest-asyncio
- networkx
- ninja
- numba
- numpy
- onnx
- optimum
- orjson
- outlines
- packaging
- pandas
- polygraphy
- prometheus_client
- protobuf
- psutil
- pulp
- py-cpuinfo
- pyarrow
- pyarrow-hotfix
- pydantic
- pydantic_core
- pygments
- pynvml
- python-dateutil
- python-dotenv
- python-multipart
- pytz
- pyyaml
- ray
- referencing
- regex
- requests
- rich
- rpds-py
- scipy
- shellingham
- six
- sniffio
- starlette
- strenum
- sympy
- tensorstore
- tiktoken
- tomli
- torch
- tqdm
- transformers
- typer
- typing_extensions
- tzdata
- tzlocal
- ujson
- urllib3
- uvicorn
- uvloop
- vllm
- watchfiles
- websockets
- xformers
- xxhash
- yarl
- zipp
- EULA