Best Practices#
This section provides best practices for configuring the Tokkio LLM-RAG agent and the corresponding RAG server.
RAG Server#
The Tokkio LLM-RAG agent supports any external RAG server that adheres to the schema from NVIDIA RAG Blueprint. The RAG server can be tuned for latency or accuracy, depending on the use case. Best practices for common NVIDIA RAG Blueprint settings can be found here: NVIDIA RAG Blueprint Best Practices.
Recommended Network Bandwidths#
The network bandwidth should be between the minimum bitrate and maximum bitrate range for each specified resolution. If the network bandwidth is low, the video will stutter or freeze. If the network bandwidth is too low and unstable, that can also result in disconnection. A bandwidth value higher than the max bitrate is harmless, as it will not be utilized by the system.
Resolution |
Min Bitrate (Mbps) |
Optimal Bitrate (Mbps) |
Max Bitrate (Mbps) |
|---|---|---|---|
3820 x 2160 (Ultra HD) |
30 |
40 |
80 |
2560 x 1440p (Quad HD) |
15 |
20 |
40 |
1920 x 1080 (Full HD) |
5 |
10 |
20 |
1280 x 720 (HD) |
2 |
5 |
10 |
854 x 480 (FWVGA) |
0.8 |
3 |
5 |