Tokkio 4.1.1#
This release fixes a critical issue causing failure to LLM RAG bot while interacting with APIs. Please use latest release NVIDIA/ACE for this hotfix.
Hotfix : OpenAI Library proxy configuration issue#
The LLM RAG bot experienced a critical error, causing the bot reply one of these “I am sorry, but we are experiencing some technical issues”, “Sorry I have a technical issue” or “There is a technical issue at the moment” messages to all user queries.
This was caused by a plugin server error: “TypeError: Client.init() got an unexpected keyword argument ‘proxies’”. The root cause was traced to the OpenAI library version 1.44.0, which contained a deprecated ‘proxies’ argument
To resolve this issue, the following actions were taken:
Library Upgrade: The OpenAI library was updated to version 1.55.3 on the plugin server
Functionality Preservation: No changes to existing functionality were implemented during this upgrade
This hotfix ensures the LLM RAG bot can now process user queries without encountering the previous technical issue, restoring normal operation for both NIM and OpenAI configurations.