Running Inference
Verify Server Health
Perform a health check on the gRPC endpoint.
-
Install
grpcurlfrom hereExample commands to run on Ubuntu:
-
Download the health checking proto:
-
Run the health check on
<server_ip>or localhost:
If the service is ready, you will get a response similar to the following:
Running Inference via Script
1. Clone the Repository
Download the Maxine Studio Voice Python client code by cloning the NVIDIA Maxine NIM Clients Repository:
2. Install Dependencies
3. Run the Python Client
You can use the sample client script in the Maxine Studio Voice GitHub repo to send a gRPC request to the hosted NIM server:
-
Go to the scripts directory.
-
Run the command to send gRPC request.
The following example command processes the packaged sample audio file and generates a studio_voice_48k_output.wav file in the current folder.
Only WAV files are supported.
Usage for Preview API Request
Command Line Arguments
To view the details of command line arguments, run this command:
--use-ssl- Flag to control if SSL/TLS encryption should be used. When running preview SSL must be used.--target <ip:port>- URI of NIM’s gRPC service. Usegrpc.nvcf.nvidia.com:443when hosted on NVCF. Default value is127.0.0.1:8001.--api-key <NGC_API_KEY>- NGC API key required for authentication. Utilized when using TRY API, ignored otherwise.--function-id- NVCF function ID for the service. Utilized when using TRY API, ignored otherwise.--input- The path to the input audio file. Default value is../assets/studio_voice_48k_input.wav.--output- The path for the output audio file. Default is./studio_voice_48k_output.wav.