Frequently Asked Questions for AI Workbench Locations#
This section answers general frequently asked questions about working with AI Workbench locations and NVIDIA Brev.
Remote Locations#
How does the SSH connection work?#
When you connect to a remote location, AI Workbench automatically establishes two SSH tunnels that securely map ports from the remote system to your local machine.
One tunnel is dedicated to the AI Workbench service, while the other manages the reverse proxy to provide access from localhost.
By default, AI Workbench assigns ports starting at 10000 and 10001 for the proxy and service, respectively. These details are stored in the .nvwb/contexts.json file.
How do I create a private-public key pair for remote locations?#
Creating the key pair is straight forward. Typically the difficulty is getting the public key onto the remote system.
The general steps for Ubuntu and macOS are below. If you get stuck, use an LLM to help with the details.
Prerequisites
Before you create the key pair, you need the following:
Password based SSH access to the remote system.
The IP address or hostname of the remote system,
<REMOTE_HOST>.The username for the non-root user with sudo privileges on the remote system,
<USER_NAME>.
Steps
Create a private-public key pair locally using
ssh-keygenRun the following command:
ssh-keygen -f "$HOME/.ssh/<KEY-NAME>"
Set permissions on the private by running:
chmod 400 $HOME/.ssh/<KEY-NAME>
Add the public key to the $HOME/.ssh/authorized_keys file on the remote system
Run the following command:
ssh-copy-id -i $HOME/.ssh/<KEY-NAME>.pub <USER-NAME>@<REMOTE_HOST>
This assumes
ssh-copy-idis installed in the environment, and you have password based SSH access to the remote system
Note
The Unix based steps will work for Windows if you do them from a WSL distribution like NVIDIA-Workbench.
Can I use a password-protected SSH key for remote locations in Workbench?#
Yes. You can use a password-protected SSH key, but you have to do it
by using ssh-agent.
Can I use the AI Workbench CLI to create a remote location?#
Yes. You can use the AI Workbench CLI to create a remote location.
Run the following command:
nvwb create context
Enter the relevant connection information
NVIDIA Brev#
Is Brev a cloud provider?#
No. Brev is not a cloud provider. Brev partners with major cloud providers to offer a single platform to deploy and manage GPU instances.
Is Brev free?#
No. Brev has a flexible, pay-as-you-go model where you only pay for the time you use an instance. You need a credit card to provision an instance.
Can I configure the Brev integration with the CLI?#
Yes. You can configure the integration and you can create a Brev location using the CLI.
Use the command the following command and then select Brev from the drop down:
nvwb connect integration
You can add a running Brev instance with the command the following command and then select the instance name from the drop down:
nvwb create context --brev
Why doesn’t my Brev instance show up in Workbench?#
There are a few potential reasons:
You haven’t configured the Brev integration with that particular account
You already created a location with that instance
You are looking in the wrong Brev org in the remote location modal
I see a Brev instance in the remote location modal, but I can’t add it as a location. Why is that?#
There are a few potential reasons:
The instance is not running
The instance is a Lambda Labs instance and AI Workbench does not support using them as a remote location