Is this page helpful?

NVIDIA Brev

Get Started

• Welcome to Brev
  • Core Features and Capabilities
• Quickstart
  • Create Brev Instance
    • Create an Account
    • Create New Instance
    • Select Your Compute
    • Configure and Deploy
  • Next Steps

Brev Features

• Launchables
• Creating a Launchable
• Step 1: Files and Runtime
• Step 2: Configure the Runtime
• Step 3: Jupyter and Networking
• Step 4: Compute Configuration
• Step 5: Final Review
• Next Steps
• Brev CLI
  • Installation Instructions
  • Instance Commands
    • refresh
      • Syntax
      • Description
      • Example
    • list
      • Syntax
      • Description
      • Example
    • start
      • Syntax
      • Description
      • Example
    • stop
      • Syntax
      • Description
    • port-forward
      • Syntax
      • Description
      • Example
        • Interactively port forward a workspace:
        • Alternative: Using Tunnels
    • delete
      • Syntax
      • Description
      • Example
  • Organization Commands
    • set
      • Syntax
      • Description
      • Example
    • login
      • Syntax
      • Description
      • Example
    • logout
      • Syntax
      • Description
      • Example
    • ssh-key
  • SSH Connectivity
    • IP Address Management
    • Testing SSH Connection
• Web Console
  • Quick Start
  • Navigation
  • Instances
    • Create a new instance
    • Instance Deployment
    • Exposing ports
  • Notebooks
    • Deploy a Notebook
  • People
    • Invite a new member
  • Billing
• Inference Deployments
  • Overview
  • Key Features
  • How It Works
  • Cost Calculation
  • Benefits
  • FAQ
  • Get Started
• Adding Data to Your Instance
  • What is SCP?
  • Using SCP With Brev
    • Prerequisites
    • Running the command
      • Container SCP Caveats

Guides and Examples

• Using Custom Containers?
  • Let’s add a custom container when spinning up a new Brev instance!
    • 1. Create a new instance with + New button on the console
    • 2. Click on Container or Docker Compose Mode
    • 3. If you select Container Mode, you’ll see the following options:
    • 4. Choose your GPU type now!
• Crusoe Instances
  • Overview
  • Storage Configuration
    • Root Disk Size
    • Ephemeral Storage
    • Best Practices
  • Additional Resources
• Deploying NIMs on Brev
  • Launch a NIM on Brev!
    • First off, a short background on NVIDIA NIMs
    • 1. Create an account
    • 2. Launch an instance
    • 3. Connect to and setup your instance
    • 4. Time to deploy your first NIM! We’ll be using the llama3-8b-instruct model. You should be able to follow these instructions to deploy any other NVIDIA NIM.
• Debugging
  • Reset Brev
  • Issues with Custom Container/Docker Compose Builds
  • Issues with Accessing JupyterLab
  • Issues with permission denied while trying to connect to the Docker daemon socket
  • See all the startup logs