Using Crusoe Instances on Brev#

Overview#

Crusoe instances on Brev provide powerful compute resources for AI/ML workloads. This guide covers important details about Crusoe instance configuration and limitations.

Storage Configuration#

Root Disk Size#

Crusoe instances come with a fixed root disk size of 128GB. This is a limitation of the underlying infrastructure and cannot be modified during instance creation.

Ephemeral Storage#

While the root disk size is fixed, Crusoe instances provide access to 1TB of high-performance ephemeral storage. To utilize this storage:

  1. SSH into your Crusoe instance using brev shell <instance-name>

  2. Run df -h to view available storage volumes

  3. Look for the ephemeral storage mount point

  4. Configure your applications to use this storage location for temporary data, model weights, datasets, etc. ex: setting a storage_path variable in your code to /mnt/ephemeral

Best Practices#

  • Store large datasets, model checkpoints, and temporary files on the ephemeral storage volume

  • Be aware that ephemeral storage is temporary and data will not persist if the instance is stopped

  • For persistent storage needs, consider using external storage solutions or object storage

  • Regularly backup important data from ephemeral storage to persistent storage

Additional Resources#