Configuring Storage - NFS Mount and Cache

The DGX servers and the DGX Station include multiple SSDs for data caching or data storage.

  • The DGX-1 server contains four SSDs to be used in a RAID 0 configuration.
  • The DGX-2 server contains 8 or 16 SSDs to be used in a RAID 0 configuration.
  • The DGX A100 server contains 4 or 8 SSDs to be used in a RAID 0 configuration.
  • The DGX Station contains three SSDs to be used in a RAID 0 or RAID 5 configuration.

For the DGX servers, these SSDs are intended to be used as a data cache for NFS mounted directories. For the DGX Station, these SSDs are intended to be used either for local persistent storage or as a data cache for NFS mounted directories. If you are using these SSDs as a data cache for NFS mounted directories, you must set up your own NFS mounted directories for long-term data storage.

The following instructions describe how to mount the NFS directories onto the DGX system, and how to cache the NFS using the DGX SSDs for improved performance.

Make sure that you have an NFS server with one or more exports with data to be accessed by the DGX System, and that there is network access between the DGX System and the NFS server.
  1. Install the nfs packages. 
    $ sudo yum install nfs-utils
  2. Configure an NFS mount for the DGX.
    1. Edit the filesystem tables configuration.
      sudo vi /etc/fstab
    2. Add a new line for the NFS mount, using the local mount point of /mnt.
      <nfs_server>:<export_path> /mnt nfs rw,noatime,rsize=32768,wsize=32768,nolock,tcp,intr,fsc,nofail 0 0

      /mnt is used here as an example mount point.

      Consult your Network Administrator for the correct values for <nfs_server> and <export_path>.

      The nfs arguments presented here are a list of recommended values based on typical use cases. However, "fsc" must always be included as that argument specifies use of FS-Cache.

    3. Save the changes.
  3. Verify the NFS server is reachable.
    ping <nfs_server>

    Use the server IP address or the server name provided by your network administrator.

  4. Mount the NFS export.
    sudo mount /mnt

    /mnt is the example mount point used in step 1.

  5. Verify caching is enabled.
    cat /proc/fs/nfsfs/volumes

    Look for the text FSC=yes in the output. The NFS will be mounted and cached on the DGX System automatically upon subsequent reboot cycles.