Upgrading UFM on Docker Container in Standalone Mode

1. Stop the UFM Enterprise service. Run: 

   systemctl stop ufm-enterprise

2. Remove the existing docker image. Run:

   docker rmi mellanox/ufm-enterprise:latest

3. Load the new UFM Enterprise docker image. Run: 

   docker pull mellanox/ufm-enterprise:latest

4.  Run the docker upgrade command:

   docker run -it --name=ufm_installer --rm \
   -v /var/run/docker.sock:/var/run/docker.sock \
   -v /etc/systemd/system/:/etc/systemd_files/ \
   -v /opt/ufm/files/:/opt/ufm/shared_config_files/ \
   mellanox/ufm-enterprise:latest --upgrade

5. Reload system manager configuration:

   systemctl daemon-reload

6. Start UFM Enterprise service: 

   systemctl start ufm-enterprise

Upgrading UFM Container in High Availability Mode

1. Remove the old docker image from the standby server. Run:

   Stand-by# docker rmi mellanox/ufm-enterprise:latest

2. Pull the new UFM Enterprise docker image on the standby server. Run: 

   docker pull mellanox/ufm-enterprise:latest

   At this stage, the UFM container has been updated with the latest code. The UFM data, however, will be updated during the next UFM run.

3. Perform a failover to start UFM on the upgraded node. On the master node, run:

   ufm_ha_cluster failover

   When UFM starts, it will automatically update the UFM configuration.

4. Repeat steps 1-2 on the un-upgraded node (previous Master node).

5. Download and extract the latest UFM HA package. Run:

   wget https://www.mellanox.com/downloads/UFM/ufm_ha_5.1.1-6.tgz

6. Install the extracted UFM HA package: 

   In the below command, please modify the partition name based on the already configured DRBD partition.

   ./install.sh -l /opt/ufm/files/ -d /dev/sda5 -p enterprise

7. Configure HA. There are two methods: 
   • Configure HA with SSH Trust - Requires passwordless SSH connection between the servers.
   • Configure HA without SSH Trust - Does not require passwordless SSH connection between the servers, but asks you to run configuration commands on both servers.

   Configure HA with SSH Trust

   1. 1. On the master server only, configure the HA nodes. To do so, from /tmp, run the configure_ha_nodes.sh command as shown in the below example

         configure_ha_nodes.sh
         --cluster-password 12345678 \
         --local-primary-ip 10.10.50.1 \
         --peer-primary-ip 10.10.50.2 \
         --local-secondary-ip 192.168.10.1 \
         --peer-secondary-ip 192.168.10.2 \
         --no-vip 

         The script configure_ha_nodes.sh is is located under /usr/local/bin/, therefore, by default, you do not need to use the full path to run it. 

         The --cluster-password must be at least 8 characters long.

         To set up a Virtual IP for UFM and gain access to UFM through this IP, regardless of which server is running UFM, you may employ the --no-vip OR --virtual-ip command and provide an IP address as an argument. This can be achieved by navigating to https://<Virtual-IP>/ufm on your web browser.

         When using back-to-back ports with local IP addresses for HA sync interfaces, ensure that you add your IP addresses and hostnames to the /etc/hosts file. This is needed to allow the HA configuration to resolve hostnames correctly based on the IP addresses you are using.

         configure_ha_nodes.sh requires SSH connection to the standby server. If SSH trust is not configured, then you are prompted to enter the SSH password of the standby server during configuration runtime

      2. Depending on the size of your partition, wait for the configuration process to complete and DRBD sync to finish.

   Configure HA without SSH Trust
   If you cannot establish an SSH trust between your HA servers, you can use ufm_ha_cluster directly to configure HA. To configure HA, follow the below instructions: 

   Please change the variables in the commands below based on your setup.

   1. 1. [On Standby Server] Run the following command to configure Standby Server: 

         ufm_ha_cluster config -r standby \
         --local-primary-ip 10.10.50.1 \
         --peer-primary-ip 10.10.50.2 \
         --local-secondary-ip 192.168.10.1 \
         --peer-secondary-ip 192.168.10.2 \
         --hacluster-pwd 123456789 \
         --no-vip

      2. [On Master Server] Run the following command to configure Master Server: 

         ufm_ha_cluster config -r master --local-primary-ip 10.10.50.1 \
         --peer-primary-ip 10.10.50.2 \
         --local-secondary-ip 192.168.10.1 \
         --peer-secondary-ip 192.168.10.2 \
         --hacluster-pwd 123456789 \
         --no-vip

   You must wait until after configuration for DRBD sync to finish depending on the size of your partition.

8. Start UFM HA cluster. Run: 

   ufm_ha_cluster start