29.2 Rejoining the Cluster

When errors occur within the database and replicas, you must re-create the Global Master database (GMS).

You must re-install all the other servers in the cluster. You can do this by performing a fresh install of all the servers in the cluster.

It is recommended to rebuild the cluster by performing the following steps:

  1. In the primary site:

    1. Rejoin the database servers

    2. Rejoin the Webserver servers

  2. In other sites:

    1. Rejoin the Master server

    2. Rejoin the database servers

    3. Rejoin the Webserver servers

To enable the First Install wizard, perform the following steps.

  1. Log in as root to the server.

  2. Perform the following:

    1. Stop the Advanced Authentication server:

      systemctl stop aauth risk-service

    2. Remove the containers, network, and volumes which Advanced Authentication has created on the server:

      docker-compose -p aaf -f /opt/aauth/docker-compose.yml -f /opt/aauth/docker-compose.sles.yml down -v

      docker-compose -p risk -f /opt/risk/docker-compose.risk.yml down -v

    3. Start the Advanced Authentication server:

      systemctl start aauth risk-service

  3. Browse the URL: https://<servername> in a web browser and rejoin the server.

You can rejoin the cluster in any of the following scenarios:

29.2.1 Database Server is Down

Ensure to enable the SSH daemon on the appliance. To do this, browse https://<aafwebservername>:9443 and log in as a vaadmin. Click the System Services tab and start the SSH service.

NOTE:If you want to recover the database server because of a failure, you must delete the server from the Cluster tab of the Administration portal, before re-joining the web server. To delete the server in the Cluster tab, see Configuring a Cluster.

Perform the following steps to restore the database server:

  1. Log in as root to the server.

  2. Run the following commands:

    1. Stop the Advanced Authentication server:

      systemctl stop aauth risk-service

    2. Remove the containers, network, and volumes that the Advanced Authentication has created on the server:

      docker-compose -p aaf -f /opt/aauth/docker-compose.yml -f /opt/aauth/docker-compose.sles.yml down -v

      docker-compose -p risk -f /opt/risk/docker-compose.risk.yml down -v

    3. Start the Advanced Authentication server:

      systemctl start aauth risk-service

  3. Browse the URL https://<servername> in a web browser and rejoin the server.

    After joining the database server to the existing cluster, the database replication takes place. If issues occur while joining the cluster configuration, ensure that the ports are accessible by the Global Master and the database server. For more information, see Configuring the Firewall.

29.2.2 Web Server is Down

You can perform the following steps to restore a web server.

  1. Log in as root to the server.

  2. Run the following commands:

    1. Stop the Advanced Authentication server:

      systemctl stop aauth risk-service

    2. Remove the containers, network, and volumes which Advanced Authentication has created on the server:

      docker-compose -p aaf -f /opt/aauth/docker-compose.yml -f /opt/aauth/docker-compose.sles.yml down -v

      docker-compose -p risk -f /opt/risk/docker-compose.risk.yml down -v

    3. Start the Advanced Authentication server:

      systemctl start aauth risk-service

  3. Browse the URL https://<servername> in a web browser and rejoin the server.

    After joining the database server to the existing cluster, the database replication takes place. If issues occur while joining the cluster configuration, ensure that the ports are accessible towards the Global Master and the database server. For more information, see Configuring the Firewall.

    NOTE:

    • If you can access the Web server through the console, ensure to enable the SSH daemon on the appliance. To do this, browse https://<aafwebservername>:9443 and log in as a vaadmin. Click the System Services tab and start the SSH service.

    • If you want to recover the database server because of a failure, you must delete the server from the Cluster tab of the Administration portal, before re-joining the web server. To delete the server in the Cluster tab, see Configuring a Cluster.

29.2.3 Database Master is Down

A database master server exists for a multi-site implementation.

NOTE:Ensure to enable the SSH daemon on the appliance. To do this, browse https://<aafwebservername>:9443 and log in as a vaadmin. Click the System Services tab and start the SSH service.

You can perform the following steps to restore the database master:

NOTE:If you want to recover the Database Master server because of a failure, you must delete the server from the Cluster tab of the Administration portal, before re-joining the web server. To delete the server in the Cluster tab, see Configuring a Cluster. Delete the web server before re-joining.

  1. Log in as root to the server.

  2. Perform the following commands:

    1. Stop the Advanced Authentication server:

      systemctl stop aauth risk-service

    2. Remove the containers, network, and volumes which Advanced Authentication has created on the server:

      docker-compose -p aaf -f /opt/aauth/docker-compose.yml -f /opt/aauth/docker-compose.sles.yml down -v

      docker-compose -p risk -f /opt/risk/docker-compose.risk.yml down -v

    3. Start the Advanced Authentication server:

      systemctl start aauth risk-service

  3. Browse the URL https://<servername> in a web browser and rejoin the server.

    After joining the database server to the existing cluster, the database replication happens. If issues occur while joining the cluster configuration, ensure that the ports are accessible towards the Global Master and the database server. For more information, see Configuring the Firewall.

29.2.4 Site is Down

When a site goes down due to a configuration problem or a database issue, all the site infrastructure needs to be rebuild again.

Perform the following to restore the site:

Register a New Site on the Global Master Server

  1. Open the Administration portal.

  2. Click Cluster > Register new site.

  3. Specify the details.

Database Master Server Restore

A database master server exists for a multi-site implementation.

For the procedure to restore the database master, see Database Master is Down.