Forum
Welcome, Guest
Username: Password: Remember me
  • Page:
  • 1

TOPIC:

RAID0 disk failure on slave host 2 months 2 weeks ago #2070

Hello Salvatore,

one of our HA-Lizard 2node Cluster had a disk failure of the iSCSI DRDB storage.
As a result the slave node is now in diskless state.
The failing disk was replaced but all data on the local LVM device is gone as it was configured as RAID0.

Have you any advise what would be the best approach after the reboot of the slave?
BR Andreas

Please Log in or Create an account to join the conversation.

RAID0 disk failure on slave host 2 months 2 weeks ago #2071

  • Salvatore Costantino
  • Salvatore Costantino's Avatar
  • Offline
  • Posts: 644
There are a couple of possibilities here:

1) The new RAID volume has been mapped to a different path in /dev. If this is the case, your DRBD config would be off making it impossible to attach the disk. Make sure your mapping in /dev matches /etc/drbd.conf

2) After the disk failure, DRBD may have automatically detached the disk. You can try to manually attach (assuming the DRBD device is iscsi1 - change the name accordingly when running the below on the slave).
drbdadm detach iscsi1
drbdadm connect iscsi1
drbdadm attach iscsi1
service drbd restart

3) If all else fails, we ship a script that can recover from most DRBD connection issues. The script can be found in /etc/iscsi-ha-scripts/drbd-sb-tool

*** Be careful when running this. You will be prompted to select a survivor/donor host. It is advisable to backup all of your VMs before running. If you don't have a backup tool, we provide one in /etc/ha-lizard/scripts/vm_backup.sh. You can run the following for full documentation.
/etc/ha-lizard/scripts/vm_backup.sh --help

Please Log in or Create an account to join the conversation.

RAID0 disk failure on slave host 2 months 2 weeks ago #2079

Problem solved,

I had to be on site in order to reactivate the SAS replacement HDD for the RAID0 group. After this was done and a reboot a
drbdadm create-md "resource"

was necessary. A full sync had started afterwards.

Please Log in or Create an account to join the conversation.

Last edit: by ajmind.
  • Page:
  • 1