Forum
Welcome, Guest
Username: Password: Remember me
Forgot your password? Forgot your username? Create an account
Forum
Main Forum
Software Support
drbd status - diskless

TOPIC:

drbd status - diskless 4 years 1 month ago #1992

Dear Salvatore,

the mentioned parameters are all set, I do get messages from HA-Lizard by e-mail and also alerts are visible in XenCenter.

However, messages from iscsi-ha or drbd are not fired.

I have just manually detached iscsi1 at the slave node (drbdadm detach scsi1), so scsi-cfg status shows:
---------------
| DRBD Status |
---------------
-----------------------------------------------------------------------------------------
| version: 8.4.3 (api:1/proto:86-101)                                                   |
| srcversion: 19422058F8A2D4AC0C8EF09                                                   |
|  1: cs:Connected ro:Secondary/Primary ds:Diskless/UpToDate C r-----                   |
|     ns:0 nr:35801524 dw:35801524 dr:0 al:0 bm:349 lo:0 pe:0 ua:0 ap:0 ep:1 wo:f oos:0 |
-----------------------------------------------------------------------------------------
--------------------------------
| iSCSI-HA Version IHA_2.2.4   |
| Wed Mar  4 17:29:26 CET 2020 |
--------------------------------
------------------------------------------------------
| iSCSI-HA Status: Running 7305                      |
| Last Updated: Wed Mar  4 17:29:21 CET 2020         |
| HOST ROLE:              SLAVE                      |
| VIRTUAL IP:             10.10.10.3 is not local    |
| ISCSI TARGET:           Stopped [expected stopped] |
| DRBD ROLE:              iscsi1=Secondary           |
| DRBD CONNECTION:        iscsi1 in Connected state  |
------------------------------------------------------
Control + C to exit

No alert messages are fired or received.
BR Andreas

Please Log in or Create an account to join the conversation.

Last edit: by ajmind.

drbd status - diskless 4 years 1 month ago #1993

  • Salvatore Costantino
  • Salvatore Costantino's Avatar
  • Offline
  • Posts: 722
in /etc/iscsi-ha/iscsi-ha.conf, on both hosts,
can you confirm that alerts are enabled? The following 2 lines are required
MAIL_ON=1
MAIL_USE_SHARED_PARAMS=1

Please Log in or Create an account to join the conversation.

drbd status - diskless 4 years 1 month ago #1994

Dear Salvatore,

yes, on both hosts identical enabled. See result after detaching the resource:
5 09:47:39 IT1XENSLAVE1 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Scanning for Volume Group -> iscsi-sr: 0a369364-aac7-5eb3-aff1-7fa60da917de
Mar  5 09:47:39 IT1XENSLAVE1 iscsi-ha-NOTICE-/etc/iscsi-ha/init/iscsi-ha.mon: Volume Group for iSCSI-SR found OK: 0a369364-aac7-5eb3-aff1-7fa60da917de
Mar  5 09:47:39 IT1XENSLAVE1 iscsi-ha: 19870 service_execute: tgtd is stopped
Mar  5 09:47:39 IT1XENSLAVE1 iscsi-ha: 19870 service_execute: Returning exit status [ 3 ]
Mar  5 09:47:39 IT1XENSLAVE1 iscsi-ha: 19870 iSCSI target: tgtd status stopped. Expected Stopped . []
Mar  5 09:47:39 IT1XENSLAVE1 iscsi-ha: 19870 DRBD Running on this host: version: 8.4.3 (api:1/proto:86-101) srcversion: 19422058F8A2D4AC0C8EF09    1: cs:Connected ro:Secondary/Primary ds:Diskless/UpToDate C r-----     ns:0 nr:18891704 dw:18891704 dr:0 al:0 bm:717 lo:0 pe:0 ua:0 ap:0 ep:1 wo:f oos:0
Mar  5 09:47:39 IT1XENSLAVE1 iscsi-ha: 19870 validate_drbd_resources_loaded: Checking DRBD has loaded with resources. Checking [ 5 ] > [ 2 ]
Mar  5 09:47:39 IT1XENSLAVE1 iscsi-ha: 19870 validate_drbd_resources_loaded: Resources loaded
Mar  5 09:47:39 IT1XENSLAVE1 iscsi-ha: 19870 check_drbd_resource_state: DRBD Resource: iscsi1 in Secondary mode
Mar  5 09:47:39 IT1XENSLAVE1 iscsi-ha: 19870 DRBD Resource: iscsi1 in Connected state
Mar  5 09:47:39 IT1XENSLAVE1 iscsi-ha: 19870 replication_link_check on this loop
Mar  5 09:47:39 IT1XENSLAVE1 iscsi-ha: 19870 conditions not met for replication_link_check
Mar  5 09:47:42 IT1XENSLAVE1 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Mar  5 09:47:47 IT1XENSLAVE1 iscsi-ha:  iscsi-ha Watchdog: iscsi-ha running - OK
Mar  5 09:47:48 IT1XENSLAVE1 iscsi-ha: 19830 Spawning new instance of iscsi-ha
Mar  5 09:47:48 IT1XENSLAVE1 iscsi-ha: 19830 check_logger_processes Checking logger processes
Mar  5 09:47:48 IT1XENSLAVE1 iscsi-ha: 19830 check_logger_processes No processes to clear
Mar  5 09:47:48 IT1XENSLAVE1 iscsi-ha:  Normalized ISCSI_TARGET_SERVICE [ tgtd ]
Mar  5 09:47:48 IT1XENSLAVE1 iscsi-ha:  XenServer Major Release = [ 6 ]
Mar  5 09:47:48 IT1XENSLAVE1 iscsi-ha:  Mail Spool Directory Found /dev/shm/iscsi-ha-mail
Mar  5 09:47:48 IT1XENSLAVE1 iscsi-ha:  This iteration is count 3676
Mar  5 09:47:48 IT1XENSLAVE1 iscsi-ha:  Checking if this host is a Pool Master or Slave
Mar  5 09:47:48 IT1XENSLAVE1 iscsi-ha:  This host's pool status = slave:192.168.1.110
Mar  5 09:47:48 IT1XENSLAVE1 iscsi-ha:  service_execute: Execute [ status ] on [ iscsi-ha ]
Mar  5 09:47:48 IT1XENSLAVE1 iscsi-ha:  service_execute: System V mode detected
iscsi-ha running: 7305SLAVE1 iscsi-ha:  service_execute: [  OK  ]
Mar  5 09:47:49 IT1XENSLAVE1 iscsi-ha:  service_execute: Returning exit status [ 0 ]
Mar  5 09:47:49 IT1XENSLAVE1 iscsi-ha: 20485 local_ip_list: Local IP list returned 127.0.0.1  192.168.1.112  10.10.10.2
Mar  5 09:47:49 IT1XENSLAVE1 iscsi-ha: 20485 service_execute: Execute [ status ] on [ tgtd ]
Mar  5 09:47:49 IT1XENSLAVE1 iscsi-ha: 20485 service_execute: System V mode detected

Please Log in or Create an account to join the conversation.

Last edit: by ajmind.

drbd status - diskless 4 years 1 month ago #1995

  • Salvatore Costantino
  • Salvatore Costantino's Avatar
  • Offline
  • Posts: 722
I now see why there was no alert.

We are only alerting on the connection state and not the disk state. Sorry for the confusion.

We can look at adding something to check disk state in the next release.

Please Log in or Create an account to join the conversation.

drbd status - diskless 4 years 1 month ago #1997

I have setup a cronjob to run a script checking the status of the drbd conncetion:
#!/bin/bash
# Get this host's UUID
thisUUID=`xe host-list name-label=$HOSTNAME params=uuid --minimal`

status=$(cat /proc/drbd | egrep -o UpToDate/UpToDate | wc -l)

if [ ! $status -eq 1 ] ; then
# mail -s "DRBD-state wrong - Cluster Node $(hostname)" someone@example.com </dev/null
xe message-create host-uuid=$thisUUID name="DRBD Status ALARM!" body="text to be mailed"
fi

BR Andreas

Please Log in or Create an account to join the conversation.

drbd status - diskless 3 years 6 months ago #2211

  • Salvatore Costantino
  • Salvatore Costantino's Avatar
  • Offline
  • Posts: 722
We are working on a release now and have added disk state tracking and alerting. It should be available in about 1 week,

Please Log in or Create an account to join the conversation.
Forum
Main Forum
Software Support
drbd status - diskless