Opensourcetechブログ

OpensourcetechによるNGINX/Zabbix/Neo4j/Linuxなどオープンソース技術に関するブログです。

Oracle XE with Pacemaker/Corosync on CentOS7


LinuCエヴァンジェリストの鯨井貴博@opensourcetechです。

今回は、以下の2つの記事を組み合わせて、Oracle XEのクラスター環境を構築してみます。

1.Oracle Database Express Edition (XE) on CentOS7
2.DRBD9/Pacemaker1.1/Corocync2/PCSによるストレージ冗長構成構築 on CentOS7

なお、「2.」の記事の内容が構築済みである前提となります。

一応、設定のみ載せておきます。

[root@db01 ~]# cat /etc/corosync/corosync.conf
totem {
        version: 2
        crypto_cipher: none
        cluster_name: drbd_cluster
        crypto_hash: none
        interface {
                ringnumber: 0
                bindnetaddr: 192.168.1.0
                mcastport: 5405
                ttl: 1
        }
        transport: udpu
}
logging {
        fileline: off
        to_logfile: yes
        to_syslog: no
        logfile: /var/log/cluster/corosync.log
        debug: off
        timestamp: on
        logger_subsys {
                subsys: QUORUM
                debug: off
        }
}
nodelist {
        node {
                name: db01
                ring0_addr: 192.168.1.222
                nodeid: 1
        }
        node {
                name: db02
                ring0_addr: 192.168.1.223
                nodeid: 2
        }
}
quorum {
        provider: corosync_votequorum
        expected_votes: 2
        two_node: 1
}

[root@db01 ~]# cat /etc/drbd.conf
# You can find an example in  /usr/share/doc/drbd.../drbd.conf.example

include "drbd.d/global_common.conf";
include "drbd.d/*.res";

[root@db01 ~]# cat /etc/drbd.d/
global_common.conf  r0.res
[root@db01 ~]# cat /etc/drbd.d/global_common.conf
# DRBD is the result of over a decade of development by LINBIT.
# In case you need professional services for DRBD or have
# feature requests visit http://www.linbit.com

global {
#       usage-count yes;
        usage-count no;

        # Decide what kind of udev symlinks you want for "implicit" volumes
        # (those without explicit volume <vnr> {} block, implied vnr=0):
        # /dev/drbd/by-resource/<resource>/<vnr>   (explicit volumes)
        # /dev/drbd/by-resource/<resource>         (default for implict)
        udev-always-use-vnr; # treat implicit the same as explicit volumes

        # minor-count dialog-refresh disable-ip-verification
        # cmd-timeout-short 5; cmd-timeout-medium 121; cmd-timeout-long 600;
}

common {
        handlers {
                # These are EXAMPLE handlers only.
                # They may have severe implications,
                # like hard resetting the node under certain circumstances.
                # Be careful when choosing your poison.

                # pri-on-incon-degr "/usr/lib/drbd/notify-pri-on-incon-degr.sh; /usr/lib/drbd/notify-emergency-reboot.sh; echo b > /proc/sysrq-trigger ; reboot -f";
                # pri-lost-after-sb "/usr/lib/drbd/notify-pri-lost-after-sb.sh; /usr/lib/drbd/notify-emergency-reboot.sh; echo b > /proc/sysrq-trigger ; reboot -f";
                # local-io-error "/usr/lib/drbd/notify-io-error.sh; /usr/lib/drbd/notify-emergency-shutdown.sh; echo o > /proc/sysrq-trigger ; halt -f";
                # fence-peer "/usr/lib/drbd/crm-fence-peer.sh";
                # split-brain "/usr/lib/drbd/notify-split-brain.sh root";
                # out-of-sync "/usr/lib/drbd/notify-out-of-sync.sh root";
                # before-resync-target "/usr/lib/drbd/snapshot-resync-target-lvm.sh -p 15 -- -c 16k";
                # after-resync-target /usr/lib/drbd/unsnapshot-resync-target-lvm.sh;
                # quorum-lost "/usr/lib/drbd/notify-quorum-lost.sh root";
        }

        startup {
                # wfc-timeout degr-wfc-timeout outdated-wfc-timeout wait-after-sb
        }

        options {
                auto-promote yes;
                # cpu-mask on-no-data-accessible

                # RECOMMENDED for three or more storage nodes with DRBD 9:
                # quorum majority;
                # on-no-quorum suspend-io | io-error;
        }

        disk {
                # size on-io-error fencing disk-barrier disk-flushes
                # disk-drain md-flushes resync-rate resync-after al-extents
                # c-plan-ahead c-delay-target c-fill-target c-max-rate
                # c-min-rate disk-timeout
        }

        net {
                # protocol timeout max-epoch-size max-buffers
                # connect-int ping-int sndbuf-size rcvbuf-size ko-count
                # allow-two-primaries cram-hmac-alg shared-secret after-sb-0pri
                # after-sb-1pri after-sb-2pri always-asbp rr-conflict
                # ping-timeout data-integrity-alg tcp-cork on-congestion
                # congestion-fill congestion-extents csums-alg verify-alg
                # use-rle
        }
}

[root@db01 ~]# cat /etc/drbd.d/r0.res
resource r0 {
        protocol C;

        disk /dev/sdb1;
        device /dev/drbd0;
        meta-disk internal;
        on db01 {
                address 192.168.1.222:7789;
        }
        on db02 {
                address 192.168.1.223:7789;
        }
}



Oracle XEのインストール ※両系で実施

[root@db01 ~]# cd /var/tmp/
[root@db01 tmp]# ll
合計 317916
-rw-r--r--. 1 root root    722808  5月 22 18:03 drbd90-utils-9.10.0-1.el7.elrepo.x86_64.rpm
-rw-r--r--. 1 root root    287020  5月 22 18:03 kmod-drbd90-9.0.20-1.el7_7.elrepo.x86_64.rpm
-rw-r--r--. 1 root root 315891481  5月 29 18:43 oracle-xe-11.2.0-1.0.x86_64.rpm.zip
-rw-r--r--. 1 root root   8614312  5月 22 18:27 pacemaker-repo-1.1.21-1.1.el7.x86_64.rpm
[root@db01 Disk1]# rpm -ivh oracle-xe-11.2.0-1.0.x86_64.rpm 
準備しています...                                                (100%)#                                 (100%)##                                (100%)###                               (100%)####                              (100%)#####                             (100%)######                            (100%)#######                           (100%)########                          (100%)#########                         (100%)##########                        (100%)################################# [100%]
/var/tmp/rpm-tmp.ghPJXM: 257 行: [: 18446744073692774399: 整数の式が予期されます
/var/tmp/rpm-tmp.ghPJXM: 271 行: [: 18446744073692774399: 整数の式が予期されます
更新中 / インストール中...
   1:oracle-xe-11.2.0-1.0
   ( 99%)################################# [100%]
Executing post-install steps...

You must run '/etc/init.d/oracle-xe configure' as the root user to configure the database.



なお、Oracle XEの依存関係にあるbcコマンドが未インストールの場合、以下のように「/u01/app/oracle/product/11.2.0/xe/config/scripts/init.ora 」の32行目が空memory_target=となり、エラーが起きるので注意。
※一度Oracle XEをアンインストールして、bc・Oracle XEの順でインストールし直せば解決します。

[root@db01 Disk1]# rpm -ivh oracle-xe-11.2.0-1.0.x86_64.rpm 
準備しています...                                                (100%)#                                 (100%)##                                (100%)###                               (100%)####                              (100%)#####                             (100%)######                            (100%)#######                           (100%)########                          (100%)#########                         (100%)##########                        (100%)################################# [100%]
/var/tmp/rpm-tmp.y5eGlP: 行 186: bc: コマンドが見つかりません
/var/tmp/rpm-tmp.y5eGlP: 257 行: [: 18446744073692774399: 整数の式が予期されます
/var/tmp/rpm-tmp.y5eGlP: 271 行: [: 18446744073692774399: 整数の式が予期されます
更新中 / インストール中...
   1:oracle-xe-11.2.0-1.0
   ( 99%)################################# [100%]
Executing post-install steps...
/var/tmp/rpm-tmp.oN8D23: 行 76: bc: コマンドが見つかりません
/var/tmp/rpm-tmp.oN8D23: 行 77: bc: コマンドが見つかりません
/var/tmp/rpm-tmp.oN8D23: 78 行: [: -gt: 単項演算子が予期されます
/var/tmp/rpm-tmp.oN8D23: 行 82: bc: コマンドが見つかりません
You must run '/etc/init.d/oracle-xe configure' as the root user to configure the database.
[root@db01 Disk1]# yum -y install bc
読み込んだプラグイン:fastestmirror
Loading mirror speeds from cached hostfile
 * base: ftp-srv2.kddilabs.jp
 * extras: ftp-srv2.kddilabs.jp
 * updates: ftp-srv2.kddilabs.jp
base                                                                                | 3.6 kB  00:00:00     
extras                                                                              | 2.9 kB  00:00:00     
linux-ha-ja-pacemaker                                                               | 2.9 kB  00:00:00     
updates                                                                             | 2.9 kB  00:00:00     
依存性の解決をしています
--> トランザクションの確認を実行しています。
---> パッケージ bc.x86_64 0:1.06.95-13.el7 を インストール
--> 依存性解決を終了しました。

依存性を解決しました

===========================================================================================================
 Package             アーキテクチャー        バージョン                        リポジトリー           容量
===========================================================================================================
インストール中:
 bc                  x86_64                  1.06.95-13.el7                    base                  115 k

トランザクションの要約
===========================================================================================================
インストール  1 パッケージ

総ダウンロード容量: 115 k
インストール容量: 215 k
Downloading packages:
bc-1.06.95-13.el7.x86_64.rpm                                                        | 115 kB  00:00:00     
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
警告: RPMDB は yum 以外で変更されました。
  インストール中          : bc-1.06.95-13.el7.x86_64 [############################################## ] 1/1 
  検証中                  : bc-1.06.95-13.el7.x86_64                                                   1/1 

インストール:
  bc.x86_64 0:1.06.95-13.el7                                                                               

完了しました!
[root@db01 Disk1]# /etc/init.d/oracle-xe configure

Oracle Database 11g Express Edition Configuration
-------------------------------------------------
This will configure on-boot properties of Oracle Database 11g Express 
Edition.  The following questions will determine whether the database should 
be starting upon system boot, the ports it will use, and the passwords that 
will be used for database accounts.  Press <Enter> to accept the defaults. 
Ctrl-C will abort.

Specify the HTTP port that will be used for Oracle Application Express [8080]:

Specify a port that will be used for the database listener [1521]:

Specify a password to be used for database accounts.  Note that the same
password will be used for SYS and SYSTEM.  Oracle recommends the use of 
different passwords for each database account.  This can be done after 
initial configuration:
Confirm the password:

Do you want Oracle Database 11g Express Edition to be started on boot (y/n) [y]:

Starting Oracle Net Listener...Done
Configuring database...
Database Configuration failed.  Look into /u01/app/oracle/product/11.2.0/xe/config/log for details
[root@db01 Disk1]# cat -n /u01/app/oracle/product/11.2.0/xe/config/scripts/init.ora 
     1  ##############################################################################
     2  # Copyright (c) 1991, 2011, Oracle and/or its affiliates. All rights reserved. 
     3  ##############################################################################
     4   
     5  ###########################################
     6  # Cursors and Library Cache
     7  ###########################################
     8  open_cursors=300
     9   
    10  ###########################################
    11  # Database Identification
    12  ###########################################
    13  db_name=XE
    14   
    15  ###########################################
    16  # File Configuration
    17  ###########################################
    18  control_files=("/u01/app/oracle/oradata/XE/control.dbf")
    19  DB_RECOVERY_FILE_DEST=/u01/app/oracle/fast_recovery_area
    20  DB_RECOVERY_FILE_DEST_SIZE=10G
    21   
    22  ###########################################
    23  # Job Queues
    24  ###########################################
    25  job_queue_processes=4
    26   
    27  ###########################################
    28  # Miscellaneous
    29  ###########################################
    30  compatible=11.2.0.0.0
    31  diagnostic_dest=/u01/app/oracle
    32  memory_target=
    33   
    34  ###########################################
    35  # Sessions
    36  ###########################################
    37  sessions=20
    38   
    39  ###########################################
    40  # Security and Auditing
    41  ###########################################
    42  audit_file_dest=/u01/app/oracle/admin/XE/adump
    43  remote_login_passwordfile=EXCLUSIVE
    44   
    45  ###########################################
    46  # Shared Server
    47  ###########################################
    48  dispatchers="(PROTOCOL=TCP) (SERVICE=XEXDB)"
    49  shared_servers=4
    50  
    51  ###########################################
    52  # System Managed Undo and Rollback Segments
    53  ###########################################
    54  undo_management=AUTO
    55  undo_tablespace=UNDOTBS1
[root@db01 Disk1]# cat -n /u01/app/oracle/product/11.2.0/xe/config/log/cloneDBCreation.log
     1  begin
     2  *
     3  ERROR at line 1:
     4  ORA-01034: ORACLE not available 
     5  Process ID: 0 
     6  Session ID: 0 Serial number: 0 
     7  
     8  
     9  create spfile='/u01/app/oracle/product/11.2.0/xe/dbs/spfileXE.ora' FROM pfile='/u01/app/oracle/product/11.2.0/xe/config/scripts/init.ora'
    10  *
    11  ERROR at line 1:
    12  ORA-01078: failure in processing system parameters 
    13  LRM-00116: syntax error at 'sessions' following '=' 
    14  
    15  
    16  ORA-01034: ORACLE not available
    17  ORA-27101: shared memory realm does not exist
    18  Linux-x86_64 Error: 2: No such file or directory
    19  ORA-01078: failure in processing system parameters
    20  LRM-00109: could not open parameter file '/u01/app/oracle/product/11.2.0/xe/dbs/initXE.ora'
    21  select 'utl_recomp_begin: ' || to_char(sysdate, 'HH:MI:SS') from dual
    22  *
    23  ERROR at line 1:
    24  ORA-01034: ORACLE not available 
    25  Process ID: 0 
    26  Session ID: 0 Serial number: 0 
    27  
    28  
    29  BEGIN utl_recomp.recomp_serial(); END;
    30  
    31  *
    32  ERROR at line 1:
    33  ORA-01034: ORACLE not available 
    34  Process ID: 0 
    35  Session ID: 0 Serial number: 0 
    36  
    37  
    38  select 'utl_recomp_end: ' || to_char(sysdate, 'HH:MI:SS') from dual
    39  *
    40  ERROR at line 1:
    41  ORA-01034: ORACLE not available 
    42  Process ID: 0 
    43  Session ID: 0 Serial number: 0
    44  
    45  


ログファイルにも、以下のエラーが出ます。

     1  begin
     2  *
     3  ERROR at line 1:
     4  ORA-01034: ORACLE not available 
     5  Process ID: 0 
     6  Session ID: 0 Serial number: 0 
     7  
     8  
     9  create spfile='/u01/app/oracle/product/11.2.0/xe/dbs/spfileXE.ora' FROM pfile='/u01/app/oracle/product/11.2.0/xe/config/scripts/init.ora'
    10  *
    11  ERROR at line 1:
    12  ORA-01078: failure in processing system parameters 
    13  LRM-00116: syntax error at 'sessions' following '=' 



Oracle XEの環境設定 ※両系で実施
続いて、Oracle XEの環境設定。

[root@db01 Disk1]# /etc/init.d/oracle-xe configure

Oracle Database 11g Express Edition Configuration
-------------------------------------------------
This will configure on-boot properties of Oracle Database 11g Express 
Edition.  The following questions will determine whether the database should 
be starting upon system boot, the ports it will use, and the passwords that 
will be used for database accounts.  Press <Enter> to accept the defaults. 
Ctrl-C will abort.

Specify the HTTP port that will be used for Oracle Application Express [8080]:

Specify a port that will be used for the database listener [1521]:

Specify a password to be used for database accounts.  Note that the same
password will be used for SYS and SYSTEM.  Oracle recommends the use of 
different passwords for each database account.  This can be done after 
initial configuration:
Confirm the password:

Do you want Oracle Database 11g Express Edition to be started on boot (y/n) [y]:

Starting Oracle Net Listener...Done
Configuring database...Done
Starting Oracle Database 11g Express Edition instance...Done
Installation completed successfully.
[root@db01 Disk1]# cat -n /u01/app/oracle/product/11.2.0/xe/config/scripts/init.ora 
     1  ##############################################################################
     2  # Copyright (c) 1991, 2011, Oracle and/or its affiliates. All rights reserved. 
     3  ##############################################################################
     4   
     5  ###########################################
     6  # Cursors and Library Cache
     7  ###########################################
     8  open_cursors=300
     9   
    10  ###########################################
    11  # Database Identification
    12  ###########################################
    13  db_name=XE
    14   
    15  ###########################################
    16  # File Configuration
    17  ###########################################
    18  control_files=("/u01/app/oracle/oradata/XE/control.dbf")
    19  DB_RECOVERY_FILE_DEST=/u01/app/oracle/fast_recovery_area
    20  DB_RECOVERY_FILE_DEST_SIZE=10G
    21   
    22  ###########################################
    23  # Job Queues
    24  ###########################################
    25  job_queue_processes=4
    26   
    27  ###########################################
    28  # Miscellaneous
    29  ###########################################
    30  compatible=11.2.0.0.0
    31  diagnostic_dest=/u01/app/oracle
    32  memory_target=770703360
    33   
    34  ###########################################
    35  # Sessions
    36  ###########################################
    37  sessions=20
    38   
    39  ###########################################
    40  # Security and Auditing
    41  ###########################################
    42  audit_file_dest=/u01/app/oracle/admin/XE/adump
    43  remote_login_passwordfile=EXCLUSIVE
    44   
    45  ###########################################
    46  # Shared Server
    47  ###########################################
    48  dispatchers="(PROTOCOL=TCP) (SERVICE=XEXDB)"
    49  shared_servers=4
    50  
    51  ###########################################
    52  # System Managed Undo and Rollback Segments
    53  ###########################################
    54  undo_management=AUTO
    55  undo_tablespace=UNDOTBS1
[root@db01 Disk1]# cd /u01/app/oracle/product/11.2.0/xe/bin
[root@db01 bin]# ll
合計 191312
-rwxr-xr-x. 1 oracle dba     13091  8月 29  2011 adapters
-rwxr-xr-x. 1 oracle dba      8614  8月 29  2011 createdb.sh
-rwxr-xr-x. 1 oracle dba    523832  8月 29  2011 ctxkbtc
-rwxr-xr-x. 1 oracle dba    453648  8月 29  2011 ctxlc
-rwxr-xr-x. 1 oracle dba    193080  8月 29  2011 ctxload
-rwxr-xr-x. 1 oracle dba      6840  8月 29  2011 cursize
-rwxr-xr-x. 1 oracle dba    558768  8月 29  2011 dbfs_client
-rwxr-xr-x. 1 oracle dba      6856  8月 29  2011 dbfsize
-rwxr-xr-x. 1 oracle dba      2415  8月 29  2011 dbhome
-rwxr-xr-x. 1 oracle dba    321904  8月 29  2011 dbv
-rwxr-xr-x. 1 oracle dba    340072  8月 29  2011 dg4odbc
-rwxr-xr-x. 1 oracle dba    349320  8月 29  2011 dgmgrl
-rwxr-xr-x. 1 oracle dba      8296  8月 29  2011 dumpsga
-rwxr-xr-x. 1 oracle dba    614568  8月 29  2011 exp
-rwxr-xr-x. 1 oracle dba    126440  8月 29  2011 expdp
-rwxr-xr-x. 1 oracle dba    608048  8月 29  2011 extjob
-rwxr-xr-x. 1 oracle dba    608048  8月 29  2011 extjobo
-rwxr-xr-x. 1 oracle dba      5944  8月 29  2011 extproc
-rwxr-xr-x. 1 oracle dba    300968  8月 29  2011 imp
-rwxr-xr-x. 1 oracle dba    136904  8月 29  2011 impdp
-rwxr-xr-x. 1 oracle dba    368456  8月 29  2011 kgmgr
-rwxr-xr-x. 1 oracle dba     12536  8月 29  2011 loadpsp
-rwxr-xr-x. 1 oracle dba     91016  8月 29  2011 lsnrctl
-rwxr-xr-x. 1 oracle dba    511824  8月 29  2011 lxchknlb
-rwxr-xr-x. 1 oracle dba      7960  8月 29  2011 mapsga
-rwxr-xr-x. 1 oracle dba      6872  8月 29  2011 maxmem
-rwxr-xr-x. 1 oracle dba     58968  8月 29  2011 nid
-rwxr-xr-x. 1 oracle dba     16759  8月 29  2011 nls_lang.sh
-rwsr-s--x. 1 oracle dba 165700472  8月 29  2011 oracle
-rwxr-xr-x. 1 oracle dba       156  8月 29  2011 oracle_env.csh
-rwxr-xr-x. 1 oracle dba       156  8月 29  2011 oracle_env.sh
-rwxr-xr-x. 1 oracle dba     52800  8月 29  2011 oradism
-rwxr-xr-x. 1 oracle dba      6183  8月 29  2011 oraenv
-rwxr-xr-x. 1 oracle dba     15232  8月 29  2011 orapwd
-rwxr-xr-x. 1 oracle dba     19936  8月 29  2011 osdbagrp
-rwxr-xr-x. 1 oracle dba     20040  8月 29  2011 osh
-rwxr-xr-x. 1 oracle dba       946  8月 29  2011 ott
-rwxr-xr-x. 1 oracle dba  14087984  8月 29  2011 rman
-rwxr-xr-x. 1 oracle dba   1313712  8月 29  2011 sqlldr
-rwxr-x--x. 1 oracle dba      4968  8月 29  2011 sqlplus
-rwxr-xr-x. 1 oracle dba     13352  8月 29  2011 sysresv
-rwxr-xr-x. 1 oracle dba     85096  8月 29  2011 tkprof
-rwxr-xr-x. 1 oracle dba    738440  8月 29  2011 tnslsnr
-rwxr-xr-x. 1 oracle dba     11040  8月 29  2011 tnsping
-rwxr-xr-x. 1 oracle dba     16496  8月 29  2011 trcroute
-rwxr-xr-x. 1 oracle dba    144784  8月 29  2011 unzip
-rwxr-xr-x. 1 oracle dba   7097808  8月 29  2011 wrap
-rwxr-xr-x. 1 oracle dba    208384  8月 29  2011 zip
[root@db01 bin]# cat -n oracle_env.sh
     1  export ORACLE_HOME=/u01/app/oracle/product/11.2.0/xe
     2  export ORACLE_SID=XE
     3  export NLS_LANG=`$ORACLE_HOME/bin/nls_lang.sh`
     4  export PATH=$ORACLE_HOME/bin:$PATH
[root@db01 bin]# . ./oracle_env.sh 
[root@db01 bin]# echo $ORACLE_HOME
/u01/app/oracle/product/11.2.0/xe
[root@db01 ~]# cat /etc/passwd
root:x:0:0:root:/root:/bin/bash
bin:x:1:1:bin:/bin:/sbin/nologin
daemon:x:2:2:daemon:/sbin:/sbin/nologin
adm:x:3:4:adm:/var/adm:/sbin/nologin
lp:x:4:7:lp:/var/spool/lpd:/sbin/nologin
sync:x:5:0:sync:/sbin:/bin/sync
shutdown:x:6:0:shutdown:/sbin:/sbin/shutdown
halt:x:7:0:halt:/sbin:/sbin/halt
mail:x:8:12:mail:/var/spool/mail:/sbin/nologin
operator:x:11:0:operator:/root:/sbin/nologin
games:x:12:100:games:/usr/games:/sbin/nologin
ftp:x:14:50:FTP User:/var/ftp:/sbin/nologin
nobody:x:99:99:Nobody:/:/sbin/nologin
systemd-network:x:192:192:systemd Network Management:/:/sbin/nologin
dbus:x:81:81:System message bus:/:/sbin/nologin
polkitd:x:999:998:User for polkitd:/:/sbin/nologin
sshd:x:74:74:Privilege-separated SSH:/var/empty/sshd:/sbin/nologin
postfix:x:89:89::/var/spool/postfix:/sbin/nologin
chrony:x:998:996::/var/lib/chrony:/sbin/nologin
oracle:x:1000:1000:oracle:/home/oracle:/bin/bash
rpc:x:32:32:Rpcbind Daemon:/var/lib/rpcbind:/sbin/nologin
rpcuser:x:29:29:RPC Service User:/var/lib/nfs:/sbin/nologin
nfsnobody:x:65534:65534:Anonymous NFS User:/var/lib/nfs:/sbin/nologin
tss:x:59:59:Account used by the trousers package to sandbox the tcsd daemon:/dev/null:/sbin/nologin
hacluster:x:189:189:cluster user:/home/hacluster:/sbin/nologin


各ユーザ(root/oracle)のホームディレクトリや/etc/skelにある.bashrc・.bash_profileにも環境変数を追記しておきます。


続いて、Oracle XE起動時に自動起動するインスタンス(XE)の設定をします。

[root@db01 skel]# cat /etc/oratab 
XE:/u01/app/oracle/product/11.2.0/xe:N
[root@db01 skel]# vi /etc/oratab 
[root@db01 skel]# vi /etc/oratab cat
XE:/u01/app/oracle/product/11.2.0/xe:Y



Oracle XEに関するクラスター設定 ※Primaryとなる側でのみ実施
まず、現状のクラスター設定および動作確認。

[root@db01 skel]# crm configure show
node 1: db01
node 2: db02 \
        attributes
primitive FS Filesystem \
        params device="/dev/drbd0" directory="/mnt/drbd" fstype=xfs \
        op monitor interval=10s on-fail=restart timeout=60s \
        op start interval=0s on-fail=restart timeout=60s \
        op stop interval=0s on-fail=block timeout=60s
primitive VIP IPaddr2 \
        params cidr_netmask=24 ip=192.168.1.221 \
        op monitor interval=10s \
        op start interval=0s timeout=20s \
        op stop interval=0s timeout=20s
primitive prmPing ocf:pacemaker:ping \
        params attempts=5 debug=true host_list="192.168.1.222 192.168.1.223" multiplier=1 name=default_ping _set timeout=50 \
        op monitor interval=10s on-fail=restart timeout=60s \
        op start interval=0s on-fail=restart timeout=60s \
        op stop interval=0s on-fail=ignore timeout=60s
primitive vipcheck VIPcheck \
        params count=3 target_ip=192.168.1.221 wait=5 \
        op monitor interval=10s on-fail=restart start-delay=0 timeout=60s \
        op start interval=0s on-fail=restart timeout=60s \
:        op stop interval=0s on-fail=ignore timeout=60s
group Group-FS FS vipcheck VIP
clone prmPing-clone prmPing
property cib-bootstrap-options: \
        have-watchdog=false \
        dc-version=1.1.21-1.el7-f14e36f \
        cluster-infrastructure=corosync \
        stonith-enabled=false \
        no-quorum-policy=ignore \
        cluster-name=drbd_cluster
rsc_defaults rsc_defaults-options: \
        migration-threshold=1
[root@db01 ~]# pcs status
Cluster name: drbd_cluster

WARNINGS:
Corosync and pacemaker node names do not match (IPs used in setup?)

Stack: corosync
Current DC: db01 (version 1.1.21-1.el7-f14e36f) - partition with quorum
Last updated: Fri May 29 15:50:40 2020
Last change: Thu May 28 20:46:10 2020 by root via cibadmin on db01

2 nodes configured
5 resources configured

Online: [ db01 db02 ]

Full list of resources:

 Resource Group: Group-FS
     FS (ocf::heartbeat:Filesystem):    Started db01
     vipcheck   (ocf::heartbeat:VIPcheck):  Started db01
     VIP    (ocf::heartbeat:IPaddr2):   Started db01
 Clone Set: prmPing-clone [prmPing]
     Started: [ db01 db02 ]

Daemon Status:
  corosync: active/enabled
  pacemaker: active/enabled
  pcsd: active/enabled


以下にある、oralsnroracleを使います。

[root@db01 ~]# find / -name oralsnr
/usr/lib/ocf/resource.d/heartbeat/oralsnr
[root@db01 ~]# ls /usr/lib/ocf/resource.d/pacemaker/
ClusterMon  HealthCPU    Stateful  SystemHealth  controld  ifspeed  ping   remote
Dummy       HealthSMART  SysInfo   attribute     diskd     o2cb     pingd
[root@db01 ~]# ls /usr/lib/ocf/resource.d/pacemaker/heartbeat/
AoEtarget        SendArp             conntrackd          kamailio                 podman
AudibleAlarm     ServeRAID           db2                 ldirectord               portblock
CTDB             SphinxSearchDaemon  dhcpd               lvmlockd                 postfix
ClusterMon       Squid               dnsupdate           lxc                      pound
Delay            Stateful            docker              lxd-info                 proftpd
Dummy            SysInfo             dovecot             machine-info             rabbitmq-cluster
EvmsSCC          VIPArip             eDir88              mariadb                  redis
Evmsd            VIPcheck            ethmonitor          minio                    rkt
Filesystem       VirtualDomain       exportfs            mpathpersist             rsyncd
ICP              WAS                 fio                 mysql                    rsyslog
IPaddr           WAS6                galera              mysql-proxy              scsi2reservation
IPaddr2          WinPopup            garbd               nagios                   sfex
IPsrcaddr        Xen                 gcp-pd-move         named                    sg_persist
IPv6addr         Xinetd              gcp-vpc-move-ip     nfsnotify                slapd
LVM              ZFS                 gcp-vpc-move-route  nfsserver                sybaseASE
LVM-activate     aliyun-vpc-move-ip  gcp-vpc-move-vip    nginx                    symlink
LinuxSCSI        anything            hulft               openstack-cinder-volume  syslog-ng
MailTo           apache              iSCSILogicalUnit    openstack-floating-ip    tomcat
ManageRAID       asterisk            iSCSITarget         openstack-info           varnish
ManageVE         aws-vpc-move-ip     ids                 oraasm                   vdo-vol
NodeUtilization  aws-vpc-route53     iface-bridge        oracle                   vmware
Pure-FTPd        awseip              iface-vlan          oralsnr                  vsftpd
Raid1            awsvip              ipsec               ovsmonitor               zabbixserver
Route            azure-events        iscsi               pgagent
SAPDatabase      azure-lb            jboss               pgsql
SAPInstance      clvm                jira                pingd


クラスター設定追加。

[root@db01 ~]# pcs resource create OraLsnr ocf:heartbeat:oralsnr  sid=XE op start interval="0s" timeout="60ss" op monitor interval="30s" timeout="60s" depth=0 op stop interval="0s" timeout="60s"
[root@db01 ~]# pcs constraint colocation add OraLsnr-with-FS FS OraLsnr
[root@db01 ~]# pcs constraint order set FS OraLsnr
[root@db01 ~]# pcs resource create OraSrv ocf:heartbeat:oracle  sid=XE home="/u01/app/oracle/product/11.2.0 /xe" user=oracle op start interval="0s" timeout="120s" op monitor interval="120s" timeout="60s" op stop int erval="0s" timeout="120s"
[root@db01 ~]# pcs constraint colocation add OraLsnr OraSrv
[root@db01 ~]# pcs constraint order set OraLsnr OraSrv


[root@db01 ~]# pcs config
Cluster Name: drbd_cluster
Corosync Nodes:
 192.168.1.222 192.168.1.223
Pacemaker Nodes:
 db01 db02

Resources:
 Group: Group-FS
  Resource: FS (class=ocf provider=heartbeat type=Filesystem)
   Attributes: device=/dev/drbd0 directory=/mnt/drbd fstype=xfs run_fsck=no
   Operations: monitor interval=15s timeout=40s (FS-monitor-15s)
               start interval=0s timeout=60s (FS-start-interval-0s)
               stop interval=0s on-fail=ignore timeout=60s (FS-stop-interval-0s)
  Resource: vipcheck (class=ocf provider=heartbeat type=VIPcheck)
   Attributes: count=3 target_ip=192.168.1.221 wait=5
   Operations: monitor interval=10s on-fail=restart start-delay=0 timeout=60s (vipcheck-monitor-interval-10s)
               start interval=0s on-fail=restart timeout=60s (vipcheck-start-interval-0s)
               stop interval=0s on-fail=ignore timeout=60s (vipcheck-stop-interval-0s)
  Resource: VIP (class=ocf provider=heartbeat type=IPaddr2)
   Attributes: cidr_netmask=24 ip=192.168.1.221 nic=enp0s3
   Operations: monitor interval=30s (VIP-monitor-30s)
               start interval=0s timeout=20s (VIP-start-interval-0s)
               stop interval=0s timeout=20s (VIP-stop-interval-0s)
  Resource: prmPing (class=ocf provider=pacemaker type=ping)
   Attributes: attempts=5 debug=true host_list=192.168.1.1 multiplier=1 name=default_ping_set timeout=50s
   Operations: monitor interval=10s on-fail=restart timeout=60s (prmPing-monitor-interval-10s)
               start interval=0s on-fail=restart timeout=60s (prmPing-start-interval-0s)
               stop interval=0s on-fail=fence timeout=60s (prmPing-stop-interval-0s)
 Resource: OraLsnr (class=ocf provider=heartbeat type=oralsnr)
  Attributes: sid=XE
  Operations: monitor interval=30s timeout=120s depth=0 (OraLsnr-monitor-interval-30s)
              start interval=0s timeout=120s (OraLsnr-start-interval-0s)
              stop interval=0s timeout=120s (OraLsnr-stop-interval-0s)
 Resource: OraSrv (class=ocf provider=heartbeat type=oracle)
  Attributes: home=/u01/app/oracle/product/11.2.0/xe sid=XE user=oracle
  Operations: monitor interval=120s timeout=60s (OraSrv-monitor-interval-120s)
              start interval=0s timeout=120s (OraSrv-start-interval-0s)
              stop interval=0s timeout=120s (OraSrv-stop-interval-0s)

Stonith Devices:
Fencing Levels:

Location Constraints:
Ordering Constraints:
  Resource Sets:
    set FS OraLsnr (id:pcs_rsc_set_FS_OraLsnr) (id:pcs_rsc_order_set_FS_OraLsnr)
    set OraLsnr OraSrv (id:pcs_rsc_set_OraLsnr_OraSrv) (id:pcs_rsc_order_set_OraLsnr_OraSrv)
Colocation Constraints:
  FS with OraLsnr (score:INFINITY) (id:colocation-FS-OraLsnr-INFINITY)
  OraLsnr with OraSrv (score:INFINITY) (id:colocation-OraLsnr-OraSrv-INFINITY)
Ticket Constraints:

Alerts:
 No alerts defined

Resources Defaults:
 migration-threshold=1
 resource-stickiness=INFINITY
Operations Defaults:
 No defaults set

Cluster Properties:
 cluster-infrastructure: corosync
 cluster-name: drbd_cluster
 dc-version: 1.1.21-1.el7-f14e36f
 have-watchdog: false
 last-lrm-refresh: 1560163421
 no-quorum-policy: ignore
 stonith-enabled: false

Quorum:
  Options:


[root@db01 skel]# crm configure show
node 1: db01 \
        attributes standby=off
node 2: db02 \
        attributes
primitive FS Filesystem \
        params run_fsck=no device="/dev/drbd0" directory="/mnt/drbd" fstype=xfs \
        op monitor interval=15s timeout=40s \
        op start interval=0s timeout=60s \
        op stop interval=0s on-fail=ignore timeout=60s
primitive OraLsnr oralsnr \
        params sid=XE \
        op monitor interval=30s timeout=120s depth=0 \
        op start interval=0s timeout=120s \
        op stop interval=0s timeout=120s
primitive OraSrv oracle \
        params home="/u01/app/oracle/product/11.2.0/xe" sid=XE user=oracle \
        op monitor interval=120s timeout=60s \
        op start interval=0s timeout=120s \
        op stop interval=0s timeout=120s
primitive VIP IPaddr2 \
        params cidr_netmask=24 ip=192.168.1.221 nic=enp0s3 \
        op monitor interval=30s \
        op start interval=0s timeout=20s \
        op stop interval=0s timeout=20s
primitive prmPing ocf:pacemaker:ping \
        params attempts=5 debug=true host_list=192.168.1.1 multiplier=1 name=default_ping_set timeout=50s \
        op monitor interval=10s on-fail=restart timeout=60s \
        op start interval=0s on-fail=restart timeout=60s \
        op stop interval=0s on-fail=fence timeout=60s
primitive vipcheck VIPcheck \
        params count=3 target_ip=192.168.1.221 wait=5 \
        op monitor interval=10s on-fail=restart start-delay=0 timeout=60s \
        op start interval=0s on-fail=restart timeout=60s \
        op stop interval=0s on-fail=ignore timeout=60s
group Group-FS FS vipcheck VIP prmPing
colocation colocation-FS-OraLsnr-INFINITY inf: FS OraLsnr
colocation colocation-OraLsnr-OraSrv-INFINITY inf: OraLsnr OraSrv
order pcs_rsc_order_set_FS_OraLsnr _rsc_set_ FS OraLsnr
order pcs_rsc_order_set_OraLsnr_OraSrv _rsc_set_ OraLsnr OraSrv
property cib-bootstrap-options: \
        have-watchdog=false \
        dc-version=1.1.21-1.el7-f14e36f \
        cluster-infrastructure=corosync \
        stonith-enabled=false \
        no-quorum-policy=ignore \
        cluster-name=drbd_cluster \
        last-lrm-refresh=1560163421
rsc_defaults rsc_defaults-options: \
        resource-stickiness=INFINITY \
        migration-threshold=1


[root@db01 ~]# crm configure save /var/tmp/oracle_pacemaker.crm
[root@db01 ~]# cat /var/tmp/oracle_pacemaker.crm
node 1: db01 \
        attributes standby=off
node 2: db02 \
        attributes
primitive FS Filesystem \
        params run_fsck=no device="/dev/drbd0" directory="/mnt/drbd" fstype=xfs \
        op monitor interval=15s timeout=40s \
        op start interval=0s timeout=60s \
        op stop interval=0s on-fail=ignore timeout=60s
primitive OraLsnr oralsnr \
        params sid=XE \
        op monitor interval=30s timeout=120s depth=0 \
        op start interval=0s timeout=120s \
        op stop interval=0s timeout=120s
primitive OraSrv oracle \
        params home="/u01/app/oracle/product/11.2.0/xe" sid=XE user=oracle \
        op monitor interval=120s timeout=60s \
        op start interval=0s timeout=120s \
        op stop interval=0s timeout=120s
primitive VIP IPaddr2 \
        params cidr_netmask=24 ip=192.168.1.221 nic=enp0s3 \
        op monitor interval=30s \
        op start interval=0s timeout=20s \
        op stop interval=0s timeout=20s
primitive prmPing ocf:pacemaker:ping \
        params attempts=5 debug=true host_list=192.168.1.1 multiplier=1 name=default_ping_set timeout=50s \
        op monitor interval=10s on-fail=restart timeout=60s \
        op start interval=0s on-fail=restart timeout=60s \
        op stop interval=0s on-fail=fence timeout=60s
primitive vipcheck VIPcheck \
        params count=3 target_ip=192.168.1.221 wait=5 \
        op monitor interval=10s on-fail=restart start-delay=0 timeout=60s \
        op start interval=0s on-fail=restart timeout=60s \
        op stop interval=0s on-fail=ignore timeout=60s
group Group-FS FS vipcheck VIP prmPing
colocation colocation-FS-OraLsnr-INFINITY inf: FS OraLsnr
colocation colocation-OraLsnr-OraSrv-INFINITY inf: OraLsnr OraSrv
order pcs_rsc_order_set_FS_OraLsnr _rsc_set_ FS OraLsnr
order pcs_rsc_order_set_OraLsnr_OraSrv _rsc_set_ OraLsnr OraSrv
property cib-bootstrap-options: \
        have-watchdog=false \
        dc-version=1.1.21-1.el7-f14e36f \
        cluster-infrastructure=corosync \
        stonith-enabled=false \
        no-quorum-policy=ignore \
        cluster-name=drbd_cluster \
        last-lrm-refresh=1560163421
rsc_defaults rsc_defaults-options: \
        resource-stickiness=INFINITY \
        migration-threshold=1
[root@db01 ~]# cat -n /var/tmp/oracle_pacemaker.crm
     1  node 1: db01 \
     2          attributes standby=off
     3  node 2: db02 \
     4          attributes
     5  primitive FS Filesystem \
     6          params run_fsck=no device="/dev/drbd0" directory="/mnt/drbd" fstype=xfs \
     7          op monitor interval=15s timeout=40s \
     8          op start interval=0s timeout=60s \
     9          op stop interval=0s on-fail=ignore timeout=60s
    10  primitive OraLsnr oralsnr \
    11          params sid=XE \
    12          op monitor interval=30s timeout=120s depth=0 \
    13          op start interval=0s timeout=120s \
    14          op stop interval=0s timeout=120s
    15  primitive OraSrv oracle \
    16          params home="/u01/app/oracle/product/11.2.0/xe" sid=XE user=oracle \
    17          op monitor interval=120s timeout=60s \
    18          op start interval=0s timeout=120s \
    19          op stop interval=0s timeout=120s
    20  primitive VIP IPaddr2 \
    21          params cidr_netmask=24 ip=192.168.1.221 nic=enp0s3 \
    22          op monitor interval=30s \
    23          op start interval=0s timeout=20s \
    24          op stop interval=0s timeout=20s
    25  primitive prmPing ocf:pacemaker:ping \
    26          params attempts=5 debug=true host_list=192.168.1.1 multiplier=1 name=default_ping_set timeout=50s \
    27          op monitor interval=10s on-fail=restart timeout=60s \
    28          op start interval=0s on-fail=restart timeout=60s \
    29          op stop interval=0s on-fail=fence timeout=60s
    30  primitive vipcheck VIPcheck \
    31          params count=3 target_ip=192.168.1.221 wait=5 \
    32          op monitor interval=10s on-fail=restart start-delay=0 timeout=60s \
    33          op start interval=0s on-fail=restart timeout=60s \
    34          op stop interval=0s on-fail=ignore timeout=60s
    35  group Group-FS FS vipcheck VIP prmPing
    36  colocation colocation-FS-OraLsnr-INFINITY inf: FS OraLsnr
    37  colocation colocation-OraLsnr-OraSrv-INFINITY inf: OraLsnr OraSrv
    38  order pcs_rsc_order_set_FS_OraLsnr _rsc_set_ FS OraLsnr
    39  order pcs_rsc_order_set_OraLsnr_OraSrv _rsc_set_ OraLsnr OraSrv
    40  property cib-bootstrap-options: \
    41          have-watchdog=false \
    42          dc-version=1.1.21-1.el7-f14e36f \
    43          cluster-infrastructure=corosync \
    44          stonith-enabled=false \
    45          no-quorum-policy=ignore \
    46          cluster-name=drbd_cluster \
    47          last-lrm-refresh=1560163421
    48  rsc_defaults rsc_defaults-options: \
    49          resource-stickiness=INFINITY \
    50          migration-threshold=1


設定の反映等確認。

[root@db01 ~]# pcs status
Cluster name: drbd_cluster

WARNINGS:
Corosync and pacemaker node names do not match (IPs used in setup?)

Stack: corosync
Current DC: db01 (version 1.1.21-1.el7-f14e36f) - partition with quorum
Last updated: Fri May 29 16:11:51 2020
Last change: Fri May 29 16:11:37 2020 by root via cibadmin on db01

2 nodes configured
7 resources configured

Online: [ db01 db02 ]

Full list of resources:

 Resource Group: Group-FS
     FS (ocf::heartbeat:Filesystem):    Started db01
     vipcheck   (ocf::heartbeat:VIPcheck):  Started db01
     VIP    (ocf::heartbeat:IPaddr2):   Started db01
 Clone Set: prmPing-clone [prmPing]
     Started: [ db01 db02 ]
 OraLsnr    (ocf::heartbeat:oralsnr):   Started db01
 OraSrv (ocf::heartbeat:oracle):    Started db01

Daemon Status:
  corosync: active/enabled
  pacemaker: active/enabled
  pcsd: active/enabled
[root@db01 ~]# ss -tan
State       Recv-Q Send-Q        Local Address:Port                       Peer Address:Port              
LISTEN      0      100               127.0.0.1:25                                    *:*                  
LISTEN      0      128                       *:111                                   *:*                  
LISTEN      0      128                       *:22                                    *:*                  
ESTAB       0      0             192.168.1.222:22                        192.168.1.131:50173              
ESTAB       0      0             192.168.1.222:7789                      192.168.1.223:58679              
ESTAB       0      0             192.168.1.222:54307                     192.168.1.223:7789               
ESTAB       0      0             192.168.1.222:53214                     192.168.1.222:1521               
LISTEN      0      100                   [::1]:25                                 [::]:*                  
LISTEN      0      128                    [::]:33221                              [::]:*                  
LISTEN      0      128                    [::]:111                                [::]:*                  
LISTEN      0      128                    [::]:8080                               [::]:*                  
LISTEN      0      128                    [::]:2224                               [::]:*                  
LISTEN      0      128                    [::]:1521                               [::]:*                  
LISTEN      0      128                    [::]:22                                 [::]:*                  
TIME-WAIT   0      0        [::ffff:192.168.1.222]:1521                 [::ffff:192.168.1.222]:53204              
TIME-WAIT   0      0        [::ffff:192.168.1.222]:1521                 [::ffff:192.168.1.222]:53202              
ESTAB       0      0        [::ffff:192.168.1.222]:1521                 [::ffff:192.168.1.222]:53214              


DB接続の確認。

[root@db01 ~]# pcs status
Cluster name: drbd_cluster

WARNINGS:
Corosync and pacemaker node names do not match (IPs used in setup?)

Stack: corosync
Current DC: db01 (version 1.1.21-1.el7-f14e36f) - partition with quorum
Last updated: Fri May 29 16:11:51 2020
Last change: Fri May 29 16:11:37 2020 by root via cibadmin on db01

2 nodes configured
7 resources configured

Online: [ db01 db02 ]

Full list of resources:

 Resource Group: Group-FS
     FS (ocf::heartbeat:Filesystem):    Started db01
     vipcheck   (ocf::heartbeat:VIPcheck):  Started db01
     VIP    (ocf::heartbeat:IPaddr2):   Started db01
 Clone Set: prmPing-clone [prmPing]
     Started: [ db01 db02 ]
 OraLsnr    (ocf::heartbeat:oralsnr):   Started db01
 OraSrv (ocf::heartbeat:oracle):    Started db01

Daemon Status:
  corosync: active/enabled
  pacemaker: active/enabled
  pcsd: active/enabled
[root@db01 ~]# ss -tan
State       Recv-Q Send-Q        Local Address:Port                       Peer Address:Port              
LISTEN      0      100               127.0.0.1:25                                    *:*                  
LISTEN      0      128                       *:111                                   *:*                  
LISTEN      0      128                       *:22                                    *:*                  
ESTAB       0      0             192.168.1.222:22                        192.168.1.131:50173              
ESTAB       0      0             192.168.1.222:7789                      192.168.1.223:58679              
ESTAB       0      0             192.168.1.222:54307                     192.168.1.223:7789               
ESTAB       0      0             192.168.1.222:53214                     192.168.1.222:1521               
LISTEN      0      100                   [::1]:25                                 [::]:*                  
LISTEN      0      128                    [::]:33221                              [::]:*                  
LISTEN      0      128                    [::]:111                                [::]:*                  
LISTEN      0      128                    [::]:8080                               [::]:*                  
LISTEN      0      128                    [::]:2224                               [::]:*                  
LISTEN      0      128                    [::]:1521                               [::]:*                  
LISTEN      0      128                    [::]:22                                 [::]:*                  
TIME-WAIT   0      0        [::ffff:192.168.1.222]:1521                 [::ffff:192.168.1.222]:53204              
TIME-WAIT   0      0        [::ffff:192.168.1.222]:1521                 [::ffff:192.168.1.222]:53202              
ESTAB       0      0        [::ffff:192.168.1.222]:1521                 [::ffff:192.168.1.222]:53214              


大丈夫そうですね♪


障害試験
では、続いて障害試験。
Primaryで動作している側をshutdownして切り替え、起動後の切り戻りをチェックします。

[root@db01 ~]# reboot


db01の再起動後、状態確認。

[root@db01 ~]# pcs status
Cluster name: drbd_cluster

WARNINGS:
Corosync and pacemaker node names do not match (IPs used in setup?)

Stack: corosync
Current DC: db02 (version 1.1.21-1.el7-f14e36f) - partition with quorum
Last updated: Fri May 29 18:17:17 2020
Last change: Fri May 29 16:11:37 2020 by root via cibadmin on db01

2 nodes configured
7 resources configured

Online: [ db01 db02 ]

Full list of resources:

 Resource Group: Group-FS
     FS (ocf::heartbeat:Filesystem):    Started db02
     vipcheck   (ocf::heartbeat:VIPcheck):  Started db02
     VIP    (ocf::heartbeat:IPaddr2):   Started db02
 Clone Set: prmPing-clone [prmPing]
     Started: [ db01 ]
     Stopped: [ db02 ]
 OraLsnr    (ocf::heartbeat:oralsnr):   Started db02
 OraSrv (ocf::heartbeat:oracle):    Started db02

Failed Resource Actions:
* VIP_monitor_10000 on db01 'unknown error' (1): call=67, status=Timed Out, exitreason='',
    last-rc-change='Fri May 29 18:16:56 2020', queued=0ms, exec=0ms
* prmPing_monitor_10000 on db02 'unknown error' (1): call=122, status=Timed Out, exitreason='',
    last-rc-change='Fri May 29 18:16:55 2020', queued=0ms, exec=0ms

Daemon Status:
  corosync: active/enabled
  pacemaker: active/enabled
  pcsd: active/enabled


2系に切り替わってますね。
※「Failed Resource Actions;」は、こちらにある方法で消しておいてください。


では、1系に戻します。

[root@db01 ~]# pcs cluster standby db02
[root@db01 ~]# pcs status
Cluster name: drbd_cluster

WARNINGS:
Corosync and pacemaker node names do not match (IPs used in setup?)

Stack: corosync
Current DC: db02 (version 1.1.21-1.el7-f14e36f) - partition with quorum
Last updated: Fri May 29 18:19:20 2020
Last change: Fri May 29 18:18:56 2020 by root via cibadmin on db01

2 nodes configured
7 resources configured

Node db02: standby
Online: [ db01 ]

Full list of resources:

 Resource Group: Group-FS
     FS (ocf::heartbeat:Filesystem):    Started db01
     vipcheck   (ocf::heartbeat:VIPcheck):  Started db01
     VIP    (ocf::heartbeat:IPaddr2):   Started db01
 Clone Set: prmPing-clone [prmPing]
     Started: [ db01 ]
     Stopped: [ db02 ]
 OraLsnr    (ocf::heartbeat:oralsnr):   Started db01
 OraSrv (ocf::heartbeat:oracle):    Started db01

Daemon Status:
  corosync: active/enabled
  pacemaker: active/enabled
  pcsd: active/enabled

[root@db01 ~]# pcs cluster unstandby db02
[root@db01 ~]# pcs status
Cluster name: drbd_cluster

WARNINGS:
Corosync and pacemaker node names do not match (IPs used in setup?)

Stack: corosync
Current DC: db02 (version 1.1.21-1.el7-f14e36f) - partition with quorum
Last updated: Fri May 29 18:19:26 2020
Last change: Fri May 29 18:19:24 2020 by root via cibadmin on db01

2 nodes configured
7 resources configured

Online: [ db01 db02 ]

Full list of resources:

 Resource Group: Group-FS
     FS (ocf::heartbeat:Filesystem):    Started db01
     vipcheck   (ocf::heartbeat:VIPcheck):  Started db01
     VIP    (ocf::heartbeat:IPaddr2):   Started db01
 Clone Set: prmPing-clone [prmPing]
     Started: [ db01 ]
     Stopped: [ db02 ]
 OraLsnr    (ocf::heartbeat:oralsnr):   Started db01
 OraSrv (ocf::heartbeat:oracle):    Started db01

Daemon Status:
  corosync: active/enabled
  pacemaker: active/enabled
  pcsd: active/enabled


大丈夫ですね。

また、クラスター設定の再編集や保存・読み込みが必要な場合には、以下の記事にある方法で実施可能なので、
恐れる必要はありません。
-Pacemakerの設定を編集する(crm configure edit)
-Pacemakerの設定を保存する/読み込む(crm configure save/crm configure load)

Opensourcetech by Takahiro Kujirai