Exadata : Disk Replacement

Operational Activities:

*.Diagnostics & SR Creation

   CellCLI> list celldisk where name='<Cell_Disk>' details

       Disk Status -> Online/Offline  #Both Cases

       Error Count -> more than 0.

   SR Creation

         1. ASR Configure

         2. Manual SR - read Doc ID - 761868.1

Reference :

Sundiag & Other Diagnostics: Oracle Exadata Diagnostic Information required for Disk Failures and some other Hardware issues (Doc ID 761868.1)

*.Drop Faulted Disk

   1.Normal -> Confined offline

          *.Amber LED

          *.Rebalance Initiated

   2.Confined offline -> offline

         *.Blue LED

         *.Ready for Replacement

Reference:

Drop Online Disk: Things to Check in ASM When Replacing an ONLINE disk from Exadata Storage Cell (Doc ID 1326611.1)

*.Disk replacement

    FSE visit and Replacement

Reference:

Replace Procedure: How to Replace a Hard Drive in an Exadata Storage Server (Predictive Failure) (Doc ID 1390836.1)

CRS-5016 CRS-2674 ACFS-00591 ACFS-02037 CRS resource for ACFS

Once Add/Register ACFS filesystem as a Cluster 

srvctl add filesystem -d /dev/asm/sharedvol-64 -g GG_APP -v SHAREDVOL -m /gg_acfs/ggs -u oracle

[root@rac1 bin]# srvctl status filesystem -d /dev/asm/sharedvol-64

ACFS file system is not running

[root@rac1 bin]# srvctl start filesystem -d /dev/asm/sharedvol-64
PRCR-1079 : Failed to start resource ora.gg_app.sharedvol.acfs
CRS-5016: Process "/u01/app/11204/grid/bin/acfssinglefsmount" spawned by agent "/u01/app/11204/grid/bin/orarootagent.bin" for action "start" failed: details at "(:CLSN00010:)" in "/u01/app/11204/grid/log/rac2/agent/crsd/orarootagent_root//orarootagent_root.log"
CRS-5016: Process "/u01/app/11204/grid/bin/acfssinglefsmount" spawned by agent "/u01/app/11204/grid/bin/orarootagent.bin" for action "start" failed: details at "(:CLSN00010:)" in "/u01/app/11204/grid/log/rac1/agent/crsd/orarootagent_root//orarootagent_root.log"
CRS-5016: Process "/sbin/acfsutil" spawned by agent "/u01/app/11204/grid/bin/orarootagent.bin" for action "start" failed: details at "(:CLSN00010:)" in "/u01/app/11204/grid/log/rac2/agent/crsd/orarootagent_root//orarootagent_root.log"
CRS-5016: Process "/sbin/acfsutil" spawned by agent "/u01/app/11204/grid/bin/orarootagent.bin" for action "start" failed: details at "(:CLSN00010:)" in "/u01/app/11204/grid/log/rac1/agent/crsd/orarootagent_root//orarootagent_root.log"
CRS-2674: Start of 'ora.gg_app.sharedvol.acfs' on 'rac2' failed
CRS-2674: Start of 'ora.gg_app.sharedvol.acfs' on 'rac1' failed


# mount.acfs -o all
mount.acfs: ACFS-00591: error found in volume disk header
mount.acfs: ACFS-02037: File system not created on a Linux system. Cannot mount.
found error... so(make acfs)

[root@rac1 bin]# mkfs.acfs -f /dev/asm/sharedvol-64
mkfs.acfs: version                   = 11.2.0.4.0
mkfs.acfs: on-disk version           = 39.0
mkfs.acfs: volume                    = /dev/asm/sharedvol-64
mkfs.acfs: volume size               = 9663676416
mkfs.acfs: Format complete.

[root@rac1 bin]# mount.acfs -o all

[root@rac1 bin]#  acfsutil registry -a -f /dev/asm/sharedvol-64 /gg_acfs/ggs/

[root@rac1 bin]# srvctl start filesystem -d /dev/asm/sharedvol-64

[root@rac1 bin]# srvctl status filesystem -d /dev/asm/sharedvol-64
ACFS file system is running on rac1,rac2

[root@rac1 bin]# df -h /gg_acfs/ggs
Filesystem            Size  Used Avail Use% Mounted on
/dev/asm/sharedvol-64
                      9.0G   95M  9.0G   2% /gg_acfs/ggs