RAC磁盘组添加磁盘

rac diskgroup add disk or drop disk

环境：

SQL> select * from v$version;

BANNER

--------------------------------------------------------------------------------

Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit Production

PL/SQL Release 11.2.0.4.0 - Production

CORE    11.2.0.4.0      Production

TNS for Linux: Version 11.2.0.4.0 - Production

NLSRTL Version 11.2.0.4.0 - Production

SQL> !uname -a

Linux CALLDB2 2.6.32-220.el6.x86_64 #1 SMP Wed Nov 9 08:03:13 EST 2011 x86_64 x86_64 x86_64 GNU/Linux

crsctl stop has

--(all nodes);准备磁盘需停掉RAC

sysasm用户进行操作

--drop disk from existing diskgroup

alter diskgroup dougroup drop disk dougroup_0001;

alter diskgroup dougroup rebalance power 11;

select * from v$asm_operation;

--无结果即完成再平衡

alter diskgroup dougroup check all repair;

--add disk to exitsing diskgroup

alter diskgroup dougroup add  disk '/dev/asm-add';

alter diskgroup dougroup rebalance power 11;

select * from v$asm_operation;

--无结果即完成再平衡

ALTER DISKGROUP dougroup CHECK ALL REPAIR;

附表为详细操作过程

--drop disk from existing diskgroup

col name for a20

col path for a30

SQL> select name,path,state from v$asm_disk order by 1;

NAME                 PATH                           STATE

-------------------- ------------------------------ ----------------

ARCH_0001            /dev/asm-add                   NORMAL

DATA_0000            /dev/asm-data1                 NORMAL

DATA_0001            /dev/asm-data2                 NORMAL

DATA_0002            /dev/asm-data3                 NORMAL

DATA_0003            /dev/asm-arch                  NORMAL

OCR_0000             /dev/asm-ocr1                  NORMAL

OCR_0001             /dev/asm-ocr2                  NORMAL

OCR_0002             /dev/asm-ocr3                  NORMAL

alter diskgroup data drop disk DATA_0003 rebalance power 11 wait

--asm alert

--执行命令节点

Tue Oct 28 08:46:54 2014

ARB0 started with pid=28, OS id=23167

NOTE: assigning ARB0 to group 2/0xd186035 (DATA) with 11 parallel I/Os cellip.ora not found.

NOTE: Attempting voting file refresh on diskgroup DATA

NOTE: Refresh completed on diskgroup DATA. No voting file found.

Tue Oct 28 08:56:30 2014

NOTE: GroupBlock outside rolling migration privileged region

NOTE: requesting all-instance membership refresh for group=2

Tue Oct 28 08:56:35 2014

GMON updating for reconfiguration, group 2 at 22 for pid 33, osid 24868

NOTE: group 2 PST updated.

SUCCESS: grp 2 disk DATA_0003 emptied

NOTE: erasing header on grp 2 disk DATA_0003

NOTE: process _x000_+asm1 (24868) initiating offline of disk 3.3915944149 (DATA_0003) with mask 0x7e in group 2

NOTE: initiating PST update: grp = 2, dsk = 3/0xe96890d5, mask = 0x6a, op = clear

GMON updating disk modes for group 2 at 23 for pid 33, osid 24868

NOTE: PST update grp = 2 completed successfully

NOTE: initiating PST update: grp = 2, dsk = 3/0xe96890d5, mask = 0x7e, op = clear

GMON updating disk modes for group 2 at 24 for pid 33, osid 24868

NOTE: cache closing disk 3 of grp 2: DATA_0003

NOTE: PST update grp = 2 completed successfully

GMON updating for reconfiguration, group 2 at 25 for pid 33, osid 24868

NOTE: cache closing disk 3 of grp 2: (not open) DATA_0003

NOTE: group 2 PST updated.

Tue Oct 28 08:56:35 2014

NOTE: membership refresh pending for group 2/0xd186035 (DATA)

GMON querying group 2 at 26 for pid 18, osid 8046

GMON querying group 2 at 27 for pid 18, osid 8046

NOTE: Disk DATA_0003 in mode 0x0 marked for de-assignment

SUCCESS: refreshed membership for 2/0xd186035 (DATA)

NOTE: stopping process ARB0

SUCCESS: rebalance completed for group 2/0xd186035 (DATA)

NOTE: Attempting voting file refresh on diskgroup DATA

NOTE: Refresh completed on diskgroup DATA. No voting file found.

Tue Oct 28 08:56:39 2014

SUCCESS: alter diskgroup data drop disk DATA_0003 rebalance power 11 wait

--另一节点

Tue Oct 28 08:46:54 2014

GMON querying group 2 at 34 for pid 18, osid 8054

SUCCESS: refreshed membership for 2/0xd185ec1 (DATA)

NOTE: Attempting voting file refresh on diskgroup DATA

NOTE: Refresh completed on diskgroup DATA. No voting file found.

Tue Oct 28 08:56:35 2014

NOTE: cache closing disk 3 of grp 2: DATA_0003

Tue Oct 28 08:56:35 2014

NOTE: membership refresh pending for group 2/0xd185ec1 (DATA)

GMON querying group 2 at 35 for pid 18, osid 8054

GMON querying group 2 at 36 for pid 18, osid 8054

NOTE: Disk DATA_0003 in mode 0x0 marked for de-assignment

SUCCESS: refreshed membership for 2/0xd185ec1 (DATA)

NOTE: Attempting voting file refresh on diskgroup DATA

NOTE: Refresh completed on diskgroup DATA. No voting file found.

select * from  v$asm_operation;

no rows selected

--直到此命令无结果，再平衡成功。

SQL>  select name,path,state from v$asm_disk order by 1;

NAME                 PATH                           STATE

-------------------- ------------------------------ ----------------

ARCH_0001            /dev/asm-add                   NORMAL

DATA_0000            /dev/asm-data1                 NORMAL

DATA_0001            /dev/asm-data2                 NORMAL

DATA_0002            /dev/asm-data3                 NORMAL

OCR_0000             /dev/asm-ocr1                  NORMAL

OCR_0001             /dev/asm-ocr2                  NORMAL

OCR_0002             /dev/asm-ocr3                  NORMAL

                     /dev/asm-arch                  NORMAL

检查磁盘组可用性

SQL> select name,state from v$asm_diskgroup;

NAME                 STATE

-------------------- ----------------------

ARCH                 MOUNTED

DATA                 MOUNTED

OCR                  MOUNTED

至此，从磁盘组中卸载磁盘已经完成。

--add disk to exitsing diskgroup

ALTER DISKGROUP arch add DISK '/dev/asm-arch' rebalance power 11;

--asm alert

--执行命令节点

Tue Oct 28 09:07:13 2014

SQL> ALTER DISKGROUP arch add DISK '/dev/asm-arch' rebalance power 11

NOTE: GroupBlock outside rolling migration privileged region

NOTE: Assigning number (1,0) to disk (/dev/asm-arch)

NOTE: requesting all-instance membership refresh for group=1

NOTE: initializing header on grp 1 disk ARCH_0000

NOTE: requesting all-instance disk validation for group=1

Tue Oct 28 09:07:16 2014

NOTE: skipping rediscovery for group 1/0xd186034 (ARCH) on local instance.

NOTE: requesting all-instance disk validation for group=1

NOTE: skipping rediscovery for group 1/0xd186034 (ARCH) on local instance.

NOTE: initiating PST update: grp = 1

Tue Oct 28 09:07:22 2014

GMON updating group 1 at 28 for pid 27, osid 21726

NOTE: PST update grp = 1 completed successfully

NOTE: membership refresh pending for group 1/0xd186034 (ARCH)

GMON querying group 1 at 29 for pid 18, osid 8046

NOTE: cache opening disk 0 of grp 1: ARCH_0000 path:/dev/asm-arch

Tue Oct 28 09:07:28 2014

NOTE: Attempting voting file refresh on diskgroup ARCH

NOTE: Refresh completed on diskgroup ARCH. No voting file found.

GMON querying group 1 at 30 for pid 18, osid 8046

SUCCESS: refreshed membership for 1/0xd186034 (ARCH)

Tue Oct 28 09:07:28 2014

SUCCESS: ALTER DISKGROUP arch add DISK '/dev/asm-arch' rebalance power 11

NOTE: starting rebalance of group 1/0xd186034 (ARCH) at power 11

Starting background process ARB0

Tue Oct 28 09:07:28 2014

ARB0 started with pid=28, OS id=26830

NOTE: assigning ARB0 to group 1/0xd186034 (ARCH) with 11 parallel I/Os

cellip.ora not found.

NOTE: Attempting voting file refresh on diskgroup ARCH

NOTE: Refresh completed on diskgroup ARCH. No voting file found.

Tue Oct 28 09:10:43 2014

NOTE: GroupBlock outside rolling migration privileged region

NOTE: requesting all-instance membership refresh for group=1

Tue Oct 28 09:10:46 2014

NOTE: membership refresh pending for group 1/0xd186034 (ARCH)

Tue Oct 28 09:10:49 2014

GMON querying group 1 at 31 for pid 18, osid 8046

SUCCESS: refreshed membership for 1/0xd186034 (ARCH)

NOTE: Attempting voting file refresh on diskgroup ARCH

NOTE: Refresh completed on diskgroup ARCH. No voting file found.

Tue Oct 28 09:15:13 2014

NOTE: stopping process ARB0

SUCCESS: rebalance completed for group 1/0xd186034 (ARCH)

--另一个节点

Tue Oct 28 09:07:16 2014

NOTE: disk validation pending for group 1/0xd185ec0 (ARCH)

SUCCESS: validated disks for 1/0xd185ec0 (ARCH)

NOTE: disk validation pending for group 1/0xd185ec0 (ARCH)

NOTE: Assigning number (1,0) to disk (/dev/asm-arch)

SUCCESS: validated disks for 1/0xd185ec0 (ARCH)

NOTE: membership refresh pending for group 1/0xd185ec0 (ARCH)

Tue Oct 28 09:07:25 2014

GMON querying group 1 at 37 for pid 18, osid 8054

NOTE: cache opening disk 0 of grp 1: ARCH_0000 path:/dev/asm-arch

GMON querying group 1 at 38 for pid 18, osid 8054

SUCCESS: refreshed membership for 1/0xd185ec0 (ARCH)

Tue Oct 28 09:07:28 2014

NOTE: Attempting voting file refresh on diskgroup ARCH

NOTE: Refresh completed on diskgroup ARCH. No voting file found.

Tue Oct 28 09:10:46 2014

NOTE: membership refresh pending for group 1/0xd185ec0 (ARCH)

Tue Oct 28 09:10:49 2014

GMON querying group 1 at 39 for pid 18, osid 8054

SUCCESS: refreshed membership for 1/0xd185ec0 (ARCH)

NOTE: Attempting voting file refresh on diskgroup ARCH

NOTE: Refresh completed on diskgroup ARCH. No voting file found.

set line 200

col GROUP_NAME for a20

col name for a15

col path for a20

SQL> select a.group_number,b.name as group_name,a.name,a.path,a.state,a.total_mb,b.state from

  2  v$asm_disk a,v$asm_diskgroup b where a.group_number=b.group_number order by 1;

GROUP_NUMBER GROUP_NAME           NAME            PATH                 STATE              TOTAL_MB STATE

------------ -------------------- --------------- -------------------- ---------------- ---------- ----------------------

           1 ARCH                 ARCH_0001       /dev/asm-add         NORMAL               307200 MOUNTED

           1 ARCH                 ARCH_0000       /dev/asm-arch        NORMAL               307200 MOUNTED

           2 DATA                 DATA_0002       /dev/asm-data3       NORMAL               921600 MOUNTED

           2 DATA                 DATA_0000       /dev/asm-data1       NORMAL               921600 MOUNTED

           2 DATA                 DATA_0001       /dev/asm-data2       NORMAL               921600 MOUNTED

           3 OCR                  OCR_0002        /dev/asm-ocr3        NORMAL                 2048 MOUNTED

           3 OCR                  OCR_0000        /dev/asm-ocr1        NORMAL                 2048 MOUNTED

           3 OCR                  OCR_0001        /dev/asm-ocr2        NORMAL                 2048 MOUNTED

8 rows selected.

SQL> select * from  v$asm_operation;

no rows selected

SQL> ALTER DISKGROUP arch CHECK ALL REPAIR;

Diskgroup altered.

--asm alert

Tue Oct 28 09:24:09 2014

SQL> ALTER DISKGROUP arch CHECK ALL REPAIR

NOTE: starting check of diskgroup ARCH

Tue Oct 28 09:24:13 2014

GMON checking disk 0 for group 1 at 32 for pid 27, osid 21726

GMON checking disk 1 for group 1 at 33 for pid 27, osid 21726

SUCCESS: check of diskgroup ARCH found no errors

SUCCESS: ALTER DISKGROUP arch CHECK ALL REPAIR

至此给磁盘组添加磁盘已完成。

另附加 oracle alert

2014-10-28 08:56:35.365000 +08:00

NOTE: disk 3 (DATA_0003) in group 2 (DATA) is offline for reads

NOTE: disk 3 (DATA_0003) in group 2 (DATA) is offline for writes

SUCCESS: disk DATA_0003 (3.3915944149) dropped from diskgroup DATA

2014-10-28 09:07:25.177000 +08:00

SUCCESS: disk ARCH_0000 (0.3915944151) added to diskgroup ARCH

2014-10-28 08:56:35.383000 +08:00

NOTE: disk 3 (DATA_0003) in group 2 (DATA) is offline for reads

NOTE: disk 3 (DATA_0003) in group 2 (DATA) is offline for writes

SUCCESS: disk DATA_0003 (3.3915951681) dropped from diskgroup DATA

2014-10-28 09:07:25.328000 +08:00

SUCCESS: disk ARCH_0000 (0.3915951683) added to diskgroup ARCH

来自群组: Oracle DBA交流

11g ASM已经很稳定了，10g的时候rebalance有bug，
可能导致无法识别磁盘头