1、 模式简介
Ø 硬件版本：FAS3220 BIOS version:5.2.0
Ø 软件版本：NetApp Release 8.1.2 7-Mode: Tue Oct 30 19:56:51 PDT 2012
Ø 已知有4种模式：
普通模式：fas3220-2a> 正常启动后的模式
高级模式：fas3220-2a*> 普通模式升级权限
维护模式：LOADER-B> 未正常启动系统，业务无法访问。
诊断模式：*> 在维护模式下进入
2、 诊断模式可用命令：help
Ø 维护模式执行Boot_Diags进入诊断模式，诊断模式退出输入halt重启
2.1、退出诊断模式：halt
Ø 单控制器重启，不影响另外的控制器运行。
3、查看当前环境变量：printenv
Ø 进入维护模式后，查看单前环境，booted_from 如果是other ,则执行set-defaults，恢复默认。一直自动进入维护模式的问题很有可能是“BOOTED_FROM”参数设置为“OTHER”导致的
4、维护模式可用命令：help
Ø 系统有故障，重启会自动进入维护模式
5、手动启动系统：boot_ontap
Ø 下面是全部启动过程，中间可以按ctrl+c进入启动菜单，无操作则默认启动
【......忽略部分：这部分会输出日志信息，日志只显示一周，B控制器4月4日2:29重启】
【Tue Apr 4 02:29:45 GMT [fas3220-2b:mgr.boot.reason_ok:notice]: System rebooted.】
6、高级模式可用命令
1、进入高级模式：
fas3220-2a> priv set advanced 或者fas3220-2b> priv set diag
fas3220-2a*>
2、退出高级模式
fas3220-2a*> priv set admin 或者priv set -q
fas3220-2a>
fas3220-2a*> priv ?
Usage: priv
priv set [ -q ] [ <level> ]
priv help
priv -level <level> (DEPRECATED FORM)
Valid privilege levels are
admin administrative commands
advanced potentially dangerous commands that should be
used under guidance from NetApp Global Services;
also includes the admin commands
3、高级模式可用命令
fas3220-2a*> help
/etc/rmt fsecurity nv8 smf
? ftp ontapi smtape
acorn gdb options snap
acpadmin getXXbyYY orouted snaplock
aggr halt panic snapmirror
anvl hammer parityck snapvault
arp help partner snmp
autosupport hostname passwd software
availtime httpstat perf source
backup ic ping sp
blink_off icbulk ping6 spares_zero
blink_on ifconfig pktt spinhi_stats
bmc ifconfig_priv portset spinnp_replay
bootargs ifgrp printflag spinnp_replay_stats
bootfs ifinfo priority stack
bringhome ifstat priv statit
cdpd ifswitch prof stats
cf igroup ps storage
charmap inodepath qtree stsb
cifs iomem quota stty
clone ipsec radius sum32
cna ipspace raid_config sync
com iscsi rastrace sysconfig
config iswt rdate syslog
coredump key_manager rdfile sysstat
ct_dbg_fatal_err_t3 keymgr reallocate system
ct_phy_read kma_stats reboot systemshell
ct_phy_read_t3 kt registry tape_qual
ct_phy_write label restore tcp_client
ct_phy_write_t3 labelmaint restore_backup tcp_server
ct_reg_read led_off result test_lcd
ct_reg_read_t3 led_off_all revert_to time
ct_reg_write led_on rlm timezone
ct_reg_write_t3 led_on_all rm toe
ct_tpi_par led_on_off rmt traceroute
ct_tpi_read led_reset_all route traceroute6
ct_tpi_write led_test route_priv treecompare
cxgbtool led_test_one routed treemigrate
date license rpc_stats ttcp
dbg lock rshkill udp_client
dcb log rshstat udp_server
dd log_fio rsm ups
df logger rtag uptime
disk logout rtfo useradmin
disk_fw_update ls sasadmin vdom
disk_list lun sasstat version
disk_stat mailbox sata vfiler
dns man savecore vif
download maxfiles schedstat vlan
du mbstat scsi vm_stat
dump mem_scrub_stats sectrace vmservices
dumpblock mem_stats secureadmin vol
dumpstack memerr sesdiag vol_db
echo mkfile setflag vscan
ems mt setral vstorage
environ mv setup vtic
environment mviatest sftp waffinity_stats
exit nbtstat sh wafl
export_stats ndmpcopy shelfchk wafl_cmd_restrictions
export_tbl_dump ndmpd show_faults wafl_steal_stats
exportfs ndp showfh wafl_susp
fcadmin netdiag showfh4 wafltop
fcmon netmpstat signal wcc
fcnic netstat sis wrfile
fcp nfs sldiag xttcp
fcstat nfs_hist slist ypcat
file nfsstat sm_mon ypgroup
filersio nis sm_mon_old ypmatch
flexcache nm sm_not ypwhich
fpolicy nv smb_hist
fas3220-2a*>
4、普通模式可用命令
fas3220-2a> help
? fpolicy nis sis
acpadmin fsecurity options smtape
aggr ftp orouted snap
arp halt partner snaplock
autosupport help passwd snapmirror
backup hostname ping snapvault
bmc httpstat ping6 snmp
cdpd ic pktt software
cf ifconfig portset source
charmap ifgrp priority sp
cifs ifstat priv stats
clone igroup qtree storage
config ipsec quota sysconfig
coredump ipspace radius sysstat
date iscsi rdate system
dcb key_manager rdfile timezone
df keymgr reallocate traceroute
disk license reboot traceroute6
disk_fw_update lock restore ups
dns logger restore_backup uptime
download logout revert_to useradmin
du lun rlm version
dump man route vfiler
echo maxfiles routed vlan
ems mt rshstat vmservices
environment nbtstat sasadmin vol
exportfs ndmpcopy sasstat vscan
fcadmin ndmpd savecore wcc
fcnic ndp sectrace wrfile
fcp netdiag secureadmin ypcat
fcstat netstat setup ypgroup
file nfs sftp ypmatch
flexcache nfsstat shelfchk ypwhich
7、维护前检查配置：
7.1、查看日志：rdfile /etc/messages
Ø 日志每隔1小时会统计一次运行时间和性能指标（IOPS每秒的读写次数，）
Ø 一个raid组双盘失效会触发一个24小时后自动重启的任务，此任务每隔1小时记录一次日志。
Ø 硬盘0b.00.0有过报错信息[SN: WD-WCAY01470931]，更换硬盘后恢复正常。
【0b.00.0原归属于B控，故障后，B控出现双盘失效（4月3日2:28），触发重启(4月4日3:00)，0b.00.0更换硬盘（4月3日上午）后归属于A控】
Ø 本次重启发生在2023年4月4日凌晨3点。
Ø B控制器上未发现热备盘
7.2、A控配置sysconfig -r
Ø 1个raid组，11块盘；4个热备盘,一个未zero。
Ø 如果在Spare disks对应的硬盘后面有提示“Not zeroed”出现， 则需要输入命令“disk zero spares” ，这时没有零化的热备盘会开始零化，这可能需要一段时间，可以用“sysconfig –r”命令进行监控。
fas3220-2a*> sysconfig -r
Aggregate aggr0 (online, raid_dp) (block checksums)
Plex /aggr0/plex0 (online, normal, active, pool0)
RAID group /aggr0/plex0/rg0 (normal, block checksums)
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
dparity 0a.00.12 0a 0 12 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
parity 0b.00.13 0b 0 13 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.2 0a 0 2 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0b.00.15 0b 0 15 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.16 0a 0 16 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0b.00.17 0b 0 17 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.18 0a 0 18 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.20 0a 0 20 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0b.00.3 0b 0 3 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.14 0a 0 14 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.22 0a 0 22 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
Pool1 spare disks (empty)
Pool0 spare disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
Spare disks for block checksum
spare 0a.00.0 0a 0 0 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
spare 0b.00.19 0b 0 19 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
spare 0b.00.21 0b 0 21 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
spare 0b.00.23 0b 0 23 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816 (Not zeroed)
Partner disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
partner 0b.00.5 0b 0 5 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.9 0b 0 9 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.10 0a 0 10 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.11 0b 0 11 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.8 0a 0 8 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.7 0b 0 7 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.6 0a 0 6 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.1 0b 0 1 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.4 0a 0 4 SA:A 0 BSAS 7200 0/0 1695759/3472914816
7.3、B控配置sysconfig
fas3220-2b> sysconfig
NetApp Release 8.1.2 7-Mode: Tue Oct 30 19:56:51 PDT 2012
System ID: 2014472760 (fas3220-2b); partner ID: 2013964971 (fas3220-2a)
System Serial Number: 450000003461 (fas3220-2b)
System Rev: B3
System Storage Configuration: Multi-Path HA
System ACP Connectivity: NA
slot 0: System Board
Processors: 4
Processor type: Intel(R) Xeon(R) CPU L5410 @ 2.33GHz
Memory Size: 12288 MB
Memory Attributes: Bank Interleaving
Hoisting
Rank Interleaving
Chipkill ECC
Service Processor Status: Online
slot 0: Dual 10G Ethernet Controller T320E-SFP/KR
c0a MAC Address: 00:a0:98:37:87:7a (auto-unknown-cfg_down)
c0b MAC Address: 00:a0:98:37:87:7b (auto-10g_kr-fd-up)
slot 0: Internal BGE 10/100 Ethernet Controller
e0M MAC Address: 00:a0:98:37:87:7c (auto-unknown-down)
e0P MAC Address: 00:a0:98:37:87:7d (auto-100tx-fd-up)
slot 0: Dual 10/100/1000 Ethernet Controller G20
e0a MAC Address: 00:a0:98:37:87:78 (auto-unknown-down)
e0b MAC Address: 00:a0:98:37:87:79 (auto-unknown-down)
slot 0: SAS Host Adapter 0a
24 Disks: 40691.1GB
1 shelf with IOM6
slot 0: SAS Host Adapter 0b
24 Disks: 40691.1GB
1 shelf with IOM6
slot 0: FC Host Adapter 0c
slot 0: FC Host Adapter 0d
slot 0: Intel ICH USB EHCI Adapter u0a (0xdfe01400)
boot0 Micron Technology Real SSD eUSB 2GB, class 0/0, rev 2.00/11.10, addr 2 1936MB 512B/sect (B8F0022700076747)
slot 1: Quad Gigabit Ethernet Controller 82580
e1a MAC Address: 90:e2:ba:3a:38:20 (auto-1000t-fd-up)
e1b MAC Address: 90:e2:ba:3a:38:21 (auto-1000t-fd-up)
e1c MAC Address: 90:e2:ba:3a:38:22 (auto-1000t-fd-up)
e1d MAC Address: 90:e2:ba:3a:38:23 (auto-1000t-fd-up)
fas3220-2b> sysconfig -r
Aggregate aggr0 (online, raid_dp, degraded) (block checksums)
Plex /aggr0/plex0 (online, normal, active, pool0)
RAID group /aggr0/plex0/rg0 (double degraded, block checksums)
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
dparity FAILED N/A 1695466/ -
parity 0a.00.1 0a 0 1 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.11 0a 0 11 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data FAILED N/A 1695466/ -
data 0b.00.4 0b 0 4 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.5 0a 0 5 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0b.00.6 0b 0 6 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.7 0a 0 7 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0b.00.8 0b 0 8 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.9 0a 0 9 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0b.00.10 0b 0 10 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
Pool1 spare disks (empty)
Pool0 spare disks (empty)
Partner disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
partner 0a.00.23 0a 0 23 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.19 0a 0 19 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.18 0b 0 18 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.12 0b 0 12 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.2 0b 0 2 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.21 0a 0 21 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.22 0b 0 22 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.15 0a 0 15 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.14 0b 0 14 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.17 0a 0 17 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.16 0b 0 16 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.3 0a 0 3 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.0 0b 0 0 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.13 0a 0 13 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.20 0b 0 20 SA:A 0 BSAS 7200 0/0 1695759/3472914816
7.4、B控配置sysconfig -r
Ø 1个raid组，显示10块盘，2个failed；0个热备盘。
fas3220-2b*> sysconfig -r
Aggregate aggr0 (online, raid_dp, degraded) (block checksums)
Plex /aggr0/plex0 (online, normal, active, pool0)
RAID group /aggr0/plex0/rg0 (double degraded, block checksums)
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
dparity FAILED N/A 1695466/ -
parity 0a.00.1 0a 0 1 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.11 0a 0 11 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data FAILED N/A 1695466/ -
data 0b.00.4 0b 0 4 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.5 0a 0 5 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0b.00.6 0b 0 6 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.7 0a 0 7 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0b.00.8 0b 0 8 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.9 0a 0 9 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0b.00.10 0b 0 10 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
Pool1 spare disks (empty)
Pool0 spare disks (empty)
Partner disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
partner 0a.00.23 0a 0 23 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.19 0a 0 19 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.18 0b 0 18 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.12 0b 0 12 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.2 0b 0 2 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.21 0a 0 21 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.22 0b 0 22 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.15 0a 0 15 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.14 0b 0 14 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.17 0a 0 17 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.16 0b 0 16 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.3 0a 0 3 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.0 0b 0 0 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.13 0a 0 13 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.20 0b 0 20 SA:A 0 BSAS 7200 0/0 1695759/3472914816
7.5、B控disk show
Ø 两个控制器的Disk show 输出结果相同。
Ø 总共24块硬盘，归属A控制器15块，归属B控制器9块。
fas3220-2b> disk show
DISK OWNER POOL SERIAL NUMBER HOME
------------ ------------- ----- ------------- -------------
0b.00.14 fas3220-2a(2013964971) Pool0 Z1P39VHM fas3220-2a(2013964971)
0b.00.2 fas3220-2a(2013964971) Pool0 WD-WCC1P1303107 fas3220-2a(2013964971)
0b.00.0 fas3220-2a(2013964971) Pool0 P5HW6THV fas3220-2a(2013964971)
0b.00.16 fas3220-2a(2013964971) Pool0 WD-WCAY01505850 fas3220-2a(2013964971)
0b.00.12 fas3220-2a(2013964971) Pool0 WD-WCAY01469356 fas3220-2a(2013964971)
0b.00.20 fas3220-2a(2013964971) Pool0 Z1P4P0K3 fas3220-2a(2013964971)
0a.00.15 fas3220-2a(2013964971) Pool0 WD-WCAY01462693 fas3220-2a(2013964971)
0a.00.13 fas3220-2a(2013964971) Pool0 WD-WCAY01468243 fas3220-2a(2013964971)
0a.00.21 fas3220-2a(2013964971) Pool0 WD-WMAY02916902 fas3220-2a(2013964971)
0b.00.22 fas3220-2a(2013964971) Pool0 WD-WCAY01477233 fas3220-2a(2013964971)
0a.00.17 fas3220-2a(2013964971) Pool0 WD-WCAY01470262 fas3220-2a(2013964971)
0b.00.18 fas3220-2a(2013964971) Pool0 WD-WCAY01470956 fas3220-2a(2013964971)
0a.00.23 fas3220-2a(2013964971) Pool0 Z1P0LFGT fas3220-2a(2013964971)
0a.00.3 fas3220-2a(2013964971) Pool0 B8K1AT6Z fas3220-2a(2013964971)
0a.00.19 fas3220-2a(2013964971) Pool0 YFHPRKEC fas3220-2a(2013964971)
0a.00.7 fas3220-2b(2014472760) Pool0 WD-WCAY01471777 fas3220-2b(2014472760)
0b.00.4 fas3220-2b(2014472760) Pool0 WD-WCAY01505873 fas3220-2b(2014472760)
0a.00.9 fas3220-2b(2014472760) Pool0 WD-WCAY01467254 fas3220-2b(2014472760)
0b.00.10 fas3220-2b(2014472760) Pool0 WD-WCAY01471721 fas3220-2b(2014472760)
0b.00.6 fas3220-2b(2014472760) Pool0 WD-WCAY01467898 fas3220-2b(2014472760)
0a.00.11 fas3220-2b(2014472760) Pool0 WD-WCAY01467350 fas3220-2b(2014472760)
0a.00.5 fas3220-2b(2014472760) Pool0 WD-WCAY01477231 fas3220-2b(2014472760)
0b.00.8 fas3220-2b(2014472760) Pool0 WD-WCAY01497626 fas3220-2b(2014472760)
0a.00.1 fas3220-2b(2014472760) Pool0 WD-WCAY01475091 fas3220-2b(2014472760)
7.6、B控aggr status
fas3220-2b*> aggr status
Aggr State Status Options
aggr0 online raid_dp, aggr root
degraded
64-bit
7.6.1、aggr options
fas3220-2b*> aggr options ?
aggr options: Invalid aggregate name ?.
usage:
aggr options <aggr-name> <option-name> <option-val>
The following commands are available; for more information
type "aggr help options <command>"
free_space_realloc max_write_alloc_blocks raid_lost_write root
fs_size_fixed metadata_checking raid_zoned snapmirrored
ha_policy nosnap raidsize snapshot_autodelete
hybrid_enabled percent_snapshot_space raidtype thorough_scrub
lost_write_protect raid_cv resyncsnaptime
7.6.2、aggr show_space
fas3220-2b*> aggr show_space
Aggregate 'aggr0'
Total space WAFL reserve Snap reserve Usable space BSR NVLOG A-SIS Smtape
15625232640KB 1562523264KB 0KB 14062709376KB 0KB 0KB 0KB
Space allocated to volumes in the aggregate
Volume Allocated Used Guarantee
vol0 427660900KB 7312256KB volume
vol1 13529336892KB 8082854496KB volume
Aggregate Allocated Used Avail
Total space 13956997792KB 8090166752KB 0KB
Snap reserve 0KB 281257676KB 0KB
WAFL reserve 1562523264KB 187958632KB 1374564632KB
7.6.3、aggr可选参数
fas3220-2b*> aggr ?
The following commands are available; for more information
type "aggr help <command>"
64bit-upgrade media_scrub recons show_space
add migrate release_mirror_snap split
block_check mirror rename status
clear_rpbits offline reserve undestroy
copy online restrict verify
create options rewrite_fsid volcount
destroy read_fsid scrub wafliron
7.7、B控system health status show
fas3220-2b*> system health status show
Status
---------------
OK
7.8、B控uptime
fas3220-2b*> uptime
10:54pm up 1:15 0 NFS ops, 6345777 CIFS ops, 0 HTTP ops, 0 FCP ops, 0 iSCSI ops
7.9、disk_list
Ø Disk_list、disk show 两个控制器输出结果相同
fas3220-2a*> disk_list
DISK CHAN VENDOR PRODUCT ID REV SERIAL# HW (BLOCKS BPS) DQ
------------ ----- -------- ---------------- ---- -------------------- -- -------------- --
0a.00.2 SA:A NETAPP X306_WKOJN02TSSM NA00 WD-WCC1P1303107 ff 3907029168 512 N
0a.00.0 SA:A NETAPP X306_HMRKP02TSSM NA00 P5HW6THV ff 3907029168 512 N
0a.00.4 SA:A NETAPP X306_WMANT02TSSM NA08 WD-WCAY01505873 ff 3907029168 512 N
0b.00.3 SA:B NETAPP X306_HJUPI02TSSM NA06 B8K1AT6Z ff 3907029168 512 N
0a.00.6 SA:A NETAPP X306_WMANT02TSSM NA08 WD-WCAY01467898 ff 3907029168 512 N
0b.00.7 SA:B NETAPP X306_WMANT02TSSM NA08 WD-WCAY01471777 ff 3907029168 512 N
0b.00.1 SA:B NETAPP X306_WMANT02TSSM NA08 WD-WCAY01475091 ff 3907029168 512 N
0a.00.8 SA:A NETAPP X306_WMANT02TSSM NA08 WD-WCAY01497626 ff 3907029168 512 N
0b.00.9 SA:B NETAPP X306_WMANT02TSSM NA08 WD-WCAY01467254 ff 3907029168 512 N
0a.00.10 SA:A NETAPP X306_WMANT02TSSM NA08 WD-WCAY01471721 ff 3907029168 512 N
0b.00.11 SA:B NETAPP X306_WMANT02TSSM NA08 WD-WCAY01467350 ff 3907029168 512 N
0a.00.18 SA:A NETAPP X306_WMANT02TSSM NA08 WD-WCAY01470956 ff 3907029168 512 N
0b.00.13 SA:B NETAPP X306_WMANT02TSSM NA08 WD-WCAY01468243 ff 3907029168 512 N
0b.00.15 SA:B NETAPP X306_WMANT02TSSM NA08 WD-WCAY01462693 ff 3907029168 512 N
0b.00.5 SA:B NETAPP X306_WMANT02TSSM NA08 WD-WCAY01477231 ff 3907029168 512 N
0a.00.16 SA:A NETAPP X306_WMANT02TSSM NA08 WD-WCAY01505850 ff 3907029168 512 N
0a.00.14 SA:A NETAPP X306_SMSKP02TSSM NA03 Z1P39VHM ff 3907029168 512 N
0b.00.17 SA:B NETAPP X306_WMANT02TSSM NA08 WD-WCAY01470262 ff 3907029168 512 N
0a.00.12 SA:A NETAPP X306_WMANT02TSSM NA08 WD-WCAY01469356 ff 3907029168 512 N
0b.00.23 SA:B NETAPP X306_SMSKP02TSSM NA03 Z1P0LFGT ff 3907029168 512 N
0b.00.21 SA:B NETAPP X306_WMANT02TSSM NA08 WD-WMAY02916902 ff 3907029168 512 N
0a.00.22 SA:A NETAPP X306_WMANT02TSSM NA08 WD-WCAY01477233 ff 3907029168 512 N
0a.00.20 SA:A NETAPP X306_SMSKP02TSSA NA00 Z1P4P0K3 ff 3907029168 512 N
0b.00.19 SA:B NETAPP X306_HMARK02TSSA NA02 YFHPRKEC ff 3907029168 512 N
7.10、fas3220-2a> vol status
fas3220-2a> vol status
Volume State Status Options
vol0 online raid_dp, flex root, create_ucode=on
64-bit
vol1 online raid_dp, flex nosnap=on, create_ucode=on
64-bit
8、维护操作
8.1、A控制器zero spares
fas3220-2a> disk zero spares
fas3220-2a>
8.2、A控移除一块热备
Ø 先在A控移除热备，然后指定到B控。（需要高级模式下进行）
fas3220-2a*> disk remove_ownership 0b.00.21
Disk 0b.00.21 will have its ownership removed
Note: Disks may be automatically assigned to this node, since option disk.auto_assign is on.
Volumes must be taken offline. Are all impacted volumes offline(y/n)?? y
fas3220-2a*> sysconfig -r
Aggregate aggr0 (online, raid_dp) (block checksums)
Plex /aggr0/plex0 (online, normal, active, pool0)
RAID group /aggr0/plex0/rg0 (normal, block checksums)
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
dparity 0a.00.12 0a 0 12 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
parity 0b.00.13 0b 0 13 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.2 0a 0 2 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0b.00.15 0b 0 15 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.16 0a 0 16 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0b.00.17 0b 0 17 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.18 0a 0 18 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.20 0a 0 20 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0b.00.3 0b 0 3 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.14 0a 0 14 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.22 0a 0 22 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
Pool1 spare disks (empty)
Pool0 spare disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
Spare disks for block checksum
spare 0a.00.0 0a 0 0 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
spare 0b.00.19 0b 0 19 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
spare 0b.00.23 0b 0 23 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816 (zeroing, 24% done)
Partner disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
partner 0b.00.5 0b 0 5 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.9 0b 0 9 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.10 0a 0 10 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.11 0b 0 11 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.8 0a 0 8 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.7 0b 0 7 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.6 0a 0 6 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.1 0b 0 1 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.4 0a 0 4 SA:A 0 BSAS 7200 0/0 1695759/3472914816
fas3220-2a*> Mon Apr 10 23:35:09 CST [fas3220-2a:diskown.AutoAssign.MultipleOwners:warning]: Automatic assigning failed for disk 0b.00.21 (S/N WD-WMAY02916902) because the disks on the loop are owned by multiple systems. Automatic assigning failed for all unowned disks on this loop.
8.3、A控指定热备盘到B控0b.00.21
Ø 0b.00.21当前归属于A控制器，只能在A控制器上操作。
Ø 热备盘到B控制器后，自动重建failed磁盘。
fas3220-2a*> disk assign 0b.00.21 -o fas3220-2b
fas3220-2a*> Mon Apr 10 23:36:29 CST [fas3220-2a:diskown.changingOwner:info]: changing ownership for disk 0b.00.21 (S/N WD-WMAY02916902) from unowned (ID 4294967295) to fas3220-2b (ID 2014472760)
====
fas3220-2b*> sysconfig -r
Aggregate aggr0 (online, raid_dp, reconstruct, degraded) (block checksums)
Plex /aggr0/plex0 (online, normal, active, pool0)
RAID group /aggr0/plex0/rg0 (reconstruction 0% completed, block checksums)
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
dparity FAILED N/A 1695466/ -
parity 0a.00.1 0a 0 1 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.11 0a 0 11 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.21 0a 0 21 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816 (reconstruction 0% completed)
data 0b.00.4 0b 0 4 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.5 0a 0 5 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0b.00.6 0b 0 6 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.7 0a 0 7 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0b.00.8 0b 0 8 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.9 0a 0 9 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0b.00.10 0b 0 10 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
Pool1 spare disks (empty)
Pool0 spare disks (empty)
Partner disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
partner 0a.00.23 0a 0 23 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.19 0a 0 19 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.18 0b 0 18 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.12 0b 0 12 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.2 0b 0 2 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.22 0b 0 22 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.15 0a 0 15 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.14 0b 0 14 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.17 0a 0 17 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.16 0b 0 16 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.3 0a 0 3 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.0 0b 0 0 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.13 0a 0 13 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.20 0b 0 20 SA:A 0 BSAS 7200 0/0 1695759/3472914816
8.3.1、disk assign可用选项
fas3220-2a> disk assign ?
disk assign {<disk_name> | all | [-T <storage type> | -shelf <shelf name>] [-n <count>] | auto} [-p <pool>] [-o <ownername>] [-s <sysid>] [-c block|zoned] [-f] - assign a disk to a filer or all unowned disks by specifying "all" or <count> number of unowned disks
fas3220-2a> disk assign 0b.00.21 -o fas3220-2b
disk 0b.00.21 (S/N WD-WMAY02916902) is already owned by system fas3220-2a (ID 2013964971).
disk assign: Assign failed for one or more disks in the disk list.
fas3220-2a> disk ?
usage: disk <options>
Options are:
assign {<disk_name> | all | [-T <storage type> | -shelf <shelf name>] [-n <count>] | auto} [-p <pool>] [-o <ownername>] [-s <sysid>] [-c block|zoned] [-f] - assign a disk to a filer or all unowned disks by specifying "all" or <count> number of unowned disks
encrypt { lock | rekey | destroy | sanitize | show } - perform tasks specific to self-encrypting disks
fail [-i] [-f] <disk_name> - fail a file system disk
maint { start | abort | status | list} - run maintenance tests on one or more disks
remove [-w] <disk_name> - remove a spare disk
replace {start [-f] [-m] <disk_name> <spare_disk_name>} | {stop <disk_name>} - replace a file system disk with a spare disk or stop replacing
sanitize { start | abort | status | release } - sanitize one or more disks
scrub { start | stop } - start or stop disk scrubbing
show [-o <ownername> | -s <sysid> | -n | -v | -a] - lists disks and owners
simpull <disk_name1> [<disk_name2> [<disk_name3> ... ]] - simulate one or more disk pulls
simpush [<sim_disk_path_name1> [<sim_disk_path_name2> [<sim_disk_path_name3> ...]] | -l] - simulate one or more disk pushes or list available disks to push
zero spares - Zero all spare disks
8.4、A控指定热备盘到B控
fas3220-2a*> disk remove_ownership 0b.00.19
Disk 0b.00.19 will have its ownership removed
Note: Disks may be automatically assigned to this node, since option disk.auto_assign is on.
Volumes must be taken offline. Are all impacted volumes offline(y/n)?? y
fas3220-2a*> disk assign 0b.00.19 -o fas3220-2b
Mon Apr 10 23:38:04 CST [fas3220-2a:diskown.changingOwner:info]: changing ownership for disk 0b.00.19 (S/N YFHPRKEC) from unowned (ID 4294967295) to fas3220-2b (ID 2014472760)
8.5、热备重新分配后disk show
Ø 热备盘重新分配后，B控11块盘，A控13块盘
fas3220-2a*> disk show
DISK OWNER POOL SERIAL NUMBER HOME
------------ ------------- ----- ------------- -------------
0a.00.4 fas3220-2b(2014472760) Pool0 WD-WCAY01505873 fas3220-2b(2014472760)
0a.00.6 fas3220-2b(2014472760) Pool0 WD-WCAY01467898 fas3220-2b(2014472760)
0a.00.10 fas3220-2b(2014472760) Pool0 WD-WCAY01471721 fas3220-2b(2014472760)
0b.00.1 fas3220-2b(2014472760) Pool0 WD-WCAY01475091 fas3220-2b(2014472760)
0b.00.5 fas3220-2b(2014472760) Pool0 WD-WCAY01477231 fas3220-2b(2014472760)
0b.00.7 fas3220-2b(2014472760) Pool0 WD-WCAY01471777 fas3220-2b(2014472760)
0a.00.8 fas3220-2b(2014472760) Pool0 WD-WCAY01497626 fas3220-2b(2014472760)
0b.00.9 fas3220-2b(2014472760) Pool0 WD-WCAY01467254 fas3220-2b(2014472760)
0b.00.11 fas3220-2b(2014472760) Pool0 WD-WCAY01467350 fas3220-2b(2014472760)
0b.00.19 fas3220-2b(2014472760) Pool0 YFHPRKEC fas3220-2b(2014472760)
0a.00.20 fas3220-2a(2013964971) Pool0 Z1P4P0K3 fas3220-2a(2013964971)
0a.00.14 fas3220-2a(2013964971) Pool0 Z1P39VHM fas3220-2a(2013964971)
0a.00.2 fas3220-2a(2013964971) Pool0 WD-WCC1P1303107 fas3220-2a(2013964971)
0b.00.13 fas3220-2a(2013964971) Pool0 WD-WCAY01468243 fas3220-2a(2013964971)
0a.00.0 fas3220-2a(2013964971) Pool0 P5HW6THV fas3220-2a(2013964971)
0a.00.16 fas3220-2a(2013964971) Pool0 WD-WCAY01505850 fas3220-2a(2013964971)
0a.00.22 fas3220-2a(2013964971) Pool0 WD-WCAY01477233 fas3220-2a(2013964971)
0b.00.3 fas3220-2a(2013964971) Pool0 B8K1AT6Z fas3220-2a(2013964971)
0b.00.21 fas3220-2b(2014472760) Pool0 WD-WMAY02916902 fas3220-2b(2014472760)
0a.00.12 fas3220-2a(2013964971) Pool0 WD-WCAY01469356 fas3220-2a(2013964971)
0b.00.23 fas3220-2a(2013964971) Pool0 Z1P0LFGT fas3220-2a(2013964971)
0a.00.18 fas3220-2a(2013964971) Pool0 WD-WCAY01470956 fas3220-2a(2013964971)
0b.00.17 fas3220-2a(2013964971) Pool0 WD-WCAY01470262 fas3220-2a(2013964971)
0b.00.15 fas3220-2a(2013964971) Pool0 WD-WCAY01462693 fas3220-2a(2013964971)
8.6、A控sysconfig -r
fas3220-2a*> sysconfig -r
Aggregate aggr0 (online, raid_dp) (block checksums)
Plex /aggr0/plex0 (online, normal, active, pool0)
RAID group /aggr0/plex0/rg0 (normal, block checksums)
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
dparity 0a.00.12 0a 0 12 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
parity 0b.00.13 0b 0 13 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.2 0a 0 2 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0b.00.15 0b 0 15 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.16 0a 0 16 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0b.00.17 0b 0 17 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.18 0a 0 18 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.20 0a 0 20 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0b.00.3 0b 0 3 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.14 0a 0 14 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.22 0a 0 22 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
Pool1 spare disks (empty)
Pool0 spare disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
Spare disks for block checksum
spare 0a.00.0 0a 0 0 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
spare 0b.00.23 0b 0 23 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816 (zeroing, 25% done)
Partner disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
partner 0b.00.19 0b 0 19 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
partner 0b.00.21 0b 0 21 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
partner 0b.00.5 0b 0 5 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.9 0b 0 9 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.10 0a 0 10 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.11 0b 0 11 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.8 0a 0 8 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.7 0b 0 7 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.6 0a 0 6 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.1 0b 0 1 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.4 0a 0 4 SA:A 0 BSAS 7200 0/0 1695759/3472914816
8.7、B控sysconfig -r
fas3220-2b*> sysconfig -r
Aggregate aggr0 (online, raid_dp, reconstruct) (block checksums)
Plex /aggr0/plex0 (online, normal, active, pool0)
RAID group /aggr0/plex0/rg0 (double reconstruction 0% completed, block checksums)
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
dparity 0a.00.19 0a 0 19 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816 (reconstruction 0% completed)
parity 0a.00.1 0a 0 1 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.11 0a 0 11 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.21 0a 0 21 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816 (reconstruction 0% completed)
data 0b.00.4 0b 0 4 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.5 0a 0 5 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0b.00.6 0b 0 6 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.7 0a 0 7 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0b.00.8 0b 0 8 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.9 0a 0 9 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0b.00.10 0b 0 10 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
Pool1 spare disks (empty)
Pool0 spare disks (empty)
Partner disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
partner 0a.00.23 0a 0 23 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.18 0b 0 18 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.12 0b 0 12 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.2 0b 0 2 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.22 0b 0 22 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.15 0a 0 15 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.14 0b 0 14 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.17 0a 0 17 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.16 0b 0 16 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.3 0a 0 3 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.0 0b 0 0 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.13 0a 0 13 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.20 0b 0 20 SA:A 0 BSAS 7200 0/0 1695759/3472914816
9、检查操作
9.1、A控隔天检查zero
Ø 2TB磁盘zeroing 大约用时5.5h
fas3220-2a> sysconfig -r
Aggregate aggr0 (online, raid_dp) (block checksums)
Plex /aggr0/plex0 (online, normal, active, pool0)
RAID group /aggr0/plex0/rg0 (normal, block checksums)
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
dparity 0a.00.12 0a 0 12 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
parity 0b.00.13 0b 0 13 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.2 0a 0 2 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0b.00.15 0b 0 15 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.16 0a 0 16 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0b.00.17 0b 0 17 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.18 0a 0 18 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.20 0a 0 20 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0b.00.3 0b 0 3 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.14 0a 0 14 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.22 0a 0 22 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
Pool1 spare disks (empty)
Pool0 spare disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
Spare disks for block checksum
spare 0a.00.0 0a 0 0 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
spare 0b.00.23 0b 0 23 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
Partner disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
partner 0b.00.19 0b 0 19 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
partner 0b.00.21 0b 0 21 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
partner 0b.00.5 0b 0 5 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.9 0b 0 9 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.10 0a 0 10 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.11 0b 0 11 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.8 0a 0 8 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.7 0b 0 7 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.6 0a 0 6 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.1 0b 0 1 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.4 0a 0 4 SA:A 0 BSAS 7200 0/0 1695759/3472914816
9.2、A控隔天检查日志rdfile /etc/meaassages
fas3220-2a> rdfile /etc/meaassages
Sun Apr 9 00:30:34 CST [fas3220-2a:kern.log.rotate:notice]: System fas3220-2a (ID 2013964971) is running 8.1.2
Sun Apr 9 00:43:29 CST [fas3220-2a:cf.hwassist.localMonitor:warning]: hw_assist: hw_assist functionality is inactive.
Sun Apr 9 01:00:00 CST [fas3220-2a:kern.uptime.filer:info]: 1:00am up 4 days, 16:20 0 NFS ops, 6077601416 CIFS ops, 0 HTTP ops, 0 FCP ops, 0 iSCSI ops
Mon Apr 10 22:07:20 CST [fas3220-2a: console_login_mgr:info]: root logged in from console
Mon Apr 10 22:10:20 CST [fas3220-2a:raid.label.io.writeError:error]: Label write on Disk 0b.00.23 Shelf 0 Bay 23 [NETAPP X306_SMSKP02TSSM NA03] S/N [Z1P0LFGT] failed with storage error Internal error: raid label commit failed. The system will stop using the disk for I/O operations.
Mon Apr 10 22:10:20 CST [fas3220-2a:raid.config.spare.disk.not.responding:error]: Spare Disk 0b.00.23 Shelf 0 Bay 23 [NETAPP X306_SMSKP02TSSM NA03] S/N [Z1P0LFGT] is not responding.
Mon Apr 10 22:10:20 CST [fas3220-2a:callhome.sdsk.noio:error]: Call home for SPARE DISK NOT RESPONDING
Mon Apr 10 22:10:20 CST [fas3220-2a:disk.failmsg:error]: Disk 0b.00.23 (Z1P0LFGT): non-persistent message received.
Mon Apr 10 22:10:21 CST [fas3220-2a:diskown.errorReadingOwnership:warning]: error 23 (adapter error prevents command from being sent to device) while reading ownership on disk 0b.00.23 (S/N Z1P0LFGT)
Mon Apr 10 22:10:21 CST [fas3220-2a:diskown.errorDuringIO:error]: error 23 (adapter error prevents command from being sent to device) on disk 0b.00.23 (S/N Z1P0LFGT) while reading individual disk ownership area
Mon Apr 10 22:11:00 CST [fas3220-2a:monitor.globalStatus.nonCritical:warning]: Disk on adapter 0b, shelf 0, bay 23, failed.
Mon Apr 10 22:16:23 CST [fas3220-2a:callhome.sfo.miscount:CRITICAL]: Call home for HA GROUP ERROR: DISK/SHELF COUNT MISMATCH
Mon Apr 10 22:33:39 CST [fas3220-2a:raid.disk.unfail.done:info]: Disk 0b.00.23 Shelf 0 Bay 23 [NETAPP X306_SMSKP02TSSM NA03] S/N [Z1P0LFGT] unfailed, and is now a spare
Mon Apr 10 22:34:00 CST [fas3220-2a:monitor.globalStatus.ok:info]: The system's global status is normal.
Mon Apr 10 22:34:23 CST [fas3220-2a:cf.disk.inventory.mismatchOK:info]: The node (fas3220-2a) included the disk 0b.00.23 (500605BA:0086B634:00000000:00000000:00000000:00000000:00000000:00000000:00000000:00000000) in its inventory.
Mon Apr 10 22:41:25 CST [fas3220-2a: console_login_mgr:info]: root logged in from console
Mon Apr 10 23:00:00 CST [fas3220-2a:kern.uptime.filer:info]: 11:00pm up 6 days, 14:20 0 NFS ops, 8519297597 CIFS ops, 0 HTTP ops, 0 FCP ops, 0 iSCSI ops
Mon Apr 10 23:04:55 CST [fas3220-2a:asup.post.drop:error]: AutoSupport message (HA Group Notification from fas3220-2a (SPARE DISK NOT RESPONDING) WARNING) for host (0) was not posted to NetApp. The system will drop the message.
Mon Apr 10 23:35:09 CST [fas3220-2a:diskown.AutoAssign.MultipleOwners:warning]: Automatic assigning failed for disk 0b.00.21 (S/N WD-WMAY02916902) because the disks on the loop are owned by multiple systems. Automatic assigning failed for all unowned disks on this loop.
Mon Apr 10 23:36:29 CST [fas3220-2a:diskown.changingOwner:info]: changing ownership for disk 0b.00.21 (S/N WD-WMAY02916902) from unowned (ID 4294967295) to fas3220-2b (ID 2014472760)
Mon Apr 10 23:38:04 CST [fas3220-2a:diskown.changingOwner:info]: changing ownership for disk 0b.00.19 (S/N YFHPRKEC) from unowned (ID 4294967295) to fas3220-2b (ID 2014472760)
Tue Apr 11 00:00:00 CST [fas3220-2a:kern.uptime.filer:info]: 12:00am up 6 days, 15:20 0 NFS ops, 8575692117 CIFS ops, 0 HTTP ops, 0 FCP ops, 0 iSCSI ops
Tue Apr 11 03:50:05 CST [fas3220-2a:raid.disk.zero.done:notice]: Disk 0b.00.23 Shelf 0 Bay 23 [NETAPP X306_SMSKP02TSSM NA03] S/N [Z1P0LFGT] : disk zeroing complete
9.3、B控隔天检查sysconfig -r
Ø 单块盘重建预计2h, 两块盘同时重建实际花费10h,两块几乎同时完成。
fas3220-2b> sysconfig -r
Aggregate aggr0 (online, raid_dp) (block checksums)
Plex /aggr0/plex0 (online, normal, active, pool0)
RAID group /aggr0/plex0/rg0 (scrubbing 42% completed, block checksums)
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
dparity 0a.00.19 0a 0 19 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
parity 0a.00.1 0a 0 1 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.11 0a 0 11 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.21 0a 0 21 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0b.00.4 0b 0 4 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.5 0a 0 5 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0b.00.6 0b 0 6 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.7 0a 0 7 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0b.00.8 0b 0 8 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.9 0a 0 9 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0b.00.10 0b 0 10 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
Pool1 spare disks (empty)
Pool0 spare disks (empty)
Partner disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
partner 0a.00.23 0a 0 23 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.18 0b 0 18 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.12 0b 0 12 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.2 0b 0 2 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.22 0b 0 22 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.15 0a 0 15 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.14 0b 0 14 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.17 0a 0 17 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.16 0b 0 16 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.3 0a 0 3 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.0 0b 0 0 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.13 0a 0 13 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.20 0b 0 20 SA:A 0 BSAS 7200 0/0 1695759/3472914816
9.4、B控隔天检查日志
fas3220-2b> rdfile /etc/meaasges
Mon Apr 10 21:50:14 CST [fas3220-2b:callhome.weekly:info]: Call home for WEEKLY_LOG
Mon Apr 10 21:50:15 CST [fas3220-2b:kern.log.rotate:notice]: System fas3220-2b (ID 2014472760) is running 8.1.2
Mon Apr 10 22:00:00 CST [fas3220-2b:kern.uptime.filer:info]: 10:00pm up 20 mins, 0 NFS ops, 1358595 CIFS ops, 0 HTTP ops, 0 FCP ops, 0 iSCSI ops
Mon Apr 10 22:00:00 CST [fas3220-2b:monitor.shutdown.brokenDisk.pending:warning]: the dparity disk and a data disk in RAID group /aggr0/plex0/rg0 are broken. Halting system in 24 hours.
Mon Apr 10 23:00:00 CST [fas3220-2b:monitor.shutdown.brokenDisk.pending:warning]: the dparity disk and a data disk in RAID group /aggr0/plex0/rg0 are broken. Halting system in 23 hours.
Mon Apr 10 23:29:22 CST [fas3220-2b:diskown.AutoAssign.MultipleOwners:warning]: Automatic assigning failed for disk 0a.00.21 (S/N WD-WMAY02916902) because the disks on the loop are owned by multiple systems. Automatic assigning failed for all unowned disks on this loop.
Mon Apr 10 23:30:32 CST [fas3220-2b:raid.rg.recons.missing:notice]: RAID group /aggr0/plex0/rg0 is missing 2 disk(s).
Mon Apr 10 23:30:32 CST [fas3220-2b:raid.rg.recons.info:notice]: Spare disk 0a.00.21 will be used to reconstruct one missing disk in RAID group /aggr0/plex0/rg0.
Mon Apr 10 23:30:32 CST [fas3220-2b:raid.rg.recons.missing:notice]: RAID group /aggr0/plex0/rg0 is missing 1 disk(s).
Mon Apr 10 23:30:32 CST [fas3220-2b:raid.rg.recons.cantStart:warning]: The reconstruction cannot start in RAID group /aggr0/plex0/rg0: No matching disks available in spare pool, targeting any spare pool
Mon Apr 10 23:30:32 CST [fas3220-2b:raid.rg.recons.start:notice]: /aggr0/plex0/rg0: starting reconstruction, using disk 0a.00.21
Mon Apr 10 23:32:07 CST [fas3220-2b:raid.rg.recons.missing:notice]: RAID group /aggr0/plex0/rg0 is missing 1 disk(s).
Mon Apr 10 23:32:07 CST [fas3220-2b:raid.rg.recons.info:notice]: Spare disk 0a.00.19 will be used to reconstruct one missing disk in RAID group /aggr0/plex0/rg0.
Mon Apr 10 23:32:07 CST [fas3220-2b:raid.rg.recons.aborted:debug]: /aggr0/plex0/rg0: reconstruction aborted at disk block 974080 after 1:34.43
Mon Apr 10 23:32:07 CST [fas3220-2b:raid.rg.recons.resume:debug]: /aggr0/plex0/rg0: resuming reconstruction, using disk 0a.00.21 (block 974080, 0% complete)
Mon Apr 10 23:32:07 CST [fas3220-2b:raid.rg.drecons:notice]: /aggr0/plex0/rg0: starting double reconstruction, using disks 0a.00.21 and 0a.00.19
Mon Apr 10 23:32:07 CST [fas3220-2b:fmmb.lock.disk.remove:info]: Disk 0a.00.11 removed from local mailbox set.
Mon Apr 10 23:32:07 CST [fas3220-2b:fmmb.current.lock.disk:info]: Disk 0a.00.1 is a local HA mailbox disk.
Mon Apr 10 23:32:07 CST [fas3220-2b:fmmb.current.lock.disk:info]: Disk 0a.00.19 is a local HA mailbox disk.
Mon Apr 10 23:41:56 CST [fas3220-2b:openssh.versionExchange.Fail:error]: Did not receive identification string from 10.0.206.168.
Tue Apr 11 00:00:00 CST [fas3220-2b:kern.uptime.filer:info]: 12:00am up 2:20 0 NFS ops, 13751505 CIFS ops, 0 HTTP ops, 0 FCP ops, 0 iSCSI ops
Tue Apr 11 00:00:00 CST [fas3220-2b:monitor.shutdown.cancel:warning]: Automatic shutdown sequence cancelled
Tue Apr 11 01:00:53 CST [fas3220-2b:raid.rg.recons.media.err:notice]: Read error on Disk /aggr0/plex0/rg0/0b.00.4 Shelf 0 Bay 4 [NETAPP X306_WMANT02TSSM NA08] S/N [WD-WCAY01505873], block #57492770 during reconstruction
Tue Apr 11 01:00:53 CST [fas3220-2b:raid.rg.recons.media.err:notice]: Read error on Disk /aggr0/plex0/rg0/0b.00.4 Shelf 0 Bay 4 [NETAPP X306_WMANT02TSSM NA08] S/N [WD-WCAY01505873], block #57492771 during reconstruction
Tue Apr 11 01:00:53 CST [fas3220-2b:raid.rg.recons.media.err:notice]: Read error on Disk /aggr0/plex0/rg0/0b.00.4 Shelf 0 Bay 4 [NETAPP X306_WMANT02TSSM NA08] S/N [WD-WCAY01505873], block #57492772 during reconstruction
Tue Apr 11 01:00:53 CST [fas3220-2b:raid.rg.recons.media.err:notice]: Read error on Disk /aggr0/plex0/rg0/0b.00.4 Shelf 0 Bay 4 [NETAPP X306_WMANT02TSSM NA08] S/N [WD-WCAY01505873], block #57492789 during reconstruction
Tue Apr 11 01:00:53 CST [fas3220-2b:raid.rg.recons.media.err:notice]: Read error on Disk /aggr0/plex0/rg0/0b.00.4 Shelf 0 Bay 4 [NETAPP X306_WMANT02TSSM NA08] S/N [WD-WCAY01505873], block #57492792 during reconstruction
Tue Apr 11 01:00:53 CST [fas3220-2b:raid.rg.recons.media.err:notice]: Read error on Disk /aggr0/plex0/rg0/0b.00.4 Shelf 0 Bay 4 [NETAPP X306_WMANT02TSSM NA08] S/N [WD-WCAY01505873], block #57492793 during reconstruction
Tue Apr 11 01:00:53 CST [fas3220-2b:raid.rg.recons.media.err:notice]: Read error on Disk /aggr0/plex0/rg0/0b.00.4 Shelf 0 Bay 4 [NETAPP X306_WMANT02TSSM NA08] S/N [WD-WCAY01505873], block #57492796 during reconstruction
Tue Apr 11 01:01:01 CST [fas3220-2b:raid.rg.recons.media.err:notice]: Read error on Disk /aggr0/plex0/rg0/0b.00.4 Shelf 0 Bay 4 [NETAPP X306_WMANT02TSSM NA08] S/N [WD-WCAY01505873], block #57492800 during reconstruction
Tue Apr 11 01:01:05 CST [fas3220-2b:raid.multierr.bad.block:CRITICAL]: Marking 'Disk /aggr0/plex0/rg0/0b.00.4 Shelf 0 Bay 4 [NETAPP X306_WMANT02TSSM NA08] S/N [WD-WCAY01505873]', block number 57492770, volume block number 925556002, as a bad block.
Tue Apr 11 09:14:49 CST [fas3220-2b:raid.rg.recons.done:notice]: /aggr0/plex0/rg0: reconstruction completed for 0a.00.21 in 9:44:16.45
Tue Apr 11 09:14:49 CST [fas3220-2b:raid.rg.recons.resume:debug]: /aggr0/plex0/rg0: resuming reconstruction, using disk 0a.00.19 (block 5248, 100% complete)
Tue Apr 11 09:16:08 CST [fas3220-2b:raid.rg.recons.done:notice]: /aggr0/plex0/rg0: reconstruction completed for 0a.00.19 in 9:44:01.55
Tue Apr 11 09:16:08 CST [fas3220-2b:raid.rg.scrub.start:notice]: /aggr0/plex0/rg0: starting scrub
Tue Apr 11 10:00:00 CST [fas3220-2b:kern.uptime.filer:info]: 10:00am up 12:20 0 NFS ops, 22202318 CIFS ops, 0 HTTP ops, 0 FCP ops, 0 iSCSI ops
Tue Apr 11 11:03:44 CST [fas3220-2b:raid.rg.scrub.media.err:debug]: Read error on Disk /aggr0/plex0/rg0/0b.00.4 Shelf 0 Bay 4 [NETAPP X306_WMANT02TSSM NA08] S/N [WD-WCAY01505873], block #65857370, during scrub.
Tue Apr 11 11:04:14 CST [fas3220-2b:raid.rg.readerr.repair.data:debug]: Fixing bad data on Disk /aggr0/plex0/rg0/0b.00.4 Shelf 0 Bay 4 [NETAPP X306_WMANT02TSSM NA08] S/N [WD-WCAY01505873], block #65857370
9.5、检查纪要
Ø A控共13块盘：一个raid组，11块盘，2个热备。
Ø B控共11块盘：一个raid组，11块盘，0个热备。
Ø B控raid组正在scrubbing，隔天再检查日志.
使用命令：fas3220-2b> rdfile /etc/meaassages
Ø 需均衡热备盘：在A控制器上将0b.00.23指定到B控制器。（隔天检查日志后操作）
使用命令：fas3220-2a> disk remove_ownership 0b.00.23
fas3220-2a> disk assign 0b.00.23 -o fas3220-2b
Ø 隔天检查发现0b.00.4硬盘有报错信息，建议更换此硬盘，本次双盘失效，可能和此硬盘状态不佳有关。
10、更换状态正常的磁盘
一、检查系统状态
fas3220-2b*> sysconfig -r
Aggregate aggr0 (online, raid_dp) (block checksums)
Plex /aggr0/plex0 (online, normal, active, pool0)
RAID group /aggr0/plex0/rg0 (normal, block checksums)
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
dparity 0a.00.19 0a 0 19 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
parity 0a.00.1 0a 0 1 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.11 0a 0 11 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.21 0a 0 21 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0b.00.4 0b 0 4 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.5 0a 0 5 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0b.00.6 0b 0 6 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.7 0a 0 7 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0b.00.8 0b 0 8 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.9 0a 0 9 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0b.00.10 0b 0 10 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
Pool1 spare disks (empty)
Pool0 spare disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
Spare disks for block checksum
spare 0a.00.23 0a 0 23 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
Partner disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
partner 0b.00.18 0b 0 18 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.12 0b 0 12 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.2 0b 0 2 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.22 0b 0 22 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.15 0a 0 15 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.14 0b 0 14 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.17 0a 0 17 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.16 0b 0 16 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.3 0a 0 3 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.0 0b 0 0 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.13 0a 0 13 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.20 0b 0 20 SA:A 0 BSAS 7200 0/0 1695759/3472914816
fas3220-2b*>
二、输出日期
fas3220-2b*> date
Fri Apr 14 20:32:28 CST 2023
三、查看日志
fas3220-2b*>rdfile /etc/messages
Ø 确定需要更换的磁盘编号,本次更换的磁盘编号为0b.00.4，位置为bay4.
四、使磁盘失效
Ø 由于0b.00.4磁盘当前并未失效，只是有坏道，所以需要手动失效磁盘。
Ø 执行手动失效磁盘后，系统会将0b.00.4上的数据拷贝到热备盘，待热备盘数据同步完成后，才可以更换磁盘。
fas3220-2b*> disk fail 0b.00.4
五、更换磁盘后检查
1、检查B控配置状态，23号磁盘已经完成数据同步，由原来的热备盘变为data盘。当前B控制器无热备盘，新更换的0b.00.4磁盘归属A控制器。
fas3220-2b> sysconfig -r
Aggregate aggr0 (online, raid_dp) (block checksums)
Plex /aggr0/plex0 (online, normal, active, pool0)
RAID group /aggr0/plex0/rg0 (normal, block checksums)
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks ) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- ------------- - --------------
dparity 0a.00.19 0a 0 19 SA:B 0 BSAS 7200 1695466/34723 15904 1695759/3472914816
parity 0a.00.1 0a 0 1 SA:B 0 BSAS 7200 1695466/34723 15904 1695759/3472914816
data 0a.00.11 0a 0 11 SA:B 0 BSAS 7200 1695466/34723 15904 1695759/3472914816
data 0a.00.21 0a 0 21 SA:B 0 BSAS 7200 1695466/34723 15904 1695759/3472914816
data 0a.00.23 0a 0 23 SA:B 0 BSAS 7200 1695466/34723 15904 1695759/3472914816
data 0a.00.5 0a 0 5 SA:B 0 BSAS 7200 1695466/34723 15904 1695759/3472914816
data 0b.00.6 0b 0 6 SA:A 0 BSAS 7200 1695466/34723 15904 1695759/3472914816
data 0a.00.7 0a 0 7 SA:B 0 BSAS 7200 1695466/34723 15904 1695759/3472914816
data 0b.00.8 0b 0 8 SA:A 0 BSAS 7200 1695466/34723 15904 1695759/3472914816
data 0a.00.9 0a 0 9 SA:B 0 BSAS 7200 1695466/34723 15904 1695759/3472914816
data 0b.00.10 0b 0 10 SA:A 0 BSAS 7200 1695466/34723 15904 1695759/3472914816
Pool1 spare disks (empty)
Pool0 spare disks (empty)
Partner disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks ) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- ------------- - --------------
partner 0b.00.4 0b 0 4 SA:A 0 BSAS 7200 1695466/34723 15904 1695759/3472914816
partner 0b.00.18 0b 0 18 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.12 0b 0 12 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.2 0b 0 2 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.22 0b 0 22 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.15 0a 0 15 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.14 0b 0 14 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.17 0a 0 17 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.16 0b 0 16 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.3 0a 0 3 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.0 0b 0 0 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.13 0a 0 13 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.20 0b 0 20 SA:A 0 BSAS 7200 0/0
2、检查A控制器状态，A控制器有两个热备盘。0a.00.4为新更换的磁盘。
fas3220-2a> sysconfig -r
Aggregate aggr0 (online, raid_dp) (block checksums)
Plex /aggr0/plex0 (online, normal, active, pool0)
RAID group /aggr0/plex0/rg0 (normal, block checksums)
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
dparity 0a.00.12 0a 0 12 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
parity 0b.00.13 0b 0 13 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.2 0a 0 2 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0b.00.15 0b 0 15 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.16 0a 0 16 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0b.00.17 0b 0 17 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.18 0a 0 18 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.20 0a 0 20 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0b.00.3 0b 0 3 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.14 0a 0 14 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.22 0a 0 22 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
Pool1 spare disks (empty)
Pool0 spare disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
Spare disks for block checksum
spare 0a.00.0 0a 0 0 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
spare 0a.00.4 0a 0 4 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
Partner disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
partner 0b.00.23 0b 0 23 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
partner 0b.00.19 0b 0 19 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
partner 0b.00.21 0b 0 21 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
partner 0b.00.5 0b 0 5 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.9 0b 0 9 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.10 0a 0 10 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.11 0b 0 11 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.8 0a 0 8 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.7 0b 0 7 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.6 0a 0 6 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.1 0b 0 1 SA:B 0 BSAS 7200 0/0 1695759/3472914816
3、A控制器修改热备盘到B控制器
fas3220-2a> priv set advanced
Warning: These advanced commands are potentially dangerous; use
them only when directed to do so by NetApp
personnel.
fas3220-2a*> disk remove_ownership 0a.00.4
Disk 0a.00.4 will have its ownership removed
Note: Disks may be automatically assigned to this node, since option disk.auto_assign is on.
Volumes must be taken offline. Are all impacted volumes offline(y/n)?? y
fas3220-2a*> disk assign 0a.00.4 -o fas3220-2b
Mon Apr 17 09:43:08 CST [fas3220-2a:diskown.changingOwner:info]: changing ownership for disk 0a.00.4 (S/N P5JUKUMV) from unowned (ID 4294967295) to fas3220-2b (ID 2014472760)
fas3220-2a*> priv set admin
4、再次检查A\B控制器配置，均正常。
fas3220-2a*> sysconfig -r
Aggregate aggr0 (online, raid_dp) (block checksums)
Plex /aggr0/plex0 (online, normal, active, pool0)
RAID group /aggr0/plex0/rg0 (normal, block checksums)
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
dparity 0a.00.12 0a 0 12 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
parity 0b.00.13 0b 0 13 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.2 0a 0 2 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0b.00.15 0b 0 15 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.16 0a 0 16 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0b.00.17 0b 0 17 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.18 0a 0 18 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.20 0a 0 20 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0b.00.3 0b 0 3 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.14 0a 0 14 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.22 0a 0 22 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
Pool1 spare disks (empty)
Pool0 spare disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
Spare disks for block checksum
spare 0a.00.0 0a 0 0 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
Partner disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
partner 0a.00.4 0a 0 4 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
partner 0b.00.23 0b 0 23 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
partner 0b.00.19 0b 0 19 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
partner 0b.00.21 0b 0 21 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
partner 0b.00.5 0b 0 5 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.9 0b 0 9 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.10 0a 0 10 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.11 0b 0 11 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.8 0a 0 8 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.7 0b 0 7 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.6 0a 0 6 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.1 0b 0 1 SA:B 0 BSAS 7200 0/0 1695759/3472914816
fas3220-2b> sysconfig -r
Aggregate aggr0 (online, raid_dp) (block checksums)
Plex /aggr0/plex0 (online, normal, active, pool0)
RAID group /aggr0/plex0/rg0 (normal, block checksums)
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
dparity 0a.00.19 0a 0 19 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
parity 0a.00.1 0a 0 1 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.11 0a 0 11 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.21 0a 0 21 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.23 0a 0 23 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.5 0a 0 5 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0b.00.6 0b 0 6 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.7 0a 0 7 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0b.00.8 0b 0 8 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0a.00.9 0a 0 9 SA:B 0 BSAS 7200 1695466/3472315904 1695759/3472914816
data 0b.00.10 0b 0 10 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
Pool1 spare disks (empty)
Pool0 spare disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
Spare disks for block checksum
spare 0b.00.4 0b 0 4 SA:A 0 BSAS 7200 1695466/3472315904 1695759/3472914816
Partner disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
partner 0b.00.18 0b 0 18 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.12 0b 0 12 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.2 0b 0 2 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.22 0b 0 22 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.15 0a 0 15 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.14 0b 0 14 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.17 0a 0 17 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.16 0b 0 16 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.3 0a 0 3 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.0 0b 0 0 SA:A 0 BSAS 7200 0/0 1695759/3472914816
partner 0a.00.13 0a 0 13 SA:B 0 BSAS 7200 0/0 1695759/3472914816
partner 0b.00.20 0b 0 20 SA:A 0 BSAS 7200 0/0 1695759/3472914816
