由于需要将磁盘划分为两个raid,一是raid 1用于安装操作系统,另一个是raid 5用于存放大量数据,由于Dell powerEdge R730xd,不支持开机界面组建多raid,只能进入系统使用megacli来操作

查看已有raid 信息,目前是针对操作系统做了一个raid 1


  • [root@ns-xxx ~]# megacli -LDInfo -Lall -aALL

Adapter 0 -- Virtual Drive Information:
Virtual Drive: 0 (Target Id: 0)
Name :
RAID Level : Primary-1, Secondary-0, RAID Level Qualifier-0
Size : 5.457 TB
Is VD emulated : Yes
Mirror Data : 5.457 TB
State : Optimal
Strip Size : 64 KB
Number Of Drives : 2
Span Depth : 1
Default Cache Policy: WriteBack, ReadAdaptive, Direct, No Write Cache if Bad BBU
Current Cache Policy: WriteBack, ReadAdaptive, Direct, No Write Cache if Bad BBU
Default Access Policy: Read/Write
Current Access Policy: Read/Write
Disk Cache Policy : Disk's Default
Encryption Type : None
Default Power Savings Policy: Controller Defined
Current Power Savings Policy: None
Can spin up in 1 minute: Yes
LD has drives that support T10 power conditions: Yes
LD's IO profile supports MAX power savings with cached writes: No
Bad Blocks Exist: No
PI type: No PI

Is VD Cached: No

查看磁盘信息

  • [root@ns-xxx ~]# megacli -PDList -aALL |egrep 'Adapter|Enclosure|Slot|Firmware state'
    Adapter #0
    Enclosure Device ID: 32
    Slot Number: 0
    Enclosure position: 1
    Firmware state: Online, Spun Up
    Enclosure Device ID: 32
    Slot Number: 1
    Enclosure position: 1
    Firmware state: Online, Spun Up
    Enclosure Device ID: 32
    Slot Number: 2
    Enclosure position: 1
    Firmware state: JBOD
    Enclosure Device ID: 32
    Slot Number: 3
    Enclosure position: 1
    Firmware state: JBOD
    Enclosure Device ID: 32
    Slot Number: 4
    Enclosure position: 1
    Firmware state: JBOD
    Enclosure Device ID: 32
    Slot Number: 5
    Enclosure position: 1
    Firmware state: JBOD
    Enclosure Device ID: 32
    Slot Number: 6
    Enclosure position: 1
    Firmware state: JBOD
    Enclosure Device ID: 32
    Slot Number: 7
    Enclosure position: 1
    Firmware state: JBOD
    Enclosure Device ID: 32
    Slot Number: 8
    Enclosure position: 1
    Firmware state: JBOD
    Enclosure Device ID: 32
    Slot Number: 9
    Enclosure position: 1
    Firmware state: JBOD
    Enclosure Device ID: 32
    Slot Number: 10
    Enclosure position: 1
    Firmware state: JBOD
    Enclosure Device ID: 32
    Slot Number: 11
    Enclosure position: 1
    Firmware state: JBOD
    Enclosure Device ID: 32
    Slot Number: 12
    Enclosure position: 1
    Firmware state: JBOD
    Enclosure Device ID: 32
    Slot Number: 13
    Enclosure position: 1
    Firmware state: JBOD

根据Enclosure Device ID及Slot Number组成数据,r5为raid 5 ,a0为Adapter number

  • [root@ns-xxx~]# megacli -CfgLdAdd -r5 [32:2,32:3,32:4,32:5,32:6,32:7,32:8,32:9,32:10,32:11,32:12,32:13] -a0

组建raid时抛出异常

  • [root@ns-xxx ~]# megacli -CfgLdAdd -r5 [32:2,32:3,32:4,32:5,32:6,32:7,32:8,32:9,32:10,32:11,32:12,32:13] -a0
  • The specified physical disk does not have the appropriate attributes to complete
  • the requested command.
  • Exit Code: 0x26
    将其设置为good后再执行即可
  • [root@ns-xxx ~]# megacli -PDMakeGood -Physdrv [32:2,32:3,32:4,32:5,32:6,32:7,32:8,32:9,32:10,32:11,32:12,32:13] -force -a0
  • Adapter: 0: EnclId-32 SlotId-2 state changed to Unconfigured-Good.
  • Adapter: 0: EnclId-32 SlotId-3 state changed to Unconfigured-Good.
  • Adapter: 0: EnclId-32 SlotId-4 state changed to Unconfigured-Good.
  • Adapter: 0: EnclId-32 SlotId-5 state changed to Unconfigured-Good.
  • Adapter: 0: EnclId-32 SlotId-6 state changed to Unconfigured-Good.
  • Adapter: 0: EnclId-32 SlotId-7 state changed to Unconfigured-Good.
  • Adapter: 0: EnclId-32 SlotId-8 state changed to Unconfigured-Good.
  • Adapter: 0: EnclId-32 SlotId-9 state changed to Unconfigured-Good.
  • Adapter: 0: EnclId-32 SlotId-10 state changed to Unconfigured-Good.
  • Adapter: 0: EnclId-32 SlotId-11 state changed to Unconfigured-Good.
  • Adapter: 0: EnclId-32 SlotId-12 state changed to Unconfigured-Good.
  • Adapter: 0: EnclId-32 SlotId-13 state changed to Unconfigured-Good.
  • [root@ns-ceph-208205 ~]# megacli -CfgLdAdd -r5 [32:2,32:3,32:4,32:5,32:6,32:7,32:8,32:9,32:10,32:11] -a0
  • Adapter 0: Created VD 1
  • Adapter 0: Configured the Adapter!!
  • Exit Code: 0x00

查看组建后raid 5的raid卡状态

[root@ns-ceph-208205 ~]# megacli -ShowSummary -aALL

System
Operating System: Linux version 3.10.0-514.6.2.el7.x86_64
Driver Version: 06.811.02.00-rh1
CLI Version: 8.04.07

Hardware
Controller
ProductName : PERC H730 Mini(Bus 0, Dev 0)
SAS Address : 51866da07969d800
FW Package Version: 25.4.1.0004
Status : Optimal
BBU
BBU Type : BBU
Status : Healthy
Enclosure
Product Id : BP13G+EXP
Type : SES
Status : OK

PD
Connector : 00<Internal><Encl Pos 1 >: Slot 0
Vendor Id : ATA
Product Id : TOSHIBA MG04ACA6
State : Online
Disk Type : SATA,Hard Disk Device
Capacity : 5.457 TB
Power State : Active

Connector : 00<Internal><Encl Pos 1 >: Slot 1
Vendor Id : ATA
Product Id : TOSHIBA MG04ACA6
State : Online
Disk Type : SATA,Hard Disk Device
Capacity : 5.457 TB
Power State : Active

Connector : 00<Internal><Encl Pos 1 >: Slot 2
Vendor Id : ATA
Product Id : TOSHIBA MG04ACA6
State : Online
Disk Type : SATA,Hard Disk Device
Capacity : 5.457 TB
Power State : Active

Connector : 00<Internal><Encl Pos 1 >: Slot 3
Vendor Id : ATA
Product Id : TOSHIBA MG04ACA6
State : Online
Disk Type : SATA,Hard Disk Device
Capacity : 5.457 TB
Power State : Active

Connector : 00<Internal><Encl Pos 1 >: Slot 4
Vendor Id : ATA
Product Id : TOSHIBA MG04ACA6
State : Online
Disk Type : SATA,Hard Disk Device
Capacity : 5.457 TB
Power State : Active

Connector : 00<Internal><Encl Pos 1 >: Slot 5
Vendor Id : ATA
Product Id : TOSHIBA MG04ACA6
State : Online
Disk Type : SATA,Hard Disk Device
Capacity : 5.457 TB
Power State : Active

Connector : 00<Internal><Encl Pos 1 >: Slot 6
Vendor Id : ATA
Product Id : TOSHIBA MG04ACA6
State : Online
Disk Type : SATA,Hard Disk Device
Capacity : 5.457 TB
Power State : Active

Connector : 00<Internal><Encl Pos 1 >: Slot 7
Vendor Id : ATA
Product Id : TOSHIBA MG04ACA6
State : Online
Disk Type : SATA,Hard Disk Device
Capacity : 5.457 TB
Power State : Active

Connector : 00<Internal><Encl Pos 1 >: Slot 8
Vendor Id : ATA
Product Id : TOSHIBA MG04ACA6
State : Online
Disk Type : SATA,Hard Disk Device
Capacity : 5.457 TB
Power State : Active

Connector : 00<Internal><Encl Pos 1 >: Slot 9
Vendor Id : ATA
Product Id : TOSHIBA MG04ACA6
State : Online
Disk Type : SATA,Hard Disk Device
Capacity : 5.457 TB
Power State : Active

Connector : 00<Internal><Encl Pos 1 >: Slot 10
Vendor Id : ATA
Product Id : TOSHIBA MG04ACA6
State : Online
Disk Type : SATA,Hard Disk Device
Capacity : 5.457 TB
Power State : Active

Connector : 00<Internal><Encl Pos 1 >: Slot 11
Vendor Id : ATA
Product Id : TOSHIBA MG04ACA6
State : Online
Disk Type : SATA,Hard Disk Device
Capacity : 5.457 TB
Power State : Active

Connector : 00<Internal><Encl Pos 1 >: Slot 12
Vendor Id : ATA
Product Id : INTEL SSDSC2BX40
State : Unconfigured Good
Disk Type : SATA,Solid State Device
Capacity : 372.0 GB
Power State : Active

Connector : 00<Internal><Encl Pos 1 >: Slot 13
Vendor Id : ATA
Product Id : INTEL SSDSC2BX40
State : Unconfigured Good
Disk Type : SATA,Solid State Device
Capacity : 372.0 GB
Power State : Active

Storage

Virtual Drives
Virtual drive : Target Id 0 ,VD name
Size : 5.457 TB
State : Optimal
Operation In Progress : Background Initialization
RAID Level : 1

Virtual drive : Target Id 1 ,VD name
Size : 49.117 TB
State : Optimal
RAID Level : 5

可以看出已经有一个target id为0,一个target id为1的两个raid了,至此raid组建完毕

parted用于格式化大于1T的raid磁盘,文件系统为xfs

  • [root@ns-xxx ~]# parted /dev/sdb
  • (parted) mklabel
  • New disk label type? gpt
  • Warning: The existing disk label on /dev/sdb will be destroyed and all data on this disk will be lost. Do you want to continue?
  • Yes/No? yes
  • (parted) mkpart
  • Partition name? []? registry
  • File system type? [ext2]? xfs
  • Start? 0%
  • End? 100%
  • (parted) quit
  • Information: You may need to update /etc/fstab.

    格式化后,查看信息

    • [root@ns-xxx ~]# mkfs.xfs -f /dev/sdb1
  • meta-data=/dev/sdb1 isize=512 agcount=50, agsize=268435455 blks
  • = sectsz=4096 attr=2, projid32bit=1
  • = crc=1 finobt=0, sparse=0
  • data = bsize=4096 blocks=13184925184, imaxpct=5
  • = sunit=0 swidth=0 blks
  • naming =version 2 bsize=4096 ascii-ci=0 ftype=1
  • log =internal log bsize=4096 blocks=521728, version=2
  • = sectsz=4096 sunit=1 blks, lazy-count=1
  • realtime =none extsz=4096 blocks=0, rtextents=0
  • [root@ns-xxx ~]# parted /dev/sdb print
  • Model: DELL PERC H730 Mini (scsi)
  • Disk /dev/sdb: 54.0TB
  • Sector size (logical/physical): 512B/4096B
  • Partition Table: gpt
  • Disk Flags:
  • Number Start End Size File system Name Flags
  • 1 1049kB 54.0TB 54.0TB xfs registry

查看对应的分区uuid信息并写入fstab开启自动挂载

  • [root@ns-xxx ~]# blkid
  • /dev/sda2: UUID="fd2db1bd-a0c8-441e-854d-0490ce3fbed6" TYPE="xfs" PARTUUID="226fa127-f1bc-47ed-a2d3-1f1d03767e22"
  • /dev/sda3: UUID="1a060266-8b5e-40b6-956e-694e73eb8e84" TYPE="swap" PARTUUID="efdc9bdf-50e8-4535-a3ac-ba9d3cc4d94b"
  • /dev/sda4: UUID="412ebd90-52d2-417c-8f5f-b7d6edf5885f" TYPE="xfs" PARTUUID="58d856f7-82f8-4d2a-8040-e2eb606ee5aa"
  • /dev/sdb1: UUID="88afcd28-cd54-432a-b72b-b879068d44ac" TYPE="ext4" PARTLABEL="registry" PARTUUID="eb457d79-56d6-4dd5-8f02-9be866b19527"
  • /dev/sda1: PARTUUID="c8ffa803-6674-4128-a2f9-f2589249275a"
  • [root@ns-xxx ~]# cat /etc/fstab
  • ....
  • UUID=412ebd90-52d2-417c-8f5f-b7d6edf5885f / xfs defaults 0 0
  • UUID=fd2db1bd-a0c8-441e-854d-0490ce3fbed6 /boot xfs defaults 0 0
  • UUID=1a060266-8b5e-40b6-956e-694e73eb8e84 swap swap defaults 0 0
  • UUID=293ea69f-15b4-42ca-a10e-a5fa9a6a8759 /registry xfs defaults 0 0

查看硬件信息
[root@ns-xxx ~]# dmidecode |more

参考链接:
https://serverfault.com/questions/331807/megacli-is-killing-me-any-help-appreciated
http://support.huawei.com/huaweiconnect/enterprise/zh/thread-430333-1-1.html
http://fibrevillage.com/storage/374-megacli-raid-0-1-5-6-and-raid50-raid60-creation-examples
https://blog.csdn.net/z_yttt/article/details/53020797