书接上回​​国产虚拟化云宏CNware WinStack安装体验-3 云平台添加计算节点​​,接下来我们准备部署WinStore分布式存储软件。

存储网络规划

部署之前我们先规划下存储的网络,前面我们规划了管理网络,在WinStore中要用的2个网络,集群网络和公共网络,我们为了简化部署,使集群和公共网络公用,下面给出IP规划:

主机名

管理IP

网卡

集群和公共IP

网卡

cnware-new0

192.168.3.11/24

eth0 1G

10.1.43.11/24

eth3 10G

cnware-new1

192.168.3.12/24

eth0 1G

10.1.43.12/24

eth3 10G

cnware-new2

192.168.3.13/24

eth0 1G

10.1.43.13/24

eth3 10G

计算节点安装WinStore依赖包

这个依赖包我们在部署计算节点的阶段已经选择安装:

国产虚拟化云宏CNware WinStack安装体验-4 安装分布式存储WinStore_CNware

计算节点部署 WinStore 容器

咱们部署的环境是X86架构,将winstore-deploy-3.3.1-43-x86_64-internal-release.tar安装包上传至 X86 计算节点/root 目录下

国产虚拟化云宏CNware WinStack安装体验-4 安装分布式存储WinStore_HCI_02

解压

[root@cnware-new0 ~]# tar -xvf winstore-deploy-3.3.1-43-x86_64-internal-release.tar
winstore-deploy-3.3.1-43-x86_64-internal-release/
winstore-deploy-3.3.1-43-x86_64-internal-release/install.sh
winstore-deploy-3.3.1-43-x86_64-internal-release/uninstall.sh
winstore-deploy-3.3.1-43-x86_64-internal-release/meta.json
winstore-deploy-3.3.1-43-x86_64-internal-release/metagen

安装

[root@cnware-new0 ~]# cd winstore-deploy-3.3.1-43-x86_64-internal-release/
[root@cnware-new0 winstore-deploy-3.3.1-43-x86_64-internal-release]# sh install.sh
END-User License Agreement

Thank you for using Winstore software provided by Aerospace Winhong Technology Ltd. (hereinafter referred to as the "Winhong")!

Important notice:
Please be sure to carefully read and understand all the rights and obligations specified in this End-user License Agreement (hereinafter r
eferred to as the "Agreement").If you are a person with limited civil capacity or no capacity for civil conduct, you should read it accomp
anied by your guardian, with the consent of whom you can download, install or use the Winstore software (hereinafter referred to as the "S
oftware"). Unless you have already accepted all the terms of this Agreement, you have no right to download, install or use the Software an
d its related services. If you do not agree with any of the terms of this Agreement, please do not install, copy or use the Software. Once
you download, install or use the Software, you will be deemed to be bound by each and every term of this Agreement. This Agreement may be
updated at any time by Winhong and once the terms are published after being updated, they will substitute the previous corresponding term
s of the Agreement without giving you any further notice. You can re-download and install this Software or get the access to the site of W
inhong and refer to the latest version of the terms of the Agreement. If, after Winhong modified any terms of this Agreement, you do not a
ccept the terms modified, please immediately stop using the Software and its related services and you will be deemed to have accepted the
modified Agreement if you keep using the Software and its related services.

Trial License:
If you obtain the license of the Software for trial, you can only use it for non-profit purposes within the limited period as set forth in
the License, during which you should also adhere to the stipulations of this Agreement. Although trial license is provided according to t
he original license agreement, Winhong is not liable for any damages, support or guarantees and obligations under this Agreement.

1 License:
1.1 License Scope:
Under relevant terms of this Agreement, Winhong grants you a non-exclusive and non-transferable license within the term of license provide
d that you have already paid for the relevant costs in accordance with the provisions of the order/contract, and Winhong provides you with
the Software and related services only in the form of executable code under the stipulations of relevant agreements, documentation, manua
ls, guides and other documents attached to the Software.
...
...
8.6 Contact information:
Please send legal notices or other communications to: Company name: Aerospace Winhong Technology Ltd., Postal address: Building B2 ,Tianhe
Huitong Industry Park,No.33 Yuangangheng Road,Tianhe District,Guangzhou,China, Post code: 510650. If you have any questions concerning th
is Agreement, please send an email to info@winhong.com<mailto:info@winhong.com>.
Please type y to accept, n otherwise [n]: y
Verifying archive integrity... 100% All good.
Uncompressing winstore-deploy package 100%
Created symlink from /etc/systemd/system/multi-user.target.wants/docker.service to /usr/lib/systemd/system/docker.service.
Extracting image: 603M/603M(100%), time elapsed: 15s
1b498c2a30f4: Loading layer [==================================================>] 1.345GB/1.345GB
Loaded image: winstore-deploy:3.3.1-43-x86_64-internal-release
8d95106c264c3ef4c0e929c01424c9b9aad44a339cc698ca42ff7a7f92182299
Waiting for container initialization....... done.
Installing packages............
done.
[root@cnware-new0 winstore-deploy-3.3.1-43-x86_64-internal-release]#

其他所有节点同样操作,过程略过。

检查容器部署状态

等待部署完完毕后,执行命令:docker ps,出现如图所示,则表示 WinStore 部署成功,status 为 healthy ,表示容器运行正常。

国产虚拟化云宏CNware WinStack安装体验-4 安装分布式存储WinStore_CNware_03


管理界面新建存储集群

用户登录云平台后,将鼠标滑动至左侧菜单栏-所有功能,点击WinStore

国产虚拟化云宏CNware WinStack安装体验-4 安装分布式存储WinStore_分布式存储_04

点击 “添加存储集群”按钮,进入“新建集群”页面

国产虚拟化云宏CNware WinStack安装体验-4 安装分布式存储WinStore_CNware_05

设置名称Cluster1

国产虚拟化云宏CNware WinStack安装体验-4 安装分布式存储WinStore_CNware_06

输入主机名和IP信息,输入用户名密码进行连接测试

国产虚拟化云宏CNware WinStack安装体验-4 安装分布式存储WinStore_ceph_07

连接成功,点击下一步

国产虚拟化云宏CNware WinStack安装体验-4 安装分布式存储WinStore_CNware_08

网络配置

此处需要说明下,这里集群网络是私有网络,公共网络是对外提供存储服务的网络,本次集群网络和公共网络公用。

这里有一次失败,原因是网络选择了分布式交换机,这里只能选择网卡,交换机配置access。

国产虚拟化云宏CNware WinStack安装体验-4 安装分布式存储WinStore_ceph_09

设置缓存盘和日志盘,这看不到任何磁盘信息,经过排查发现是现有磁盘上已经存在分区数据,需要先清除分区后在操作

dd if=/dev/zero of=/dev/sdX bs=1024M count=1 && sgdisk -Z /dev/sdX

国产虚拟化云宏CNware WinStack安装体验-4 安装分布式存储WinStore_ceph_10

 dd if=/dev/zero of=/dev/sda bs=1024M count=1 && sgdisk -Z /dev/sda
dd if=/dev/zero of=/dev/sdc bs=1024M count=1 && sgdisk -Z /dev/sdc
dd if=/dev/zero of=/dev/sde bs=1024M count=1 && sgdisk -Z /dev/sde
dd if=/dev/zero of=/dev/sdd bs=1024M count=1 && sgdisk -Z /dev/sdd

执行之后可以看到磁盘

国产虚拟化云宏CNware WinStack安装体验-4 安装分布式存储WinStore_CNware_11

设置ssd缓存盘

国产虚拟化云宏CNware WinStack安装体验-4 安装分布式存储WinStore_分布式存储_12

设置数据盘

国产虚拟化云宏CNware WinStack安装体验-4 安装分布式存储WinStore_HCI_13

可以从任务列表看到任务详情

国产虚拟化云宏CNware WinStack安装体验-4 安装分布式存储WinStore_HCI_14

部署成功

国产虚拟化云宏CNware WinStack安装体验-4 安装分布式存储WinStore_ceph_15

初始化分布式存储

部署任务完成后,即可从 菜单-存储资源-Winstore 打开界面

国产虚拟化云宏CNware WinStack安装体验-4 安装分布式存储WinStore_HCI_16


国产虚拟化云宏CNware WinStack安装体验-4 安装分布式存储WinStore_分布式存储_17

资源管理-存储池管理

国产虚拟化云宏CNware WinStack安装体验-4 安装分布式存储WinStore_分布式存储_18

添加存储池

国产虚拟化云宏CNware WinStack安装体验-4 安装分布式存储WinStore_ceph_19

存储池添加成功

国产虚拟化云宏CNware WinStack安装体验-4 安装分布式存储WinStore_CNware_20

国产虚拟化云宏CNware WinStack安装体验-4 安装分布式存储WinStore_分布式存储_21

数据盘管理

国产虚拟化云宏CNware WinStack安装体验-4 安装分布式存储WinStore_CNware_22

缓存盘管理

国产虚拟化云宏CNware WinStack安装体验-4 安装分布式存储WinStore_分布式存储_23

使用分布式存储

从 菜单-存储资源-分布式存储 打开界面

国产虚拟化云宏CNware WinStack安装体验-4 安装分布式存储WinStore_CNware_24

点击更多,关联主机

国产虚拟化云宏CNware WinStack安装体验-4 安装分布式存储WinStore_分布式存储_25

关联主机

国产虚拟化云宏CNware WinStack安装体验-4 安装分布式存储WinStore_CNware_26

国产虚拟化云宏CNware WinStack安装体验-4 安装分布式存储WinStore_分布式存储_27

扫描存储资源

国产虚拟化云宏CNware WinStack安装体验-4 安装分布式存储WinStore_分布式存储_28

 扫描发现一个存储资源

国产虚拟化云宏CNware WinStack安装体验-4 安装分布式存储WinStore_CNware_29

点击更多创建存储池

国产虚拟化云宏CNware WinStack安装体验-4 安装分布式存储WinStore_HCI_30

关联主机

国产虚拟化云宏CNware WinStack安装体验-4 安装分布式存储WinStore_分布式存储_31

可以看到新建的分布式存储资源池

国产虚拟化云宏CNware WinStack安装体验-4 安装分布式存储WinStore_CNware_32

国产虚拟化云宏CNware WinStack安装体验-4 安装分布式存储WinStore_ceph_33

现在尝试使用下分布式存储池,迁移一台虚拟机过去

国产虚拟化云宏CNware WinStack安装体验-4 安装分布式存储WinStore_分布式存储_34

更改存储

国产虚拟化云宏CNware WinStack安装体验-4 安装分布式存储WinStore_ceph_35

选择分布式存储池

国产虚拟化云宏CNware WinStack安装体验-4 安装分布式存储WinStore_ceph_36

国产虚拟化云宏CNware WinStack安装体验-4 安装分布式存储WinStore_ceph_37

迁移完成

国产虚拟化云宏CNware WinStack安装体验-4 安装分布式存储WinStore_HCI_38

开机之后虚拟机正常运行

国产虚拟化云宏CNware WinStack安装体验-4 安装分布式存储WinStore_分布式存储_39

以上,分布式存储部署完毕,后续会测试 IP-SAN和NAS,以及集群HA相关场景。