操作命令：
ceph osd getcrushmap -o map_old 导出map
crushtool -d map_old -o map_old.txt 转化成可编辑格式
crushtool -c map_new.txt -o map_new 还原为map
ceph osd setcrushmap -i map_new 将map导入ceph
更改Crush map流程：
1、修改配置文件,防止ceph自动更新crushmap
echo 'osd_crush_update_on_start = false' >> /etc/ceph/ceph.conf /etc/init.d/ceph restart
2、导出map,并转化成可编辑格式
ceph osd getcrushmap -o map_old crushtool -d map_old -o map_old.txt cp map_old.txt map_new.txt
3、更改map_new.txt
如：
##################sas
host node1-sas {
id -2 # do not change unnecessarily
# weight 0.120
alg straw
hash 0 # rjenkins1
item osd.0 weight 0.040
item osd.1 weight 0.040
}
host node2-sas {
id -3 # do not change unnecessarily
# weight 0.120
alg straw
hash 0 # rjenkins1
item osd.3 weight 0.040
item osd.4 weight 0.040
}
##################ssd
host node1-ssd {
id -5 # do not change unnecessarily
# weight 0.120
alg straw
hash 0 # rjenkins1
item osd.2 weight 0.040
}
host node2-ssd {
id -6 # do not change unnecessarily
# weight 0.120
alg straw
hash 0 # rjenkins1
item osd.5 weight 0.040
}
#################pool
root sas-pool {
id -1 # do not change unnecessarily
# weight 0.360
alg straw
hash 0 # rjenkins1
item node1-sas weight 0.080
item node2-sas weight 0.080
}
root ssd-pool {
id -8 # do not change unnecessarily
# weight 0.360
alg straw
hash 0 # rjenkins1
item node1-ssd weight 0.040
item node2-ssd weight 0.040
}
##################rule
rule sas {
ruleset 0
type replicated
min_size 1
max_size 10
step take sas-pool
step choose firstn 0 type osd
step emit
}
rule ssd {
ruleset 1
type replicated
min_size 1
max_size 10
step take ssd-pool
step choose firstn 0 type osd
step emit
}4、将修改后的crushmap编译并且注入集群中
crushtool -c map_new.txt -o map_new ceph osd setcrushmap -i map_new ceph osd tree
5、创建资源池，使用新创建的规则
ceph osd pool create sas 128 128 ceph osd pool create ssd 128 128 ceph osd pool set sas crush_ruleset 0 ceph osd pool set ssd crush_ruleset 1
6、重新对pool授权(如果对接过openstack)
ceph auth del client.cinder ceph auth get-or-create client.cinder mon 'allow r' osd 'allow class-read object_prefix rbd_children,allow rwx pool=volumes, \ allow rwx pool=vms, allow rx pool=p_w_picpaths, allow rwx pool=ssd'
更改Monitor IP流程：
1、获取monmap，并查看
ceph mon getmap -o map monmaptool --print map
2、删除旧的map配置，新增配置到map
monmaptool --rm node1 --rm node2 --rm node3 map monmaptool --add node1 10.0.2.21:6789 --add node2 10.0.2.22:6789 --add node3 10.0.2.23:6789 map monmaptool --print map
3、复制新map到所有mon节点
scp mon node2:~ scp mon node3:~
4、更改/etc/ceph/ceph.conf中的mon_host(所有mon节点执行)
vim /etc/ceph/ceph.conf mon_host= new1_ip:6789,new2_ip:6789,new3_ip:6789:
5、停止mon进程(所有mon节点执行)
/etc/init.d/ceph stop mon
6、载入新的monmap(所有mon节点执行)
ceph-mon -i node1 --inject-monmap map
7、启动mon(所有mon节点执行)
/etc/init.d/ceph start mon
Ctrl+Enter 发布
发布
取消