Openstack Kolla-Ansible安装部署

部署节点制作

环境准备

  1. CentOS环境安装
  • 配置国内pypi源：
mkdir -p ~/.config/pip/
vim ~/.config/pip/pip.conf

[global]
index-url = https://mirrors.ustc.edu.cn/pypi/web/simple
format = columns
  • CentOS 部分常用软件安装
yum install -y vim net-tools  bash-completion-extras git
  1. 安装依赖
  • pip
yum install -y python-pip
pip install --upgrade pip
  • 软件依赖
yum install -y python-devel libffi-devel gcc openssl-devel libselinux-python
  • ansible 安装
yum install -y ansible
pip install -U ansible
  • 修改ansible配置文件 /etc/ansible/ansible.cfg：
[defaults]
host_key_checking=False
pipelining=True
forks=100

安装docker-ce

cd /etc/yum.repos.d/
wget https://mirrors.aliyun.com/docker-ce/linux/centos/docker-ce.repo
yum install docker-ce -y

开启 Docker 的共享挂载功能：所谓共享挂载即同一个目录或设备可以挂载到多个不同的路径并且能够保持互相之间的共享可见性，类似于 mount --shared。在 OpenStack for Kolla 中，主要解决 Neutron 的 namespace 在不同 container 中得以保持实效性的问题。

mkdir /etc/systemd/system/docker.service.d
tee /etc/systemd/system/docker.service.d/kolla.conf << 'EOF'
> [Service]
> MountFlags=shared
> EOF

使用阿里的加速器(登陆阿里云–>控制台–>产品与服务–>容器镜像服务–>镜像加速器 即可获取加速器地址)

mkdir -p /etc/docker
tee /etc/docker/daemon.json <<-'EOF'
{
  "registry-mirrors": ["https://mb8n4btz.mirror.aliyuncs.com"]
}
EOF

启动docker服务

systemctl enable docker.service
systemctl start docker.service

Kolla-Ansible 安装

Kolla-Ansible 可以从pip安装，也可以从git安装，这里从git安装

  1. clone 代码
git clone https://github.com/openstack/kolla
git clone https://github.com/openstack/kolla-ansible
  1. 安装
pip install -r kolla/requirements.txt
pip install -r kolla-ansible/requirements.txt
python kolla-ansible/setup.py install

注意：
如果出现requests 2.20.0 has requirement idna<2.8,>=2.5, but you'll have idna 2.4 which is incompatible.错误，则强制更新requets库

pip install --ignore-installed requests

同样，出现Cannot uninstall 'PyYAML'. It is a distutils installed project and thus we cannot accurately determine which files belong to it which would lead to only a partial uninstall.错误，强制更新

sudo pip install --ignore-installed PyYAML
  1. copy globals.ymlpasswords.ymlto /etc/kolla 
mkdir -p /etc/kolla
cp -r kolla-ansible/etc/kolla/* /etc/kolla
  1. 配置安装目录
mkdir dep-158
cp kolla-ansible/ansible/inventory/* ./dep-158

制作本地镜像源

  1. 修改kolla镜像有关配置
vim /etc/kolla/globals.yml
openstack_release: "rocky"
network_interface: "ens192"
  1. 拉取镜像
kolla-ansible pull -vvv
  1. 启动容器
mkdir -p /var/www/html/registry
# docker run -d -p 5000:5000 -v /var/www/html/registry:/var/lib/registry --restart=always --name registry registry:2.6.2
  1. 修改docker配置,10.10.129.151是ens192的ip
vim /etc/docker/daemon.json
{
  "registry-mirrors": ["https://mb8n4btz.mirror.aliyuncs.com"],
  "insecure-registries":["10.10.129.151:5000"]
}
  1. 修改镜像tag
for i in `docker images|grep -v registry|grep -v R|awk '{print $1}'`;do docker image tag $i:rocky 10.10.129.151:5000/$i:rocky;done
  1. 上传镜像到私有镜像仓库
for i in `docker images|grep 10.10.129.151|awk '{print $1}'`;do docker push $i:rocky;done
  1. 查看镜像是否上传成功
curl -XGET http://10.10.129.151:5000/v2/_catalog
  1. 备份镜像文件
tar -zcvf kolla-openstack-queens-registry.tar.gz /var/www/html/registry

Openstack 部署

环境说明

部署配置

kolla自带了all-in-one和多节点的两种部署方式，需要配置ansible 部署文件

  1. multinode部署文件修改
[control]
10.0.0.[10:12] ansible_user=ubuntu ansible_password=foobar ansible_become=true
# Ansible supports syntax like [10:12] - that means 10, 11 and 12.
# Become clause means "use sudo".

[network:children]
control
# when you specify group_name:children, it will use contents of group specified.

[compute]
10.0.0.[13:14] ansible_user=ubuntu ansible_password=foobar ansible_become=true

[monitoring]
10.0.0.10
# This group is for monitoring node.
# Fill it with one of the controllers' IP address or some others.

[storage:children]
compute

[deployment]
localhost       ansible_connection=local become=true
# use localhost and sudo

说明：

  1. 部署中使用的密码存储在/etc/kolla/passwords.yml文件中。通过运行下面命令生成随机密码,初始化之后，可手动更改keystone_admin_password密码（OpenStack登录密码）
kolla-genpwd
vim /etc/kolla/passwords.yml
keystone_admin_password: password

部署

  1. 确认inventory配置文件是否正确
ansible -m ping all -i ./multinode

结果：
localhost | SUCCESS => {
    "changed": false,
    "ping": "pong"
}
10.10.129.158 | SUCCESS => {
    "changed": false,
    "ping": "pong"
}
10.10.129.159 | SUCCESS => {
    "changed": false,
    "ping": "pong"
}
  1. 向各个节点安装基本依赖，如docker等；

修改docker yum源。https 有时会报ssl的错误，这里替换为http，也可以修改成本地源

vim /usr/share/kolla-ansible/ansible/roles/baremetal/defaults/main.yml
docker_yum_url: "http://yum.dockerproject.org"

如果打开了octavia，需要在/var/lib/kolla/config_files路径下制作证书文件

mkdir -p /etc/kolla/config/octavia
git clone https://github.com/openstack/octavia.git
source create_certificates.sh /etc/kolla/config/octavia/ /home/octavia/etc/certificates/openssl.cnf
# 注意 /home/octavia/etc/certificates/openssl.cnf 为octavia的代码路径下的文件
cp /etc/kolla/config/octavia/private/* /etc/kolla/config/octavia/
# -vvv 可以打印出最详细的信息
kolla-ansible -i ./multinode bootstrap-servers -vvv
  1. 对主机执行预部署检查
kolla-ansible -i ./multinode prechecks -vv
  1. 执行OpenStack部署
kolla-ansible -i ./multinode deploy -vv
  1. 使用OpenStack
kolla-ansible post-deploy
. /etc/kolla/admin-openrc.sh

一些注意事项

  • 部署过程中所有的ansible task都在 /usr/share/kolla-ansible/ansible/roles/glance/tasks/下面，可以查看；

参考文档