应用环境:

使用salt写了个自动部署mysql的配置配置管理文件,由于mysql的有版本号,端口等不确定属性,需要使用pillar来单独配置每个minion的属性。

一,原始方法

例如,需要在salt id为10.1.1.1-centos.game.web的服务器上部署mysql,版本号为5.5.25,实例有3个,3306,3307,3308, 正常情况下的流程是这样的:

1,在/srv/salt/top.sls中添加配置信息,确保mysql对应的配置被加载

base:

  10.1.1.1-centos.game.web:

    - centos.public_services.mysql

2,在/srv/pillar/top.sls配置minion对应的sls文件位置(ps:salt文件中不能再带".",否则会报错)

base:

  10.1.1.1-centos.game.web:

    - custom.10-1-1-1-centos-game-web

3,新建/srv/pillar/custom/10-1-1-1-centos-game-web.sls,内容如下:

mysql:

  ports:

    - 3306

    - 3307

    - 3308

  version:  '5_5_25'

4,执行同步命令

salt 10.1.1.1-centos.game.web state.highstate -v -t 300

二,改进方法

oh,shit,说好的自动化呢,怎么还要这么多步骤,这可不行!

利用py模式的sls配置文件(其实就是python脚本,只要返回yaml格式的字典文件就好了),我们可以将以上的操作简化成1步,思路如下:

1,/srv/pillar/top.sls中编写配置:

base:

 '*':

 - custom

2,使用py模式编写/srv/pillar/custom/init.sls,自动读取pillar配置,例如salt id是:10.1.1.1-centos.game.web,那么project为game,然后根据获取的pillar_root组合成路径/srv/pillar/custom/game/10.1.1.1-centos.game.web.yaml,利用yaml模块从文件中读取信息,返回字典

3,在/srv/salt/top.sls文件中匹配所有的minion

‘*’:

  - centos.public_services

4,/srv/salt/centos/public_services/init.sls文件使用py模式编写,配置会获取对应的minion的pillar信息,如果包含mysql配置信息且配置正确的话,则返回mysql实例的配置。

那现在要怎么使用呢,很简单,例如你的id为10.1.1.1-centos.game.web,首先在/srv/pillar/custom/目录下建个game目录(从salt id获取的项目名),然后在game目录先新建文件10.1.1.1-centos.game.web.yaml,里面写上配置信息:

mysql:

  ports:

    - 3306

    - 3307

    - 3308

  version:  '5_5_25'

 

最后执行命令:

salt 10.1.1.1-centos.game.web state.highstate -v -t 300

静静的等待执行完成就好了!

三,具体代码

/srv/pillar/custom/init.sls

#!py

#coding:utf-8

"""

返回minion对应的pillar信息

"""

import yaml

import os

 

def run():

  """

  首先获取请求的id,从id中获取project,例如id是:1.2.3.4-centos.game.web,那么project为game

  然后根据获取的pillar_root组合成路径/srv/pillar/custom/game/1.2.3.4-centos.game.web.yaml,利用yaml模块从文件中读取信息,返回字典

  """

  config={}

  id=__opts__['id']

  project=id.split('-')[-1].split('.')[1]

  pillar_root=__opts__['pillar_roots']['base'][0]

  path='%s/custom/%s/%s.yaml'%(pillar_root,project,id)

  if os.path.isfile(path):

    s=open(path).read()

    config=yaml.load(s)

  return config

/srv/salt/centos/public_services/init.sls


#!py

#coding: utf-8

import subprocess

 

class MY_ERROR(Exception):

  def __init__(self,value):

    self.value=value

  def __str__(self):

    return self.value

 

def mysql():

  """

  1,检查是minion中pillar是否有mysql参数,以及参数是否合法

  如果参数没有问题,则返回对应版本的include配置

  pillar e.q.

  mysql:

    ports:

      - 3306

      - 3307

    version: '5_5_25'

  """

  mysql_sls_path='centos.public_services.mysql.'

  #必要的参数

  required_keys=['version','ports']

  if __pillar__.has_key('mysql'):

    mysql_d=__pillar__['mysql']

    #不存在必要的键值对则返回None

    for key in required_keys:

      if not mysql_d.has_key(key) or str(mysql_d[key]).strip()=="":

        raise MY_ERROR('key error! key: %s'%(str(key)))

    #判断port是否合法

    for port in mysql_d['ports']:

      if not port or not 1024<int(port)<65535:

        raise MY_ERROR('mysql ports value error: %s'%(str(mysql_d['ports'])))

    #组合配置参数

    cfg=mysql_sls_path+str(mysql_d['version'][0])

    return cfg

  return None

 

def run():

  config={}

  config['include']=[]

  #mysql

  mysql_cfg=mysql()

  if mysql_cfg:

    config['include'].append(mysql_cfg)

  if config['include']==[]:

    return {}

  return config

/srv/salt/centos/public_services/mysql/5/init.sls


include:

  - centos.public_services.mysql.5.packet

  - centos.public_services.mysql.5.my_cnf

  - centos.public_services.mysql.5.instance

/srv/salt/centos/public_services/mysql/5/packet.sls

mysql软件包要放到相应的目录中,具体位置参考下面配置


{%set version=pillar['mysql']['version']%}

mysql:

  user.present:

    - home: /home/mysql

    - shell: /sbin/nologin

 

/usr/local/nagios/libexec/check_safe -u:

  cmd.wait:

    - watch:

      - user: mysql

 

/usr/local/src/mysql-{{version.replace('_','.')}}.tar.gz:

  file.managed:

    - source: salt://centos/public_services/mysql/5/`version`/mysql-{{version.replace('_','.')}}.tar.gz

 

tar -xf mysql-{{version.replace('_','.')}}.tar.gz -C /usr/local/:

  cmd.run:

    - cwd: /usr/local/src

    - unless: ls -l /usr/local/ | grep -e ".* mysql-{{version.replace('_','.')}}$"

 

/usr/local/mysql-{{version.replace('_','.')}}:

  file.directory:

    - user: mysql

    - group: mysql

    - recurse:

      - user

      - group

 

/data/mysql_log:

  file.directory:

    - makedirs: True

    - user: mysql

    - group: mysql

    - recurse:

      - user

      - group

 

/data/log-bin:

  file.directory:

    - makedirs: True

    - user: mysql

    - group: mysql

    - recurse:

      - user

      - group

 

/usr/bin/mysql:

  file.symlink:

    - target: /usr/local/mysql-{{version.replace('_','.')}}/bin/mysql

    - unless: ls -l /usr/bin | grep -e " mysql$"

/srv/salt/centos/public_services/mysql/5/my_cnf.sls

注意修改最后的初始化密码

my.cnf配置文件需要放到对应的目录中,my.cnf文件中要设置对应的模板变量:


port= `port` #还有其它的和端口相关的配置都要改成`port`

 basedir=/usr/local/mysql-`version` #还有其它的和版本相关的配置都要改成`version`


#!py

#coding:utf-8

"""

生成my.cnf配置文件,如果文件已存在,不作任何修改

"""

import os

 

def run():

  config={}

  version=__pillar__['mysql']['version']

  for port in __pillar__['mysql']['ports']:

    port=str(port)

    if not os.path.isfile('/data/mysql_data_%s/my.cnf'%(port)):

      config['/data/mysql_data_%s/my.cnf'%(port)]={

        'file.managed':[

          {'source':'salt://centos/public_services/mysql/5/%s/my.cnf'%(version)},

          {'template':'jinja'},

          {'context':{'port':port,'version':'%s'%(version.replace('_','.'))}},

          {'require':[{'file':'/data/mysql_data_%s'%(port)}]},

          ],

      }

      config['chown mysql.mysql /data/mysql_data_%s/my.cnf'%(port)]='cmd.run'

 

  return config

/srv/salt/centos/public_services/mysql/5/instance.sls

mysql启动脚本需要放到对应的目录中,启动脚本中要设置对应的模板变量:


basedir=/usr/local/mysql-`version` #还有其它的和版本相关的配置都要改成`version`

 datadir=/data/mysql_data_`port` #还有其它的和端口相关的配置都要改成`port`


{% for port in pillar['mysql']['ports'] %}

 

/data/mysql_data_`port`:

  file.directory:

    - makedirs: True

    - user: mysql

    - group: mysql

    - recurse:

      - user

      - group

 

/etc/init.d/mysqld_`port`:

  file.managed:

    - source: salt://centos/public_services/mysql/5/{{pillar['mysql']['version']}}/mysql.service

    - user: root

    - group: root

    - mode: 755

    - template: jinja

    - context:

      port: `port`

      version: {{pillar['mysql']['version'].replace('_','.')}}

 

chkconfig --add mysqld_`port`;chkconfig --level 345 mysqld_`port` on;:

  cmd.run:

    - unless: chkconfig --list | grep mysqld_`port`

 

#初始化库

init_mysql_`port`:

  cmd.run:

    - name: /usr/local/mysql-{{pillar['mysql']['version'].replace('_','.')}}/scripts/mysql_install_db --user=mysql --basedir=/usr/local/mysql-{{pillar['mysql']['version'].replace('_','.')}}  --datadir=/data/mysql_data_`port`/

    - unless: ls -l /data/mysql_data_`port` | grep -e ".* mysql$"

 

/etc/init.d/mysqld_`port` start:

  cmd.wait:

    - watch:

      - cmd: init_mysql_`port`

 

/usr/local/mysql-{{pillar['mysql']['version'].replace('_','.')}}/bin/mysqladmin -uroot -S /tmp/mysql_`port`.sock password 'yourmysqlpasswd!':

  cmd.wait:

    - watch:

      - cmd: init_mysql_`port`

 

{%endfor%}

四,总结

这个方法不仅可以用在mysql,同样的nginx,redis等都可以举一反三,配置文件编写完成后,仅仅需要简单的在pillar中添加几个变量就可以轻松批量部署了。


https://www.ttlsa.com/saltstack/saltstack-mysql/