MongoDB Sharding Cluster 分片集群


规划:

10个实例:38017-38026


(1)configserver:

3台构成的复制集(1主两从,不支持arbiter)38018-38020(复制集名字configsvr)


(2)shard节点:


sh1:38021-23    (1主两从,其中一个节点为arbiter,复制集名字sh1)

sh2:38024-26    (1主两从,其中一个节点为arbiter,复制集名字sh2)



配置过程


shard复制集配置:

2.1目录创建:

mkdir -p /mongodb/38021/conf  /mongodb/38021/log  /mongodb/38021/data

mkdir -p /mongodb/38022/conf  /mongodb/38022/log  /mongodb/38022/data

mkdir -p /mongodb/38023/conf  /mongodb/38023/log  /mongodb/38023/data

mkdir -p /mongodb/38024/conf  /mongodb/38024/log  /mongodb/38024/data

mkdir -p /mongodb/38025/conf  /mongodb/38025/log  /mongodb/38025/data

mkdir -p /mongodb/38026/conf  /mongodb/38026/log  /mongodb/38026/data


2.2修改配置文件:


sh1:

vi /mongodb/38021/conf/mongodb.conf

===============

根据需求修改相应参数:

systemLog:

  destination: file

  path: /mongodb/38021/log/mongodb.log   

  logAppend: true

storage:

  journal:

    enabled: true

  dbPath: /mongodb/38021/data

  directoryPerDB: true

  #engine: wiredTiger

  wiredTiger:

    engineConfig:

      cacheSizeGB: 1

      directoryForIndexes: true

    collectionConfig:

      blockCompressor: zlib

    indexConfig:

      prefixCompression: true

net:

  port: 38021

replication:

  oplogSizeMB: 2048

  replSetName: sh1

sharding:

  clusterRole: shardsvr

processManagement:

  fork: true


===============

cp  /mongodb/38021/conf/mongodb.conf  /mongodb/38022/conf/

cp  /mongodb/38021/conf/mongodb.conf  /mongodb/38023/conf/


sed 's#38021#38022#g' /mongodb/38022/conf/mongodb.conf -i

sed 's#38021#38023#g' /mongodb/38023/conf/mongodb.conf -i


sh2:

vi /mongodb/38024/conf/mongodb.conf

========

根据需求修改相应参数:

systemLog:

  destination: file

  path: /mongodb/38024/log/mongodb.log   

  logAppend: true

storage:

  journal:

    enabled: true

  dbPath: /mongodb/38024/data

  directoryPerDB: true

  wiredTiger:

    engineConfig:

      cacheSizeGB: 1

      directoryForIndexes: true

    collectionConfig:

      blockCompressor: zlib

    indexConfig:

      prefixCompression: true

net:

  port: 38024

replication:

  oplogSizeMB: 2048

  replSetName: sh2

sharding:

  clusterRole: shardsvr

processManagement:

  fork: true

========



cp  /mongodb/38024/conf/mongodb.conf  /mongodb/38025/conf/

cp  /mongodb/38024/conf/mongodb.conf  /mongodb/38026/conf/


sed 's#38024#38025#g' /mongodb/38025/conf/mongodb.conf -i

sed 's#38024#38026#g' /mongodb/38026/conf/mongodb.conf -i



2.3启动所有节点,并搭建复制集:


mongod -f  /mongodb/38021/conf/mongodb.conf

mongod -f  /mongodb/38022/conf/mongodb.conf

mongod -f  /mongodb/38023/conf/mongodb.conf

mongod -f  /mongodb/38024/conf/mongodb.conf

mongod -f  /mongodb/38025/conf/mongodb.conf

mongod -f  /mongodb/38026/conf/mongodb.conf  




mongo --port 38021


use  admin

config = {_id: 'sh1', members: [

                          {_id: 0, host: '10.0.0.53:38021'},

                          {_id: 1, host: '10.0.0.53:38022'},

                          {_id: 2, host: '10.0.0.53:38023',"arbiterOnly":true}]

           }


rs.initiate(config)



 mongo --port 38024

 use admin

config = {_id: 'sh2', members: [

                          {_id: 0, host: '10.0.0.53:38024'},

                          {_id: 1, host: '10.0.0.53:38025'},

                          {_id: 2, host: '10.0.0.53:38026',"arbiterOnly":true}]

           }


rs.initiate(config)


=-=----=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-

---3、config节点配置:


3.1目录创建:

mkdir -p /mongodb/38018/conf  /mongodb/38018/log  /mongodb/38018/data

mkdir -p /mongodb/38019/conf  /mongodb/38019/log  /mongodb/38019/data

mkdir -p /mongodb/38020/conf  /mongodb/38020/log  /mongodb/38020/data


3.2修改配置文件:


[mongod@server1 ~]$ vi /mongodb/38018/conf/mongodb.conf


systemLog:

  destination: file

  path: /mongodb/38018/log/mongodb.conf

  logAppend: true

storage:

  journal:

    enabled: true

  dbPath: /mongodb/38018/data

  directoryPerDB: true

  #engine: wiredTiger

  wiredTiger:

    engineConfig:

      cacheSizeGB: 1

      directoryForIndexes: true

    collectionConfig:

      blockCompressor: zlib

    indexConfig:

      prefixCompression: true

net:

  port: 38018

replication:

  oplogSizeMB: 2048

  replSetName: configReplSet

sharding:

  clusterRole: configsvr

processManagement:

  fork: true



cp /mongodb/38018/conf/mongodb.conf /mongodb/38019/conf/

cp /mongodb/38018/conf/mongodb.conf /mongodb/38020/conf/


sed 's#38018#38019#g' /mongodb/38019/conf/mongodb.conf -i

sed 's#38018#38020#g' /mongodb/38020/conf/mongodb.conf -i



3.3启动节点,并配置复制集



mongod -f /mongodb/38018/conf/mongodb.conf

mongod -f /mongodb/38019/conf/mongodb.conf

mongod -f /mongodb/38020/conf/mongodb.conf



mongo --port 38018

use  admin


 config = {_id: 'configReplSet', members: [

                          {_id: 0, host: '10.0.0.53:38018'},

                          {_id: 1, host: '10.0.0.53:38019'},

                          {_id: 2, host: '10.0.0.53:38020'}]

           }

rs.initiate(config)  



注:configserver 可以是一个节点,官方建议复制集。configserver不能有arbiter。

新版本中,要求必须是复制集。

注:mongodb 3.4之后,虽然要求config server为replica set,但是不支持arbiter

=============================================================================


4、mongos节点配置:

4.1创建目录:


mkdir -p /mongodb/38017/conf  /mongodb/38017/log


4.2配置文件



vi /mongodb/38017/conf/mongos.conf

systemLog:

  destination: file

  path: /mongodb/38017/log/mongos.log

  logAppend: true

net:

  port: 38017

sharding:

  configDB: configReplSet/10.0.0.53:38018,10.0.0.53:38019,10.0.0.53:38020

processManagement:

  fork: true


4.3启动mongos


 mongos -f /mongodb/38017/conf/mongos.conf


5、分片集群操作:


 连接到其中一个mongos(10.0.0.51),做以下配置

(1)连接到mongs的admin数据库

# su - mongod

$ mongo 10.0.0.51:38017/admin


(2)添加分片

db.runCommand( { addshard : "sh1/10.0.0.51:38021,10.0.0.51:38022,10.0.0.51:38023",name:"shard1"} )


db.runCommand( { addshard : "sh2/10.0.0.51:38024,10.0.0.51:38025,10.0.0.51:38026",name:"shard2"} )



(3)列出分片

mongos> db.runCommand( { listshards : 1 } )



(4)整体状态查看

mongos> sh.status();