1復制集

創建mongo鏡像,dockerfile如下

from centos:7
RUN yum install net-tools vim -y
RUN mkdir -p /mongodb/{bin,data,log,conf} \
&& touch /mongodb/log/mongodb.log \
&& chmod 755 /mongodb -R
ENV MONGOD_HOME /mongodb
ENV PATH $MONGOD_HOME/bin:$PATH
COPY ./mongodb/bin/ /mongodb/bin/
COPY mongod.conf /mongodb/conf/mongod.conf
COPY run.sh /mongodb/bin/run.sh
RUN chmod a+x /mongodb/bin/run.sh
CMD ["/mongodb/bin/run.sh"]

run.sh如下

#!/bin/bash
echo "######啟動程序##########"
mongod -f /mongodb/conf/mongod.conf
echo "######查看端口##########"
netstat -ntulp
echo "######查看進程##########"
ps -ef |grep -v grep  |grep mongod
while true
do
        sleep 1h
done

mongod.conf如下

systemLog:
  destination: file
  path: /mongodb/log/mongodb.log
  logAppend: true
storage:
  journal:
    enabled: true
  dbPath: /mongodb/data
  directoryPerDB: true
  #engine: wiredTiger
  wiredTiger:
    engineConfig:
      # cacheSizeGB: 1
      directoryForIndexes: true
    collectionConfig:
      blockCompressor: zlib
    indexConfig:
      prefixCompression: true
processManagement:
  fork: true
net:
  bindIpAll: true
  port: 27017
replication:
  oplogSizeMB: 2048
  replSetName: my_repl

docker-compose.yml如下，ip說明：我單機創建的虛擬網

version: '3.4'
x-logging:
  &default-logging
  options:
    max-size: '12m'
    max-file: '5'
  driver: json-file
services:
  mongo1:
    image: mongo:v15
    logging: *default-logging
    restart: always
    hostname: mongo1
    networks:
       doufy:
         ipv4_address: 172.19.0.71
    volumes:
      -  /etc/localtime:/etc/localtime:ro
      - /data/mongo/1/data:/mongodb/data
      - /data/mongo/1/log:/mongodb/log
  mongo2:
    image: mongo:v15
    logging: *default-logging
    restart: always
    hostname: mongo2
    networks:
       doufy:
         ipv4_address: 172.19.0.72
    volumes:
      -  /etc/localtime:/etc/localtime:ro
      - /data/mongo/2/data:/mongodb/data
      - /data/mongo/2/log:/mongodb/log

  mongo3:
    image: mongo:v15
    logging: *default-logging
    restart: always
    hostname: mongo3
    networks:
       doufy:
         ipv4_address: 172.19.0.73
    volumes:
      -  /etc/localtime:/etc/localtime:ro
      - /data/mongo/3/data:/mongodb/data
      - /data/mongo/3/log:/mongodb/log
networks:
    doufy:
      external: true

dockefile中的mongodb為官網下載，版本為4.2。下載后解壓拷貝至相應目錄

鏈接 https://www.mongodb.com/download-center/enterprise

具體配置參考配置文件。

開啟mongo數據庫

[root@dou mongo]# docker-compose up -d
Creating mongo_mongo3_1 ... done
Creating mongo_mongo2_1 ... done
Creating mongo_mongo1_1 ... done
[root@dou mongo]# docker ps |grep mongo_mongo
031d13d5c978      mongo:v15      "/mongodb/bin/run.sh"   14 seconds ago    Up 13 seconds       mongo_mongo2_1
199ed80ae7bb      mongo:v15      "/mongodb/bin/run.sh"   14 seconds ago    Up 13 seconds       mongo_mongo3_1
0fd2fc8e73cc      mongo:v15      "/mongodb/bin/run.sh"   14 seconds ago    Up 13 seconds       mongo_mongo1_1
[root@dou mongo]#

登陸數據庫，配置mongodb復制集

shell> mongo --port 27017

config = {_id: 'my_repl', members: [
                          {_id: 0, host: '172.19.0.71:27017'},
                          {_id: 1, host: '172.19.0.72:27017'},
                          {_id: 2, host: '172.19.0.73:27017'}]
          }

初始化這個配置

> rs.initiate(config)

查看狀態,數據庫已變為 PRIMARY或者SECONDARY（下面標紅部分）,rs.status可查看具體配置信息

[root@mongo2 /]# mongo
MongoDB shell version v4.2.2
connecting to: mongodb://127.0.0.1:27017/?compressors=disabled&gssapiServiceName=mongodb
Implicit session: session { "id" : UUID("93bc73e6-19fa-4661-9d6f-9ab55cecd631") }
MongoDB server version: 4.2.2
Server has startup warnings:
2019-12-16T16:53:20.003+0800 I  STORAGE  [initandlisten]
2019-12-16T16:53:20.003+0800 I  STORAGE  [initandlisten] ** WARNING: Using the XFS filesystem is strongly recommended with the WiredTiger storage engine
2019-12-16T16:53:20.003+0800 I  STORAGE  [initandlisten] **          See http://dochub.mongodb.org/core/prodnotes-filesystem
2019-12-16T16:53:23.351+0800 I  CONTROL  [initandlisten]
2019-12-16T16:53:23.356+0800 I  CONTROL  [initandlisten] ** WARNING: Access control is not enabled for the database.
2019-12-16T16:53:23.356+0800 I  CONTROL  [initandlisten] **          Read and write access to data and configuration is unrestricted.
2019-12-16T16:53:23.356+0800 I  CONTROL  [initandlisten] ** WARNING: You are running this process as the root user,which is not recommended.
2019-12-16T16:53:23.356+0800 I  CONTROL  [initandlisten]
---
Enable MongoDB's free cloud-based monitoring service, which will then receive and display
metrics about your deployment (disk utilization, CPU, operation statistics, etc).

The monitoring data will be available on a MongoDB website with a unique URL accessible to you
and anyone you share the URL with. MongoDB may use this information to make product
improvements and to suggest MongoDB products and deployment options to you.

To enable free monitoring, run the following command: db.enableFreeMonitoring()
To permanently disable this reminder, run the following command: db.disableFreeMonitoring()
---

my_repl:PRIMARY> rs.status()
{
        "set" : "my_repl",
        "date" : ISODate("2019-12-16T09:17:56.194Z"),
        "myState" : 1,
        "term" : NumberLong(3),
        "syncingTo" : "",
        "syncSourceHost" : "",
        "syncSourceId" : -1,
        "heartbeatIntervalMillis" : NumberLong(2000),
        "majorityVoteCount" : 2,
        "writeMajorityCount" : 2,
        "optimes" : {
                "lastCommittedOpTime" : {
                        "ts" : Timestamp(1576487867, 1),
                        "t" : NumberLong(3)
                },
                "lastCommittedWallTime" : ISODate("2019-12-16T09:17:47.805Z"),
                "readConcernMajorityOpTime" : {
                        "ts" : Timestamp(1576487867, 1),
                        "t" : NumberLong(3)
                },
                "readConcernMajorityWallTime" : ISODate("2019-12-16T09:17:47.805Z"),
                "appliedOpTime" : {
                        "ts" : Timestamp(1576487867, 1),
                        "t" : NumberLong(3)
                },
                "durableOpTime" : {
                        "ts" : Timestamp(1576487867, 1),
                        "t" : NumberLong(3)
                },
                "lastAppliedWallTime" : ISODate("2019-12-16T09:17:47.805Z"),
                "lastDurableWallTime" : ISODate("2019-12-16T09:17:47.805Z")
        },
        "lastStableRecoveryTimestamp" : Timestamp(1576487837, 1),
        "lastStableCheckpointTimestamp" : Timestamp(1576487837, 1),
        "electionCandidateMetrics" : {
                "lastElectionReason" : "electionTimeout",
                "lastElectionDate" : ISODate("2019-12-16T08:58:41.635Z"),
                "electionTerm" : NumberLong(3),
                "lastCommittedOpTimeAtElection" : {
                        "ts" : Timestamp(1576486664, 1),
                        "t" : NumberLong(2)
                },
                "lastSeenOpTimeAtElection" : {
                        "ts" : Timestamp(1576486664, 1),
                        "t" : NumberLong(2)
                },
                "numVotesNeeded" : 2,
                "priorityAtElection" : 1,
                "electionTimeoutMillis" : NumberLong(10000),
                "numCatchUpOps" : NumberLong(0),
                "newTermStartDate" : ISODate("2019-12-16T08:58:47.761Z"),
                "wMajorityWriteAvailabilityDate" : ISODate("2019-12-16T08:58:48.557Z")
        },
        "electionParticipantMetrics" : {
                "votedForCandidate" : true,
                "electionTerm" : NumberLong(2),
                "lastVoteDate" : ISODate("2019-12-16T08:53:34.481Z"),
                "electionCandidateMemberId" : 0,
                "voteReason" : "",
                "lastAppliedOpTimeAtElection" : {
                        "ts" : Timestamp(1576486389, 1),
                        "t" : NumberLong(1)
                },
                "maxAppliedOpTimeInSet" : {
                        "ts" : Timestamp(1576486389, 1),
                        "t" : NumberLong(1)
                },
                "priorityAtElection" : 1
        },
        "members" : [
                {
                        "_id" : 0,
                        "name" : "172.19.0.71:27017",
                        "ip" : "172.19.0.71",
                        "health" : 1,
                        "state" : 2,
                        "stateStr" : "SECONDARY",
                        "uptime" : 1138,
                        "optime" : {
                                "ts" : Timestamp(1576487867, 1),
                                "t" : NumberLong(3)
                        },
                        "optimeDurable" : {
                                "ts" : Timestamp(1576487867, 1),
                                "t" : NumberLong(3)
                        },
                        "optimeDate" : ISODate("2019-12-16T09:17:47Z"),
                        "optimeDurableDate" : ISODate("2019-12-16T09:17:47Z"),
                        "lastHeartbeat" : ISODate("2019-12-16T09:17:55.713Z"),
                        "lastHeartbeatRecv" : ISODate("2019-12-16T09:17:55.705Z"),
                        "pingMs" : NumberLong(0),
                        "lastHeartbeatMessage" : "",
                        "syncingTo" : "172.19.0.73:27017",
                        "syncSourceHost" : "172.19.0.73:27017",
                        "syncSourceId" : 2,
                        "infoMessage" : "",
                        "configVersion" : 1
                },
                {
                        "_id" : 1,
                        "name" : "172.19.0.72:27017",
                        "ip" : "172.19.0.72",
                        "health" : 1,
                        "state" : 1,
                        "stateStr" : "PRIMARY",
                        "uptime" : 1477,
                        "optime" : {
                                "ts" : Timestamp(1576487867, 1),
                                "t" : NumberLong(3)
                        },
                        "optimeDate" : ISODate("2019-12-16T09:17:47Z"),
                        "syncingTo" : "",
                        "syncSourceHost" : "",
                        "syncSourceId" : -1,
                        "infoMessage" : "",
                        "electionTime" : Timestamp(1576486721, 1),
                        "electionDate" : ISODate("2019-12-16T08:58:41Z"),
                        "configVersion" : 1,
                        "self" : true,
                        "lastHeartbeatMessage" : ""
                },
                {
                        "_id" : 2,
                        "name" : "172.19.0.73:27017",
                        "ip" : "172.19.0.73",
                        "health" : 1,
                        "state" : 2,
                        "stateStr" : "SECONDARY",
                        "uptime" : 1158,
                        "optime" : {
                                "ts" : Timestamp(1576487867, 1),
                                "t" : NumberLong(3)
                        },
                        "optimeDurable" : {
                                "ts" : Timestamp(1576487867, 1),
                                "t" : NumberLong(3)
                        },
                        "optimeDate" : ISODate("2019-12-16T09:17:47Z"),
                        "optimeDurableDate" : ISODate("2019-12-16T09:17:47Z"),
                        "lastHeartbeat" : ISODate("2019-12-16T09:17:55.714Z"),
                        "lastHeartbeatRecv" : ISODate("2019-12-16T09:17:54.613Z"),
                        "pingMs" : NumberLong(0),
                        "lastHeartbeatMessage" : "",
                        "syncingTo" : "172.19.0.72:27017",
                        "syncSourceHost" : "172.19.0.72:27017",
                        "syncSourceId" : 1,
                        "infoMessage" : "",
                        "configVersion" : 1
                }
        ],
        "ok" : 1,
        "$clusterTime" : {
                "clusterTime" : Timestamp(1576487867, 1),
                "signature" : {
                        "hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="),
                        "keyId" : NumberLong(0)
                }
        },
        "operationTime" : Timestamp(1576487867, 1)
}
my_repl:PRIMARY>

View Code

常用命令

查看復制集狀態：
   rs.status();    //查看整體復制集狀態
   rs.isMaster(); // 查看當前是否是主節點
添加刪除節點
   rs.remove("ip:port"); // 刪除一個節點
   rs.add("ip:port"); // 新增從節點
   rs.addArb("ip:port"); // 新增仲裁節點

檢查復制集狀態，首先在master節點插入數據

my_repl:PRIMARY> show tables;      #查看表，插入數據，並查找數據
my_repl:PRIMARY> db.doufy.insert({title: 'MongoDB 集群測試', description: 'MongoDB 是一個 Nosql 數據庫', by: 'doufy', url: 'https://www.cnblogs.com/doufy/p/12050182.html', tags: ['mongodb', 'database', 'NoSQL'], likes: 200})
WriteResult({ "nInserted" : 1 })   #插入成功
my_repl:PRIMARY> show tables;
doufy
my_repl:PRIMARY> db.doufy.find().pretty(){
        "_id" : ObjectId("5df840efae0e90ae5aa605d6"),
        "title" : "MongoDB 集群測試",
        "description" : "MongoDB 是一個 Nosql 數據庫",
        "by" : "doufy",
        "url" : "https://www.cnblogs.com/doufy/p/12050182.html",
        "tags" : [
                "mongodb",
                "database",
                "NoSQL"
        ],
        "likes" : 200
}
my_repl:PRIMARY>

從節點檢查數據

my_repl:SECONDARY> rs.slaveOk()
my_repl:SECONDARY> show tables;
doufy
my_repl:SECONDARY> db.doufy.find().pretty()
{
        "_id" : ObjectId("5df840efae0e90ae5aa605d6"),
        "title" : "MongoDB 集群測試",
        "description" : "MongoDB 是一個 Nosql 數據庫",
        "by" : "doufy",
        "url" : "https://www.cnblogs.com/doufy/p/12050182.html",
        "tags" : [
                "mongodb",
                "database",
                "NoSQL"
        ],
        "likes" : 200
}
#由此可見數據正常同步，此時我們在主庫（PRIMARY）執行刪除表  db.doufy.drop()，然后從庫查詢，發現數據被刪除了
my_repl:SECONDARY> show tables; 
my_repl:SECONDARY> db.doufy.find().pretty() 
my_repl:SECONDARY>

#注可自己測試，停止主節點，查看從節點狀態，是否變為主節點

主節點關閉，然后去從節點看下。
use  admin
db.shutdownServer()

2分片集

分片集群部署圖

IP地址	路由服務	配置服務	shard1	shard2	shard3
172.19.0.81	27017	27018	27011	27012	27013
172.19.0.82	27017	27018	27011	27012	27013
172.19.0.83	27017	27018	27011	27012	27013

相應的配置文件如下，過長我折疊了

#dockerfile  如下
from centos:7
RUN yum install net-tools vim -y
RUN mkdir -p /mongodb/{bin,conf,data/{share{1,2,3},conf,mongos},log} \
 && touch /mongodb/log/{share{1,2,3}.log,mongos.log,conf.log} \
 && chmod 755 /mongodb -R
ENV MONGOD_HOME /mongodb
ENV PATH $MONGOD_HOME/bin:$PATH
COPY  ./mongodb/bin/   /mongodb/bin/
COPY config  /mongodb/conf/
COPY run.sh  /mongodb/bin/run.sh
RUN chmod a+x /mongodb/bin/run.sh

------------------------分割線---------------------------------
#run.sh如下
#!/bin/bash
echo "######啟動程序##########"
mongod -f /mongodb/conf/mongod1.yml
mongod -f /mongodb/conf/mongod2.yml
mongod -f /mongodb/conf/mongod3.yml
mongod -f /mongodb/conf/conf.yml
mongos -f /mongodb/conf/mongos.yml --fork
echo "######查看端口##########"
netstat -ntulp
echo "######查看進程##########"
ps -ef |grep -v grep  |grep mongod
while true
do
        sleep 1h
done

------------------------分割線---------------------------------
#docker-compose.yml    掛在目錄有點問題

version: '3.4'
x-logging:
  &default-logging
  options:
    max-size: '12m'
    max-file: '5'
  driver: json-file
services:
  mongo1:
    image: mongo:v25
    logging: *default-logging
    restart: always
    hostname: mongo1
    networks:
       doufy:
         ipv4_address: 172.19.0.81
    volumes:
      -  /etc/localtime:/etc/localtime:ro
    #  - /data/mongoshare/1/log:/mongodb/log
     # - /data/mongoshare/1/data:/mongodb/data
  mongo2:
    image: mongo:v25
    logging: *default-logging
    restart: always
    hostname: mongo2
    networks:
       doufy:
         ipv4_address: 172.19.0.82
    volumes:
      -  /etc/localtime:/etc/localtime:ro
      #- /data/mongoshare/2/log:/mongodb/log
      #- /data/mongoshare/2/data:/mongodb/data

  mongo3:
    image: mongo:v25
    logging: *default-logging
    restart: always
    hostname: mongo3
    networks:
       doufy:
         ipv4_address: 172.19.0.83
    volumes:
      -  /etc/localtime:/etc/localtime:ro
     # - /data/mongoshare/3/log:/mongodb/log
    #  - /data/mongoshare/3/data:/mongodb/data
networks:
    doufy:
      external: true
------------------------分割線---------------------------------
#conf.yml
systemLog:
  destination: file
  path: /mongodb/log/conf.log
  logAppend: true
storage:
  journal:
    enabled: true
  dbPath: /mongodb/data/conf/
  directoryPerDB: true
  #engine: wiredTiger
  wiredTiger:
    engineConfig:
      # cacheSizeGB: 1
      directoryForIndexes: true
    collectionConfig:
      blockCompressor: zlib
    indexConfig:
      prefixCompression: true
processManagement:
  fork: true
sharding:
   clusterRole:  configsvr
net:
  port: 27018
  bindIpAll: true
replication:
  oplogSizeMB: 2048
  replSetName: configReplSet

------------------------分割線---------------------------------
#mongod1.yml   
#mongod2.yml 和mongod3.yml修改path和dbPath replSetName字段
systemLog:
  destination: file
  path: /mongodb/log/share1.log
  logAppend: true
storage:
  journal:
    enabled: true
  dbPath: /mongodb/data/share1/
  directoryPerDB: true
  #engine: wiredTiger
  wiredTiger:
    engineConfig:
      # cacheSizeGB: 1
      directoryForIndexes: true
    collectionConfig:
      blockCompressor: zlib
    indexConfig:
      prefixCompression: true
processManagement:
  fork: true
sharding:
   clusterRole: shardsvr
net:
  port: 27011
  bindIpAll: true
replication:
  oplogSizeMB: 2048
  replSetName: sh1

------------------------分割線---------------------------------
#mongos.yml

systemLog:
  destination: file
  path: /mongodb/log/mongos.log
  logAppend: true
processManagement:
  fork: true
sharding:
   configDB: configReplSet/172.19.0.81:27018,172.19.0.82:27018,172.19.0.83:27018
net:
  port: 27017
  bindIpAll: true

View Code

開啟服務

[root@dou ]# docker-compose up -d
Creating mongoshare_mongo3_1 ... done
Creating mongoshare_mongo1_1 ... done
Creating mongoshare_mongo2_1 ... done
[root@dou ]#

配置share1復制集

[root@dou ]# docker exec -it mongoshare_mongo1_1 bash -c  "echo  'rs.initiate({_id: \"sh1\", members: [{_id: 0, host: \"172.19.0.81:27011\"},{_id: 1, host: \"172.19.0.82:27011\"},{_id: 2, host: \"172.19.0.83:27011\"}]})' | mongo --port 27011"
#顯示如下
MongoDB shell version v4.2.2
connecting to: mongodb://127.0.0.1:27011/?compressors=disabled&gssapiServiceName=mongodb
Implicit session: session { "id" : UUID("3a647817-fc00-4ffd-aede-39899244e541") }
MongoDB server version: 4.2.2
{
        "ok" : 1,
        "$clusterTime" : {
                "clusterTime" : Timestamp(1576633685, 1),
                "signature" : {
                        "hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="),
                        "keyId" : NumberLong(0)
                }
        },
        "operationTime" : Timestamp(1576633685, 1)
}
bye
[root@dou ]#

依次配置share2和share3

docker exec -it mongoshare_mongo1_1 bash -c  "echo  'rs.initiate({_id: \"sh2\", members: [{_id: 0, host: \"172.19.0.81:27012\"},{_id: 1, host: \"172.19.0.82:27012\"},{_id: 2, host: \"172.19.0.83:27012\"}]})' | mongo --port 27012"
docker exec -it mongoshare_mongo1_1 bash -c  "echo  'rs.initiate({_id: \"sh3\", members: [{_id: 0, host: \"172.19.0.81:27013\"},{_id: 1, host: \"172.19.0.82:27013\"},{_id: 2, host: \"172.19.0.83:27013\"}]})' | mongo --port 27013"

配置conf配置服務

docker exec -it mongoshare_mongo1_1 bash -c  "echo  'rs.initiate({_id: \"configReplSet\",configsvr: true, members: [{_id: 0, host: \"172.19.0.81:27018\"},{_id: 1, host: \"172.19.0.82:27018\"},{_id: 2, host: \"172.19.0.83:27018\"}]})' | mongo --port 27018"

配置路由服務

docker exec -it mongoshare_mongo1_1 bash -c "echo 'db.runCommand({addshard: \"sh1/172.19.0.81:27011,172.19.0.82:27011,172.19.0.83:27011\",name:\"shard1\"} )'|mongo 127.0.0.1:27017/admin "
docker exec -it mongoshare_mongo1_1 bash -c "echo 'db.runCommand({addshard: \"sh2/172.19.0.81:27012,172.19.0.82:27012,172.19.0.83:27012\",name:\"shard2\"} )'|mongo 127.0.0.1:27017/admin "
docker exec -it mongoshare_mongo1_1 bash -c "echo 'db.runCommand({addshard: \"sh3/172.19.0.81:27013,172.19.0.82:27013,172.19.0.83:27013\",name:\"shard3\"} )'|mongo 127.0.0.1:27017/admin "

查看狀態

docker exec -it mongoshare_mongo1_1 bash -c "echo 'db.runCommand({ listshards: 1})'|mongo 127.0.0.1:27017/admin "

MongoDB shell version v4.2.2
connecting to: mongodb://127.0.0.1:27017/admin?compressors=disabled&gssapiServiceName=mongodb
Implicit session: session { "id" : UUID("42e88dc3-e52b-4ab5-98de-a2ed3f88ad0e") }
MongoDB server version: 4.2.2
{
        "shards" : [
                {
                        "_id" : "shard1",
                        "host" : "sh1/172.19.0.81:27011,172.19.0.82:27011,172.19.0.83:27011",
                        "state" : 1
                },
                {
                        "_id" : "shard2",
                        "host" : "sh2/172.19.0.81:27012,172.19.0.82:27012,172.19.0.83:27012",
                        "state" : 1
                },
                {
                        "_id" : "shard3",
                        "host" : "sh3/172.19.0.81:27013,172.19.0.82:27013,172.19.0.83:27013",
                        "state" : 1
                }
        ],
        "ok" : 1,
        "operationTime" : Timestamp(1576635328, 1),
        "$clusterTime" : {
                "clusterTime" : Timestamp(1576635328, 1),
                "signature" : {
                        "hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="),
                        "keyId" : NumberLong(0)
                }
        }
}
bye

至此分片集群部署完畢，開始使用吧

免責聲明！

本站轉載的文章為個人學習借鑒使用，本站對版權不負任何法律責任。如果侵犯了您的隱私權益，請聯系本站郵箱yoyou2525@163.com刪除。

猜您在找 Mongo分片集群部署 Docker部署ELK 7.0.1集群之Logstash安裝介紹 Docker部署ELK 7.0.1集群之Kibana安裝介紹 MongoDB之分片集群與復制集 Impala編譯部署-6集群部署 mongodb3.6集群搭建:分片+副本集 openshift3.10集群部署 Redis 5.0.3集群部署 kubernetes1.18.2集群部署 Kylin-2.6.2集群部署