k8s 安装 mongodb 分片（Sharding）+ 副本集（Replica Set）

2023-10-22 23:40
文章标签 云原生 安装 set mongodb k8s 分片 副本 sharding replica

本文主要是介绍k8s 安装 mongodb 分片（Sharding）+ 副本集（Replica Set），希望对大家解决编程问题提供一定的参考价值，需要的开发者们随着小编来一起学习吧！

k8s 安装 mongodb 分片（Sharding）+ 副本集（Replica Set）

  • 1.安装环境
  • 2.配置nfs并重启 (nfs 已经安装)
  • 3.创建 PV 持久卷
  • 4.部署 config server（配置服务器）
  • 5.创建config 集群
    • 5.1 进入任意一个pod
    • 5.2 连接上mongodb
    • 5.3 配置副本集
  • 6.部署 shard server（分片服务器）
    • 6.1验证是否创建成功
    • 6.2 配置第一分片集群
    • 6.3 配置第二分片集群
  • 7.部署 route server（mongos 路由服务器）
    • 7.1验证
    • 7.2 将路由服务器和分片副本集串联起来
  • 8.分片测试

在这里插入图片描述

1.安装环境

k8s 1.23. docker 20.10.12 centos 7

2.配置nfs并重启 (nfs 已经安装)

mkdir -p /data/k8s/mongodb/shard/pv1  &&
mkdir -p /data/k8s/mongodb/shard/pv2  &&
mkdir -p /data/k8s/mongodb/shard/pv3  &&
mkdir -p /data/k8s/mongodb/shard/pv4  &&
mkdir -p /data/k8s/mongodb/shard/pv5  &&
mkdir -p /data/k8s/mongodb/shard/pv6  &&
mkdir -p /data/k8s/mongodb/config/pv1 &&
mkdir -p /data/k8s/mongodb/config/pv2 &&
mkdir -p /data/k8s/mongodb/config/pv3 vi /etc/exports
#加入如下内容
/data/k8s/mongodb/shard/pv1 *(rw,sync,no_root_squash)
/data/k8s/mongodb/shard/pv2 *(rw,sync,no_root_squash)
/data/k8s/mongodb/shard/pv3 *(rw,sync,no_root_squash)
/data/k8s/mongodb/shard/pv4 *(rw,sync,no_root_squash)
/data/k8s/mongodb/shard/pv5 *(rw,sync,no_root_squash)
/data/k8s/mongodb/shard/pv6 *(rw,sync,no_root_squash)
/data/k8s/mongodb/config/pv1 *(rw,sync,no_root_squash)
/data/k8s/mongodb/config/pv2 *(rw,sync,no_root_squash)
/data/k8s/mongodb/config/pv3 *(rw,sync,no_root_squash)#重启
systemctl restart rpcbind
systemctl restart nfs

验证

[root@k8smaster mongodb-shard]# exportfs -v
/data/k8s       <world>(sync,wdelay,hide,no_subtree_check,sec=sys,rw,secure,no_root_squash,no_all_squash)
/opt/nfs/maven  <world>(sync,wdelay,hide,no_subtree_check,sec=sys,rw,secure,no_root_squash,no_all_squash)
/data/k8s/www-data<world>(sync,wdelay,hide,no_subtree_check,sec=sys,rw,secure,no_root_squash,no_all_squash)
/data/k8s/mongodb/shard/pv1<world>(sync,wdelay,hide,no_subtree_check,sec=sys,rw,secure,no_root_squash,no_all_squash)
/data/k8s/mongodb/shard/pv2<world>(sync,wdelay,hide,no_subtree_check,sec=sys,rw,secure,no_root_squash,no_all_squash)
/data/k8s/mongodb/shard/pv3<world>(sync,wdelay,hide,no_subtree_check,sec=sys,rw,secure,no_root_squash,no_all_squash)
/data/k8s/mongodb/shard/pv4<world>(sync,wdelay,hide,no_subtree_check,sec=sys,rw,secure,no_root_squash,no_all_squash)
/data/k8s/mongodb/shard/pv5<world>(sync,wdelay,hide,no_subtree_check,sec=sys,rw,secure,no_root_squash,no_all_squash)
/data/k8s/mongodb/shard/pv6<world>(sync,wdelay,hide,no_subtree_check,sec=sys,rw,secure,no_root_squash,no_all_squash)
/data/k8s/mongodb/config/pv1<world>(sync,wdelay,hide,no_subtree_check,sec=sys,rw,secure,no_root_squash,no_all_squash)
/data/k8s/mongodb/config/pv2<world>(sync,wdelay,hide,no_subtree_check,sec=sys,rw,secure,no_root_squash,no_all_squash)
/data/k8s/mongodb/config/pv3<world>(sync,wdelay,hide,no_subtree_check,sec=sys,rw,secure,no_root_squash,no_all_squash)
[root@k8smaster mongodb-shard]#

3.创建 PV 持久卷

#创建shard的第1个PV
apiVersion: v1
kind: PersistentVolume
metadata:name: mongodb-shard-pv1labels:app: mongodb
spec:capacity:storage: 10GiaccessModes:- ReadWriteOncestorageClassName: course-nfs-storagenfs:server: 10.10.220.101path: "/data/k8s/mongodb/shard/pv1"persistentVolumeReclaimPolicy: Retain
---
#创建shard的第2个PV
apiVersion: v1
kind: PersistentVolume
metadata:name: mongodb-shard-pv2labels:app: mongodb
spec:capacity:storage: 10GiaccessModes:- ReadWriteOncestorageClassName: course-nfs-storagenfs:server: 10.10.220.101path: "/data/k8s/mongodb/shard/pv2"persistentVolumeReclaimPolicy: Retain
---
#创建shard的第3个PV
apiVersion: v1
kind: PersistentVolume
metadata:name: mongodb-shard-pv3labels:app: mongodb
spec:capacity:storage: 10GiaccessModes:- ReadWriteOncestorageClassName: course-nfs-storagenfs:server: 10.10.220.101path: "/data/k8s/mongodb/shard/pv3"persistentVolumeReclaimPolicy: Retain
---
#创建shard的第4个PV
apiVersion: v1
kind: PersistentVolume
metadata:name: mongodb-shard-pv4labels:app: mongodb
spec:capacity:storage: 10GiaccessModes:- ReadWriteOncestorageClassName: course-nfs-storagenfs:server: 10.10.220.101path: "/data/k8s/mongodb/shard/pv4"persistentVolumeReclaimPolicy: Retain
---
#创建shard的第5个PV
apiVersion: v1
kind: PersistentVolume
metadata:name: mongodb-shard-pv5labels:app: mongodb
spec:capacity:storage: 10GiaccessModes:- ReadWriteOncestorageClassName: course-nfs-storagenfs:server: 10.10.220.101path: "/data/k8s/mongodb/shard/pv5"persistentVolumeReclaimPolicy: Retain
---
#创建shard的第6个PV
apiVersion: v1
kind: PersistentVolume
metadata:name: mongodb-shard-pv6labels:app: mongodb
spec:capacity:storage: 10GiaccessModes:- ReadWriteOncestorageClassName: course-nfs-storagenfs:server: 10.10.220.101path: "/data/k8s/mongodb/shard/pv6"persistentVolumeReclaimPolicy: Retain
---
#创建config的第1个PV
apiVersion: v1
kind: PersistentVolume
metadata:name: mongodb-config-pv1labels:app: mongodb
spec:capacity:storage: 1GiaccessModes:- ReadWriteOncestorageClassName: mongodb-config-storagenfs:server: 10.10.220.101path: "/data/k8s/mongodb/config/pv1"persistentVolumeReclaimPolicy: Retain
---
#创建config的第2个PV
apiVersion: v1
kind: PersistentVolume
metadata:name: mongodb-config-pv2labels:app: mongodb
spec:capacity:storage: 1GiaccessModes:- ReadWriteOncestorageClassName: mongodb-config-storagenfs:server: 10.10.220.101path: "/data/k8s/mongodb/config/pv2"persistentVolumeReclaimPolicy: Retain
---
#创建config的第3个PV
apiVersion: v1
kind: PersistentVolume
metadata:name: mongodb-config-pv3labels:app: mongodb
spec:capacity:storage: 1GiaccessModes:- ReadWriteOncestorageClassName: mongodb-config-storagenfs:server: 10.10.220.101path: "/data/k8s/mongodb/config/pv3"persistentVolumeReclaimPolicy: Retain

查看创建结果

[root@k8smaster mongodb-shard]# kubectl get pv|grep mongo
mongodb-config-pv1                         1Gi        RWO            Retain           Available                                                                      mongodb-config-storage            4d11h
mongodb-config-pv2                         1Gi        RWO            Retain           Available                                                                      mongodb-config-storage            4d11h
mongodb-config-pv3                         1Gi        RWO            Retain           Available                                                                      mongodb-config-storage            4d11h
mongodb-shard-pv1                          10Gi       RWO            Retain           Bound       default/mongdb-config-persistent-storage-mongodb-config-2          course-nfs-storage                4d11h
mongodb-shard-pv2                          10Gi       RWO            Retain           Bound       default/mongdb-config-persistent-storage-mongodb-config-1          course-nfs-storage                4d11h
mongodb-shard-pv3                          10Gi       RWO            Retain           Bound       default/mongdb-config-persistent-storage-mongodb-config-0          course-nfs-storage                4d11h
mongodb-shard-pv4                          10Gi       RWO            Retain           Bound       default/mongdb-shard-persistent-storage-mongodb-shard0-0           course-nfs-storage                4d11h
mongodb-shard-pv5                          10Gi       RWO            Retain           Bound       default/mongdb-shard-persistent-storage-mongodb-shard1-0           course-nfs-storage                4d11h
mongodb-shard-pv6                          10Gi       RWO            Retain           Bound       default/mongdb-shard-persistent-storage-mongodb-shard1-1           course-nfs-storage                4d11h

4.部署 config server（配置服务器）

apiVersion: apps/v1
kind: StatefulSet
metadata:name: mongodb-config
spec:selector:matchLabels:app: mongodb-configserviceName: "mongodb-config-hs"replicas: 3template:metadata:labels:app: mongodb-configspec:terminationGracePeriodSeconds: 10containers:- name: mongodb-configimage: mongo:4.4command:- mongod- "--port"- "27017"- "--configsvr"- "--replSet"- "configs"- "--bind_ip"- 0.0.0.0ports:- containerPort: 27017volumeMounts:- name: mongdb-config-persistent-storagemountPath: /data/configdbvolumeClaimTemplates:- metadata:name: mongdb-config-persistent-storagespec:storageClassName: course-nfs-storageaccessModes:- ReadWriteOnceresources:requests:storage: 1Gi
---
# headless 无头服务（提供域名供StatefulSet内部pod访问使用）
apiVersion: v1
kind: Service
metadata:name: mongodb-config-hslabels:name: mongodb-config
spec:ports:- port: 27017targetPort: 27017clusterIP: Noneselector:app: mongodb-config

验证是否创建成功

[root@k8smaster ~]# kubectl get pods
NAME                                     READY   STATUS    RESTARTS      AGE
mongodb-config-0                         1/1     Running   0             4d11h
mongodb-config-1                         1/1     Running   0             4d11h
mongodb-config-2                         1/1     Running   0             4d11h
[root@k8smaster ~]# 

[root@k8smaster ~]# kubectl get services
NAME                 TYPE        CLUSTER-IP     EXTERNAL-IP   PORT(S)           AGE
kubernetes           ClusterIP   10.96.0.1      <none>        443/TCP           112d
mongodb-config-hs    ClusterIP   None           <none>        27017/TCP         4d11h

注意：存储卷没有绑定成功？ \color{red}{注意：存储卷没有绑定成功？} 注意：存储卷没有绑定成功？

# 第1个分片（每个分片有3个副本）
apiVersion: apps/v1
kind: StatefulSet
metadata:name: mongodb-shard0
spec:selector:matchLabels:app: mongodb-shardserviceName: "mongodb-shard-hs"replicas: 3template:metadata:labels:app: mongodb-shardspec:terminationGracePeriodSeconds: 10containers:- name: mongodb-shardimage: mongo:4.4command:- mongod- "--port"- "27017"- "--shardsvr"- "--replSet"- shard0- "--bind_ip"- 0.0.0.0ports:- containerPort: 27017volumeMounts:- name: mongdb-shard-persistent-storagemountPath: /data/dbvolumeClaimTemplates:- metadata:name: mongdb-shard-persistent-storagespec:storageClassName: course-nfs-storageaccessModes:- ReadWriteOnceresources:requests:storage: 10Gi
---
# 第2个分片（每个分片有3个副本）
apiVersion: apps/v1
kind: StatefulSet
metadata:name: mongodb-shard1
spec:selector:matchLabels:app: mongodb-shardserviceName: "mongodb-shard-hs"replicas: 3template:metadata:labels:app: mongodb-shardspec:terminationGracePeriodSeconds: 10containers:- name: mongodb-shardimage: mongo:4.4command:- mongod- "--port"- "27017"- "--shardsvr"- "--replSet"- shard1- "--bind_ip"- 0.0.0.0ports:- containerPort: 27017volumeMounts:- name: mongdb-shard-persistent-storagemountPath: /data/dbvolumeClaimTemplates:- metadata:name: mongdb-shard-persistent-storagespec:storageClassName: course-nfs-storageaccessModes:- ReadWriteOnceresources:requests:storage: 10Gi
---
# headless 无头服务（提供域名供StatefulSet内部pod访问使用）
apiVersion: v1
kind: Service
metadata:name: mongodb-shard-hslabels:name: mongodb-shard
spec:ports:- port: 27017targetPort: 27017clusterIP: Noneselector:app: mongodb-shard

5.创建config 集群

5.1 进入任意一个pod

kubectl exec -it mongodb-config-0 /bin/bash

5.2 连接上mongodb

bin/mongo mongodb-config-0.mongodb-config-hs.default.svc.cluster.local:27017

5.3 配置副本集

cfg = {_id : "configs",members : [{_id : 0, host : "mongodb-config-0.mongodb-config-hs.default.svc.cluster.local:27017" },{_id : 1, host : "mongodb-config-1.mongodb-config-hs.default.svc.cluster.local:27017" },{_id : 2, host : "mongodb-config-2.mongodb-config-hs.default.svc.cluster.local:27017" }]
}

rs.initiate(cfg)

configs:PRIMARY> rs.status()
{"set" : "configs","date" : ISODate("2022-04-07T02:44:27.717Z"),"myState" : 1,"term" : NumberLong(1),"syncSourceHost" : "","syncSourceId" : -1,"configsvr" : true,"heartbeatIntervalMillis" : NumberLong(2000),"majorityVoteCount" : 2,"writeMajorityCount" : 2,"votingMembersCount" : 3,"writableVotingMembersCount" : 3,"optimes" : {"lastCommittedOpTime" : {"ts" : Timestamp(1649299466, 1),"t" : NumberLong(1)},"lastCommittedWallTime" : ISODate("2022-04-07T02:44:26.741Z"),"readConcernMajorityOpTime" : {"ts" : Timestamp(1649299466, 1),"t" : NumberLong(1)},"readConcernMajorityWallTime" : ISODate("2022-04-07T02:44:26.741Z"),"appliedOpTime" : {"ts" : Timestamp(1649299466, 1),"t" : NumberLong(1)},"durableOpTime" : {"ts" : Timestamp(1649299466, 1),"t" : NumberLong(1)},"lastAppliedWallTime" : ISODate("2022-04-07T02:44:26.741Z"),"lastDurableWallTime" : ISODate("2022-04-07T02:44:26.741Z")},"lastStableRecoveryTimestamp" : Timestamp(1649299451, 1),"electionCandidateMetrics" : {"lastElectionReason" : "electionTimeout","lastElectionDate" : ISODate("2022-04-02T15:02:26.647Z"),"electionTerm" : NumberLong(1),"lastCommittedOpTimeAtElection" : {"ts" : Timestamp(0, 0),"t" : NumberLong(-1)},"lastSeenOpTimeAtElection" : {"ts" : Timestamp(1648911736, 1),"t" : NumberLong(-1)},"numVotesNeeded" : 2,"priorityAtElection" : 1,"electionTimeoutMillis" : NumberLong(10000),"numCatchUpOps" : NumberLong(0),"newTermStartDate" : ISODate("2022-04-02T15:02:26.750Z"),"wMajorityWriteAvailabilityDate" : ISODate("2022-04-02T15:02:27.552Z")},"members" : [{"_id" : 0,"name" : "mongodb-config-0.mongodb-config-hs.default.svc.cluster.local:27017","health" : 1,"state" : 1,"stateStr" : "PRIMARY","uptime" : 388015,"optime" : {"ts" : Timestamp(1649299466, 1),"t" : NumberLong(1)},"optimeDate" : ISODate("2022-04-07T02:44:26Z"),"lastAppliedWallTime" : ISODate("2022-04-07T02:44:26.741Z"),"lastDurableWallTime" : ISODate("2022-04-07T02:44:26.741Z"),"syncSourceHost" : "","syncSourceId" : -1,"infoMessage" : "","electionTime" : Timestamp(1648911746, 1),"electionDate" : ISODate("2022-04-02T15:02:26Z"),"configVersion" : 1,"configTerm" : 1,"self" : true,"lastHeartbeatMessage" : ""},{"_id" : 1,"name" : "mongodb-config-1.mongodb-config-hs.default.svc.cluster.local:27017","health" : 1,"state" : 2,"stateStr" : "SECONDARY","uptime" : 387731,"optime" : {"ts" : Timestamp(1649299465, 1),"t" : NumberLong(1)},"optimeDurable" : {"ts" : Timestamp(1649299465, 1),"t" : NumberLong(1)},"optimeDate" : ISODate("2022-04-07T02:44:25Z"),"optimeDurableDate" : ISODate("2022-04-07T02:44:25Z"),"lastAppliedWallTime" : ISODate("2022-04-07T02:44:26.741Z"),"lastDurableWallTime" : ISODate("2022-04-07T02:44:26.741Z"),"lastHeartbeat" : ISODate("2022-04-07T02:44:26.196Z"),"lastHeartbeatRecv" : ISODate("2022-04-07T02:44:26.199Z"),"pingMs" : NumberLong(0),"lastHeartbeatMessage" : "","syncSourceHost" : "mongodb-config-0.mongodb-config-hs.default.svc.cluster.local:27017","syncSourceId" : 0,"infoMessage" : "","configVersion" : 1,"configTerm" : 1},{"_id" : 2,"name" : "mongodb-config-2.mongodb-config-hs.default.svc.cluster.local:27017","health" : 1,"state" : 2,"stateStr" : "SECONDARY","uptime" : 387731,"optime" : {"ts" : Timestamp(1649299466, 1),"t" : NumberLong(1)},"optimeDurable" : {"ts" : Timestamp(1649299466, 1),"t" : NumberLong(1)},"optimeDate" : ISODate("2022-04-07T02:44:26Z"),"optimeDurableDate" : ISODate("2022-04-07T02:44:26Z"),"lastAppliedWallTime" : ISODate("2022-04-07T02:44:26.741Z"),"lastDurableWallTime" : ISODate("2022-04-07T02:44:26.741Z"),"lastHeartbeat" : ISODate("2022-04-07T02:44:27.554Z"),"lastHeartbeatRecv" : ISODate("2022-04-07T02:44:27.554Z"),"pingMs" : NumberLong(0),"lastHeartbeatMessage" : "","syncSourceHost" : "mongodb-config-0.mongodb-config-hs.default.svc.cluster.local:27017","syncSourceId" : 0,"infoMessage" : "","configVersion" : 1,"configTerm" : 1}],"ok" : 1,"$gleStats" : {"lastOpTime" : Timestamp(0, 0),"electionId" : ObjectId("7fffffff0000000000000001")},"lastCommittedOpTime" : Timestamp(1649299466, 1),"$clusterTime" : {"clusterTime" : Timestamp(1649299466, 1),"signature" : {"hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="),"keyId" : NumberLong(0)}},"operationTime" : Timestamp(1649299466, 1)
}
configs:PRIMARY>

可以看到 configs 副本集中已经有一个 Primary 节点和两个 Secondary 节点,说明副本集的启动配置已完成。

6.部署 shard server（分片服务器）

# 第1个分片（每个分片有3个副本）
apiVersion: apps/v1
kind: StatefulSet
metadata:name: mongodb-shard0
spec:selector:matchLabels:app: mongodb-shardserviceName: "mongodb-shard-hs"replicas: 3template:metadata:labels:app: mongodb-shardspec:terminationGracePeriodSeconds: 10containers:- name: mongodb-shardimage: mongo:4.4command:- mongod- "--port"- "27017"- "--shardsvr"- "--replSet"- shard0- "--bind_ip"- 0.0.0.0ports:- containerPort: 27017volumeMounts:- name: mongdb-shard-persistent-storagemountPath: /data/dbvolumeClaimTemplates:- metadata:name: mongdb-shard-persistent-storagespec:storageClassName: course-nfs-storageaccessModes:- ReadWriteOnceresources:requests:storage: 10Gi
---
# 第2个分片（每个分片有3个副本）
apiVersion: apps/v1
kind: StatefulSet
metadata:name: mongodb-shard1
spec:selector:matchLabels:app: mongodb-shardserviceName: "mongodb-shard-hs"replicas: 3template:metadata:labels:app: mongodb-shardspec:terminationGracePeriodSeconds: 10containers:- name: mongodb-shardimage: mongo:4.4command:- mongod- "--port"- "27017"- "--shardsvr"- "--replSet"- shard1- "--bind_ip"- 0.0.0.0ports:- containerPort: 27017volumeMounts:- name: mongdb-shard-persistent-storagemountPath: /data/dbvolumeClaimTemplates:- metadata:name: mongdb-shard-persistent-storagespec:storageClassName: course-nfs-storageaccessModes:- ReadWriteOnceresources:requests:storage: 10Gi
---
# headless 无头服务（提供域名供StatefulSet内部pod访问使用）
apiVersion: v1
kind: Service
metadata:name: mongodb-shard-hslabels:name: mongodb-shard
spec:ports:- port: 27017targetPort: 27017clusterIP: Noneselector:app: mongodb-shard

6.1验证是否创建成功

[root@k8smaster mongodb-shard]# kubectl get pods
NAME                                     READY   STATUS    RESTARTS      AGE
mongodb-config-0                         1/1     Running   0             4d12h
mongodb-config-1                         1/1     Running   0             4d12h
mongodb-config-2                         1/1     Running   0             4d12h
mongodb-shard0-0                         1/1     Running   0             4d11h
mongodb-shard0-1                         1/1     Running   0             4d11h
mongodb-shard0-2                         1/1     Running   0             4d11h
mongodb-shard1-0                         1/1     Running   0             4d11h
mongodb-shard1-1                         1/1     Running   0             4d11h
mongodb-shard1-2                         1/1     Running   0             4d11h

6.2 配置第一分片集群

#进入任意一pods
kubectl exec -it mongodb-shard0-0 /bin/bash
#连接上任意一个实例
bin/mongo mongodb-shard0-0.mongodb-shard-hs.default.svc.cluster.local:27017
#切换数据库
use adminrs
#配置副本集
cfg = {_id: "shard0",members:[{_id: 0,host: 'mongodb-shard0-0.mongodb-shard-hs.default.svc.cluster.local:27017',priority: 3},{_id: 1,host: 'mongodb-shard0-1.mongodb-shard-hs.default.svc.cluster.local:27017',priority: 2},{_id: 2,host: 'mongodb-shard0-2.mongodb-shard-hs.default.svc.cluster.local:27017',priority: 1}]};
#初始化
rs.initiate(cfg)#验证 可以看到第一个分片中已经有一个 Primary 节点和两个 Secondary 节点
shard0:PRIMARY> rs.status()
{"set" : "shard0","date" : ISODate("2022-04-07T03:08:08.686Z"),"myState" : 1,"term" : NumberLong(1),"syncSourceHost" : "","syncSourceId" : -1,"heartbeatIntervalMillis" : NumberLong(2000),"majorityVoteCount" : 2,"writeMajorityCount" : 2,"votingMembersCount" : 3,"writableVotingMembersCount" : 3,"optimes" : {"lastCommittedOpTime" : {"ts" : Timestamp(1649300885, 1),"t" : NumberLong(1)},"lastCommittedWallTime" : ISODate("2022-04-07T03:08:05.048Z"),"readConcernMajorityOpTime" : {"ts" : Timestamp(1649300885, 1),"t" : NumberLong(1)},"readConcernMajorityWallTime" : ISODate("2022-04-07T03:08:05.048Z"),"appliedOpTime" : {"ts" : Timestamp(1649300885, 1),"t" : NumberLong(1)},"durableOpTime" : {"ts" : Timestamp(1649300885, 1),"t" : NumberLong(1)},"lastAppliedWallTime" : ISODate("2022-04-07T03:08:05.048Z"),"lastDurableWallTime" : ISODate("2022-04-07T03:08:05.048Z")},"lastStableRecoveryTimestamp" : Timestamp(1649300855, 1),"electionCandidateMetrics" : {"lastElectionReason" : "electionTimeout","lastElectionDate" : ISODate("2022-04-02T15:09:19.879Z"),"electionTerm" : NumberLong(1),"lastCommittedOpTimeAtElection" : {"ts" : Timestamp(0, 0),"t" : NumberLong(-1)},"lastSeenOpTimeAtElection" : {"ts" : Timestamp(1648912149, 1),"t" : NumberLong(-1)},"numVotesNeeded" : 2,"priorityAtElection" : 3,"electionTimeoutMillis" : NumberLong(10000),"numCatchUpOps" : NumberLong(0),"newTermStartDate" : ISODate("2022-04-02T15:09:20.095Z"),"wMajorityWriteAvailabilityDate" : ISODate("2022-04-02T15:09:20.581Z")},"members" : [{"_id" : 0,"name" : "mongodb-shard0-0.mongodb-shard-hs.default.svc.cluster.local:27017","health" : 1,"state" : 1,"stateStr" : "PRIMARY","uptime" : 388910,"optime" : {"ts" : Timestamp(1649300885, 1),"t" : NumberLong(1)},"optimeDate" : ISODate("2022-04-07T03:08:05Z"),"lastAppliedWallTime" : ISODate("2022-04-07T03:08:05.048Z"),"lastDurableWallTime" : ISODate("2022-04-07T03:08:05.048Z"),"syncSourceHost" : "","syncSourceId" : -1,"infoMessage" : "","electionTime" : Timestamp(1648912159, 1),"electionDate" : ISODate("2022-04-02T15:09:19Z"),"configVersion" : 2,"configTerm" : 1,"self" : true,"lastHeartbeatMessage" : ""},{"_id" : 1,"name" : "mongodb-shard0-1.mongodb-shard-hs.default.svc.cluster.local:27017","health" : 1,"state" : 2,"stateStr" : "SECONDARY","uptime" : 388739,"optime" : {"ts" : Timestamp(1649300885, 1),"t" : NumberLong(1)},"optimeDurable" : {"ts" : Timestamp(1649300885, 1),"t" : NumberLong(1)},"optimeDate" : ISODate("2022-04-07T03:08:05Z"),"optimeDurableDate" : ISODate("2022-04-07T03:08:05Z"),"lastAppliedWallTime" : ISODate("2022-04-07T03:08:05.048Z"),"lastDurableWallTime" : ISODate("2022-04-07T03:08:05.048Z"),"lastHeartbeat" : ISODate("2022-04-07T03:08:08.191Z"),"lastHeartbeatRecv" : ISODate("2022-04-07T03:08:08.660Z"),"pingMs" : NumberLong(0),"lastHeartbeatMessage" : "","syncSourceHost" : "mongodb-shard0-0.mongodb-shard-hs.default.svc.cluster.local:27017","syncSourceId" : 0,"infoMessage" : "","configVersion" : 2,"configTerm" : 1},{"_id" : 2,"name" : "mongodb-shard0-2.mongodb-shard-hs.default.svc.cluster.local:27017","health" : 1,"state" : 2,"stateStr" : "SECONDARY","uptime" : 388739,"optime" : {"ts" : Timestamp(1649300885, 1),"t" : NumberLong(1)},"optimeDurable" : {"ts" : Timestamp(1649300885, 1),"t" : NumberLong(1)},"optimeDate" : ISODate("2022-04-07T03:08:05Z"),"optimeDurableDate" : ISODate("2022-04-07T03:08:05Z"),"lastAppliedWallTime" : ISODate("2022-04-07T03:08:05.048Z"),"lastDurableWallTime" : ISODate("2022-04-07T03:08:05.048Z"),"lastHeartbeat" : ISODate("2022-04-07T03:08:08.258Z"),"lastHeartbeatRecv" : ISODate("2022-04-07T03:08:06.702Z"),"pingMs" : NumberLong(0),"lastHeartbeatMessage" : "","syncSourceHost" : "mongodb-shard0-0.mongodb-shard-hs.default.svc.cluster.local:27017","syncSourceId" : 0,"infoMessage" : "","configVersion" : 2,"configTerm" : 1}],"ok" : 1,"$gleStats" : {"lastOpTime" : Timestamp(0, 0),"electionId" : ObjectId("7fffffff0000000000000001")},"lastCommittedOpTime" : Timestamp(1649300885, 1),"$configServerState" : {"opTime" : {"ts" : Timestamp(1649300886, 5),"t" : NumberLong(1)}},"$clusterTime" : {"clusterTime" : Timestamp(1649300886, 5),"signature" : {"hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="),"keyId" : NumberLong(0)}},"operationTime" : Timestamp(1649300885, 1)
}
shard0:PRIMARY>

6.3 配置第二分片集群

# 进入第二分片任意一pod
kubectl exec -it mongodb-shard1-0 /bin/bash
#连接上mongodb
bin/mongo mongodb-shard1-0.mongodb-shard-hs.default.svc.cluster.local:27017
#切换数据库
use adminrs
#配置副本集
cfg = {_id: "shard1",members:[{_id: 0,host: 'mongodb-shard1-0.mongodb-shard-hs.default.svc.cluster.local:27017',priority: 3},{_id: 1,host: 'mongodb-shard1-1.mongodb-shard-hs.default.svc.cluster.local:27017',priority: 2},{_id: 2,host: 'mongodb-shard1-2.mongodb-shard-hs.default.svc.cluster.local:27017',priority: 1}]};
#初始化
rs.initiate(cfg)shard1:PRIMARY> rs.status()
{"set" : "shard1","date" : ISODate("2022-04-07T03:14:28.124Z"),"myState" : 1,"term" : NumberLong(1),"syncSourceHost" : "","syncSourceId" : -1,"heartbeatIntervalMillis" : NumberLong(2000),"majorityVoteCount" : 2,"writeMajorityCount" : 2,"votingMembersCount" : 3,"writableVotingMembersCount" : 3,"optimes" : {"lastCommittedOpTime" : {"ts" : Timestamp(1649301263, 1),"t" : NumberLong(1)},"lastCommittedWallTime" : ISODate("2022-04-07T03:14:23.314Z"),"readConcernMajorityOpTime" : {"ts" : Timestamp(1649301263, 1),"t" : NumberLong(1)},"readConcernMajorityWallTime" : ISODate("2022-04-07T03:14:23.314Z"),"appliedOpTime" : {"ts" : Timestamp(1649301263, 1),"t" : NumberLong(1)},"durableOpTime" : {"ts" : Timestamp(1649301263, 1),"t" : NumberLong(1)},"lastAppliedWallTime" : ISODate("2022-04-07T03:14:23.314Z"),"lastDurableWallTime" : ISODate("2022-04-07T03:14:23.314Z")},"lastStableRecoveryTimestamp" : Timestamp(1649301253, 1),"electionCandidateMetrics" : {"lastElectionReason" : "electionTimeout","lastElectionDate" : ISODate("2022-04-02T15:15:11.059Z"),"electionTerm" : NumberLong(1),"lastCommittedOpTimeAtElection" : {"ts" : Timestamp(0, 0),"t" : NumberLong(-1)},"lastSeenOpTimeAtElection" : {"ts" : Timestamp(1648912500, 1),"t" : NumberLong(-1)},"numVotesNeeded" : 2,"priorityAtElection" : 3,"electionTimeoutMillis" : NumberLong(10000),"numCatchUpOps" : NumberLong(0),"newTermStartDate" : ISODate("2022-04-02T15:15:11.151Z"),"wMajorityWriteAvailabilityDate" : ISODate("2022-04-02T15:15:11.299Z")},"members" : [{"_id" : 0,"name" : "mongodb-shard1-0.mongodb-shard-hs.default.svc.cluster.local:27017","health" : 1,"state" : 1,"stateStr" : "PRIMARY","uptime" : 389290,"optime" : {"ts" : Timestamp(1649301263, 1),"t" : NumberLong(1)},"optimeDate" : ISODate("2022-04-07T03:14:23Z"),"lastAppliedWallTime" : ISODate("2022-04-07T03:14:23.314Z"),"lastDurableWallTime" : ISODate("2022-04-07T03:14:23.314Z"),"syncSourceHost" : "","syncSourceId" : -1,"infoMessage" : "","electionTime" : Timestamp(1648912511, 1),"electionDate" : ISODate("2022-04-02T15:15:11Z"),"configVersion" : 2,"configTerm" : 1,"self" : true,"lastHeartbeatMessage" : ""},{"_id" : 1,"name" : "mongodb-shard1-1.mongodb-shard-hs.default.svc.cluster.local:27017","health" : 1,"state" : 2,"stateStr" : "SECONDARY","uptime" : 388767,"optime" : {"ts" : Timestamp(1649301263, 1),"t" : NumberLong(1)},"optimeDurable" : {"ts" : Timestamp(1649301263, 1),"t" : NumberLong(1)},"optimeDate" : ISODate("2022-04-07T03:14:23Z"),"optimeDurableDate" : ISODate("2022-04-07T03:14:23Z"),"lastAppliedWallTime" : ISODate("2022-04-07T03:14:23.314Z"),"lastDurableWallTime" : ISODate("2022-04-07T03:14:23.314Z"),"lastHeartbeat" : ISODate("2022-04-07T03:14:26.145Z"),"lastHeartbeatRecv" : ISODate("2022-04-07T03:14:28.091Z"),"pingMs" : NumberLong(0),"lastHeartbeatMessage" : "","syncSourceHost" : "mongodb-shard1-0.mongodb-shard-hs.default.svc.cluster.local:27017","syncSourceId" : 0,"infoMessage" : "","configVersion" : 2,"configTerm" : 1},{"_id" : 2,"name" : "mongodb-shard1-2.mongodb-shard-hs.default.svc.cluster.local:27017","health" : 1,"state" : 2,"stateStr" : "SECONDARY","uptime" : 388767,"optime" : {"ts" : Timestamp(1649301263, 1),"t" : NumberLong(1)},"optimeDurable" : {"ts" : Timestamp(1649301263, 1),"t" : NumberLong(1)},"optimeDate" : ISODate("2022-04-07T03:14:23Z"),"optimeDurableDate" : ISODate("2022-04-07T03:14:23Z"),"lastAppliedWallTime" : ISODate("2022-04-07T03:14:23.314Z"),"lastDurableWallTime" : ISODate("2022-04-07T03:14:23.314Z"),"lastHeartbeat" : ISODate("2022-04-07T03:14:26.144Z"),"lastHeartbeatRecv" : ISODate("2022-04-07T03:14:28.091Z"),"pingMs" : NumberLong(0),"lastHeartbeatMessage" : "","syncSourceHost" : "mongodb-shard1-1.mongodb-shard-hs.default.svc.cluster.local:27017","syncSourceId" : 1,"infoMessage" : "","configVersion" : 2,"configTerm" : 1}],"ok" : 1,"$gleStats" : {"lastOpTime" : Timestamp(0, 0),"electionId" : ObjectId("7fffffff0000000000000001")},"lastCommittedOpTime" : Timestamp(1649301263, 1),"$configServerState" : {"opTime" : {"ts" : Timestamp(1649301267, 3),"t" : NumberLong(1)}},"$clusterTime" : {"clusterTime" : Timestamp(1649301267, 3),"signature" : {"hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="),"keyId" : NumberLong(0)}},"operationTime" : Timestamp(1649301263, 1)
}
shard1:PRIMARY>

7.部署 route server（mongos 路由服务器）

apiVersion: apps/v1
kind: Deployment
metadata:name: mongodb-mongos
spec:selector:matchLabels:app: mongodb-mongosreplicas: 1template:metadata:labels:app: mongodb-mongosspec:terminationGracePeriodSeconds: 10containers:- name: mongodb-mongosimage: mongo:4.4command:- mongos- "--port"- "27017"- "--configdb"- "configs/mongodb-config-0.mongodb-config-hs.default.svc.cluster.local:27017,mongodb-config-1.mongodb-config-hs.default.svc.cluster.local:27017,mongodb-config-2.mongodb-config-hs.default.svc.cluster.local:27017"- "--bind_ip"- 0.0.0.0ports:- containerPort: 27017
---
# 标准服务（供外部访问）
apiVersion: v1
kind: Service
metadata:name: mongodb-mongos-svclabels:name: mongodb-mongos
spec:type: NodePortports:- port: 27017targetPort: 27017nodePort: 30717selector:app: mongodb-mongos

7.1验证

[root@k8smaster mongodb-shard]# kubectl get pods
NAME                                     READY   STATUS    RESTARTS      AGE
mongodb-config-0                         1/1     Running   0             4d12h
mongodb-config-1                         1/1     Running   0             4d12h
mongodb-config-2                         1/1     Running   0             4d12h
mongodb-mongos-5bf5f8956d-ckpzv          1/1     Running   0             4d11h
mongodb-shard0-0                         1/1     Running   0             4d12h
mongodb-shard0-1                         1/1     Running   0             4d12h
mongodb-shard0-2                         1/1     Running   0             4d12h
mongodb-shard1-0                         1/1     Running   0             4d12h
mongodb-shard1-1                         1/1     Running   0             4d12h
mongodb-shard1-2                         1/1     Running   0             4d12h
[root@k8smaster mongodb-shard]#

7.2 将路由服务器和分片副本集串联起来

#进入pod
kubectl exec -it  mongodb-mongos-5bf5f8956d-ckpzv  /bin/bash
#连接mongodb
bin/mongo --port 27017
#切换库
use admin#将副本集添加到分片集
sh.addShard("shard0/mongodb-shard0-0.mongodb-shard-hs.default.svc.cluster.local:27017,mongodb-shard0-1.mongodb-shard-hs.default.svc.cluster.local:27017,mongodb-shard0-2.mongodb-shard-hs.default.svc.cluster.local:27017");
sh.addShard("shard1/mongodb-shard1-0.mongodb-shard-hs.default.svc.cluster.local:27017,mongodb-shard1-1.mongodb-shard-hs.default.svc.cluster.local:27017,mongodb-shard1-2.mongodb-shard-hs.default.svc.cluster.local:27017");mongos> sh.status()
--- Sharding Status --- sharding version: {"_id" : 1,"minCompatibleVersion" : 5,"currentVersion" : 6,"clusterId" : ObjectId("624865833544ee7f865b86d7")}shards:{  "_id" : "shard0",  "host" : "shard0/mongodb-shard0-0.mongodb-shard-hs.default.svc.cluster.local:27017,mongodb-shard0-1.mongodb-shard-hs.default.svc.cluster.local:27017,mongodb-shard0-2.mongodb-shard-hs.default.svc.cluster.local:27017",  "state" : 1 }{  "_id" : "shard1",  "host" : "shard1/mongodb-shard1-0.mongodb-shard-hs.default.svc.cluster.local:27017,mongodb-shard1-1.mongodb-shard-hs.default.svc.cluster.local:27017,mongodb-shard1-2.mongodb-shard-hs.default.svc.cluster.local:27017",  "state" : 1 }active mongoses:"4.4.11" : 1autosplit:Currently enabled: yesbalancer:Currently enabled:  yesCurrently running:  noFailed balancer rounds in last 5 attempts:  0Migration Results for the last 24 hours: No recent migrationsdatabases:{  "_id" : "config",  "primary" : "config",  "partitioned" : true }config.system.sessionsshard key: { "_id" : 1 }unique: falsebalancing: truechunks:shard0  512shard1  512too many chunks to print, use verbose if you want to force print{  "_id" : "mom",  "primary" : "shard0",  "partitioned" : true,  "version" : {  "uuid" : UUID("5bd831f4-b5bb-44ee-9885-c736aa0a7e18"),  "lastMod" : 1 } }

8.分片测试

#连接 route serverkubectl exec -it  mongodb-mongos-5bf5f8956d-ckpzv   /bin/bash
bin/mongo --port 27017
use admin
#假设我们需要让mom这个数据库启用分片，只需要执行如下命令，便可以对该数据库内的集合进行分片了
sh.enableSharding("mom")#对集合分片时，我们要选择一个分片键（shard key）。分片键是集合的一个键，MongoDB 根据这个键拆分数据。执行下面命令让 ApiRecord 集合依据 traceId 对集合进行分片： 
sh.shardCollection("mom.ApiRecord", {"traceId" : "hashed"})
#切换到mom库
use mom
#接着执行如下命令往 mom 集合中插入 5.5 千条数据：
for(var i=100000;i<105500;i++){db.ApiRecord.insert({"traceId" : "user"+i , "created_at" : new Date()});
}db.ApiRecord.getShardDistribution()
mongos> db.mom.getShardDistribution()
Collection mom.mom is not sharded.
mongos> use admin
switched to db admin
mongos> db.mom.getShardDistribution()
Collection admin.mom is not sharded.
mongos> db.ApiRecord.getShardDistribution()
Collection admin.ApiRecord is not sharded.
mongos> use mom
switched to db mom
mongos> db.ApiRecord.getShardDistribution()Shard shard0 at shard0/mongodb-shard0-0.mongodb-shard-hs.default.svc.cluster.local:27017,mongodb-shard0-1.mongodb-shard-hs.default.svc.cluster.local:27017,mongodb-shard0-2.mongodb-shard-hs.default.svc.cluster.local:27017data : 178KiB docs : 2775 chunks : 2estimated data per chunk : 89KiBestimated docs per chunk : 1387Shard shard1 at shard1/mongodb-shard1-0.mongodb-shard-hs.default.svc.cluster.local:27017,mongodb-shard1-1.mongodb-shard-hs.default.svc.cluster.local:27017,mongodb-shard1-2.mongodb-shard-hs.default.svc.cluster.local:27017data : 175KiB docs : 2725 chunks : 2estimated data per chunk : 87KiBestimated docs per chunk : 1362Totalsdata : 354KiB docs : 5500 chunks : 4Shard shard0 contains 50.45% data, 50.45% docs in cluster, avg obj size on shard : 66BShard shard1 contains 49.54% data, 49.54% docs in cluster, avg obj size on shard : 66B

注意：要用如下语句的用户连接
db.createUser({user:“daniel”,pwd:“123456”,roles:[{role:“dbOwner”,db:“good”}]})

参考：K8s - 安装部署MongoDB数据库教程3（分片集群）

这篇关于k8s 安装 mongodb 分片（Sharding）+ 副本集（Replica Set）的文章就介绍到这儿，希望我们推荐的文章对编程师们有所帮助！


http://www.chinasem.cn/article/264342。

相关文章

JAVA中安装多个JDK的方法

JAVA中安装多个JDK的方法

《JAVA中安装多个JDK的方法》文章介绍了在Windows系统上安装多个JDK版本的方法,包括下载、安装路径修改、环境变量配置（JAVA_HOME和Path）,并说明如何通过调整JAVA_HOME在... 首先去oracle官网下载好两个版本不同的jdk（需要登录Oracle账号，没有可以免费注册）下载完
阅读更多...
Java JDK1.8 安装和环境配置教程详解

Java JDK1.8 安装和环境配置教程详解

《JavaJDK1.8安装和环境配置教程详解》文章简要介绍了JDK1.8的安装流程,包括官网下载对应系统版本、安装时选择非系统盘路径、配置JAVA_HOME、CLASSPATH和Path环境变量,... 目录1.下载JDK2.安装JDK3.配置环境变量4.检验JDK官网下载地址：Java Downloads
阅读更多...
SQL server数据库如何下载和安装

SQL server数据库如何下载和安装

《SQLserver数据库如何下载和安装》本文指导如何下载安装SQLServer2022评估版及SSMS工具,涵盖安装配置、连接字符串设置、C#连接数据库方法和安全注意事项,如混合验证、参数化查... 目录第一步：打开官网下载对应文件第二步：程序安装配置第三部：安装工具SQL Server Manageme
阅读更多...
Python中win32包的安装及常见用途介绍

Python中win32包的安装及常见用途介绍

《Python中win32包的安装及常见用途介绍》在Windows环境下,PythonWin32模块通常随Python安装包一起安装,：本文主要介绍Python中win32包的安装及常见用途的相关... 目录前言主要组件安装方法常见用途1. 操作Windows注册表2. 操作Windows服务3. 窗口操作
阅读更多...
c++中的set容器介绍及操作大全

c++中的set容器介绍及操作大全

《c++中的set容器介绍及操作大全》：本文主要介绍c++中的set容器介绍及操作大全,本文通过实例代码给大家介绍的非常详细,对大家的学习或工作具有一定的参考借鉴价值,需要的朋友参考下吧... 目录​​一、核心特性​​️ ​​二、基本操作​​​​1. 初始化与赋值​​​​2. 增删查操作​​​​3. 遍历方
阅读更多...
SpringBoot中4种数据水平分片策略

SpringBoot中4种数据水平分片策略

《SpringBoot中4种数据水平分片策略》数据水平分片作为一种水平扩展策略,通过将数据分散到多个物理节点上,有效解决了存储容量和性能瓶颈问题,下面小编就来和大家分享4种数据分片策略吧... 目录一、前言二、哈希分片2.1 原理2.2 SpringBoot实现2.3 优缺点分析2.4 适用场景三、范围分片
阅读更多...
Redis分片集群、数据读写规则问题小结

Redis分片集群、数据读写规则问题小结

《Redis分片集群、数据读写规则问题小结》本文介绍了Redis分片集群的原理,通过数据分片和哈希槽机制解决单机内存限制与写瓶颈问题,实现分布式存储和高并发处理,但存在通信开销大、维护复杂及对事务支持... 目录一、分片集群解android决的问题二、分片集群图解 分片集群特征如何解决的上述问题？（与哨兵模
阅读更多...
shell中set -u、set -x、set -e的使用

shell中set -u、set -x、set -e的使用

《shell中set-u、set-x、set-e的使用》本文主要介绍了shell中set-u、set-x、set-e的使用,文中通过示例代码介绍的非常详细,对大家的学习或者工作具有一定的参... 目录✅ 1. set -u：防止使用未定义变量 作用： 示例：❌ 报错示例输出：✅ 推荐使用场景：✅ 2. se
阅读更多...
k8s上运行的mysql、mariadb数据库的备份记录(支持x86和arm两种架构)

k8s上运行的mysql、mariadb数据库的备份记录(支持x86和arm两种架构)

《k8s上运行的mysql、mariadb数据库的备份记录(支持x86和arm两种架构)》本文记录在K8s上运行的MySQL/MariaDB备份方案,通过工具容器执行mysqldump,结合定时任务实... 目录前言一、获取需要备份的数据库的信息二、备份步骤1.准备工作（X86）1.准备工作（arm）2.手
阅读更多...
gitlab安装及邮箱配置和常用使用方式

gitlab安装及邮箱配置和常用使用方式

《gitlab安装及邮箱配置和常用使用方式》：本文主要介绍gitlab安装及邮箱配置和常用使用方式,具有很好的参考价值,希望对大家有所帮助,如有错误或未考虑完全的地方,望不吝赐教... 目录1.安装GitLab2.配置GitLab邮件服务3.GitLab的账号注册邮箱验证及其分组4.gitlab分支和标签的
阅读更多...

Copyright China编程 23002807@qq.com

沪ICP备2023033072号-2