k8s 安装 mongodb 分片（Sharding）+ 副本集（Replica Set）

2023-10-22 23:40
文章标签 云原生 安装 set mongodb k8s 分片 副本 sharding replica

本文主要是介绍k8s 安装 mongodb 分片（Sharding）+ 副本集（Replica Set），希望对大家解决编程问题提供一定的参考价值，需要的开发者们随着小编来一起学习吧！

k8s 安装 mongodb 分片（Sharding）+ 副本集（Replica Set）

  • 1.安装环境
  • 2.配置nfs并重启 (nfs 已经安装)
  • 3.创建 PV 持久卷
  • 4.部署 config server（配置服务器）
  • 5.创建config 集群
    • 5.1 进入任意一个pod
    • 5.2 连接上mongodb
    • 5.3 配置副本集
  • 6.部署 shard server（分片服务器）
    • 6.1验证是否创建成功
    • 6.2 配置第一分片集群
    • 6.3 配置第二分片集群
  • 7.部署 route server（mongos 路由服务器）
    • 7.1验证
    • 7.2 将路由服务器和分片副本集串联起来
  • 8.分片测试

在这里插入图片描述

1.安装环境

k8s 1.23. docker 20.10.12 centos 7

2.配置nfs并重启 (nfs 已经安装)

mkdir -p /data/k8s/mongodb/shard/pv1  &&
mkdir -p /data/k8s/mongodb/shard/pv2  &&
mkdir -p /data/k8s/mongodb/shard/pv3  &&
mkdir -p /data/k8s/mongodb/shard/pv4  &&
mkdir -p /data/k8s/mongodb/shard/pv5  &&
mkdir -p /data/k8s/mongodb/shard/pv6  &&
mkdir -p /data/k8s/mongodb/config/pv1 &&
mkdir -p /data/k8s/mongodb/config/pv2 &&
mkdir -p /data/k8s/mongodb/config/pv3 vi /etc/exports
#加入如下内容
/data/k8s/mongodb/shard/pv1 *(rw,sync,no_root_squash)
/data/k8s/mongodb/shard/pv2 *(rw,sync,no_root_squash)
/data/k8s/mongodb/shard/pv3 *(rw,sync,no_root_squash)
/data/k8s/mongodb/shard/pv4 *(rw,sync,no_root_squash)
/data/k8s/mongodb/shard/pv5 *(rw,sync,no_root_squash)
/data/k8s/mongodb/shard/pv6 *(rw,sync,no_root_squash)
/data/k8s/mongodb/config/pv1 *(rw,sync,no_root_squash)
/data/k8s/mongodb/config/pv2 *(rw,sync,no_root_squash)
/data/k8s/mongodb/config/pv3 *(rw,sync,no_root_squash)#重启
systemctl restart rpcbind
systemctl restart nfs

验证

[root@k8smaster mongodb-shard]# exportfs -v
/data/k8s       <world>(sync,wdelay,hide,no_subtree_check,sec=sys,rw,secure,no_root_squash,no_all_squash)
/opt/nfs/maven  <world>(sync,wdelay,hide,no_subtree_check,sec=sys,rw,secure,no_root_squash,no_all_squash)
/data/k8s/www-data<world>(sync,wdelay,hide,no_subtree_check,sec=sys,rw,secure,no_root_squash,no_all_squash)
/data/k8s/mongodb/shard/pv1<world>(sync,wdelay,hide,no_subtree_check,sec=sys,rw,secure,no_root_squash,no_all_squash)
/data/k8s/mongodb/shard/pv2<world>(sync,wdelay,hide,no_subtree_check,sec=sys,rw,secure,no_root_squash,no_all_squash)
/data/k8s/mongodb/shard/pv3<world>(sync,wdelay,hide,no_subtree_check,sec=sys,rw,secure,no_root_squash,no_all_squash)
/data/k8s/mongodb/shard/pv4<world>(sync,wdelay,hide,no_subtree_check,sec=sys,rw,secure,no_root_squash,no_all_squash)
/data/k8s/mongodb/shard/pv5<world>(sync,wdelay,hide,no_subtree_check,sec=sys,rw,secure,no_root_squash,no_all_squash)
/data/k8s/mongodb/shard/pv6<world>(sync,wdelay,hide,no_subtree_check,sec=sys,rw,secure,no_root_squash,no_all_squash)
/data/k8s/mongodb/config/pv1<world>(sync,wdelay,hide,no_subtree_check,sec=sys,rw,secure,no_root_squash,no_all_squash)
/data/k8s/mongodb/config/pv2<world>(sync,wdelay,hide,no_subtree_check,sec=sys,rw,secure,no_root_squash,no_all_squash)
/data/k8s/mongodb/config/pv3<world>(sync,wdelay,hide,no_subtree_check,sec=sys,rw,secure,no_root_squash,no_all_squash)
[root@k8smaster mongodb-shard]#

3.创建 PV 持久卷

#创建shard的第1个PV
apiVersion: v1
kind: PersistentVolume
metadata:name: mongodb-shard-pv1labels:app: mongodb
spec:capacity:storage: 10GiaccessModes:- ReadWriteOncestorageClassName: course-nfs-storagenfs:server: 10.10.220.101path: "/data/k8s/mongodb/shard/pv1"persistentVolumeReclaimPolicy: Retain
---
#创建shard的第2个PV
apiVersion: v1
kind: PersistentVolume
metadata:name: mongodb-shard-pv2labels:app: mongodb
spec:capacity:storage: 10GiaccessModes:- ReadWriteOncestorageClassName: course-nfs-storagenfs:server: 10.10.220.101path: "/data/k8s/mongodb/shard/pv2"persistentVolumeReclaimPolicy: Retain
---
#创建shard的第3个PV
apiVersion: v1
kind: PersistentVolume
metadata:name: mongodb-shard-pv3labels:app: mongodb
spec:capacity:storage: 10GiaccessModes:- ReadWriteOncestorageClassName: course-nfs-storagenfs:server: 10.10.220.101path: "/data/k8s/mongodb/shard/pv3"persistentVolumeReclaimPolicy: Retain
---
#创建shard的第4个PV
apiVersion: v1
kind: PersistentVolume
metadata:name: mongodb-shard-pv4labels:app: mongodb
spec:capacity:storage: 10GiaccessModes:- ReadWriteOncestorageClassName: course-nfs-storagenfs:server: 10.10.220.101path: "/data/k8s/mongodb/shard/pv4"persistentVolumeReclaimPolicy: Retain
---
#创建shard的第5个PV
apiVersion: v1
kind: PersistentVolume
metadata:name: mongodb-shard-pv5labels:app: mongodb
spec:capacity:storage: 10GiaccessModes:- ReadWriteOncestorageClassName: course-nfs-storagenfs:server: 10.10.220.101path: "/data/k8s/mongodb/shard/pv5"persistentVolumeReclaimPolicy: Retain
---
#创建shard的第6个PV
apiVersion: v1
kind: PersistentVolume
metadata:name: mongodb-shard-pv6labels:app: mongodb
spec:capacity:storage: 10GiaccessModes:- ReadWriteOncestorageClassName: course-nfs-storagenfs:server: 10.10.220.101path: "/data/k8s/mongodb/shard/pv6"persistentVolumeReclaimPolicy: Retain
---
#创建config的第1个PV
apiVersion: v1
kind: PersistentVolume
metadata:name: mongodb-config-pv1labels:app: mongodb
spec:capacity:storage: 1GiaccessModes:- ReadWriteOncestorageClassName: mongodb-config-storagenfs:server: 10.10.220.101path: "/data/k8s/mongodb/config/pv1"persistentVolumeReclaimPolicy: Retain
---
#创建config的第2个PV
apiVersion: v1
kind: PersistentVolume
metadata:name: mongodb-config-pv2labels:app: mongodb
spec:capacity:storage: 1GiaccessModes:- ReadWriteOncestorageClassName: mongodb-config-storagenfs:server: 10.10.220.101path: "/data/k8s/mongodb/config/pv2"persistentVolumeReclaimPolicy: Retain
---
#创建config的第3个PV
apiVersion: v1
kind: PersistentVolume
metadata:name: mongodb-config-pv3labels:app: mongodb
spec:capacity:storage: 1GiaccessModes:- ReadWriteOncestorageClassName: mongodb-config-storagenfs:server: 10.10.220.101path: "/data/k8s/mongodb/config/pv3"persistentVolumeReclaimPolicy: Retain

查看创建结果

[root@k8smaster mongodb-shard]# kubectl get pv|grep mongo
mongodb-config-pv1                         1Gi        RWO            Retain           Available                                                                      mongodb-config-storage            4d11h
mongodb-config-pv2                         1Gi        RWO            Retain           Available                                                                      mongodb-config-storage            4d11h
mongodb-config-pv3                         1Gi        RWO            Retain           Available                                                                      mongodb-config-storage            4d11h
mongodb-shard-pv1                          10Gi       RWO            Retain           Bound       default/mongdb-config-persistent-storage-mongodb-config-2          course-nfs-storage                4d11h
mongodb-shard-pv2                          10Gi       RWO            Retain           Bound       default/mongdb-config-persistent-storage-mongodb-config-1          course-nfs-storage                4d11h
mongodb-shard-pv3                          10Gi       RWO            Retain           Bound       default/mongdb-config-persistent-storage-mongodb-config-0          course-nfs-storage                4d11h
mongodb-shard-pv4                          10Gi       RWO            Retain           Bound       default/mongdb-shard-persistent-storage-mongodb-shard0-0           course-nfs-storage                4d11h
mongodb-shard-pv5                          10Gi       RWO            Retain           Bound       default/mongdb-shard-persistent-storage-mongodb-shard1-0           course-nfs-storage                4d11h
mongodb-shard-pv6                          10Gi       RWO            Retain           Bound       default/mongdb-shard-persistent-storage-mongodb-shard1-1           course-nfs-storage                4d11h

4.部署 config server（配置服务器）

apiVersion: apps/v1
kind: StatefulSet
metadata:name: mongodb-config
spec:selector:matchLabels:app: mongodb-configserviceName: "mongodb-config-hs"replicas: 3template:metadata:labels:app: mongodb-configspec:terminationGracePeriodSeconds: 10containers:- name: mongodb-configimage: mongo:4.4command:- mongod- "--port"- "27017"- "--configsvr"- "--replSet"- "configs"- "--bind_ip"- 0.0.0.0ports:- containerPort: 27017volumeMounts:- name: mongdb-config-persistent-storagemountPath: /data/configdbvolumeClaimTemplates:- metadata:name: mongdb-config-persistent-storagespec:storageClassName: course-nfs-storageaccessModes:- ReadWriteOnceresources:requests:storage: 1Gi
---
# headless 无头服务（提供域名供StatefulSet内部pod访问使用）
apiVersion: v1
kind: Service
metadata:name: mongodb-config-hslabels:name: mongodb-config
spec:ports:- port: 27017targetPort: 27017clusterIP: Noneselector:app: mongodb-config

验证是否创建成功

[root@k8smaster ~]# kubectl get pods
NAME                                     READY   STATUS    RESTARTS      AGE
mongodb-config-0                         1/1     Running   0             4d11h
mongodb-config-1                         1/1     Running   0             4d11h
mongodb-config-2                         1/1     Running   0             4d11h
[root@k8smaster ~]# 

[root@k8smaster ~]# kubectl get services
NAME                 TYPE        CLUSTER-IP     EXTERNAL-IP   PORT(S)           AGE
kubernetes           ClusterIP   10.96.0.1      <none>        443/TCP           112d
mongodb-config-hs    ClusterIP   None           <none>        27017/TCP         4d11h

注意：存储卷没有绑定成功？ \color{red}{注意：存储卷没有绑定成功？} 注意：存储卷没有绑定成功？

# 第1个分片（每个分片有3个副本）
apiVersion: apps/v1
kind: StatefulSet
metadata:name: mongodb-shard0
spec:selector:matchLabels:app: mongodb-shardserviceName: "mongodb-shard-hs"replicas: 3template:metadata:labels:app: mongodb-shardspec:terminationGracePeriodSeconds: 10containers:- name: mongodb-shardimage: mongo:4.4command:- mongod- "--port"- "27017"- "--shardsvr"- "--replSet"- shard0- "--bind_ip"- 0.0.0.0ports:- containerPort: 27017volumeMounts:- name: mongdb-shard-persistent-storagemountPath: /data/dbvolumeClaimTemplates:- metadata:name: mongdb-shard-persistent-storagespec:storageClassName: course-nfs-storageaccessModes:- ReadWriteOnceresources:requests:storage: 10Gi
---
# 第2个分片（每个分片有3个副本）
apiVersion: apps/v1
kind: StatefulSet
metadata:name: mongodb-shard1
spec:selector:matchLabels:app: mongodb-shardserviceName: "mongodb-shard-hs"replicas: 3template:metadata:labels:app: mongodb-shardspec:terminationGracePeriodSeconds: 10containers:- name: mongodb-shardimage: mongo:4.4command:- mongod- "--port"- "27017"- "--shardsvr"- "--replSet"- shard1- "--bind_ip"- 0.0.0.0ports:- containerPort: 27017volumeMounts:- name: mongdb-shard-persistent-storagemountPath: /data/dbvolumeClaimTemplates:- metadata:name: mongdb-shard-persistent-storagespec:storageClassName: course-nfs-storageaccessModes:- ReadWriteOnceresources:requests:storage: 10Gi
---
# headless 无头服务（提供域名供StatefulSet内部pod访问使用）
apiVersion: v1
kind: Service
metadata:name: mongodb-shard-hslabels:name: mongodb-shard
spec:ports:- port: 27017targetPort: 27017clusterIP: Noneselector:app: mongodb-shard

5.创建config 集群

5.1 进入任意一个pod

kubectl exec -it mongodb-config-0 /bin/bash

5.2 连接上mongodb

bin/mongo mongodb-config-0.mongodb-config-hs.default.svc.cluster.local:27017

5.3 配置副本集

cfg = {_id : "configs",members : [{_id : 0, host : "mongodb-config-0.mongodb-config-hs.default.svc.cluster.local:27017" },{_id : 1, host : "mongodb-config-1.mongodb-config-hs.default.svc.cluster.local:27017" },{_id : 2, host : "mongodb-config-2.mongodb-config-hs.default.svc.cluster.local:27017" }]
}

rs.initiate(cfg)

configs:PRIMARY> rs.status()
{"set" : "configs","date" : ISODate("2022-04-07T02:44:27.717Z"),"myState" : 1,"term" : NumberLong(1),"syncSourceHost" : "","syncSourceId" : -1,"configsvr" : true,"heartbeatIntervalMillis" : NumberLong(2000),"majorityVoteCount" : 2,"writeMajorityCount" : 2,"votingMembersCount" : 3,"writableVotingMembersCount" : 3,"optimes" : {"lastCommittedOpTime" : {"ts" : Timestamp(1649299466, 1),"t" : NumberLong(1)},"lastCommittedWallTime" : ISODate("2022-04-07T02:44:26.741Z"),"readConcernMajorityOpTime" : {"ts" : Timestamp(1649299466, 1),"t" : NumberLong(1)},"readConcernMajorityWallTime" : ISODate("2022-04-07T02:44:26.741Z"),"appliedOpTime" : {"ts" : Timestamp(1649299466, 1),"t" : NumberLong(1)},"durableOpTime" : {"ts" : Timestamp(1649299466, 1),"t" : NumberLong(1)},"lastAppliedWallTime" : ISODate("2022-04-07T02:44:26.741Z"),"lastDurableWallTime" : ISODate("2022-04-07T02:44:26.741Z")},"lastStableRecoveryTimestamp" : Timestamp(1649299451, 1),"electionCandidateMetrics" : {"lastElectionReason" : "electionTimeout","lastElectionDate" : ISODate("2022-04-02T15:02:26.647Z"),"electionTerm" : NumberLong(1),"lastCommittedOpTimeAtElection" : {"ts" : Timestamp(0, 0),"t" : NumberLong(-1)},"lastSeenOpTimeAtElection" : {"ts" : Timestamp(1648911736, 1),"t" : NumberLong(-1)},"numVotesNeeded" : 2,"priorityAtElection" : 1,"electionTimeoutMillis" : NumberLong(10000),"numCatchUpOps" : NumberLong(0),"newTermStartDate" : ISODate("2022-04-02T15:02:26.750Z"),"wMajorityWriteAvailabilityDate" : ISODate("2022-04-02T15:02:27.552Z")},"members" : [{"_id" : 0,"name" : "mongodb-config-0.mongodb-config-hs.default.svc.cluster.local:27017","health" : 1,"state" : 1,"stateStr" : "PRIMARY","uptime" : 388015,"optime" : {"ts" : Timestamp(1649299466, 1),"t" : NumberLong(1)},"optimeDate" : ISODate("2022-04-07T02:44:26Z"),"lastAppliedWallTime" : ISODate("2022-04-07T02:44:26.741Z"),"lastDurableWallTime" : ISODate("2022-04-07T02:44:26.741Z"),"syncSourceHost" : "","syncSourceId" : -1,"infoMessage" : "","electionTime" : Timestamp(1648911746, 1),"electionDate" : ISODate("2022-04-02T15:02:26Z"),"configVersion" : 1,"configTerm" : 1,"self" : true,"lastHeartbeatMessage" : ""},{"_id" : 1,"name" : "mongodb-config-1.mongodb-config-hs.default.svc.cluster.local:27017","health" : 1,"state" : 2,"stateStr" : "SECONDARY","uptime" : 387731,"optime" : {"ts" : Timestamp(1649299465, 1),"t" : NumberLong(1)},"optimeDurable" : {"ts" : Timestamp(1649299465, 1),"t" : NumberLong(1)},"optimeDate" : ISODate("2022-04-07T02:44:25Z"),"optimeDurableDate" : ISODate("2022-04-07T02:44:25Z"),"lastAppliedWallTime" : ISODate("2022-04-07T02:44:26.741Z"),"lastDurableWallTime" : ISODate("2022-04-07T02:44:26.741Z"),"lastHeartbeat" : ISODate("2022-04-07T02:44:26.196Z"),"lastHeartbeatRecv" : ISODate("2022-04-07T02:44:26.199Z"),"pingMs" : NumberLong(0),"lastHeartbeatMessage" : "","syncSourceHost" : "mongodb-config-0.mongodb-config-hs.default.svc.cluster.local:27017","syncSourceId" : 0,"infoMessage" : "","configVersion" : 1,"configTerm" : 1},{"_id" : 2,"name" : "mongodb-config-2.mongodb-config-hs.default.svc.cluster.local:27017","health" : 1,"state" : 2,"stateStr" : "SECONDARY","uptime" : 387731,"optime" : {"ts" : Timestamp(1649299466, 1),"t" : NumberLong(1)},"optimeDurable" : {"ts" : Timestamp(1649299466, 1),"t" : NumberLong(1)},"optimeDate" : ISODate("2022-04-07T02:44:26Z"),"optimeDurableDate" : ISODate("2022-04-07T02:44:26Z"),"lastAppliedWallTime" : ISODate("2022-04-07T02:44:26.741Z"),"lastDurableWallTime" : ISODate("2022-04-07T02:44:26.741Z"),"lastHeartbeat" : ISODate("2022-04-07T02:44:27.554Z"),"lastHeartbeatRecv" : ISODate("2022-04-07T02:44:27.554Z"),"pingMs" : NumberLong(0),"lastHeartbeatMessage" : "","syncSourceHost" : "mongodb-config-0.mongodb-config-hs.default.svc.cluster.local:27017","syncSourceId" : 0,"infoMessage" : "","configVersion" : 1,"configTerm" : 1}],"ok" : 1,"$gleStats" : {"lastOpTime" : Timestamp(0, 0),"electionId" : ObjectId("7fffffff0000000000000001")},"lastCommittedOpTime" : Timestamp(1649299466, 1),"$clusterTime" : {"clusterTime" : Timestamp(1649299466, 1),"signature" : {"hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="),"keyId" : NumberLong(0)}},"operationTime" : Timestamp(1649299466, 1)
}
configs:PRIMARY>

可以看到 configs 副本集中已经有一个 Primary 节点和两个 Secondary 节点,说明副本集的启动配置已完成。

6.部署 shard server（分片服务器）

# 第1个分片（每个分片有3个副本）
apiVersion: apps/v1
kind: StatefulSet
metadata:name: mongodb-shard0
spec:selector:matchLabels:app: mongodb-shardserviceName: "mongodb-shard-hs"replicas: 3template:metadata:labels:app: mongodb-shardspec:terminationGracePeriodSeconds: 10containers:- name: mongodb-shardimage: mongo:4.4command:- mongod- "--port"- "27017"- "--shardsvr"- "--replSet"- shard0- "--bind_ip"- 0.0.0.0ports:- containerPort: 27017volumeMounts:- name: mongdb-shard-persistent-storagemountPath: /data/dbvolumeClaimTemplates:- metadata:name: mongdb-shard-persistent-storagespec:storageClassName: course-nfs-storageaccessModes:- ReadWriteOnceresources:requests:storage: 10Gi
---
# 第2个分片（每个分片有3个副本）
apiVersion: apps/v1
kind: StatefulSet
metadata:name: mongodb-shard1
spec:selector:matchLabels:app: mongodb-shardserviceName: "mongodb-shard-hs"replicas: 3template:metadata:labels:app: mongodb-shardspec:terminationGracePeriodSeconds: 10containers:- name: mongodb-shardimage: mongo:4.4command:- mongod- "--port"- "27017"- "--shardsvr"- "--replSet"- shard1- "--bind_ip"- 0.0.0.0ports:- containerPort: 27017volumeMounts:- name: mongdb-shard-persistent-storagemountPath: /data/dbvolumeClaimTemplates:- metadata:name: mongdb-shard-persistent-storagespec:storageClassName: course-nfs-storageaccessModes:- ReadWriteOnceresources:requests:storage: 10Gi
---
# headless 无头服务（提供域名供StatefulSet内部pod访问使用）
apiVersion: v1
kind: Service
metadata:name: mongodb-shard-hslabels:name: mongodb-shard
spec:ports:- port: 27017targetPort: 27017clusterIP: Noneselector:app: mongodb-shard

6.1验证是否创建成功

[root@k8smaster mongodb-shard]# kubectl get pods
NAME                                     READY   STATUS    RESTARTS      AGE
mongodb-config-0                         1/1     Running   0             4d12h
mongodb-config-1                         1/1     Running   0             4d12h
mongodb-config-2                         1/1     Running   0             4d12h
mongodb-shard0-0                         1/1     Running   0             4d11h
mongodb-shard0-1                         1/1     Running   0             4d11h
mongodb-shard0-2                         1/1     Running   0             4d11h
mongodb-shard1-0                         1/1     Running   0             4d11h
mongodb-shard1-1                         1/1     Running   0             4d11h
mongodb-shard1-2                         1/1     Running   0             4d11h

6.2 配置第一分片集群

#进入任意一pods
kubectl exec -it mongodb-shard0-0 /bin/bash
#连接上任意一个实例
bin/mongo mongodb-shard0-0.mongodb-shard-hs.default.svc.cluster.local:27017
#切换数据库
use adminrs
#配置副本集
cfg = {_id: "shard0",members:[{_id: 0,host: 'mongodb-shard0-0.mongodb-shard-hs.default.svc.cluster.local:27017',priority: 3},{_id: 1,host: 'mongodb-shard0-1.mongodb-shard-hs.default.svc.cluster.local:27017',priority: 2},{_id: 2,host: 'mongodb-shard0-2.mongodb-shard-hs.default.svc.cluster.local:27017',priority: 1}]};
#初始化
rs.initiate(cfg)#验证 可以看到第一个分片中已经有一个 Primary 节点和两个 Secondary 节点
shard0:PRIMARY> rs.status()
{"set" : "shard0","date" : ISODate("2022-04-07T03:08:08.686Z"),"myState" : 1,"term" : NumberLong(1),"syncSourceHost" : "","syncSourceId" : -1,"heartbeatIntervalMillis" : NumberLong(2000),"majorityVoteCount" : 2,"writeMajorityCount" : 2,"votingMembersCount" : 3,"writableVotingMembersCount" : 3,"optimes" : {"lastCommittedOpTime" : {"ts" : Timestamp(1649300885, 1),"t" : NumberLong(1)},"lastCommittedWallTime" : ISODate("2022-04-07T03:08:05.048Z"),"readConcernMajorityOpTime" : {"ts" : Timestamp(1649300885, 1),"t" : NumberLong(1)},"readConcernMajorityWallTime" : ISODate("2022-04-07T03:08:05.048Z"),"appliedOpTime" : {"ts" : Timestamp(1649300885, 1),"t" : NumberLong(1)},"durableOpTime" : {"ts" : Timestamp(1649300885, 1),"t" : NumberLong(1)},"lastAppliedWallTime" : ISODate("2022-04-07T03:08:05.048Z"),"lastDurableWallTime" : ISODate("2022-04-07T03:08:05.048Z")},"lastStableRecoveryTimestamp" : Timestamp(1649300855, 1),"electionCandidateMetrics" : {"lastElectionReason" : "electionTimeout","lastElectionDate" : ISODate("2022-04-02T15:09:19.879Z"),"electionTerm" : NumberLong(1),"lastCommittedOpTimeAtElection" : {"ts" : Timestamp(0, 0),"t" : NumberLong(-1)},"lastSeenOpTimeAtElection" : {"ts" : Timestamp(1648912149, 1),"t" : NumberLong(-1)},"numVotesNeeded" : 2,"priorityAtElection" : 3,"electionTimeoutMillis" : NumberLong(10000),"numCatchUpOps" : NumberLong(0),"newTermStartDate" : ISODate("2022-04-02T15:09:20.095Z"),"wMajorityWriteAvailabilityDate" : ISODate("2022-04-02T15:09:20.581Z")},"members" : [{"_id" : 0,"name" : "mongodb-shard0-0.mongodb-shard-hs.default.svc.cluster.local:27017","health" : 1,"state" : 1,"stateStr" : "PRIMARY","uptime" : 388910,"optime" : {"ts" : Timestamp(1649300885, 1),"t" : NumberLong(1)},"optimeDate" : ISODate("2022-04-07T03:08:05Z"),"lastAppliedWallTime" : ISODate("2022-04-07T03:08:05.048Z"),"lastDurableWallTime" : ISODate("2022-04-07T03:08:05.048Z"),"syncSourceHost" : "","syncSourceId" : -1,"infoMessage" : "","electionTime" : Timestamp(1648912159, 1),"electionDate" : ISODate("2022-04-02T15:09:19Z"),"configVersion" : 2,"configTerm" : 1,"self" : true,"lastHeartbeatMessage" : ""},{"_id" : 1,"name" : "mongodb-shard0-1.mongodb-shard-hs.default.svc.cluster.local:27017","health" : 1,"state" : 2,"stateStr" : "SECONDARY","uptime" : 388739,"optime" : {"ts" : Timestamp(1649300885, 1),"t" : NumberLong(1)},"optimeDurable" : {"ts" : Timestamp(1649300885, 1),"t" : NumberLong(1)},"optimeDate" : ISODate("2022-04-07T03:08:05Z"),"optimeDurableDate" : ISODate("2022-04-07T03:08:05Z"),"lastAppliedWallTime" : ISODate("2022-04-07T03:08:05.048Z"),"lastDurableWallTime" : ISODate("2022-04-07T03:08:05.048Z"),"lastHeartbeat" : ISODate("2022-04-07T03:08:08.191Z"),"lastHeartbeatRecv" : ISODate("2022-04-07T03:08:08.660Z"),"pingMs" : NumberLong(0),"lastHeartbeatMessage" : "","syncSourceHost" : "mongodb-shard0-0.mongodb-shard-hs.default.svc.cluster.local:27017","syncSourceId" : 0,"infoMessage" : "","configVersion" : 2,"configTerm" : 1},{"_id" : 2,"name" : "mongodb-shard0-2.mongodb-shard-hs.default.svc.cluster.local:27017","health" : 1,"state" : 2,"stateStr" : "SECONDARY","uptime" : 388739,"optime" : {"ts" : Timestamp(1649300885, 1),"t" : NumberLong(1)},"optimeDurable" : {"ts" : Timestamp(1649300885, 1),"t" : NumberLong(1)},"optimeDate" : ISODate("2022-04-07T03:08:05Z"),"optimeDurableDate" : ISODate("2022-04-07T03:08:05Z"),"lastAppliedWallTime" : ISODate("2022-04-07T03:08:05.048Z"),"lastDurableWallTime" : ISODate("2022-04-07T03:08:05.048Z"),"lastHeartbeat" : ISODate("2022-04-07T03:08:08.258Z"),"lastHeartbeatRecv" : ISODate("2022-04-07T03:08:06.702Z"),"pingMs" : NumberLong(0),"lastHeartbeatMessage" : "","syncSourceHost" : "mongodb-shard0-0.mongodb-shard-hs.default.svc.cluster.local:27017","syncSourceId" : 0,"infoMessage" : "","configVersion" : 2,"configTerm" : 1}],"ok" : 1,"$gleStats" : {"lastOpTime" : Timestamp(0, 0),"electionId" : ObjectId("7fffffff0000000000000001")},"lastCommittedOpTime" : Timestamp(1649300885, 1),"$configServerState" : {"opTime" : {"ts" : Timestamp(1649300886, 5),"t" : NumberLong(1)}},"$clusterTime" : {"clusterTime" : Timestamp(1649300886, 5),"signature" : {"hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="),"keyId" : NumberLong(0)}},"operationTime" : Timestamp(1649300885, 1)
}
shard0:PRIMARY>

6.3 配置第二分片集群

# 进入第二分片任意一pod
kubectl exec -it mongodb-shard1-0 /bin/bash
#连接上mongodb
bin/mongo mongodb-shard1-0.mongodb-shard-hs.default.svc.cluster.local:27017
#切换数据库
use adminrs
#配置副本集
cfg = {_id: "shard1",members:[{_id: 0,host: 'mongodb-shard1-0.mongodb-shard-hs.default.svc.cluster.local:27017',priority: 3},{_id: 1,host: 'mongodb-shard1-1.mongodb-shard-hs.default.svc.cluster.local:27017',priority: 2},{_id: 2,host: 'mongodb-shard1-2.mongodb-shard-hs.default.svc.cluster.local:27017',priority: 1}]};
#初始化
rs.initiate(cfg)shard1:PRIMARY> rs.status()
{"set" : "shard1","date" : ISODate("2022-04-07T03:14:28.124Z"),"myState" : 1,"term" : NumberLong(1),"syncSourceHost" : "","syncSourceId" : -1,"heartbeatIntervalMillis" : NumberLong(2000),"majorityVoteCount" : 2,"writeMajorityCount" : 2,"votingMembersCount" : 3,"writableVotingMembersCount" : 3,"optimes" : {"lastCommittedOpTime" : {"ts" : Timestamp(1649301263, 1),"t" : NumberLong(1)},"lastCommittedWallTime" : ISODate("2022-04-07T03:14:23.314Z"),"readConcernMajorityOpTime" : {"ts" : Timestamp(1649301263, 1),"t" : NumberLong(1)},"readConcernMajorityWallTime" : ISODate("2022-04-07T03:14:23.314Z"),"appliedOpTime" : {"ts" : Timestamp(1649301263, 1),"t" : NumberLong(1)},"durableOpTime" : {"ts" : Timestamp(1649301263, 1),"t" : NumberLong(1)},"lastAppliedWallTime" : ISODate("2022-04-07T03:14:23.314Z"),"lastDurableWallTime" : ISODate("2022-04-07T03:14:23.314Z")},"lastStableRecoveryTimestamp" : Timestamp(1649301253, 1),"electionCandidateMetrics" : {"lastElectionReason" : "electionTimeout","lastElectionDate" : ISODate("2022-04-02T15:15:11.059Z"),"electionTerm" : NumberLong(1),"lastCommittedOpTimeAtElection" : {"ts" : Timestamp(0, 0),"t" : NumberLong(-1)},"lastSeenOpTimeAtElection" : {"ts" : Timestamp(1648912500, 1),"t" : NumberLong(-1)},"numVotesNeeded" : 2,"priorityAtElection" : 3,"electionTimeoutMillis" : NumberLong(10000),"numCatchUpOps" : NumberLong(0),"newTermStartDate" : ISODate("2022-04-02T15:15:11.151Z"),"wMajorityWriteAvailabilityDate" : ISODate("2022-04-02T15:15:11.299Z")},"members" : [{"_id" : 0,"name" : "mongodb-shard1-0.mongodb-shard-hs.default.svc.cluster.local:27017","health" : 1,"state" : 1,"stateStr" : "PRIMARY","uptime" : 389290,"optime" : {"ts" : Timestamp(1649301263, 1),"t" : NumberLong(1)},"optimeDate" : ISODate("2022-04-07T03:14:23Z"),"lastAppliedWallTime" : ISODate("2022-04-07T03:14:23.314Z"),"lastDurableWallTime" : ISODate("2022-04-07T03:14:23.314Z"),"syncSourceHost" : "","syncSourceId" : -1,"infoMessage" : "","electionTime" : Timestamp(1648912511, 1),"electionDate" : ISODate("2022-04-02T15:15:11Z"),"configVersion" : 2,"configTerm" : 1,"self" : true,"lastHeartbeatMessage" : ""},{"_id" : 1,"name" : "mongodb-shard1-1.mongodb-shard-hs.default.svc.cluster.local:27017","health" : 1,"state" : 2,"stateStr" : "SECONDARY","uptime" : 388767,"optime" : {"ts" : Timestamp(1649301263, 1),"t" : NumberLong(1)},"optimeDurable" : {"ts" : Timestamp(1649301263, 1),"t" : NumberLong(1)},"optimeDate" : ISODate("2022-04-07T03:14:23Z"),"optimeDurableDate" : ISODate("2022-04-07T03:14:23Z"),"lastAppliedWallTime" : ISODate("2022-04-07T03:14:23.314Z"),"lastDurableWallTime" : ISODate("2022-04-07T03:14:23.314Z"),"lastHeartbeat" : ISODate("2022-04-07T03:14:26.145Z"),"lastHeartbeatRecv" : ISODate("2022-04-07T03:14:28.091Z"),"pingMs" : NumberLong(0),"lastHeartbeatMessage" : "","syncSourceHost" : "mongodb-shard1-0.mongodb-shard-hs.default.svc.cluster.local:27017","syncSourceId" : 0,"infoMessage" : "","configVersion" : 2,"configTerm" : 1},{"_id" : 2,"name" : "mongodb-shard1-2.mongodb-shard-hs.default.svc.cluster.local:27017","health" : 1,"state" : 2,"stateStr" : "SECONDARY","uptime" : 388767,"optime" : {"ts" : Timestamp(1649301263, 1),"t" : NumberLong(1)},"optimeDurable" : {"ts" : Timestamp(1649301263, 1),"t" : NumberLong(1)},"optimeDate" : ISODate("2022-04-07T03:14:23Z"),"optimeDurableDate" : ISODate("2022-04-07T03:14:23Z"),"lastAppliedWallTime" : ISODate("2022-04-07T03:14:23.314Z"),"lastDurableWallTime" : ISODate("2022-04-07T03:14:23.314Z"),"lastHeartbeat" : ISODate("2022-04-07T03:14:26.144Z"),"lastHeartbeatRecv" : ISODate("2022-04-07T03:14:28.091Z"),"pingMs" : NumberLong(0),"lastHeartbeatMessage" : "","syncSourceHost" : "mongodb-shard1-1.mongodb-shard-hs.default.svc.cluster.local:27017","syncSourceId" : 1,"infoMessage" : "","configVersion" : 2,"configTerm" : 1}],"ok" : 1,"$gleStats" : {"lastOpTime" : Timestamp(0, 0),"electionId" : ObjectId("7fffffff0000000000000001")},"lastCommittedOpTime" : Timestamp(1649301263, 1),"$configServerState" : {"opTime" : {"ts" : Timestamp(1649301267, 3),"t" : NumberLong(1)}},"$clusterTime" : {"clusterTime" : Timestamp(1649301267, 3),"signature" : {"hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="),"keyId" : NumberLong(0)}},"operationTime" : Timestamp(1649301263, 1)
}
shard1:PRIMARY>

7.部署 route server（mongos 路由服务器）

apiVersion: apps/v1
kind: Deployment
metadata:name: mongodb-mongos
spec:selector:matchLabels:app: mongodb-mongosreplicas: 1template:metadata:labels:app: mongodb-mongosspec:terminationGracePeriodSeconds: 10containers:- name: mongodb-mongosimage: mongo:4.4command:- mongos- "--port"- "27017"- "--configdb"- "configs/mongodb-config-0.mongodb-config-hs.default.svc.cluster.local:27017,mongodb-config-1.mongodb-config-hs.default.svc.cluster.local:27017,mongodb-config-2.mongodb-config-hs.default.svc.cluster.local:27017"- "--bind_ip"- 0.0.0.0ports:- containerPort: 27017
---
# 标准服务（供外部访问）
apiVersion: v1
kind: Service
metadata:name: mongodb-mongos-svclabels:name: mongodb-mongos
spec:type: NodePortports:- port: 27017targetPort: 27017nodePort: 30717selector:app: mongodb-mongos

7.1验证

[root@k8smaster mongodb-shard]# kubectl get pods
NAME                                     READY   STATUS    RESTARTS      AGE
mongodb-config-0                         1/1     Running   0             4d12h
mongodb-config-1                         1/1     Running   0             4d12h
mongodb-config-2                         1/1     Running   0             4d12h
mongodb-mongos-5bf5f8956d-ckpzv          1/1     Running   0             4d11h
mongodb-shard0-0                         1/1     Running   0             4d12h
mongodb-shard0-1                         1/1     Running   0             4d12h
mongodb-shard0-2                         1/1     Running   0             4d12h
mongodb-shard1-0                         1/1     Running   0             4d12h
mongodb-shard1-1                         1/1     Running   0             4d12h
mongodb-shard1-2                         1/1     Running   0             4d12h
[root@k8smaster mongodb-shard]#

7.2 将路由服务器和分片副本集串联起来

#进入pod
kubectl exec -it  mongodb-mongos-5bf5f8956d-ckpzv  /bin/bash
#连接mongodb
bin/mongo --port 27017
#切换库
use admin#将副本集添加到分片集
sh.addShard("shard0/mongodb-shard0-0.mongodb-shard-hs.default.svc.cluster.local:27017,mongodb-shard0-1.mongodb-shard-hs.default.svc.cluster.local:27017,mongodb-shard0-2.mongodb-shard-hs.default.svc.cluster.local:27017");
sh.addShard("shard1/mongodb-shard1-0.mongodb-shard-hs.default.svc.cluster.local:27017,mongodb-shard1-1.mongodb-shard-hs.default.svc.cluster.local:27017,mongodb-shard1-2.mongodb-shard-hs.default.svc.cluster.local:27017");mongos> sh.status()
--- Sharding Status --- sharding version: {"_id" : 1,"minCompatibleVersion" : 5,"currentVersion" : 6,"clusterId" : ObjectId("624865833544ee7f865b86d7")}shards:{  "_id" : "shard0",  "host" : "shard0/mongodb-shard0-0.mongodb-shard-hs.default.svc.cluster.local:27017,mongodb-shard0-1.mongodb-shard-hs.default.svc.cluster.local:27017,mongodb-shard0-2.mongodb-shard-hs.default.svc.cluster.local:27017",  "state" : 1 }{  "_id" : "shard1",  "host" : "shard1/mongodb-shard1-0.mongodb-shard-hs.default.svc.cluster.local:27017,mongodb-shard1-1.mongodb-shard-hs.default.svc.cluster.local:27017,mongodb-shard1-2.mongodb-shard-hs.default.svc.cluster.local:27017",  "state" : 1 }active mongoses:"4.4.11" : 1autosplit:Currently enabled: yesbalancer:Currently enabled:  yesCurrently running:  noFailed balancer rounds in last 5 attempts:  0Migration Results for the last 24 hours: No recent migrationsdatabases:{  "_id" : "config",  "primary" : "config",  "partitioned" : true }config.system.sessionsshard key: { "_id" : 1 }unique: falsebalancing: truechunks:shard0  512shard1  512too many chunks to print, use verbose if you want to force print{  "_id" : "mom",  "primary" : "shard0",  "partitioned" : true,  "version" : {  "uuid" : UUID("5bd831f4-b5bb-44ee-9885-c736aa0a7e18"),  "lastMod" : 1 } }

8.分片测试

#连接 route serverkubectl exec -it  mongodb-mongos-5bf5f8956d-ckpzv   /bin/bash
bin/mongo --port 27017
use admin
#假设我们需要让mom这个数据库启用分片，只需要执行如下命令，便可以对该数据库内的集合进行分片了
sh.enableSharding("mom")#对集合分片时，我们要选择一个分片键（shard key）。分片键是集合的一个键，MongoDB 根据这个键拆分数据。执行下面命令让 ApiRecord 集合依据 traceId 对集合进行分片： 
sh.shardCollection("mom.ApiRecord", {"traceId" : "hashed"})
#切换到mom库
use mom
#接着执行如下命令往 mom 集合中插入 5.5 千条数据：
for(var i=100000;i<105500;i++){db.ApiRecord.insert({"traceId" : "user"+i , "created_at" : new Date()});
}db.ApiRecord.getShardDistribution()
mongos> db.mom.getShardDistribution()
Collection mom.mom is not sharded.
mongos> use admin
switched to db admin
mongos> db.mom.getShardDistribution()
Collection admin.mom is not sharded.
mongos> db.ApiRecord.getShardDistribution()
Collection admin.ApiRecord is not sharded.
mongos> use mom
switched to db mom
mongos> db.ApiRecord.getShardDistribution()Shard shard0 at shard0/mongodb-shard0-0.mongodb-shard-hs.default.svc.cluster.local:27017,mongodb-shard0-1.mongodb-shard-hs.default.svc.cluster.local:27017,mongodb-shard0-2.mongodb-shard-hs.default.svc.cluster.local:27017data : 178KiB docs : 2775 chunks : 2estimated data per chunk : 89KiBestimated docs per chunk : 1387Shard shard1 at shard1/mongodb-shard1-0.mongodb-shard-hs.default.svc.cluster.local:27017,mongodb-shard1-1.mongodb-shard-hs.default.svc.cluster.local:27017,mongodb-shard1-2.mongodb-shard-hs.default.svc.cluster.local:27017data : 175KiB docs : 2725 chunks : 2estimated data per chunk : 87KiBestimated docs per chunk : 1362Totalsdata : 354KiB docs : 5500 chunks : 4Shard shard0 contains 50.45% data, 50.45% docs in cluster, avg obj size on shard : 66BShard shard1 contains 49.54% data, 49.54% docs in cluster, avg obj size on shard : 66B

注意：要用如下语句的用户连接
db.createUser({user:“daniel”,pwd:“123456”,roles:[{role:“dbOwner”,db:“good”}]})

参考：K8s - 安装部署MongoDB数据库教程3（分片集群）

这篇关于k8s 安装 mongodb 分片（Sharding）+ 副本集（Replica Set）的文章就介绍到这儿，希望我们推荐的文章对编程师们有所帮助！


http://www.chinasem.cn/article/264342。

相关文章

Jsoncpp的安装与使用方式

Jsoncpp的安装与使用方式

《Jsoncpp的安装与使用方式》JsonCpp是一个用于解析和生成JSON数据的C++库,它支持解析JSON文件或字符串到C++对象,以及将C++对象序列化回JSON格式,安装JsonCpp可以通过... 目录安装jsoncppJsoncpp的使用Value类构造函数检测保存的数据类型提取数据对json数
阅读更多...
mac安装redis全过程

mac安装redis全过程

《mac安装redis全过程》文章内容主要介绍了如何从官网下载指定版本的Redis,以及如何在自定义目录下安装和启动Redis,还提到了如何修改Redis的密码和配置文件,以及使用RedisInsig... 目录MAC安装Redis安装启动redis 配置redis 常用命令总结mac安装redis官网下
阅读更多...
如何安装 Ubuntu 24.04 LTS 桌面版或服务器? Ubuntu安装指南

如何安装 Ubuntu 24.04 LTS 桌面版或服务器? Ubuntu安装指南

《如何安装Ubuntu24.04LTS桌面版或服务器?Ubuntu安装指南》对于我们程序员来说，有一个好用的操作系统、好的编程环境也是很重要，如何安装Ubuntu24.04LTS桌面... Ubuntu 24.04 LTS，代号 Noble NumBAT，于 2024 年 4 月 25 日正式发布，引入了众
阅读更多...
如何安装HWE内核? Ubuntu安装hwe内核解决硬件太新的问题

如何安装HWE内核? Ubuntu安装hwe内核解决硬件太新的问题

《如何安装HWE内核?Ubuntu安装hwe内核解决硬件太新的问题》今天的主角就是hwe内核(hardwareenablementkernel)，一般安装的Ubuntu都是初始内核，不能很好地支... 对于追求系统稳定性，又想充分利用最新硬件特性的 Ubuntu 用户来说，HWEXBQgUbdlna（Har
阅读更多...
python中poetry安装依赖

python中poetry安装依赖

《python中poetry安装依赖》本文主要介绍了Poetry工具及其在Python项目中的安装和使用,文中通过示例代码介绍的非常详细,对大家的学习或者工作具有一定的参考学习价值,需要的朋友们下面随... 目录前言1. 为什么pip install poetry 会造成依赖冲突1.1 全局环境依赖混淆：1
阅读更多...
windows端python版本管理工具pyenv-win安装使用

windows端python版本管理工具pyenv-win安装使用

《windows端python版本管理工具pyenv-win安装使用》：本文主要介绍如何通过git方式下载和配置pyenv-win,包括下载、克隆仓库、配置环境变量等步骤,同时还详细介绍了如何使用... 目录pyenv-win 下载配置环境变量使用 pyenv-win 管理 python 版本一、安装 和
阅读更多...
Linux下MySQL8.0.26安装教程

Linux下MySQL8.0.26安装教程

《Linux下MySQL8.0.26安装教程》文章详细介绍了如何在Linux系统上安装和配置MySQL,包括下载、解压、安装依赖、启动服务、获取默认密码、设置密码、支持远程登录以及创建表,感兴趣的朋友... 目录1.找到官网下载位置1.访问mysql存档2.下载社区版3.百度网盘中2.linux安装配置1.
阅读更多...
Kibana的安装和配置全过程

Kibana的安装和配置全过程

《Kibana的安装和配置全过程》Kibana是一个开源的数据分析和可视化平台,它与Elasticsearch紧密集成,提供了一个直观的Web界面,使您可以快速地搜索、分析和可视化数据,在本文中,我们... 目录Kibana的安装和配置1.安装Java运行环境2.下载Kibana3.解压缩Kibana4.配
阅读更多...
Zookeeper安装和配置说明

Zookeeper安装和配置说明

一、Zookeeper的搭建方式 Zookeeper安装方式有三种，单机模式和集群模式以及伪集群模式。 ■ 单机模式：Zookeeper只运行在一台服务器上，适合测试环境； ■ 伪集群模式：就是在一台物理机上运行多个Zookeeper 实例； ■ 集群模式：Zookeeper运行于一个集群上，适合生产环境，这个计算机集群被称为一个“集合体”（ensemble） Zookeeper通过复制来实现
阅读更多...
CentOS7安装配置mysql5.7 tar免安装版

CentOS7安装配置mysql5.7 tar免安装版

一、CentOS7.4系统自带mariadb # 查看系统自带的Mariadb[root@localhost~]# rpm -qa|grep mariadbmariadb-libs-5.5.44-2.el7.centos.x86_64# 卸载系统自带的Mariadb[root@localhost ~]# rpm -e --nodeps mariadb-libs-5.5.44-2.el7
阅读更多...

Copyright China编程 23002807@qq.com

沪ICP备2023033072号-2