K8S Redis-Cluster安装(含redis-cluster-proxy、RedisInsight)

2024-05-06 10:12

本文主要是介绍K8S Redis-Cluster安装(含redis-cluster-proxy、RedisInsight),希望对大家解决编程问题提供一定的参考价值,需要的开发者们随着小编来一起学习吧!

参考:在 K8S 中快速部署 Redis Cluster & Redisinsight
参考:Redis 中文文档(一)

helm   redis-cluster

[root@k8s-master01 redis-cluster]# helm search repo redis-cluster
NAME                    CHART VERSION   APP VERSION     DESCRIPTION
bitnami/redis-cluster   9.1.3           7.2.3           Redis(R) is an open source, scalable, distribut...[root@k8s-master01 redis-cluster]# helm pull bitnami/redis-cluster

解压,查看使用到的镜像文件,提前下载并上传私有仓库

[root@k8s-master01 redis-cluster]# cat Chart.yaml
annotations:
category: Database
images: |
- name: os-shell
image: docker.io/bitnami/os-shell:11-debian-11-r91
- name: redis-cluster
image: docker.io/bitnami/redis-cluster:7.2.3-debian-11-r1
- name: redis-exporter
image: docker.io/bitnami/redis-exporter:1.55.0-debian-11-r2

配置私有仓库

docker tag docker.io/bitnami/redis-exporter:1.55.0-debian-11-r2  harbor.david.org/bitnami/redis-exporter:1.55.0-debian-11-r2
docker tag docker.io/bitnami/redis-cluster:7.2.3-debian-11-r1  harbor.david.org/bitnami/redis-cluster:7.2.3-debian-11-r1
docker tag docker.io/bitnami/os-shell:11-debian-11-r91  harbor.david.org/bitnami/os-shell:11-debian-11-r91
docker tag docker.io/redislabs/redisinsight:latest  harbor.david.org/redislabs/redisinsight:latest

helm安装redis-cluster

使用之前的storyageClass

StorageClass
helm install redis-cluster bitnami/redis-cluster -n develop \--values values.yaml \--set persistence.storageClass=nfs-sc \--set image.registry=harbor.david.org \--set volumePermissions.image.registry=harbor.david.org \--set metrics.image.registry=harbor.david.org \--set sysctlImage.image.registry=harbor.david.org

安装完成


NAME: redis-cluster
LAST DEPLOYED: Fri Nov 24 14:05:41 2023
NAMESPACE: develop
STATUS: deployed
REVISION: 1
TEST SUITE: None
NOTES:
CHART NAME: redis-cluster
CHART VERSION: 9.1.3
APP VERSION: 7.2.3** Please be patient while the chart is being deployed **To get your password run:export REDIS_PASSWORD=$(kubectl get secret --namespace "develop" redis-cluster -o jsonpath="{.data.redis-password}" | base64 -d)You have deployed a Redis® Cluster accessible only from within you Kubernetes Cluster.INFO: The Job to create the cluster will be created.To connect to your Redis® cluster:1. Run a Redis® pod that you can use as a client:
kubectl run --namespace develop redis-cluster-client --rm --tty -i --restart='Never' \--env REDIS_PASSWORD=$REDIS_PASSWORD \
--image harbor.david.org/bitnami/redis-cluster:7.2.3-debian-11-r1 -- bash2. Connect using the Redis® CLI:redis-cli -c -h redis-cluster -a $REDIS_PASSWORD


查看密码

[root@k8s-master01 redis-cluster]# kubectl get secret --namespace "develop" redis-cluster -o jsonpath="{.data.redis-password}" | base64 -d


 

导出所有节点的地址为ClusterIp(如果需要)

参考: VMware Tanzu Application Catalog (Applications Tutorials) Documentation

 helm upgrade redis-cluster --set "password=xxxxxxxxxx,cluster.externalAccess.enabled=true bitnami/redis-cluster -n develop
[root@k8s-master01 redis]# helm upgrade redis-cluster bitnami/redis-cluster --set cluster.externalAccess.enabled=true --set password=An1y6Hh0Cv -n develop
Release "redis-cluster" has been upgraded. Happy Helming!
NAME: redis-cluster
LAST DEPLOYED: Sun Nov 26 18:10:15 2023
NAMESPACE: develop
STATUS: deployed
REVISION: 3
TEST SUITE: None
NOTES:
CHART NAME: redis-cluster
CHART VERSION: 9.1.3
APP VERSION: 7.2.3** Please be patient while the chart is being deployed **To get your password run:export REDIS_PASSWORD=$(kubectl get secret --namespace "develop" redis-cluster -o jsonpath="{.data.redis-password}" | base64 -d)To connect to your Redis® server from outside the cluster check the following information:NOTE: It may take a few minutes for the LoadBalancer IP to be available.Watch the status with: 'kubectl get svc --namespace develop -w redis-cluster'You will have a different external IP for each Redis® node. Get the external ip from `-external` suffixed services: `kubectl get svc`.Redis® port: 6379Once the LoadBalancerIPs are ready, you need to provide them and perform a Helm Upgrade:helm upgrade --namespace develop redis-cluster --set "cluster.externalAccess.enabled=true,cluster.externalAccess.service.type=LoadBalancer,cluster.externalAccess.service.loadBalancerIP[0]=load-balancerip-0,cluster.externalAccess.service.loadBalancerIP[1]=load-balancerip-1,cluster.externalAccess.service.loadBalancerIP[2]=load-balancerip-2,cluster.externalAccess.service.loadBalancerIP[3]=load-balancerip-3,cluster.externalAccess.service.loadBalancerIP[4]=load-balancerip-4,cluster.externalAccess.service.loadBalancerIP[5]=load-balancerip-5" oci://registry-1.docker.io/bitnamicharts/redis-clusterWhere loadbalancer-ip-i are the LoadBalancerIPs provided by the cluster.

helm upgrade ingress-nginx导出redis 6379端口

参考:K8s and Redis; a tale of Layer 4 Ingress

helm upgrade ingress-nginx ingress-nginx/ingress-nginx -n ingress-nginx \--values values.yaml \--set tcp.26379="develop/redis-cluster:6379" --debug

修改端口为你想要的端口

 [root@k8s-master01 ~]# kubectl edit svc -n ingress-nginx ingress-nginx-controllerservice/ingress-nginx-controller edited[root@k8s-master01 ~]# kubectl get svc -n ingress-nginx

也可以使用port-forward进行临时转发端口,不过得一直挂着

参考: 使用端口转发来访问集群中的应用
参考: kubectl port-forward 踩坑记录

 [root@k8s-master01 redis]# kubectl port-forward service/redis-cluster -n develop 30009:6379 --address 0.0.0.0Forwarding from 0.0.0.0:30009 -> 6379Handling connection for 30009


 使用ingress-nginx进行转发(集群方式下不推荐) 


 因为集群会涉及到不同的key在不同的slot上,
 Redis会进行重定向,将内网IP返回给客户端
 但客户端并不能访问到内网地址

 参考: 浅谈Redis Cluster 集群的MOVED、ASK重定向
 

 ingress-nginx导出TCP端口

 配置redis-cluster-proxy代理(外网客户端及程序可连接)
 参考: 【Redis】——引入redis-cluster-proxy使得Redis Cluster对Kubernetes外部可提供服务
 参考: Redis系列(十五)、Redis6新特性之集群代理(Cluster Proxy)

 linux上安装redis-cluster-proxy

 依赖gcc需要提前安装


 gcc version 9.3.1
 参考: CentOS/Ubuntu安装最新的gcc-9 

参考:

【已解决】Error: Failed to download metadata for repo ‘appstream‘: Cannot prepare internal mirrorlist

 或者参考下面的dockerfile

 make redis-cluster-proxy

# Make Install 
git clone https://github.com/artix75/redis-cluster-proxy
cd redis-cluster-proxy
make PREFIX=/usr/local/redis_cluster_proxy install dockerfile在目录/usr/local/redis_cluster_proxy/bin/ 下复制redis-cluster-proxy到当前目录,然后创建dockerfile 内容如下redis_cluster_proxy使用C编写,需要gcc version 9.3.1环境https://blog.csdn.net/weixin_43252521/article/details/124409151
[root@master01 redis-cluster-proxy]# vi dockerfile
FROM centos:8WORKDIR /dataRUN sed -i 's/mirrorlist/#mirrorlist/g' /etc/yum.repos.d/CentOS-*
RUN sed -i 's|#baseurl=http://mirror.centos.org|baseurl=http://vault.centos.org|g' /etc/yum.repos.d/CentOS-*
RUN yum makecache
#RUN yum update -yRUN rpm -ivh https://cbs.centos.org/kojifiles/packages/centos-release-scl-rh/2/3.el7.centos/noarch/centos-release-scl-rh-2-3.el7.centos.noarch.rpm
RUN rpm -ivh https://cbs.centos.org/kojifiles/packages/centos-release-scl/2/3.el7.centos/noarch/centos-release-scl-2-3.el7.centos.noarch.rpmRUN yum install -y centos-release-scl
RUN yum install -y devtoolset-9-gcc devtoolset-9-gcc-c++RUN echo "scl enable devtoolset-9 bash" >> /etc/profile
RUN echo "source /opt/rh/devtoolset-9/enable" >> /etc/profileRUN source /etc/profileRUN yum install -y wget
RUN wget -O /etc/yum.repos.d/CentOS-Base.repo http://mirrors.aliyun.com/repo/Centos-8.repo
RUN sed -i  's/$releasever/8/g' /etc/yum.repos.d/CentOS-Base.repo
RUN yum repolistRUN yum install -y  gcc
RUN gcc -vADD redis-cluster-proxy /usr/local/bin/EXPOSE 7777docker build . -t redis-cluster-proxy:v1.0.0
 [root@k8s-master01 ~]# docker tag redis-cluster-proxy:v1.0.0  harbor.david.org/redislabs/redis-cluster-proxy:v1.0.0[root@k8s-master01 ~]# docker push  harbor.david.org/redislabs/redis-cluster-proxy:v1.0.0

 配置redis-cluster-proxy configmap

[root@master01 redis-cluster-proxy]# vi configMap.yaml
---
# Redis-Proxy Config
apiVersion: v1
kind: ConfigMap
metadata:name: redis-cluster-proxynamespace: develop
data:proxy.conf: |cluster redis-cluster:6379     # 配置为Redis Cluster Servicebind 0.0.0.0port 7777   # redis-cluster-proxy 对外暴露端口threads 8   # 线程数量daemonize noenable-cross-slot yesauth An1y6Hh0Cv     # 配置Redis Cluster 认证密码log-level error
[root@master01 redis-cluster-proxy]#
kubectl apply -f configMap.yaml  -n develop

配置deployment.yaml

[root@master01 redis-cluster-proxy]# vi deployment.yaml
---
# Redis-Proxy NodePort
apiVersion: v1
kind: Service
metadata:name: redis-cluster-proxynamespace: develop
spec:type: NodePort # 对K8S外部提供服务ports:- name: redis-cluster-proxynodePort: 30009   # 对外提供的端口port: 7777protocol: TCPtargetPort: 7777selector:app: redis-cluster-proxy
---
# Redis-Proxy Deployment
apiVersion: apps/v1
kind: Deployment
metadata:name: redis-cluster-proxynamespace: develop
spec:replicas: 1selector:matchLabels:app: redis-cluster-proxytemplate:metadata:labels:app: redis-cluster-proxyspec:#imagePullSecrets:#  - name: harborcontainers:- name: redis-cluster-proxyimage: harbor.david.org/redislabs/redis-cluster-proxy:v1.0.0imagePullPolicy: Alwayscommand: ["redis-cluster-proxy"]args:- -c- /data/proxy.conf   # 指定启动配置文件ports:- name: redis-7777containerPort: 7777protocol: TCPvolumeMounts:- name: redis-proxy-confmountPath: /data/volumes:   # 挂载proxy配置文件- name: redis-proxy-confconfigMap:name: redis-cluster-proxy
[root@master01 redis-cluster-proxy]#
kubectl apply -f deployment.yaml  -n develop[root@master01 redis-cluster-proxy]# kubectl get pods -n develop
NAME                                   READY   STATUS    RESTARTS        AGE
redis-cluster-proxy-6679cb8f78-nbgr4   1/1     Running   0               167m[root@master01 redis-cluster-proxy]# kubectl get svc -n develop |grep redis
redis-cluster                   ClusterIP   10.102.144.124   <none>        6379/TCP                        5d21h
redis-cluster-headless          ClusterIP   None             <none>        6379/TCP,16379/TCP              5d21h
redis-cluster-proxy             NodePort    10.103.13.20     <none>        7777:30009/TCP                  167m

安装redisinsight

 参考:redisinsight
 打开网页右上角的 install

helm repo add redisinsight https://spy86.github.io/redisinsight[root@k8s-master01 ~]# helm search hub redisinsight -o json
[{"url":"https://artifacthub.io/packages/helm/redisinsight/redisinsight","version":"0.1.0","app_version":"0.1.0","description":"A Helm chart for Redis Insight.","repository":{"url":"https://spy86.github.io/redisinsight","name":"redisinsight"}},{"url":"https://artifacthub.io/packages/helm/truecharts/redisinsight","version":"3.0.13","app_version":"1.14.0","description":"GUI for Redis.","repository":{"url":"https://charts.truecharts.org/","name":"truecharts"}},{"url":"https://artifacthub.io/packages/helm/riftbit/redisinsight","version":"0.1.0","app_version":"v1.0.0","description":"RedisInsight - The GUI for Redis","repository":{"url":"https://charts.riftbit.com/","name":"riftbit"}},{"url":"https://artifacthub.io/packages/helm/heywood8-helm-charts/redisinsight","version":"0.4.5","app_version":"2.28.0","description":"A Redisinsight Helm chart for kubernetes","repository":{"url":"https://heywood8.github.io/helm-charts/","name":"heywood8-helm-charts"}},{"url":"https://artifacthub.io/packages/helm/eximiait/openshift-secured-redisinsight","version":"0.9.0","app_version":"","description":"A secured version of RedisInsight for OpenShift","repository":{"url":"https://charts.eximiait.com.ar","name":"eximiait"}}]
[root@k8s-master01 ~]#[root@k8s-master01 ~]# helm search repo redisinsight
NAME                            CHART VERSION   APP VERSION     DESCRIPTION
redisinsight/redisinsight       0.1.0           0.1.0           A Helm chart for Redis Insight.
[root@k8s-master01 ~]#

[root@k8s-master01 ~]# helm pull redisinsight/redisinsight


解压,查看values.yaml


helm install redisinsight redisinsight/redisinsight -n develop \
--values values.yaml \
--set namespace.name=develop \
--set image.repository=harbor.david.org/redislabs/redisinsightNAME: redisinsight
LAST DEPLOYED: Fri Nov 24 14:36:26 2023
NAMESPACE: develop
STATUS: deployed
REVISION: 1
NOTES:
1. Get the application URL by running these commands:export POD_NAME=$(kubectl get pods --namespace develop -l "app.kubernetes.io/name=redisinsight,app.kubernetes.io/instance=redisinsight" -o jsonpath="{.items[0].metadata.name}")echo "Visit http://127.0.0.1:8001 to use your application"kubectl --namespace develop port-forward $POD_NAME 8001:8001

配置ingress-nginx转发

vi ingress-nginx.yamlapiVersion: networking.k8s.io/v1
kind: Ingress
metadata:name: redisinsight-ingressnamespace: develop
spec:ingressClassName: nginxrules: # 一个ingress可以配置多个rules- host: redisinsight.david.org # 域名配置,可以不写,匹配*,或者写 *.bar.comhttp:        paths: # 相当于nginx的location,同一个host可以配置多个path- pathType: Prefixbackend:service:name: redisinsight  # 代理到哪个svcport:number: 80 # svc的端口path: /


 应用

 kubectl apply -f ingress-nginx.yaml

 配置hosts

 192.168.221.132 redisinsight.david.org

 访问测试
 
 http://redisinsight.david.org

这篇关于K8S Redis-Cluster安装(含redis-cluster-proxy、RedisInsight)的文章就介绍到这儿,希望我们推荐的文章对编程师们有所帮助!



http://www.chinasem.cn/article/964090

相关文章

Python中win32包的安装及常见用途介绍

《Python中win32包的安装及常见用途介绍》在Windows环境下,PythonWin32模块通常随Python安装包一起安装,:本文主要介绍Python中win32包的安装及常见用途的相关... 目录前言主要组件安装方法常见用途1. 操作Windows注册表2. 操作Windows服务3. 窗口操作

Redis出现中文乱码的问题及解决

《Redis出现中文乱码的问题及解决》:本文主要介绍Redis出现中文乱码的问题及解决,具有很好的参考价值,希望对大家有所帮助,如有错误或未考虑完全的地方,望不吝赐教... 目录1. 问题的产生2China编程. 问题的解决redihttp://www.chinasem.cns数据进制问题的解决中文乱码问题解决总结

Redis的持久化之RDB和AOF机制详解

《Redis的持久化之RDB和AOF机制详解》:本文主要介绍Redis的持久化之RDB和AOF机制,具有很好的参考价值,希望对大家有所帮助,如有错误或未考虑完全的地方,望不吝赐教... 目录概述RDB(Redis Database)核心原理触发方式手动触发自动触发AOF(Append-Only File)核

Redis分片集群、数据读写规则问题小结

《Redis分片集群、数据读写规则问题小结》本文介绍了Redis分片集群的原理,通过数据分片和哈希槽机制解决单机内存限制与写瓶颈问题,实现分布式存储和高并发处理,但存在通信开销大、维护复杂及对事务支持... 目录一、分片集群解android决的问题二、分片集群图解 分片集群特征如何解决的上述问题?(与哨兵模

SpringBoot连接Redis集群教程

《SpringBoot连接Redis集群教程》:本文主要介绍SpringBoot连接Redis集群教程,具有很好的参考价值,希望对大家有所帮助,如有错误或未考虑完全的地方,望不吝赐教... 目录1. 依赖2. 修改配置文件3. 创建RedisClusterConfig4. 测试总结1. 依赖 <de

SpringBoot+Redis防止接口重复提交问题

《SpringBoot+Redis防止接口重复提交问题》:本文主要介绍SpringBoot+Redis防止接口重复提交问题,具有很好的参考价值,希望对大家有所帮助,如有错误或未考虑完全的地方,望不... 目录前言实现思路代码示例测试总结前言在项目的使用使用过程中,经常会出现某些操作在短时间内频繁提交。例

Redis 配置文件使用建议redis.conf 从入门到实战

《Redis配置文件使用建议redis.conf从入门到实战》Redis配置方式包括配置文件、命令行参数、运行时CONFIG命令,支持动态修改参数及持久化,常用项涉及端口、绑定、内存策略等,版本8... 目录一、Redis.conf 是什么?二、命令行方式传参(适用于测试)三、运行时动态修改配置(不重启服务

浅析如何保证MySQL与Redis数据一致性

《浅析如何保证MySQL与Redis数据一致性》在互联网应用中,MySQL作为持久化存储引擎,Redis作为高性能缓存层,两者的组合能有效提升系统性能,下面我们来看看如何保证两者的数据一致性吧... 目录一、数据不一致性的根源1.1 典型不一致场景1.2 关键矛盾点二、一致性保障策略2.1 基础策略:更新数

k8s上运行的mysql、mariadb数据库的备份记录(支持x86和arm两种架构)

《k8s上运行的mysql、mariadb数据库的备份记录(支持x86和arm两种架构)》本文记录在K8s上运行的MySQL/MariaDB备份方案,通过工具容器执行mysqldump,结合定时任务实... 目录前言一、获取需要备份的数据库的信息二、备份步骤1.准备工作(X86)1.准备工作(arm)2.手

gitlab安装及邮箱配置和常用使用方式

《gitlab安装及邮箱配置和常用使用方式》:本文主要介绍gitlab安装及邮箱配置和常用使用方式,具有很好的参考价值,希望对大家有所帮助,如有错误或未考虑完全的地方,望不吝赐教... 目录1.安装GitLab2.配置GitLab邮件服务3.GitLab的账号注册邮箱验证及其分组4.gitlab分支和标签的