购物网站排名2017,win7下asp网站搭建,无锡做网站公司在哪里,深圳网络推广优化目录 概述实践安装插件docker 在线安装containerd安装二进制安装yum安装修改containder配置文件 cnietcdrsyncgo设置golang代理 安装CFSSL下载kubernetes代码编译启动本地单节点集群问题k8s没有被正常启动该如何k8s正常启动日志测试 结束 概述 此文详细说明在 centos 7上编译 k… 目录 概述实践安装插件docker 在线安装containerd安装二进制安装yum安装修改containder配置文件 cnietcdrsyncgo设置golang代理 安装CFSSL下载kubernetes代码编译启动本地单节点集群问题k8s没有被正常启动该如何k8s正常启动日志测试 结束 概述 此文详细说明在 centos 7上编译 k8s 源码并运行单个集群测试用例 nginx # 找不到 vim 等这种源找不到挂到本地安装 iso 上 [roottest kubernetes]# mount /dev/cdrom /mnt实践 安装插件 yum install -y gcc g gawk autoconf automake python3-cmarkgfm yum install -y acl libacl1-dev yum install -y attr libattr1-dev yum install -y libxxhash-dev libzstd-dev liblz4-dev libssl-dev jq python3-pip yum install -y vim wget yum install -y ca-certificates curl gnupg docker 在线安装 官方文档 wget -O /etc/yum.repos.d/CentOS-Base.repo http://mirrors.aliyun.com/repo/Centos-7.repo 阿里云 wget -O /etc/yum.repos.d/CentOS-Base.repo http://mirrors.aliyun.com/repo/Centos-7.repo [roottest kubernetes]# yum -y install yum-utilsyum remove docker \docker-client \docker-client-latest \docker-common \docker-latest \docker-latest-logrotate \docker-logrotate \docker-engineyum install -y yum-utilsyum-config-manager --add-repo https://download.docker.com/linux/centos/docker-ce.repo [roottest kubernetes]# yum install container-selinuxyum list docker-ce --showduplicates|sort -r # To install the latest version, run:yum install docker-ce docker-ce-cli containerd.io docker-buildx-plugin docker-compose-pluginsystemctl start docker docker run hello-world 系统重启有问题 [roottest kubernetes]# systemctl start docker [roottest kubernetes]# docker ps CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES [roottest kubernetes]# docker -v Docker version 25.0.2, build 29cf629 containerd安装 本次采用 yum 安装模式。 二进制安装 wget https://github.com/containerd/containerd/releases/download/v1.7.13/cri-containerd-cni-1.7.13-linux-amd64.tar.gzcurl https://github.com/containerd/containerd/releases/download/v1.7.13/cri-containerd-cni-1.7.13-linux-amd64.tar.gzyum安装 # 获取YUM源 [roottest ~]# wget -O /etc/yum.repos.d/docker-ce.repo https://mirrors.aliyun.com/docker-ce/linux/centos/docker-ce.repo --2024-02-04 13:52:47-- https://mirrors.aliyun.com/docker-ce/linux/centos/docker-ce.repo 正在解析主机 mirrors.aliyun.com (mirrors.aliyun.com)... 113.219.178.241, 101.226.26.145, 113.219.178.228, ... 正在连接 mirrors.aliyun.com (mirrors.aliyun.com)|113.219.178.241|:443... 已连接。 已发出 HTTP 请求正在等待回应... 200 OK 长度2081 (2.0K) [application/octet-stream] 正在保存至: “/etc/yum.repos.d/docker-ce.repo”100%[] 2,081 --.-K/s 用时 0s 2024-02-04 13:52:47 (183 MB/s) - 已保存 “/etc/yum.repos.d/docker-ce.repo” [2081/2081]) # 使用yum命令安装 [roottest ~]# yum -y install containerd.io 已加载插件fastestmirror Loading mirror speeds from cached hostfile* base: mirrors.aliyun.com* elrepo: ftp.yz.yamagata-u.ac.jp* extras: mirrors.aliyun.com* updates: mirrors.aliyun.com file:///mnt/repodata/repomd.xml: [Errno 14] curl#37 - Couldnt open file /mnt/repodata/repomd.xml 正在尝试其它镜像。 软件包 containerd.io-1.6.28-3.1.el7.x86_64 已安装并且是最新版本 无须任何处理 # 使用rpm -qa命令查看是否安装 [roottest ~]# rpm -qa | grep containerd containerd.io-1.6.28-3.1.el7.x86_64 # 设置containerd服务启动及开机自启动 [roottest ~]# systemctl enable containerd Created symlink from /etc/systemd/system/multi-user.target.wants/containerd.service to /usr/lib/systemd/system/containerd.service. [roottest ~]# systemctl start containerd # 查看containerd服务启动状态 [roottest ~]# systemctl status containerd ● containerd.service - containerd container runtimeLoaded: loaded (/usr/lib/systemd/system/containerd.service; enabled; vendor preset: disabled)Active: active (running) since 日 2024-02-04 13:23:26 CST; 31min agoDocs: https://containerd.ioMain PID: 2363 (containerd)CGroup: /system.slice/containerd.service└─2363 /usr/bin/containerd2月 04 13:23:26 test containerd[2363]: time2024-02-04T13:23:26.60870031008:00 levelinfo msgloading plugin \io.containerd.grpc.v1.tasks\... typeio.containerd.grpc.v1 2月 04 13:23:26 test systemd[1]: Started containerd container runtime. 2月 04 13:23:26 test containerd[2363]: time2024-02-04T13:23:26.60871387408:00 levelinfo msgloading plugin \io.containerd.grpc.v1.version\... typeio.containerd.grpc.v1 2月 04 13:23:26 test containerd[2363]: time2024-02-04T13:23:26.60872644008:00 levelinfo msgloading plugin \io.containerd.tracing.processor.v1.otlp\... type...rocessor.v1 2月 04 13:23:26 test containerd[2363]: time2024-02-04T13:23:26.60879019008:00 levelinfo msgskip loading plugin \io.containerd.tracing.processor.v1.otlp\......rocessor.v1 2月 04 13:23:26 test containerd[2363]: time2024-02-04T13:23:26.60881558908:00 levelinfo msgloading plugin \io.containerd.internal.v1.tracing\... typeio.co...internal.v1 2月 04 13:23:26 test containerd[2363]: time2024-02-04T13:23:26.60912048108:00 levelerror msgfailed to initialize a tracing processor \otlp\ errorno OpenT...kip plugin 2月 04 13:23:26 test containerd[2363]: time2024-02-04T13:23:26.61051721308:00 levelinfo msgserving... address/run/containerd/containerd.sock.ttrpc 2月 04 13:23:26 test containerd[2363]: time2024-02-04T13:23:26.61163864708:00 levelinfo msgserving... address/run/containerd/containerd.sock 2月 04 13:23:26 test containerd[2363]: time2024-02-04T13:23:26.61226316908:00 levelinfo msgcontainerd successfully booted in 0.053850s Hint: Some lines were ellipsized, use -l to show in full. # 安装Containerd时ctr命令亦可使用ctr命令主要用于管理容器及容器镜像等。 # 使用ctr命令查看Containerd客户端及服务端相关信息。 [roottest ~]# ctr version Client:Version: 1.6.28Revision: ae07eda36dd25f8a1b98dfbf587313b99c0190bbGo version: go1.20.13Server:Version: 1.6.28Revision: ae07eda36dd25f8a1b98dfbf587313b99c0190bbUUID: c839d914-41a9-469f-a3ab-590ced3f6acf [roottest ~]# 修改containder配置文件 # 创建配置文件 containerd config default /etc/containerd/config.toml # 添加配置 sed -i s/SystemdCgroup \ false/SystemdCgroup \ true/ /etc/containerd/config.toml sed -i s/snapshotter overlayfs/snapshotter native/ /etc/containerd/config.tomlsed -i /\[plugins\.io\.containerd\.grpc\.v1\.cri\.registry\.mirrors\]/a\ [plugins.io.containerd.grpc.v1.cri.registry.mirrors.docker.io]\n endpoint [https://registry.aliyuncs.com ,https://registry-1.docker.io] /etc/containerd/config.toml# 取消这个配置 [roottest kubernetes]# cat /etc/containerd/config.toml | grep -n sandbox_image 61: sandbox_image registry.k8s.io/pause:3.6systemctl restart containerd # 这个不要配置测试时不要配置 SystemdCgroup false SystemdCgroup true# 被替换 [plugins.io.containerd.grpc.v1.cri.registry.mirrors][plugins.io.containerd.grpc.v1.cri.registry.mirrors.docker.io]endpoint [https://registry.aliyuncs.com ,https://registry-1.docker.io] cni 这个网好的话可是不安装启动时会自动安装的 # 手动下载使用命令没下载下来 wget https://github.com/containernetworking/plugins/releases/download/v1.4.0/cni-plugins-linux-amd64-v1.4.0.tgz [roottest ~]# ls anaconda-ks.cfg cni-plugins-linux-amd64-v1.1.1.tgz default.etcd etcd go go1.20.13.linux-amd64.tar.gz [roottest ~]# mkdir -p /opt/cni/bin [roottest ~]# tar -zxf cni-plugins-linux-amd64-v1.1.1.tgz -C /opt/cni/bin etcd 这个需要预先安装 ETCD_VERv3.5.12 curl -L https://storage.googleapis.com/etcd/${ETCD_VER}/etcd-${ETCD_VER}-linux-amd64.tar.gz -o /tmp/etcd-${ETCD_VER}-linux-amd64.tar.gz mkdir -p ~/etcd tar xzvf /tmp/etcd-${ETCD_VER}-linux-amd64.tar.gz -C ~/etcd --strip-components1 rm -f /tmp/etcd-${ETCD_VER}-linux-amd64.tar.gz tar xzvf /data/soft/etcd-${ETCD_VER}-linux-amd64.tar.gz -C ~/etcd --strip-components1 # 最后加入export PATH/root/etcd:${PATH} source ~/.bashrc 执行支持 etcd 命令 [roottest ~]# etcd {level:info,ts:2024-02-03T09:30:46.6820800,caller:etcdmain/etcd.go:73,msg:Running: ,args:[etcd]}rsync yum install -y rsyncgo 版本没有选择最新的选择次新。 wget https://golang.google.cn/dl/go1.20.13.linux-amd64.tar.gzrm -rf /usr/local/go tar -C /usr/local -xzf go1.20.13.linux-amd64.tar.gz mkdir -p /data/soft/go mkdir -p /data/soft/go/src mkdir -p /data/soft/go/bin export GOPATH/data/soft/go export GOBIN/data/soft/go/bin export PATH/usr/local/go/bin:$GOPATH/bin:${PATH} source ~/.bashrc 设置golang代理 go env -w GO111MODULEauto go env -w GOPROXYhttps://goproxy.cn,direct 安装CFSSL 用于 k8s 证书生成 go install github.com/cloudflare/cfssl/cmd/...latest # 验证 [roottest ~]# cfssl No command is given. Usage: Available commands:signgenkeygencsrocspserverevokecertinfocrlversiongencertocspdumpselfsignocsprefreshscanbundleservegencrlocspsigninfoprint-defaults Top-level flags: [roottest ~]# 下载kubernetes代码 mkdir $GOPATH/src/k8s.io cd $GOPATH/src/k8s.io git clone https://github.com/kubernetes/kubernetes.git git checkout -b myv1.24.16 v1.24.16# 编译 [roottest kubernetes]# make [0203 09:03:04] Building go targets for linux/amd64k8s.io/kubernetes/cmd/kube-proxy (static)k8s.io/kubernetes/cmd/kube-apiserver (static)k8s.io/kubernetes/cmd/kube-controller-manager (static)k8s.io/kubernetes/cmd/kubelet (non-static)k8s.io/kubernetes/cmd/kubeadm (static)k8s.io/kubernetes/cmd/kube-scheduler (static)k8s.io/component-base/logs/kube-log-runner (static)k8s.io/kube-aggregator (static)k8s.io/apiextensions-apiserver (static)k8s.io/kubernetes/cluster/gce/gci/mounter (non-static)k8s.io/kubernetes/cmd/kubectl (static)k8s.io/kubernetes/cmd/kubectl-convert (static)github.com/onsi/ginkgo/v2/ginkgo (non-static)k8s.io/kubernetes/test/e2e/e2e.test (test)k8s.io/kubernetes/test/conformance/image/go-runner (non-static)k8s.io/kubernetes/cmd/kubemark (static)github.com/onsi/ginkgo/v2/ginkgo (non-static)k8s.io/kubernetes/test/e2e_node/e2e_node.test (test)# 生成的执行文件如下 [roottest bin]# ls apiextensions-apiserver e2e.test go-runner kube-aggregator kube-controller-manager kubectl-convert kube-log-runner kube-proxy mounter e2e_node.test ginkgo kubeadm kube-apiserver kubectl kubelet kubemark kube-scheduler [roottest bin]# pwd /root/go/src/k8s.io/kubernetes/_output/bin# 添加环境变量 export PATH/root/go/src/k8s.io/kubernetes/_output/bin:${PATH} [roottest ~]# source .bashrc编译启动本地单节点集群 首先通过设置环境变量DBG1 禁止编译二进制时做任何优化和内联必须禁止。 同时通过设置环境变量 ENABLE_DAEMONtrue 表示集群启动成功后执行二进制文件以守护进程的方式运行否则过一段时间将自动退出服务。 # 此命令 sh 两个作用一个编译一个起单节点的集群 (第一次执行) [roottest kubernetes]# /data/soft/go/src/k8s.io/kubernetes/hack/local-up-cluster.sh make: 进入目录“/root/go/src/k8s.io/kubernetes”cd /data/soft/go/src/k8s.io/kubernetes# 第二次 ENABLE_DAEMONtrue DBG1 /data/soft/go/src/k8s.io/kubernetes/hack/local-up-cluster.sh -Oexport KUBECONFIG/var/run/kubernetes/admin.kubeconfig问题 遇到如下问题一步一步如下解决 [roottest kubernetes]# kubectl describe pod nginx Name: nginx Namespace: default Priority: 0 Node: none Labels: appnginx Annotations: none Status: Pending IP: IPs: none Containers:nginx:Image: nginxPort: 80/TCPHost Port: 0/TCPEnvironment: noneMounts:/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-6rbkk (ro) Conditions:Type StatusPodScheduled False Volumes:kube-api-access-6rbkk:Type: Projected (a volume that contains injected data from multiple sources)TokenExpirationSeconds: 3607ConfigMapName: kube-root-ca.crtConfigMapOptional: nilDownwardAPI: true QoS Class: BestEffort Node-Selectors: none Tolerations: node.kubernetes.io/not-ready:NoExecute opExists for 300snode.kubernetes.io/unreachable:NoExecute opExists for 300s Events:Type Reason Age From Message---- ------ ---- ---- -------Warning FailedScheduling 6m13s default-scheduler no nodes available to schedule podsWarning FailedScheduling 65s default-scheduler no nodes available to schedule pods [roottest kubernetes]# k8s没有被正常启动该如何 看日志 cat /tmp/kubelet.log --volume-stats-agg-period duration Specifies interval for kubelet to calculate and cache the volume disk usage for all pods and volumes. To disable volume calculations, set to a negative number. (default 1m0s) (DEPRECATED: This parameter should be set via the config file specified by the Kubelets --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.)Error: failed to run Kubelet: failed to create kubelet: get remote runtime typed version failed: rpc error: code Unimplemented desc unknown service runtime.v1alpha2.RuntimeService 实际是由 # 手动修改 systemd_cgroup true 引起 解决 containerd config default /etc/containerd/config.toml sed -i s/SystemdCgroup \ false/SystemdCgroup \ true/ /etc/containerd/config.toml sed -i s/snapshotter overlayfs/snapshotter native/ /etc/containerd/config.tomlsed -i /\[plugins\.io\.containerd\.grpc\.v1\.cri\.registry\.mirrors\]/a\ [plugins.io.containerd.grpc.v1.cri.registry.mirrors.docker.io]\n endpoint [https://registry.aliyuncs.com ,https://registry-1.docker.io] /etc/containerd/config.toml[roottest kubernetes]# cat /etc/containerd/config.toml | grep -n sandbox_image 61: sandbox_image registry.k8s.io/pause:3.6 [roottest kubernetes]# vim /etc/containerd/config.tomlsystemctl restart containerd# 不再配置下面的 [rootMaster ~]# vim /etc/docker/daemon.json {exec-opts: [native.cgroupdriversystemd] } [rootMaster ~]# docker info|grep CgroupCgroup Driver: systemdCgroup Version: 1 [rootMaster ~]# [rootMaster ~]# systemctl restart docker k8s正常启动日志 [roottest kubernetes]# ENABLE_DAEMONtrue DBG1 /data/soft/go/src/k8s.io/kubernetes/hack/local-up-cluster.sh -O skipped the build. API SERVER secure port is free, proceeding... Detected host and ready to start services. Doing some housekeeping first... Using GO_OUT /data/soft/go/src/k8s.io/kubernetes/_output/bin Starting services now! Starting etcd etcd --advertise-client-urls http://127.0.0.1:2379 --data-dir /tmp/tmp.SIy3gjvswf --listen-client-urls http://127.0.0.1:2379 --log-levelwarn 2 /tmp/etcd.log /dev/null Waiting for etcd to come up.[0204 15:36:47] On try 2, etcd: : {health:true,reason:} {header:{cluster_id:14841639068965178418,member_id:10276657743932975437,revision:2,raft_term:2}}Generating a 2048 bit RSA private key .................................................................................... .. writing new private key to /var/run/kubernetes/server-ca.key ----- Generating a 2048 bit RSA private key ................. ................... writing new private key to /var/run/kubernetes/client-ca.key ----- Generating a 2048 bit RSA private key ........... ........... writing new private key to /var/run/kubernetes/request-header-ca.key ----- 2024/02/04 15:36:47 [INFO] generate received request 2024/02/04 15:36:47 [INFO] received CSR 2024/02/04 15:36:47 [INFO] generating key: rsa-2048 2024/02/04 15:36:48 [INFO] encoded CSR 2024/02/04 15:36:48 [INFO] signed certificate with serial number 503559090451029160883764206620515450001598207346 2024/02/04 15:36:48 [INFO] generate received request 2024/02/04 15:36:48 [INFO] received CSR 2024/02/04 15:36:48 [INFO] generating key: rsa-2048 2024/02/04 15:36:49 [INFO] encoded CSR 2024/02/04 15:36:49 [INFO] signed certificate with serial number 493741312692019681510347426741341846315781053599 2024/02/04 15:36:49 [INFO] generate received request 2024/02/04 15:36:49 [INFO] received CSR 2024/02/04 15:36:49 [INFO] generating key: rsa-2048 2024/02/04 15:36:49 [INFO] encoded CSR 2024/02/04 15:36:49 [INFO] signed certificate with serial number 152285310549920910920928212323269736605793904352 2024/02/04 15:36:49 [INFO] generate received request 2024/02/04 15:36:49 [INFO] received CSR 2024/02/04 15:36:49 [INFO] generating key: rsa-2048 2024/02/04 15:36:50 [INFO] encoded CSR 2024/02/04 15:36:50 [INFO] signed certificate with serial number 125312127036331176903810097174162604078302808888 2024/02/04 15:36:50 [INFO] generate received request 2024/02/04 15:36:50 [INFO] received CSR 2024/02/04 15:36:50 [INFO] generating key: rsa-2048 2024/02/04 15:36:50 [INFO] encoded CSR 2024/02/04 15:36:50 [INFO] signed certificate with serial number 181140179293506272832484903295356268063767113896 2024/02/04 15:36:50 [INFO] generate received request 2024/02/04 15:36:50 [INFO] received CSR 2024/02/04 15:36:50 [INFO] generating key: rsa-2048 2024/02/04 15:36:50 [INFO] encoded CSR 2024/02/04 15:36:50 [INFO] signed certificate with serial number 103730507459626501912222037902428030421854814351 2024/02/04 15:36:50 [INFO] generate received request 2024/02/04 15:36:50 [INFO] received CSR 2024/02/04 15:36:50 [INFO] generating key: rsa-2048 2024/02/04 15:36:51 [INFO] encoded CSR 2024/02/04 15:36:51 [INFO] signed certificate with serial number 43096772975744811124579756033905702137004279739 2024/02/04 15:36:51 [INFO] generate received request 2024/02/04 15:36:51 [INFO] received CSR 2024/02/04 15:36:51 [INFO] generating key: rsa-2048 2024/02/04 15:36:51 [INFO] encoded CSR 2024/02/04 15:36:51 [INFO] signed certificate with serial number 592246123162051006791059223014302580834797916367 Waiting for apiserver to come up[0204 15:36:57] On try 5, apiserver: : ok clusterrolebinding.rbac.authorization.k8s.io/kube-apiserver-kubelet-admin created clusterrolebinding.rbac.authorization.k8s.io/kubelet-csr created Cluster local-up-cluster set. use kubectl --kubeconfig/var/run/kubernetes/admin-kube-aggregator.kubeconfig to use the aggregated API server serviceaccount/coredns created clusterrole.rbac.authorization.k8s.io/system:coredns created clusterrolebinding.rbac.authorization.k8s.io/system:coredns created configmap/coredns created deployment.apps/coredns created service/kube-dns created coredns addon successfully deployed. Checking CNI Installation at /opt/cni/bin WARNING : The kubelet is configured to not fail even if swap is enabled; production deployments should disable swap unless testing NodeSwap feature. 2024/02/04 15:36:59 [INFO] generate received request 2024/02/04 15:36:59 [INFO] received CSR 2024/02/04 15:36:59 [INFO] generating key: rsa-2048 2024/02/04 15:37:00 [INFO] encoded CSR 2024/02/04 15:37:00 [INFO] signed certificate with serial number 274826002626477023551022370298818852502781648689 kubelet ( 12990 ) is running. wait kubelet ready No resources found No resources found No resources found No resources found No resources found No resources found No resources found 127.0.0.1 NotReady none 1s v1.24.16 2024/02/04 15:37:15 [INFO] generate received request 2024/02/04 15:37:15 [INFO] received CSR 2024/02/04 15:37:15 [INFO] generating key: rsa-2048 2024/02/04 15:37:16 [INFO] encoded CSR 2024/02/04 15:37:16 [INFO] signed certificate with serial number 439607026402203447424075767894402727838125873987 Create default storage class for storageclass.storage.k8s.io/standard created Local Kubernetes cluster is running.Logs:/tmp/kube-apiserver.log/tmp/kube-controller-manager.log/tmp/kube-proxy.log/tmp/kube-scheduler.log/tmp/kubelet.logTo start using your cluster, run:export KUBECONFIG/var/run/kubernetes/admin.kubeconfigcluster/kubectl.shAlternatively, you can write to the default kubeconfig:export KUBERNETES_PROVIDERlocalcluster/kubectl.sh config set-cluster local --serverhttps://localhost:6443 --certificate-authority/var/run/kubernetes/server-ca.crtcluster/kubectl.sh config set-credentials myself --client-key/var/run/kubernetes/client-admin.key --client-certificate/var/run/kubernetes/client-admin.crtcluster/kubectl.sh config set-context local --clusterlocal --usermyselfcluster/kubectl.sh config use-context localcluster/kubectl.sh [roottest kubernetes]# 测试 [roottest kubernetes]# export KUBECONFIG/var/run/kubernetes/admin.kubeconfig [roottest kubernetes]# [roottest kubernetes]# ./cluster/kubectl.sh get nodes NAME STATUS ROLES AGE VERSION 127.0.0.1 Ready none 18m v1.24.16 [roottest kubernetes]# ./cluster/kubectl.sh get services NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE kubernetes ClusterIP 10.0.0.1 none 443/TCP 18m [roottest kubernetes]# ./cluster/kubectl.sh get replicationcontrollers No resources found in default namespace. [roottest kubernetes]# ctr --namespace k8s.io image ls REF TYPE DIGEST SIZE PLATFORMS LABELS [roottest kubernetes]# ./cluster/kubectl.sh create -f test/fixtures/doc-yaml/user-guide/pod.yaml pod/nginx created [roottest kubernetes]# ./cluster/kubectl.sh get pods NAME READY STATUS RESTARTS AGE nginx 0/1 ContainerCreating 0 7s# 通过此验证是否有问题 kubectl describe pod nginx[roottest kubernetes]# ./cluster/kubectl.sh get pods NAME READY STATUS RESTARTS AGE nginx 1/1 Running 0 89s [roottest kubernetes]# 结束 linux k8s 源码编译及单集群测试 至此结束如有疑问欢迎评论区留言。