## 概念

Docker Registry 是一个无状态，可扩展存储并且发布 Docker 镜像的应用服务

## 创建一个 Docker Registry

```.shell
mkdir -p /mnt/registry
```

```.shell
docker run -d \
  -p 5000:5000 \
  --restart=always \
  --name registry \
  -v /mnt/registry:/var/lib/registry \
  registry:2
```  


## 私有 Docker Registry 使用 http

假如，只是在局域网上搭建 ```docker registry``` 服务, 可以不使用 https。
但是，```docker registry``` 是跑在公网上建议使用 https 。

```.shell
cat > /etc/docker/daemon.json
{
  "insecure-registries":["172.16.1.22:5000"]  # 这里 IP Address 换成自己的 register server 的 ip
}

sudo systemctl restart docker 
```

> 注：
>> 需要在每个节点上添加配置，并且重启 docker 服务器。 包括 registry server，不然无法 push 镜像

## 测试 docker registry server

* 在 docker registry 服务器上

```.shell
docker pull nginx:alpine 
docker tag nginx:apline 172.16.1.22:5000/nginx:alpine
docker push 172.16.1.22:5000/nginx:alpine
```

* 使用 ```kubectrl``` 拉 ```Docker Register``` 镜像并且部署

```.shell
kubectl create  deployment nginx-server --image=172.16.1.22:5000/nginx:alpine
```

搭建一个私有的 Docker Registry

## 安装 NFS Server 



```.shell
yum install -y nfs-utils nfs-utils-lib # centos

---- or ----

apt install -y nfs-common nfs-kernel-server   # ubuntu or debain

```


### 创建一个目录作为 NFS 共享

```.shell
sudo mkdir -p /mnt/nfs4/share
```


```.shell
cat > /etc/exports
/mnt/nfs4/share clientIP(rw,sync,no_subtree_check)

or 

/mnt/nfs4/share subnetIP/24(rw,sync,no_subtree_check)
```


```.shell
exportfs -a
```

---

## 安装 Kuberenetes 客户端

> 需要在每个节点上都安装 nfs 客户端

```
yum install -y nfs-utils    # centos

--- or ----

apt install -u nfs-common   # ubuntu or debain
```

### 需要三个 yaml 文件

1. rbac.yaml

```.yaml
apiVersion: v1
kind: ServiceAccount
metadata:
  name: nfs-client-provisioner
  # replace with namespace where provisioner is deployed
  namespace: default
---
kind: ClusterRole
apiVersion: rbac.authorization.k8s.io/v1
metadata:
  name: nfs-client-provisioner-runner
rules:
  - apiGroups: [""]
    resources: ["persistentvolumes"]
    verbs: ["get", "list", "watch", "create", "delete"]
  - apiGroups: [""]
    resources: ["persistentvolumeclaims"]
    verbs: ["get", "list", "watch", "update"]
  - apiGroups: ["storage.k8s.io"]
    resources: ["storageclasses"]
    verbs: ["get", "list", "watch"]
  - apiGroups: [""]
    resources: ["events"]
    verbs: ["create", "update", "patch"]
---
kind: ClusterRoleBinding
apiVersion: rbac.authorization.k8s.io/v1
metadata:
  name: run-nfs-client-provisioner
subjects:
  - kind: ServiceAccount
    name: nfs-client-provisioner
    # replace with namespace where provisioner is deployed
    namespace: default
roleRef:
  kind: ClusterRole
  name: nfs-client-provisioner-runner
  apiGroup: rbac.authorization.k8s.io
---
kind: Role
apiVersion: rbac.authorization.k8s.io/v1
metadata:
  name: leader-locking-nfs-client-provisioner
  # replace with namespace where provisioner is deployed
  namespace: default
rules:
  - apiGroups: [""]
    resources: ["endpoints"]
    verbs: ["get", "list", "watch", "create", "update", "patch"]
---
kind: RoleBinding
apiVersion: rbac.authorization.k8s.io/v1
metadata:
  name: leader-locking-nfs-client-provisioner
  # replace with namespace where provisioner is deployed
  namespace: default
subjects:
  - kind: ServiceAccount
    name: nfs-client-provisioner
    # replace with namespace where provisioner is deployed
    namespace: default
roleRef:
  kind: Role
  name: leader-locking-nfs-client-provisioner
  apiGroup: rbac.authorization.k8s.io
```

2. class.yaml

```.yaml
apiVersion: storage.k8s.io/v1
kind: StorageClass
metadata:
  name: managed-nfs-storage
provisioner: fuseim.pri/ifs # or choose another name, must match deployment's env PROVISIONER_NAME'
parameters:
  archiveOnDelete: "false"
```

3. deployment.yaml

```.yaml
apiVersion: apps/v1
kind: Deployment
metadata:
  name: nfs-client-provisioner
  labels:
    app: nfs-client-provisioner
  # replace with namespace where provisioner is deployed
  namespace: default
spec:
  replicas: 1
  strategy:
    type: Recreate
  selector:
    matchLabels:
      app: nfs-client-provisioner
  template:
    metadata:
      labels:
        app: nfs-client-provisioner
    spec:
      serviceAccountName: nfs-client-provisioner
      containers:
        - name: nfs-client-provisioner
          image: quay.io/external_storage/nfs-client-provisioner:latest
          volumeMounts:
            - name: nfs-client-root
              mountPath: /persistentvolumes
          env:
            - name: PROVISIONER_NAME
              value: fuseim.pri/ifs
            - name: NFS_SERVER
              value: <nfs server address>   # 这里输入 NFS 服务器地址
            - name: NFS_PATH
              value: /ifs/kubernetes        # nfs share path
      volumes:
        - name: nfs-client-root
          nfs:
            server: <nfs server address>    # 这里输入 NFS 服务器地址
            path: /ifs/kubernetes           # nfs share path
```

### 执行 kubectl apply 

```.shell
kubectl create -f deploy/rbac.yaml
kubectl create -f deploy/class.yaml
kubectl create -f deploy/deployment.yaml
```

---

## 创建一个测试 NFS 服务的 POD

```.yaml
apiVersion: v1
kind: PersistentVolumeClaim
metadata:
  name: test-pv-claim
  annotations:
    volume.beta.kubernetes.io/storage-class: "managed-nfs-storage"
spec:
  accessModes:
    - ReadWriteMany
  resources:
    requests:
      storage: 10Mi
---
kind: Pod
apiVersion: v1
metadata:
  name: test-pod
spec:
  containers:
  - name: test-pod
    image: redis:5.0.9-buster
    volumeMounts:
      - name: nfs-pvc
        mountPath: "/data"
  volumes:
    - name: nfs-pvc
      persistentVolumeClaim:
        claimName: test-pv-claim
```

搭建一个私有的 Docker Registry

使用 NFS 作为 Kuberenetes 持久化存储

GitHub