GuyT2002 opened a new issue, #628: URL: https://github.com/apache/apisix-helm-chart/issues/628
I tried installing the [helm chart of the ingress controller, admin and gateway and etcd resource using this URL](https://apisix.apache.org/docs/ingress-controller/next/deployments/openshift/), following the guide written, and using the following commands: ``` helm repo add apisix https://charts.apiseven.com helm repo add bitnami https://charts.bitnami.com/bitnami helm repo update helm install apisix apisix/apisix --set gateway.type=NodePort --set ingress-controller.enabled=true --set etcd.podSecurityContext.enabled=false --set etcd.containerSecurityContext.enabled=false --create-namespace --namespace ingress-apisix --set ingress-controller.config.apisix.serviceNamespace=ingress-apisix --set ingress-controller.config.apisix.adminAPIVersion=$ADMIN_API_VERSION ``` However, when the etcd pods are running, they recieve the following logs: ``` etcd 09:22:21.35 etcd 09:22:21.38 Welcome to the Bitnami etcd container etcd 09:22:21.39 Subscribe to project updates by watching https://github.com/bitnami/containers etcd 09:22:21.39 Submit issues and feature requests at https://github.com/bitnami/containers/issues etcd 09:22:21.40 etcd 09:22:21.40 INFO ==> ** Starting etcd setup ** etcd 09:22:21.43 INFO ==> Validating settings in ETCD_* env vars.. etcd 09:22:21.43 WARN ==> You set the environment variable ALLOW_NONE_AUTHENTICATION=yes. For safety reasons, do not use this flag in a production environment. etcd 09:22:21.44 INFO ==> Initializing etcd etcd 09:22:21.44 INFO ==> Generating etcd config file using env variables ls: cannot open directory '/bitnami/etcd/data': Permission denied etcd 09:22:21.48 INFO ==> There is no data from previous deployments etcd 09:22:21.48 INFO ==> Bootstrapping a new cluster etcd 09:22:21.52 INFO ==> Obtaining cluster member ID etcd 09:22:21.53 INFO ==> Starting etcd in background [38;5;6metcd [38;5;5m09:24:28.53 [0m[38;5;2mINFO [0m ==> ** Starting etcd ** {"level":"info","ts":"2023-09-27T09:24:28.557Z","caller":"flags/flag.go:113","msg":"recognized and used environment variable","variable-name":"ETCD_ADVERTISE_CLIENT_URLS","variable-value":"http://apisix-etcd-0.apisix-etcd-headless.ingress-apisix.svc.cluster.local:2379,http://apisix-etcd.ingress-apisix.svc.cluster.local:2379"} {"level":"info","ts":"2023-09-27T09:24:28.557Z","caller":"flags/flag.go:113","msg":"recognized and used environment variable","variable-name":"ETCD_AUTH_TOKEN","variable-value":"jwt,priv-key=/opt/bitnami/etcd/certs/token/jwt-token.pem,sign-method=RS256,ttl=10m"} {"level":"info","ts":"2023-09-27T09:24:28.557Z","caller":"flags/flag.go:113","msg":"recognized and used environment variable","variable-name":"ETCD_AUTO_TLS","variable-value":"false"} {"level":"info","ts":"2023-09-27T09:24:28.557Z","caller":"flags/flag.go:113","msg":"recognized and used environment variable","variable-name":"ETCD_CLIENT_CERT_AUTH","variable-value":"false"} {"level":"info","ts":"2023-09-27T09:24:28.557Z","caller":"flags/flag.go:113","msg":"recognized and used environment variable","variable-name":"ETCD_DATA_DIR","variable-value":"/bitnami/etcd/data"} {"level":"info","ts":"2023-09-27T09:24:28.557Z","caller":"flags/flag.go:113","msg":"recognized and used environment variable","variable-name":"ETCD_INITIAL_ADVERTISE_PEER_URLS","variable-value":"http://apisix-etcd-0.apisix-etcd-headless.ingress-apisix.svc.cluster.local:2380"} {"level":"info","ts":"2023-09-27T09:24:28.557Z","caller":"flags/flag.go:113","msg":"recognized and used environment variable","variable-name":"ETCD_INITIAL_CLUSTER","variable-value":"apisix-etcd-0=http://apisix-etcd-0.apisix-etcd-headless.ingress-apisix.svc.cluster.local:2380,apisix-etcd-1=http://apisix-etcd-1.apisix-etcd-headless.ingress-apisix.svc.cluster.local:2380,apisix-etcd-2=http://apisix-etcd-2.apisix-etcd-headless.ingress-apisix.svc.cluster.local:2380"} {"level":"info","ts":"2023-09-27T09:24:28.557Z","caller":"flags/flag.go:113","msg":"recognized and used environment variable","variable-name":"ETCD_INITIAL_CLUSTER_STATE","variable-value":"new"} {"level":"info","ts":"2023-09-27T09:24:28.557Z","caller":"flags/flag.go:113","msg":"recognized and used environment variable","variable-name":"ETCD_INITIAL_CLUSTER_TOKEN","variable-value":"etcd-cluster-k8s"} {"level":"info","ts":"2023-09-27T09:24:28.557Z","caller":"flags/flag.go:113","msg":"recognized and used environment variable","variable-name":"ETCD_LISTEN_CLIENT_URLS","variable-value":"http://0.0.0.0:2379"} {"level":"info","ts":"2023-09-27T09:24:28.557Z","caller":"flags/flag.go:113","msg":"recognized and used environment variable","variable-name":"ETCD_LISTEN_PEER_URLS","variable-value":"http://0.0.0.0:2380"} {"level":"info","ts":"2023-09-27T09:24:28.557Z","caller":"flags/flag.go:113","msg":"recognized and used environment variable","variable-name":"ETCD_LOG_LEVEL","variable-value":"info"} {"level":"info","ts":"2023-09-27T09:24:28.557Z","caller":"flags/flag.go:113","msg":"recognized and used environment variable","variable-name":"ETCD_NAME","variable-value":"apisix-etcd-0"} {"level":"info","ts":"2023-09-27T09:24:28.557Z","caller":"flags/flag.go:113","msg":"recognized and used environment variable","variable-name":"ETCD_PEER_AUTO_TLS","variable-value":"false"} {"level":"warn","ts":"2023-09-27T09:24:28.557Z","caller":"flags/flag.go:93","msg":"unrecognized environment variable","environment-variable":"ETCD_TRUSTED_CA_FILE="} {"level":"warn","ts":"2023-09-27T09:24:28.557Z","caller":"flags/flag.go:93","msg":"unrecognized environment variable","environment-variable":"ETCD_DISABLE_STORE_MEMBER_ID=no"} {"level":"warn","ts":"2023-09-27T09:24:28.557Z","caller":"flags/flag.go:93","msg":"unrecognized environment variable","environment-variable":"ETCD_CONF_FILE=/opt/bitnami/etcd/conf/etcd.yaml"} {"level":"warn","ts":"2023-09-27T09:24:28.557Z","caller":"flags/flag.go:93","msg":"unrecognized environment variable","environment-variable":"ETCD_SNAPSHOT_HISTORY_LIMIT=1"} {"level":"warn","ts":"2023-09-27T09:24:28.557Z","caller":"flags/flag.go:93","msg":"unrecognized environment variable","environment-variable":"ETCD_ON_K8S=yes"} {"level":"warn","ts":"2023-09-27T09:24:28.557Z","caller":"flags/flag.go:93","msg":"unrecognized environment variable","environment-variable":"ETCD_SNAPSHOTS_DIR=/snapshots"} {"level":"warn","ts":"2023-09-27T09:24:28.557Z","caller":"flags/flag.go:93","msg":"unrecognized environment variable","environment-variable":"ETCD_BIN_DIR=/opt/bitnami/etcd/bin"} {"level":"warn","ts":"2023-09-27T09:24:28.557Z","caller":"flags/flag.go:93","msg":"unrecognized environment variable","environment-variable":"ETCD_VOLUME_DIR=/bitnami/etcd"} {"level":"warn","ts":"2023-09-27T09:24:28.557Z","caller":"flags/flag.go:93","msg":"unrecognized environment variable","environment-variable":"ETCD_CLUSTER_DOMAIN=apisix-etcd-headless.ingress-apisix.svc.cluster.local"} {"level":"warn","ts":"2023-09-27T09:24:28.557Z","caller":"flags/flag.go:93","msg":"unrecognized environment variable","environment-variable":"ETCD_DISASTER_RECOVERY=no"} {"level":"warn","ts":"2023-09-27T09:24:28.557Z","caller":"flags/flag.go:93","msg":"unrecognized environment variable","environment-variable":"ETCD_KEY_FILE="} {"level":"warn","ts":"2023-09-27T09:24:28.557Z","caller":"flags/flag.go:93","msg":"unrecognized environment variable","environment-variable":"ETCD_CONF_DIR=/opt/bitnami/etcd/conf"} {"level":"warn","ts":"2023-09-27T09:24:28.557Z","caller":"flags/flag.go:93","msg":"unrecognized environment variable","environment-variable":"ETCD_DAEMON_GROUP=etcd"} {"level":"warn","ts":"2023-09-27T09:24:28.557Z","caller":"flags/flag.go:93","msg":"unrecognized environment variable","environment-variable":"ETCD_START_FROM_SNAPSHOT=no"} {"level":"warn","ts":"2023-09-27T09:24:28.557Z","caller":"flags/flag.go:93","msg":"unrecognized environment variable","environment-variable":"ETCD_INIT_SNAPSHOT_FILENAME="} {"level":"warn","ts":"2023-09-27T09:24:28.557Z","caller":"flags/flag.go:93","msg":"unrecognized environment variable","environment-variable":"ETCD_INIT_SNAPSHOTS_DIR=/init-snapshot"} {"level":"warn","ts":"2023-09-27T09:24:28.557Z","caller":"flags/flag.go:93","msg":"unrecognized environment variable","environment-variable":"ETCD_DISABLE_PRESTOP=no"} {"level":"warn","ts":"2023-09-27T09:24:28.557Z","caller":"flags/flag.go:93","msg":"unrecognized environment variable","environment-variable":"ETCD_TMP_DIR=/opt/bitnami/etcd/tmp"} {"level":"warn","ts":"2023-09-27T09:24:28.557Z","caller":"flags/flag.go:93","msg":"unrecognized environment variable","environment-variable":"ETCD_BASE_DIR=/opt/bitnami/etcd"} {"level":"warn","ts":"2023-09-27T09:24:28.557Z","caller":"flags/flag.go:93","msg":"unrecognized environment variable","environment-variable":"ETCD_CERT_FILE="} {"level":"warn","ts":"2023-09-27T09:24:28.557Z","caller":"flags/flag.go:93","msg":"unrecognized environment variable","environment-variable":"ETCD_NEW_MEMBERS_ENV_FILE=/bitnami/etcd/data/new_member_envs"} {"level":"warn","ts":"2023-09-27T09:24:28.557Z","caller":"flags/flag.go:93","msg":"unrecognized environment variable","environment-variable":"ETCD_DAEMON_USER=etcd"} {"level":"info","ts":"2023-09-27T09:24:28.558Z","caller":"etcdmain/etcd.go:73","msg":"Running: ","args":["etcd"]} {"level":"fatal","ts":"2023-09-27T09:24:28.558Z","caller":"etcdmain/etcd.go:435","msg":"failed to list data directory","dir":"/bitnami/etcd/data","error":"open /bitnami/etcd/data: permission denied","stacktrace":"go.etcd.io/etcd/server/v3/etcdmain.identifyDataDirOrDie\n\tgo.etcd.io/etcd/server/v3/etcdmain/etcd.go:435\ngo.etcd.io/etcd/server/v3/etcdmain.startEtcdOrProxyV2\n\tgo.etcd.io/etcd/server/v3/etcdmain/etcd.go:114\ngo.etcd.io/etcd/server/v3/etcdmain.Main\n\tgo.etcd.io/etcd/server/v3/etcdmain/main.go:40\nmain.main\n\tgo.etcd.io/etcd/server/v3/main.go:32\nruntime.main\n\truntime/proc.go:255"} ``` And the etcd pods are just stuck in crash loopback. I could not find any related issue or solution regarding this. The data dir itself has a weird UID and GID: ``` $ ls -la /bitnami/etcd total 28 drwxrwsr-x. 4 root 1001130000 4096 Sep 26 09:11 . drwxr-xr-x. 3 root root 18 Feb 26 2023 .. drwx--S---. 3 1001130000 1001130000 4096 Sep 26 09:12 data drwxrws---. 2 root 1001130000 16384 Sep 3 09:09 lost+found -rw-rw-r--. 1 1001130000 1001130000 62 Sep 26 09:22 member_removal.log $ ``` (I assume of a service account, but I believe it is not the apisix SA UID) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
