MirtoBusico commented on issue #853: URL: https://github.com/apache/apisix-ingress-controller/issues/853#issuecomment-1037329951
I've completed the reinstallation, but after 4 cluster restart the Service address is substituted by a Pod address The route just defined  The route the day after <img width="1716" alt="route after_4_restart" src="https://user-images.githubusercontent.com/11090934/153720696-e30add07-5ade-4644-be2e-14c505da6a97.png";> I installed using the new chart ``` sysop@m01serv:~/software/apisisx$ helm show chart apisix/apisix apiVersion: v2 appVersion: 2.12.0 dependencies: - condition: etcd.enabled name: etcd repository: https://charts.bitnami.com/bitnami version: 6.2.6 - alias: dashboard condition: dashboard.enabled name: apisix-dashboard repository: https://charts.apiseven.com version: 0.4.0 - alias: ingress-controller condition: ingress-controller.enabled name: apisix-ingress-controller repository: https://charts.apiseven.com version: 0.9.0 description: A Helm chart for Apache APISIX icon: https://apache.org/logos/res/apisix/apisix.png maintainers: - name: tao12345666333 name: apisix type: application version: 0.8.2 ``` On this chart I changed ``` ... gateway: type: LoadBalancer ... tls: enabled: true ... dashboard: enabled: true ingress-controller: enabled: true ``` The stream modification from issue #851 is no more applicable. The below code gives a syntax error (expected integer received string) ``` ... stream: # L4 proxy (TCP/UDP) see bug #851 enabled: true only: false tcp: # TCP proxy address list - 9100 - "127.0.0.1:9101" udp: # UDP proxy address list - 9200 - "127.0.0.1:9211" ``` Apisix installed with ``` kubectl create ns apisix kubectl label namespace apisix istio-injection=enabled helm install apisix apisix/apisix -f apisix-values.yaml \ --set ingress-controller.config.apisix.serviceNamespace=apisix \ --set ingress-controller.config.apisix.serviceName=apisix-admin \ --namespace apisix ``` Defining the route as ``` apiVersion: apisix.apache.org/v2beta2 kind: ApisixRoute metadata: name: productpage spec: http: - name: rule1 match: hosts: - www2.m01.net paths: - /* backends: - serviceName: productpage servicePort: 9080 resolveGranularity: service ``` The only strange thing in the apisix-ingress-controller log is that verdion **v2beta1** is deprecated in favor of **v2beta3** But in the yaml file there is **v2beta2** ``` [GIN] 2022/02/12 - 03:25:30 | 200 | 31.569µs | 127.0.0.6 | GET "/healthz" [GIN] 2022/02/12 - 03:25:30 | 200 | 20.218µs | 127.0.0.6 | GET "/healthz" W0212 03:25:35.736793 1 warnings.go:70] apisix.apache.org/v2beta1 ApisixRoute is deprecated; use apisix.apache.org/v2beta3 ApisixRoute [GIN] 2022/02/12 - 03:25:40 | 200 | 43.57µs | 127.0.0.6 | GET "/healthz" [GIN] 2022/02/12 - 03:25:40 | 200 | 18.58µs | 127.0.0.6 | GET "/healthz" ``` The apisix-ingress controller at startup (today) ``` 2022-02-12T16:49:19.277Z | I0213 00:49:19.277167 1 request.go:665] Waited for 1.163982311s due to client-side throttling, not priority and fairness, request: GET:https://10.43.0.1:443/apis/apisix.apache.org/v2beta3/namespaces/longhorn-system/apisixconsumers 2022-02-12T16:49:20.101Z | 2022-02-13T00:49:20+08:00 [34minfo[0m ingress/controller.go:549 controller now is running as leader {"namespace": "apisix", "pod": "apisix-ingress-controller-6846db58b8-lsv6g"} 2022-02-12T16:49:20.101Z | 2022-02-13T00:49:20+08:00 [34minfo[0m ingress/apisix_pluginconfig.go:57 ApisixPluginConfig controller started 2022-02-12T16:49:20.101Z | 2022-02-13T00:49:20+08:00 [34minfo[0m ingress/endpoint.go:56 endpoints controller started 2022-02-12T16:49:20.101Z | 2022-02-13T00:49:20+08:00 [34minfo[0m ingress/ingress.go:59 ingress controller started 2022-02-12T16:49:20.101Z | 2022-02-13T00:49:20+08:00 [34minfo[0m ingress/apisix_tls.go:58 ApisixTls controller started 2022-02-12T16:49:20.101Z | 2022-02-13T00:49:20+08:00 [34minfo[0m ingress/apisix_cluster_config.go:57 ApisixClusterConfig controller started 2022-02-12T16:49:20.101Z | 2022-02-13T00:49:20+08:00 [34minfo[0m ingress/secret.go:62 secret controller started 2022-02-12T16:49:20.101Z | 2022-02-13T00:49:20+08:00 [34minfo[0m ingress/apisix_upstream.go:58 ApisixUpstream controller started 2022-02-12T16:49:20.101Z | 2022-02-13T00:49:20+08:00 [34minfo[0m ingress/apisix_consumer.go:56 ApisixConsumer controller started 2022-02-12T16:49:20.101Z | 2022-02-13T00:49:20+08:00 [34minfo[0m ingress/apisix_route.go:59 ApisixRoute controller started 2022-02-12T16:49:20.101Z | 2022-02-13T00:49:20+08:00 [34minfo[0m ingress/namespace.go:71 namespace controller started 2022-02-12T16:49:20.101Z | 2022-02-13T00:49:20+08:00 [34minfo[0m ingress/pod.go:47 pod controller started 2022-02-12T16:49:20.102Z | W0213 00:49:20.102458 1 warnings.go:70] apisix.apache.org/v2beta1 ApisixRoute is deprecated; use apisix.apache.org/v2beta3 ApisixRoute 2022-02-12T16:49:20.106Z | W0213 00:49:20.106277 1 warnings.go:70] apisix.apache.org/v2beta1 ApisixRoute is deprecated; use apisix.apache.org/v2beta3 ApisixRoute 2022-02-12T16:49:20.243Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "istio-system_grafana_3000", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/256603fb";, "cluster": "default"} 2022-02-12T16:49:20.243Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin";, "upstream": "istio-system_grafana_3000"} 2022-02-12T16:49:20.250Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "istio-system_prometheus_9090", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/618bbe1f";, "cluster": "default"} 2022-02-12T16:49:20.250Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin";, "upstream": "istio-system_prometheus_9090"} 2022-02-12T16:49:20.255Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "kubernetes-dashboard_dashboard-metrics-scraper_8000", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/225c3962";, "cluster": "default"} 2022-02-12T16:49:20.255Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin";, "upstream": "kubernetes-dashboard_dashboard-metrics-scraper_8000"} 2022-02-12T16:49:20.258Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "longhorn-system_csi-snapshotter_12345", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/97d053af";, "cluster": "default"} 2022-02-12T16:49:20.258Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin";, "upstream": "longhorn-system_csi-snapshotter_12345"} 2022-02-12T16:49:20.263Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "apisix_apisix-etcd-headless_2379", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/b439b2f6";, "cluster": "default"} 2022-02-12T16:49:20.263Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin";, "upstream": "apisix_apisix-etcd-headless_2379"} 2022-02-12T16:49:20.265Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "apisix_apisix-etcd-headless_2380", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/4a7d169d";, "cluster": "default"} 2022-02-12T16:49:20.265Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin";, "upstream": "apisix_apisix-etcd-headless_2380"} 2022-02-12T16:49:20.268Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "istio-operator_istio-operator_8383", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/6b312a6d";, "cluster": "default"} 2022-02-12T16:49:20.268Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin";, "upstream": "istio-operator_istio-operator_8383"} 2022-02-12T16:49:20.270Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "istio-system_jaeger-collector_14268", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/b8ae0da0";, "cluster": "default"} 2022-02-12T16:49:20.270Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin";, "upstream": "istio-system_jaeger-collector_14268"} 2022-02-12T16:49:20.274Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "istio-system_jaeger-collector_14250", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/9d58d651";, "cluster": "default"} 2022-02-12T16:49:20.274Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin";, "upstream": "istio-system_jaeger-collector_14250"} 2022-02-12T16:49:20.278Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "istio-system_jaeger-collector_9411", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/6c3f31a6";, "cluster": "default"} 2022-02-12T16:49:20.278Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin";, "upstream": "istio-system_jaeger-collector_9411"} 2022-02-12T16:49:20.281Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "default_kubernetes_443", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/606b3be0";, "cluster": "default"} 2022-02-12T16:49:20.281Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin";, "upstream": "default_kubernetes_443"} 2022-02-12T16:49:20.284Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "istio-system_istiod_15010", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/861f0648";, "cluster": "default"} 2022-02-12T16:49:20.284Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin";, "upstream": "istio-system_istiod_15010"} 2022-02-12T16:49:20.287Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "istio-system_istiod_15012", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/68116764";, "cluster": "default"} 2022-02-12T16:49:20.287Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin";, "upstream": "istio-system_istiod_15012"} 2022-02-12T16:49:20.289Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "istio-system_istiod_443", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/3bd1b5fa";, "cluster": "default"} 2022-02-12T16:49:20.289Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin";, "upstream": "istio-system_istiod_443"} 2022-02-12T16:49:20.292Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "istio-system_istiod_15014", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/8172c251";, "cluster": "default"} 2022-02-12T16:49:20.292Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin";, "upstream": "istio-system_istiod_15014"} 2022-02-12T16:49:20.294Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "istio-system_kiali_20001", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/d751995a";, "cluster": "default"} 2022-02-12T16:49:20.294Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin";, "upstream": "istio-system_kiali_20001"} 2022-02-12T16:49:20.297Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "istio-system_kiali_9090", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/55e2f8be";, "cluster": "default"} 2022-02-12T16:49:20.297Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin";, "upstream": "istio-system_kiali_9090"} 2022-02-12T16:49:20.303Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "apisix_apisix-gateway_80", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/93400b20";, "cluster": "default"} 2022-02-12T16:49:20.303Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin";, "upstream": "apisix_apisix-gateway_80"} 2022-02-12T16:49:20.307Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "apisix_apisix-gateway_443", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/3b59d238";, "cluster": "default"} 2022-02-12T16:49:20.307Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin";, "upstream": "apisix_apisix-gateway_443"} 2022-02-12T16:49:20.309Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "kube-system_docker-registry_5000", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/6cec0f18";, "cluster": "default"} 2022-02-12T16:49:20.309Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin";, "upstream": "kube-system_docker-registry_5000"} 2022-02-12T16:49:20.312Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "apisix_apisix-dashboard_80", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/6624cd4a";, "cluster": "default"} 2022-02-12T16:49:20.312Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin";, "upstream": "apisix_apisix-dashboard_80"} 2022-02-12T16:49:20.315Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "apisix_apisix-admin_9180", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/930895ff";, "cluster": "default"} 2022-02-12T16:49:20.315Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin";, "upstream": "apisix_apisix-admin_9180"} 2022-02-12T16:49:20.317Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "apisix_apisix-ingress-controller_80", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/b1bea59";, "cluster": "default"} 2022-02-12T16:49:20.317Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin";, "upstream": "apisix_apisix-ingress-controller_80"} 2022-02-12T16:49:20.319Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "longhorn-system_csi-provisioner_12345", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/6d394703";, "cluster": "default"} 2022-02-12T16:49:20.319Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin";, "upstream": "longhorn-system_csi-provisioner_12345"} 2022-02-12T16:49:20.322Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "longhorn-system_longhorn-frontend_80", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/d07916d6";, "cluster": "default"} 2022-02-12T16:49:20.322Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin";, "upstream": "longhorn-system_longhorn-frontend_80"} 2022-02-12T16:49:20.325Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "istio-system_tracing_80", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/b699da65";, "cluster": "default"} 2022-02-12T16:49:20.325Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin";, "upstream": "istio-system_tracing_80"} 2022-02-12T16:49:20.329Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "istio-system_tracing_16685", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/ae80a4d";, "cluster": "default"} 2022-02-12T16:49:20.329Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin";, "upstream": "istio-system_tracing_16685"} 2022-02-12T16:49:20.344Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "longhorn-system_longhorn-backend_9500", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/2ceb1990";, "cluster": "default"} 2022-02-12T16:49:20.344Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin";, "upstream": "longhorn-system_longhorn-backend_9500"} 2022-02-12T16:49:20.356Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "longhorn-system_csi-attacher_12345", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/ee03afe2";, "cluster": "default"} 2022-02-12T16:49:20.356Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin";, "upstream": "longhorn-system_csi-attacher_12345"} 2022-02-12T16:49:20.362Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "kube-system_metrics-server_443", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/4a344633";, "cluster": "default"} 2022-02-12T16:49:20.362Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin";, "upstream": "kube-system_metrics-server_443"} 2022-02-12T16:49:20.365Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "kube-system_kube-dns_53", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/f3118c88";, "cluster": "default"} 2022-02-12T16:49:20.365Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin";, "upstream": "kube-system_kube-dns_53"} 2022-02-12T16:49:20.368Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "kube-system_kube-dns_53", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/f3118c88";, "cluster": "default"} 2022-02-12T16:49:20.368Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin";, "upstream": "kube-system_kube-dns_53"} 2022-02-12T16:49:20.371Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "kube-system_kube-dns_9153", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/23ef4d0";, "cluster": "default"} 2022-02-12T16:49:20.371Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin";, "upstream": "kube-system_kube-dns_9153"} 2022-02-12T16:49:20.374Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "longhorn-system_csi-resizer_12345", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/29267f16";, "cluster": "default"} 2022-02-12T16:49:20.374Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin";, "upstream": "longhorn-system_csi-resizer_12345"} 2022-02-12T16:49:20.378Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "kubernetes-dashboard_kubernetes-dashboard_443", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/7dc55665";, "cluster": "default"} 2022-02-12T16:49:20.378Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin";, "upstream": "kubernetes-dashboard_kubernetes-dashboard_443"} 2022-02-12T16:49:20.381Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "apisix_apisix-etcd_2379", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/ba31b611";, "cluster": "default"} 2022-02-12T16:49:20.381Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin";, "upstream": "apisix_apisix-etcd_2379"} 2022-02-12T16:49:20.385Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "apisix_apisix-etcd_2380", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/4475127a";, "cluster": "default"} 2022-02-12T16:49:20.385Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin";, "upstream": "apisix_apisix-etcd_2380"} 2022-02-12T16:49:20.388Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "istio-system_zipkin_9411", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/c4c96c99";, "cluster": "default"} 2022-02-12T16:49:20.388Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin";, "upstream": "istio-system_zipkin_9411"} 2022-02-12T16:49:20.392Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "bookinfo_reviews_9080", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/c4c02588";, "cluster": "default"} 2022-02-12T16:49:20.392Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin";, "upstream": "bookinfo_reviews_9080"} 2022-02-12T16:49:20.396Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "bookinfo_ratings_9080", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/4a5806af";, "cluster": "default"} 2022-02-12T16:49:20.396Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin";, "upstream": "bookinfo_ratings_9080"} 2022-02-12T16:49:20.399Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "bookinfo_details_9080", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/aabec2ca";, "cluster": "default"} 2022-02-12T16:49:20.399Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin";, "upstream": "bookinfo_details_9080"} 2022-02-12T16:49:21.352Z | [GIN] 2022/02/13 - 00:49:21 | 200 | 51.009µs | 127.0.0.6 | GET "/healthz" 2022-02-12T16:49:26.559Z | [GIN] 2022/02/13 - 00:49:26 | 200 | 41.23µs | 127.0.0.6 | GET "/healthz" ``` Now I'll try to delete the route and reinstall using v2beta3 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@apisix.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
![https://user-images.githubusercontent.com/11090934/153720696-e30add07-5ade-4644-be2e-14c505da6a97.png"](https://user-images.githubusercontent.com/11090934/153720696-e30add07-5ade-4644-be2e-14c505da6a97.png"){kind=link}
