删除isti和foo的配置文件之后,namespace持续terminating状态,此时也无法再创建istio-system的namespace
namespace "istio-system" edited root@ht:~/istio-0.8.0/install/kubernetes# kubectl get ns NAME STATUS AGE choerodon-devops-prod Active 21d default Active 30d foo Terminating 11d istio-system Terminating 19d jack-demo Active 29d kube-public Active 30d kube-system Active 30d sock-shop Active 22d
此时再删除istio-system也无法删除
root@ht:~/istio-0.8.0/install/kubernetes# kubectl delete ns istio-system
Error from server (Conflict): Operation cannot be fulfilled on namespaces "istio-system": The system is ensuring all content is removed from this namespace. Upon completion, this namespace will automatically be purged by the system.
好像是陷入死循环一样
此时查看pod，发现本应该已经被删除的istio系列pod依旧还出现在系统中，并且处于unknowed状态，失联了？
root@ht:~/istio-0.8.0/install/kubernetes# kubectl get pod -n istio-system NAME READY STATUS RESTARTS AGE istio-ingressgateway-6bc7c7c4bc-zwqmn 1/1 Unknown 0 19d istio-statsd-prom-bridge-6dbb7dcc7f-44gzv 1/1 Unknown 0 19d istio-telemetry-54b5bf4847-rn9qj 2/2 Unknown 0 19d
root@ht:~/istio-0.8.0/install/kubernetes# kubectl get pods -n foo NAME READY STATUS RESTARTS AGE httpbin-68fbcdcfc7-xbf2c 2/2 Unknown 0 11d
推测问题可能出在这
此时用kubetl delete -f 普通删除没有响应，故接下来采用强制删除
root@ht:~/istio-0.8.0/install/kubernetes# kubectl delete pod -n istio-system istio-ingressgateway-6bc7c7c4bc-zwqmn --grace-period=0 --force warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. pod "istio-ingressgateway-6bc7c7c4bc-zwqmn" deleted root@ht:~/istio-0.8.0/install/kubernetes# kubectl delete pod -n istio-system istio-statsd-prom-bridge-6dbb7dcc7f-44gzv --grace-period=0 --force warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. pod "istio-statsd-prom-bridge-6dbb7dcc7f-44gzv" deleted root@ht:~/istio-0.8.0/install/kubernetes# kubectl delete pod -n istio-system istio-telemetry-54b5bf4847-rn9qj --grace-period=0 --force warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. pod "istio-telemetry-54b5bf4847-rn9qj" deleted root@ht:~/istio-0.8.0/install/kubernetes# kubectl delete pod -n foo httpbin-68fbcdcfc7-xbf2c --grace-period=0 --force warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. pod "httpbin-68fbcdcfc7-xbf2c" deleted
一开始还是出现terminating的状态，等待一会后就会发现系统恢复正常
root@ht:/etc/kubernetes# kubectl get ns -o wide NAME STATUS AGE choerodon-devops-prod Active 21d default Active 30d jack-demo Active 29d kube-public Active 30d kube-system Active 30d sock-shop Active 22d