For administrators

Troubleshooting

5min

Introduction

In this section you can find some of the common issues you might encounter and ways you can try to solve them.

Expired MFA token

An error occurred (ExpiredTokenException) when calling the DescribeCluster operation: The security token included in the request is expired

If you are getting this error. Your MFA token has expired and you need to run hosty auth command. This has to be done every 24 hours.

Outdated kubectl config

... couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused

Execute aws eks update-kubeconfig --name=<clusterName> to update kube config.

Pods stuck terminating

If you try do delete the EKS cluster and get:

Error: context deadline exceeded

and the last operation before this error was something like:

module.cluster_dragon.kubernetes_namespace_v1.production["website"]: Still destroying... [id=website-production, 4m50s elapsed]

Most likely one of the pods got stuck terminating. You can check that by running kubectl get pods -n <namespace>. You should see something like:

NAME READY STATUS RESTARTS AGE website-production-drupal-8454559f74-tfk5d 0/2 Terminating 0 39h

You can get it unstuck by force removing stuck pods by running kubectl delete pods --all --grace-period=0 --force=true -n <namespace>. For example:

kubectl delete pods --all --grace-period=0 --force=true -n website-production