Recover kops Kubernetes cluster

0 votes

There's a kubernetes cluster that was created by kops and when running kops validate this is the output:

    INSTANCE GROUPS
NAME            ROLE    MACHINETYPE MIN MAX SUBNETS
master-us-east-1a   Master  m4.xlarge   1   1   us-east-1a
nodes           Node    c4.2xlarge  1   75  us-east-1a

NODE STATUS
NAME                ROLE    READY
ip-172-20-59-93.ec2.internal    master  False

VALIDATION ERRORS
KIND    NAME                MESSAGE
Machine i-0a44bbdd18c86e846     machine "i-0a44bbdd18c86e846" has not yet joined cluster
Machine i-0d3302056f3dfeef0     machine "i-0d3302056f3dfeef0" has not yet joined cluster
Machine i-0d6199876b91962f4     machine "i-0d6199876b91962f4" has not yet joined cluster
Node    ip-172-20-59-93.ec2.internal    master "ip-172-20-59-93.ec2.internal" is not ready

Validation Failed

How I can recover this cluster?

Oct 22, 2018 in Kubernetes by lina
• 8,110 points
472 views
Please provide your cluster manifest. Execute
kops get --name my.example.com -o yaml to display your cluster manifest.

2 answers to this question.

0 votes

kops stores the state of your cluster in S3.

  1. Find the bucket where the state is stored
  2. Set export KOPS_STATE_STORE=s3://your-k8s-state-store
  3. Run kops update cluster
  4. If that fails.
  5. Terminate all your instances related to the cluster
  6. Run kops create cluster
answered Oct 22, 2018 by Hannah
• 16,220 points
0 votes

Adding to @hannah's answer, you need to do one additional step, make the maxSize and minSize of the master node to 0 , run update cluster. Make it back to 1 and run update cluster

answered Oct 23, 2018 by Kalgi
• 41,990 points

Related Questions In Kubernetes

0 votes
1 answer

automating cluster setup and app deplument on kubernetes

Go through Google Cloud Deployment Manager. it automates ...READ MORE

answered Jul 5, 2018 in Kubernetes by ajs3033
• 7,280 points
50 views
0 votes
1 answer

“403 Insufficient Permission” while creating a Kubernetes Cluster on Google Cloud instance

To run ./cluster/kube-up.sh, you most likely need compute scope ...READ MORE

answered Aug 28, 2018 in Kubernetes by Kalgi
• 41,990 points
172 views
0 votes
1 answer

Unable to run Kubernetes on rancher cluster

switch Docker to 1.12.x; Kubernetes doesn't support ...READ MORE

answered Aug 28, 2018 in Kubernetes by Kalgi
• 41,990 points
172 views
0 votes
1 answer

Deepstream.io on Kubernetes cluster

Kompose doesn’t support host volume mounting. Instead ...READ MORE

answered Sep 3, 2018 in Kubernetes by Kalgi
• 41,990 points
148 views
0 votes
1 answer
0 votes
1 answer

permissions related to AWS ECR

if you add allowContainerRegistry: true, kops will add those permissions ...READ MORE

answered Oct 9, 2018 in Kubernetes by Kalgi
• 41,990 points
73 views
0 votes
1 answer

Create LoadBalancer for kubernetes cluster in aws

Hello @Lina, If you're running your cluster on ...READ MORE

answered Oct 8, 2018 in Kubernetes by Kalgi
• 41,990 points
60 views
0 votes
1 answer

kafka in Kubernetes cluster

Configure kafka container as follows: ports: ...READ MORE

answered Oct 22, 2018 in Kubernetes by Hannah
• 16,220 points
181 views
+5 votes
2 answers

Redirecting host to service path in kubernetes

What you are trying to do is ...READ MORE

answered Mar 27, 2018 in Kubernetes by DragonLord999
• 8,380 points
111 views