Playbook #1

/root/kubeinit/ci/builds/6mbKNrxD/0/kubeinit/kubeinit/kubeinit-aux/kubeinit/playbook.yml
Report Status CLI Date Duration Controller User Versions Hosts Plays Tasks Results Files Records
31 Oct 2023 08:44:29 +0000 00:45:59.97 nyctea root Ansible 2.15.2 ara 1.6.1 (client), 1.6.1 (server) Python 3.11.4 9 7 1091 1091 53 1
remote_user:root check:False tags:all

Task result details

Field Value
changed 
True
cmd 
set -eo pipefail
kubeadm reset -f || true
kubeadm init    --control-plane-endpoint "api.k8scluster.kubeinit.local:6443"    --upload-certs    --pod-network-cidr=10.244.0.0/16
delta 
0:01:20.379301
end 
2023-10-31 09:26:52.470069
invocation 
{
    "module_args": {
        "_raw_params": "set -eo pipefail\nkubeadm reset -f || true\nkubeadm init    --control-plane-endpoint \"api.k8scluster.kubeinit.local:6443\"    --upload-certs    --pod-network-cidr=10.244.0.0/16\n",
        "_uses_shell": true,
        "argv": null,
        "chdir": null,
        "creates": null,
        "executable": "/bin/bash",
        "removes": null,
        "stdin": null,
        "stdin_add_newline": true,
        "strip_empty_ends": true
    }
}
msg
rc 
0
start 
2023-10-31 09:25:32.090768
stderr 
W1031 09:25:32.214958   61264 removeetcdmember.go:106] [reset] No kubeadm config, using etcd pod spec to get data directory
W1031 09:25:32.239478   61264 cleanupnode.go:134] [reset] Failed to evaluate the "/var/lib/kubelet" directory. Skipping its unmount and cleanup: lstat /var/lib/kubelet: no such file or directory
I1031 09:25:34.164414   61263 version.go:256] remote version is much newer: v1.28.3; falling back to: stable-1.26
stderr_lines 
[
    "W1031 09:25:32.214958   61264 removeetcdmember.go:106] [reset] No kubeadm config, using etcd pod spec to get data directory",
    "W1031 09:25:32.239478   61264 cleanupnode.go:134] [reset] Failed to evaluate the \"/var/lib/kubelet\" directory. Skipping its unmount and cleanup: lstat /var/lib/kubelet: no such file or directory",
    "I1031 09:25:34.164414   61263 version.go:256] remote version is much newer: v1.28.3; falling back to: stable-1.26"
]
stdout 
[preflight] Running pre-flight checks
[reset] Deleted contents of the etcd data directory: /var/lib/etcd
[reset] Stopping the kubelet service
[reset] Unmounting mounted directories in "/var/lib/kubelet"
[reset] Deleting contents of directories: [/etc/kubernetes/manifests /etc/kubernetes/pki]
[reset] Deleting files: [/etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/bootstrap-kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf]

The reset process does not clean CNI configuration. To do so, you must remove /etc/cni/net.d

The reset process does not reset or clean up iptables rules or IPVS tables.
If you wish to reset iptables, you must do so manually by using the "iptables" command.

If your cluster was setup to utilize IPVS, run ipvsadm --clear (or similar)
to reset your system's IPVS tables.

The reset process does not clean your kubeconfig files and you must remove them manually.
Please, check the contents of the $HOME/.kube/config file.
[init] Using Kubernetes version: v1.26.10
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/etc/kubernetes/pki"
[certs] Generating "ca" certificate and key
[certs] Generating "apiserver" certificate and key
[certs] apiserver serving cert is signed for DNS names [api.k8scluster.kubeinit.local controller-01.k8scluster.kubeinit.local kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local] and IPs [10.96.0.1 10.0.0.1]
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [controller-01.k8scluster.kubeinit.local localhost] and IPs [10.0.0.1 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [controller-01.k8scluster.kubeinit.local localhost] and IPs [10.0.0.1 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[apiclient] All control plane components are healthy after 21.026627 seconds
[upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
[kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
[upload-certs] Storing the certificates in Secret "kubeadm-certs" in the "kube-system" Namespace
[upload-certs] Using certificate key:
a556f0b00416b503d4050e1d2e1b5048cb3d0030c38c3990a7d266633eb2cbdd
[mark-control-plane] Marking the node controller-01.k8scluster.kubeinit.local as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
[mark-control-plane] Marking the node controller-01.k8scluster.kubeinit.local as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]
[bootstrap-token] Using token: 17ziyg.uxb3iy6rfh4ydrr8
[bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
[bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
[bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
[bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
[bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
[bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
[kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
[addons] Applied essential addon: CoreDNS
[addons] Applied essential addon: kube-proxy

Your Kubernetes control-plane has initialized successfully!

To start using your cluster, you need to run the following as a regular user:

  mkdir -p $HOME/.kube
  sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
  sudo chown $(id -u):$(id -g) $HOME/.kube/config

Alternatively, if you are the root user, you can run:

  export KUBECONFIG=/etc/kubernetes/admin.conf

You should now deploy a pod network to the cluster.
Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
  https://kubernetes.io/docs/concepts/cluster-administration/addons/

You can now join any number of the control-plane node running the following command on each as root:

  kubeadm join api.k8scluster.kubeinit.local:6443 --token 17ziyg.uxb3iy6rfh4ydrr8 \
	--discovery-token-ca-cert-hash sha256:2b9dbb9c64d4868edf54d6eb6be607cdc1713b12e2b2155a4fa7c31059140d50 \
	--control-plane --certificate-key a556f0b00416b503d4050e1d2e1b5048cb3d0030c38c3990a7d266633eb2cbdd

Please note that the certificate-key gives access to cluster sensitive data, keep it secret!
As a safeguard, uploaded-certs will be deleted in two hours; If necessary, you can use
"kubeadm init phase upload-certs --upload-certs" to reload certs afterward.

Then you can join any number of worker nodes by running the following on each as root:

kubeadm join api.k8scluster.kubeinit.local:6443 --token 17ziyg.uxb3iy6rfh4ydrr8 \
	--discovery-token-ca-cert-hash sha256:2b9dbb9c64d4868edf54d6eb6be607cdc1713b12e2b2155a4fa7c31059140d50
stdout_lines 
[
    "[preflight] Running pre-flight checks",
    "[reset] Deleted contents of the etcd data directory: /var/lib/etcd",
    "[reset] Stopping the kubelet service",
    "[reset] Unmounting mounted directories in \"/var/lib/kubelet\"",
    "[reset] Deleting contents of directories: [/etc/kubernetes/manifests /etc/kubernetes/pki]",
    "[reset] Deleting files: [/etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/bootstrap-kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf]",
    "",
    "The reset process does not clean CNI configuration. To do so, you must remove /etc/cni/net.d",
    "",
    "The reset process does not reset or clean up iptables rules or IPVS tables.",
    "If you wish to reset iptables, you must do so manually by using the \"iptables\" command.",
    "",
    "If your cluster was setup to utilize IPVS, run ipvsadm --clear (or similar)",
    "to reset your system's IPVS tables.",
    "",
    "The reset process does not clean your kubeconfig files and you must remove them manually.",
    "Please, check the contents of the $HOME/.kube/config file.",
    "[init] Using Kubernetes version: v1.26.10",
    "[preflight] Running pre-flight checks",
    "[preflight] Pulling images required for setting up a Kubernetes cluster",
    "[preflight] This might take a minute or two, depending on the speed of your internet connection",
    "[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'",
    "[certs] Using certificateDir folder \"/etc/kubernetes/pki\"",
    "[certs] Generating \"ca\" certificate and key",
    "[certs] Generating \"apiserver\" certificate and key",
    "[certs] apiserver serving cert is signed for DNS names [api.k8scluster.kubeinit.local controller-01.k8scluster.kubeinit.local kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local] and IPs [10.96.0.1 10.0.0.1]",
    "[certs] Generating \"apiserver-kubelet-client\" certificate and key",
    "[certs] Generating \"front-proxy-ca\" certificate and key",
    "[certs] Generating \"front-proxy-client\" certificate and key",
    "[certs] Generating \"etcd/ca\" certificate and key",
    "[certs] Generating \"etcd/server\" certificate and key",
    "[certs] etcd/server serving cert is signed for DNS names [controller-01.k8scluster.kubeinit.local localhost] and IPs [10.0.0.1 127.0.0.1 ::1]",
    "[certs] Generating \"etcd/peer\" certificate and key",
    "[certs] etcd/peer serving cert is signed for DNS names [controller-01.k8scluster.kubeinit.local localhost] and IPs [10.0.0.1 127.0.0.1 ::1]",
    "[certs] Generating \"etcd/healthcheck-client\" certificate and key",
    "[certs] Generating \"apiserver-etcd-client\" certificate and key",
    "[certs] Generating \"sa\" key and public key",
    "[kubeconfig] Using kubeconfig folder \"/etc/kubernetes\"",
    "[kubeconfig] Writing \"admin.conf\" kubeconfig file",
    "[kubeconfig] Writing \"kubelet.conf\" kubeconfig file",
    "[kubeconfig] Writing \"controller-manager.conf\" kubeconfig file",
    "[kubeconfig] Writing \"scheduler.conf\" kubeconfig file",
    "[kubelet-start] Writing kubelet environment file with flags to file \"/var/lib/kubelet/kubeadm-flags.env\"",
    "[kubelet-start] Writing kubelet configuration to file \"/var/lib/kubelet/config.yaml\"",
    "[kubelet-start] Starting the kubelet",
    "[control-plane] Using manifest folder \"/etc/kubernetes/manifests\"",
    "[control-plane] Creating static Pod manifest for \"kube-apiserver\"",
    "[control-plane] Creating static Pod manifest for \"kube-controller-manager\"",
    "[control-plane] Creating static Pod manifest for \"kube-scheduler\"",
    "[etcd] Creating static Pod manifest for local etcd in \"/etc/kubernetes/manifests\"",
    "[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory \"/etc/kubernetes/manifests\". This can take up to 4m0s",
    "[apiclient] All control plane components are healthy after 21.026627 seconds",
    "[upload-config] Storing the configuration used in ConfigMap \"kubeadm-config\" in the \"kube-system\" Namespace",
    "[kubelet] Creating a ConfigMap \"kubelet-config\" in namespace kube-system with the configuration for the kubelets in the cluster",
    "[upload-certs] Storing the certificates in Secret \"kubeadm-certs\" in the \"kube-system\" Namespace",
    "[upload-certs] Using certificate key:",
    "a556f0b00416b503d4050e1d2e1b5048cb3d0030c38c3990a7d266633eb2cbdd",
    "[mark-control-plane] Marking the node controller-01.k8scluster.kubeinit.local as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]",
    "[mark-control-plane] Marking the node controller-01.k8scluster.kubeinit.local as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]",
    "[bootstrap-token] Using token: 17ziyg.uxb3iy6rfh4ydrr8",
    "[bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles",
    "[bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes",
    "[bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials",
    "[bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token",
    "[bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster",
    "[bootstrap-token] Creating the \"cluster-info\" ConfigMap in the \"kube-public\" namespace",
    "[kubelet-finalize] Updating \"/etc/kubernetes/kubelet.conf\" to point to a rotatable kubelet client certificate and key",
    "[addons] Applied essential addon: CoreDNS",
    "[addons] Applied essential addon: kube-proxy",
    "",
    "Your Kubernetes control-plane has initialized successfully!",
    "",
    "To start using your cluster, you need to run the following as a regular user:",
    "",
    "  mkdir -p $HOME/.kube",
    "  sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config",
    "  sudo chown $(id -u):$(id -g) $HOME/.kube/config",
    "",
    "Alternatively, if you are the root user, you can run:",
    "",
    "  export KUBECONFIG=/etc/kubernetes/admin.conf",
    "",
    "You should now deploy a pod network to the cluster.",
    "Run \"kubectl apply -f [podnetwork].yaml\" with one of the options listed at:",
    "  https://kubernetes.io/docs/concepts/cluster-administration/addons/",
    "",
    "You can now join any number of the control-plane node running the following command on each as root:",
    "",
    "  kubeadm join api.k8scluster.kubeinit.local:6443 --token 17ziyg.uxb3iy6rfh4ydrr8 \\",
    "\t--discovery-token-ca-cert-hash sha256:2b9dbb9c64d4868edf54d6eb6be607cdc1713b12e2b2155a4fa7c31059140d50 \\",
    "\t--control-plane --certificate-key a556f0b00416b503d4050e1d2e1b5048cb3d0030c38c3990a7d266633eb2cbdd",
    "",
    "Please note that the certificate-key gives access to cluster sensitive data, keep it secret!",
    "As a safeguard, uploaded-certs will be deleted in two hours; If necessary, you can use",
    "\"kubeadm init phase upload-certs --upload-certs\" to reload certs afterward.",
    "",
    "Then you can join any number of worker nodes by running the following on each as root:",
    "",
    "kubeadm join api.k8scluster.kubeinit.local:6443 --token 17ziyg.uxb3iy6rfh4ydrr8 \\",
    "\t--discovery-token-ca-cert-hash sha256:2b9dbb9c64d4868edf54d6eb6be607cdc1713b12e2b2155a4fa7c31059140d50 "
]