Question: What is Marking pod as critical?

Answer: T o   m a r k   a   P o d   a s   c r i t i c a l ,   s e t   p r i o r i t y C l a s s N a m e   f o r   t h a t   P o d   t o   s y s t e m - c l u s t e r - c r i t i c a l   o r   s y s t e m - n o d e - c r i t i c a l .   s y s t e m - n o d e - c r i t i c a l   i s   t h e   h i g h e s t   a v a i l a b l e   p r i o r i t y ,   e v e n   h i g h e r   t h a n   s y s t e m - c l u s t e r - c r i t i c a l .


Question: What is Force Delete StatefulSet Pods?

Answer: Force Delete StatefulSet PodsThis page shows how to delete Pods which are part of a stateful set, and explains the considerations to keep in mind when doing so.Before you beginThis is a fairly advanced task and has the potential to violate some of the properties inherent to StatefulSet.Before proceeding, make yourself familiar with the considerations enumerated below.StatefulSet considerationsIn normal operation of a StatefulSet, there is never a need to force delete a StatefulSet Pod. The StatefulSet controller is responsible for creating, scaling and deleting members of the StatefulSet. It tries to ensure that the specified number of Pods from ordinal 0 through N-1 are alive and ready. StatefulSet ensures that, at any time, there is at most one Pod with a given identity running in a cluster. This is referred to as at most one semantics provided by a StatefulSet.Manual force deletion should be undertaken with caution, as it has the potential to violate the at most one semantics inherent to StatefulSet. StatefulSets may be used to run distributed and clustered applications which have a need for a stable network identity and stable storage. These applications often have configuration which relies on an ensemble of a fixed number of members with fixed identities. Having multiple members with the same identity can be disastrous and may lead to data loss (e.g. split brain scenario in quorum-based systems).Delete PodsYou can perform a graceful pod deletion with the following command:kubectl delete pods <pod> For the above to lead to graceful termination, the Pod must not specify a pod.Spec.TerminationGracePeriodSeconds of 0. The practice of setting a pod.Spec.TerminationGracePeriodSeconds of 0 seconds is unsafe and strongly discouraged for StatefulSet Pods. Graceful deletion is safe and will ensure that the Pod shuts down gracefully before the kubelet deletes the name from the apiserver.A Pod is not deleted automatically when a node is unreachable. The Pods running on an unreachable Node enter the 'Terminating' or 'Unknown' state after a timeout. Pods may also enter these states when the user attempts graceful deletion of a Pod on an unreachable Node. The only ways in which a Pod in such a state can be removed from the apiserver are as follows:The Node object is deleted (either by you, or by the Node Controller).The kubelet on the unresponsive Node starts responding, kills the Pod and removes the entry from the apiserver.Force deletion of the Pod by the user.The recommended best practice is to use the first or second approach. If a Node is confirmed to be dead (e.g. permanently disconnected from the network, powered down, etc), then delete the Node object. If the Node is suffering from a network partition, then try to resolve this or wait for it to resolve. When the partition heals, the kubelet will complete the deletion of the Pod and free up its name in the apiserver.Normally, the system completes the deletion once the Pod is no longer running on a


Question: How does Force Delete StatefulSet Pods work?

Answer: Force Delete StatefulSet PodsThis page shows how to delete Pods which are part of a stateful set, and explains the considerations to keep in mind when doing so.Before you beginThis is a fairly advanced task and has the potential to violate some of the properties inherent to StatefulSet.Before proceeding, make yourself familiar with the considerations enumerated below.StatefulSet considerationsIn normal operation of a StatefulSet, there is never a need to force delete a StatefulSet Pod. The StatefulSet controller is responsible for creating, scaling and deleting members of the StatefulSet. It tries to ensure that the specified number of Pods from ordinal 0 through N-1 are alive and ready. StatefulSet ensures that, at any time, there is at most one Pod with a given identity running in a cluster. This is referred to as at most one semantics provided by a StatefulSet.Manual force deletion should be undertaken with caution, as it has the potential to violate the at most one semantics inherent to StatefulSet. StatefulSets may be used to run distributed and clustered applications which have a need for a stable network identity and stable storage. These applications often have configuration which relies on an ensemble of a fixed number of members with fixed identities. Having multiple members with the same identity can be disastrous and may lead to data loss (e.g. split brain scenario in quorum-based systems).Delete PodsYou can perform a graceful pod deletion with the following command:kubectl delete pods <pod> For the above to lead to graceful termination, the Pod must not specify a pod.Spec.TerminationGracePeriodSeconds of 0. The practice of setting a pod.Spec.TerminationGracePeriodSeconds of 0 seconds is unsafe and strongly discouraged for StatefulSet Pods. Graceful deletion is safe and will ensure that the Pod shuts down gracefully before the kubelet deletes the name from the apiserver.A Pod is not deleted automatically when a node is unreachable. The Pods running on an unreachable Node enter the 'Terminating' or 'Unknown' state after a timeout. Pods may also enter these states when the user attempts graceful deletion of a Pod on an unreachable Node. The only ways in which a Pod in such a state can be removed from the apiserver are as follows:The Node object is deleted (either by you, or by the Node Controller).The kubelet on the unresponsive Node starts responding, kills the Pod and removes the entry from the apiserver.Force deletion of the Pod by the user.The recommended best practice is to use the first or second approach. If a Node is confirmed to be dead (e.g. permanently disconnected from the network, powered down, etc), then delete the Node object. If the Node is suffering from a network partition, then try to resolve this or wait for it to resolve. When the partition heals, the kubelet will complete the deletion of the Pod and free up its name in the apiserver.Normally, the system completes the deletion once the Pod is no longer running on a


Question: When would you use Force Delete StatefulSet Pods?

Answer: Force Delete StatefulSet PodsThis page shows how to delete Pods which are part of a stateful set, and explains the considerations to keep in mind when doing so.Before you beginThis is a fairly advanced task and has the potential to violate some of the properties inherent to StatefulSet.Before proceeding, make yourself familiar with the considerations enumerated below.StatefulSet considerationsIn normal operation of a StatefulSet, there is never a need to force delete a StatefulSet Pod. The StatefulSet controller is responsible for creating, scaling and deleting members of the StatefulSet. It tries to ensure that the specified number of Pods from ordinal 0 through N-1 are alive and ready. StatefulSet ensures that, at any time, there is at most one Pod with a given identity running in a cluster. This is referred to as at most one semantics provided by a StatefulSet.Manual force deletion should be undertaken with caution, as it has the potential to violate the at most one semantics inherent to StatefulSet. StatefulSets may be used to run distributed and clustered applications which have a need for a stable network identity and stable storage. These applications often have configuration which relies on an ensemble of a fixed number of members with fixed identities. Having multiple members with the same identity can be disastrous and may lead to data loss (e.g. split brain scenario in quorum-based systems).Delete PodsYou can perform a graceful pod deletion with the following command:kubectl delete pods <pod> For the above to lead to graceful termination, the Pod must not specify a pod.Spec.TerminationGracePeriodSeconds of 0. The practice of setting a pod.Spec.TerminationGracePeriodSeconds of 0 seconds is unsafe and strongly discouraged for StatefulSet Pods. Graceful deletion is safe and will ensure that the Pod shuts down gracefully before the kubelet deletes the name from the apiserver.A Pod is not deleted automatically when a node is unreachable. The Pods running on an unreachable Node enter the 'Terminating' or 'Unknown' state after a timeout. Pods may also enter these states when the user attempts graceful deletion of a Pod on an unreachable Node. The only ways in which a Pod in such a state can be removed from the apiserver are as follows:The Node object is deleted (either by you, or by the Node Controller).The kubelet on the unresponsive Node starts responding, kills the Pod and removes the entry from the apiserver.Force deletion of the Pod by the user.The recommended best practice is to use the first or second approach. If a Node is confirmed to be dead (e.g. permanently disconnected from the network, powered down, etc), then delete the Node object. If the Node is suffering from a network partition, then try to resolve this or wait for it to resolve. When the partition heals, the kubelet will complete the deletion of the Pod and free up its name in the apiserver.Normally, the system completes the deletion once the Pod is no longer running on a


Question: What are the benefits of Force Delete StatefulSet Pods?

Answer: Force Delete StatefulSet PodsThis page shows how to delete Pods which are part of a stateful set, and explains the considerations to keep in mind when doing so.Before you beginThis is a fairly advanced task and has the potential to violate some of the properties inherent to StatefulSet.Before proceeding, make yourself familiar with the considerations enumerated below.StatefulSet considerationsIn normal operation of a StatefulSet, there is never a need to force delete a StatefulSet Pod. The StatefulSet controller is responsible for creating, scaling and deleting members of the StatefulSet. It tries to ensure that the specified number of Pods from ordinal 0 through N-1 are alive and ready. StatefulSet ensures that, at any time, there is at most one Pod with a given identity running in a cluster. This is referred to as at most one semantics provided by a StatefulSet.Manual force deletion should be undertaken with caution, as it has the potential to violate the at most one semantics inherent to StatefulSet. StatefulSets may be used to run distributed and clustered applications which have a need for a stable network identity and stable storage. These applications often have configuration which relies on an ensemble of a fixed number of members with fixed identities. Having multiple members with the same identity can be disastrous and may lead to data loss (e.g. split brain scenario in quorum-based systems).Delete PodsYou can perform a graceful pod deletion with the following command:kubectl delete pods <pod> For the above to lead to graceful termination, the Pod must not specify a pod.Spec.TerminationGracePeriodSeconds of 0. The practice of setting a pod.Spec.TerminationGracePeriodSeconds of 0 seconds is unsafe and strongly discouraged for StatefulSet Pods. Graceful deletion is safe and will ensure that the Pod shuts down gracefully before the kubelet deletes the name from the apiserver.A Pod is not deleted automatically when a node is unreachable. The Pods running on an unreachable Node enter the 'Terminating' or 'Unknown' state after a timeout. Pods may also enter these states when the user attempts graceful deletion of a Pod on an unreachable Node. The only ways in which a Pod in such a state can be removed from the apiserver are as follows:The Node object is deleted (either by you, or by the Node Controller).The kubelet on the unresponsive Node starts responding, kills the Pod and removes the entry from the apiserver.Force deletion of the Pod by the user.The recommended best practice is to use the first or second approach. If a Node is confirmed to be dead (e.g. permanently disconnected from the network, powered down, etc), then delete the Node object. If the Node is suffering from a network partition, then try to resolve this or wait for it to resolve. When the partition heals, the kubelet will complete the deletion of the Pod and free up its name in the apiserver.Normally, the system completes the deletion once the Pod is no longer running on a


Question: What is Force Delete StatefulSet Pods?

Answer: T h i s   p a g e   s h o w s   h o w   t o   d e l e t e   P o d s   w h i c h   a r e   p a r t   o f   a   s t a t e f u l   s e t ,   a n d   e x p l a i n s   t h e   c o n s i d e r a t i o n s   t o   k e e p   i n   m i n d   w h e n   d o i n g   s o .


Question: What is Before you begin?

Answer: T h i s   i s   a   f a i r l y   a d v a n c e d   t a s k   a n d   h a s   t h e   p o t e n t i a l   t o   v i o l a t e   s o m e   o f   t h e   p r o p e r t i e s   i n h e r e n t   t o   S t a t e f u l S e t . B e f o r e   p r o c e e d i n g ,   m a k e   y o u r s e l f   f a m i l i a r   w i t h   t h e   c o n s i d e r a t i o n s   e n u m e r a t e d   b e l o w .


Question: What is StatefulSet considerations?

Answer: I n   n o r m a l   o p e r a t i o n   o f   a   S t a t e f u l S e t ,   t h e r e   i s   n e v e r   a   n e e d   t o   f o r c e   d e l e t e   a   S t a t e f u l S e t   P o d .   T h e   S t a t e f u l S e t   c o n t r o l l e r   i s   r e s p o n s i b l e   f o r   c r e a t i n g ,   s c a l i n g   a n d   d e l e t i n g   m e m b e r s   o f   t h e   S t a t e f u l S e t .   I t   t r i e s   t o   e n s u r e   t h a t   t h e   s p e c i f i e d   n u m b e r   o f   P o d s   f r o m   o r d i n a l   0   t h r o u g h   N - 1   a r e   a l i v e   a n d   r e a d y .   S t a t e f u l S e t   e n s u r e s   t h a t ,   a t   a n y   t i m e ,   t h e r e   i s   a t   m o s t   o n e   P o d   w i t h   a   g i v e n   i d e n t i t y   r u n n i n g   i n   a   c l u s t e r .   T h i s   i s   r e f e r r e d   t o   a s   a t   m o s t   o n e   s e m a n t i c s   p r o v i d e d   b y   a   S t a t e f u l S e t .   M a n u a l   f o r c e   d e l e t i o n   s h o u l d   b e   u n d e r t a k e n   w i t h   c a u t i o n ,   a s   i t   h a s   t h e   p o t e n t i a l   t o   v i o l a t e   t h e   a t   m o s t   o n e   s e m a n t i c s   i n h e r e n t   t o   S t a t e f u l S e t .   S t a t e f u l S e t s   m a y   b e   u s e d   t o   r u n   d i s t r i b u t e d   a n d   c l u s t e r e d   a p p l i c a t i o n s   w h i c h   h a v e   a   n e e d   f o r   a   s t a b l e   n e t w o r k   i d e n t i t y   a n d   s t a b l e   s t o r a g e .   T h e s e   a p p l i c a t i o n s   o f t e n   h a v e   c o n f i g u r a t i o n   w h i c h   r e l i e s   o n   a n   e n s e m b l e   o f   a   f i x e d   n u m b e r   o f   m e m b e r s   w i t h   f i x e d   i d e n t i t i e s .   H a v i n g   m u l t i p l e   m e m b e r s   w i t h   t h e   s a m e   i d e n t i t y   c a n   b e   d i s a s t r o u s   a n d   m a y   l e a d   t o   d a t a   l o s s   ( e . g .   s p l i t   b r a i n   s c e n


Question: What is Delete Pods?

Answer: Y o u   c a n   p e r f o r m   a   g r a c e f u l   p o d   d e l e t i o n   w i t h   t h e   f o l l o w i n g   c o m m a n d :   k u b e c t l   d e l e t e   p o d s   < p o d >   F o r   t h e   a b o v e   t o   l e a d   t o   g r a c e f u l   t e r m i n a t i o n ,   t h e   P o d   m u s t   n o t   s p e c i f y   a   p o d . S p e c . T e r m i n a t i o n G r a c e P e r i o d S e c o n d s   o f   0 .   T h e   p r a c t i c e   o f   s e t t i n g   a   p o d . S p e c . T e r m i n a t i o n G r a c e P e r i o d S e c o n d s   o f   0   s e c o n d s   i s   u n s a f e   a n d   s t r o n g l y   d i s c o u r a g e d   f o r   S t a t e f u l S e t   P o d s .   G r a c e f u l   d e l e t i o n   i s   s a f e   a n d   w i l l   e n s u r e   t h a t   t h e   P o d   s h u t s   d o w n   g r a c e f u l l y   b e f o r e   t h e   k u b e l e t   d e l e t e s   t h e   n a m e   f r o m   t h e   a p i s e r v e r .   A   P o d   i s   n o t   d e l e t e d   a u t o m a t i c a l l y   w h e n   a   n o d e   i s   u n r e a c h a b l e .   T h e   P o d s   r u n n i n g   o n   a n   u n r e a c h a b l e   N o d e   e n t e r   t h e   ' T e r m i n a t i n g '   o r   ' U n k n o w n '   s t a t e   a f t e r   a   t i m e o u t .   P o d s   m a y   a l s o   e n t e r   t h e s e   s t a t e s   w h e n   t h e   u s e r   a t t e m p t s   g r a c e f u l   d e l e t i o n   o f   a   P o d   o n   a n   u n r e a c h a b l e   N o d e .   T h e   o n l y   w a y s   i n   w h i c h   a   P o d   i n   s u c h   a   s t a t e   c a n   b e   r e m o v e d   f r o m   t h e   a p i s e r v e r   a r e   a s   f o l l o w s :   T h e   N o d e   o b j e c t   i s   d e l e t e d   ( e i t h e r   b y   y o u ,   o r   b y   t h e   N o d e   C o n t r o l l e r ) . T h e   k u b e l e t   o n   t h e   u n r e s p o n s i v e   N o d e   s t a r t s   r e s p o n d i n g ,   k i l l s   t h e   P o d   a n d   r e m o v e s   t h


Question: What is Force Deletion?

Answer: F o r c e   d e l e t i o n s   d o   n o t   w a i t   f o r   c o n f i r m a t i o n   f r o m   t h e   k u b e l e t   t h a t   t h e   P o d   h a s   b e e n   t e r m i n a t e d .   I r r e s p e c t i v e   o f   w h e t h e r   a   f o r c e   d e l e t i o n   i s   s u c c e s s f u l   i n   k i l l i n g   a   P o d ,   i t   w i l l   i m m e d i a t e l y   f r e e   u p   t h e   n a m e   f r o m   t h e   a p i s e r v e r .   T h i s   w o u l d   l e t   t h e   S t a t e f u l S e t   c o n t r o l l e r   c r e a t e   a   r e p l a c e m e n t   P o d   w i t h   t h a t   s a m e   i d e n t i t y ;   t h i s   c a n   l e a d   t o   t h e   d u p l i c a t i o n   o f   a   s t i l l - r u n n i n g   P o d ,   a n d   i f   s a i d   P o d   c a n   s t i l l   c o m m u n i c a t e   w i t h   t h e   o t h e r   m e m b e r s   o f   t h e   S t a t e f u l S e t ,   w i l l   v i o l a t e   t h e   a t   m o s t   o n e   s e m a n t i c s   t h a t   S t a t e f u l S e t   i s   d e s i g n e d   t o   g u a r a n t e e .   W h e n   y o u   f o r c e   d e l e t e   a   S t a t e f u l S e t   p o d ,   y o u   a r e   a s s e r t i n g   t h a t   t h e   P o d   i n   q u e s t i o n   w i l l   n e v e r   a g a i n   m a k e   c o n t a c t   w i t h   o t h e r   P o d s   i n   t h e   S t a t e f u l S e t   a n d   i t s   n a m e   c a n   b e   s a f e l y   f r e e d   u p   f o r   a   r e p l a c e m e n t   t o   b e   c r e a t e d .   I f   y o u   w a n t   t o   d e l e t e   a   P o d   f o r c i b l y   u s i n g   k u b e c t l   v e r s i o n   > =   1 . 5 ,   d o   t h e   f o l l o w i n g :   k u b e c t l   d e l e t e   p o d s   < p o d >   - - g r a c e - p e r i o d = 0   - - f o r c e   I f   y o u ' r e   u s i n g   a n y   v e r s i o n   o f   k u b e c t l   < =   1 . 4 ,   y o u   s h o u l d   o m i t   t h e   - - f o r c e   o p t i o n   a n d   u s e :   k u b e c t l   d e l e t e   p o


Question: What is What's next?

Answer: L e a r n   m o r e   a b o u t   d e b u g g i n g   a   S t a t e f u l S e t .


Question: What is Upgrading kubeadm clusters?

Answer: Upgrading kubeadm clustersThis page explains how to upgrade a Kubernetes cluster created with kubeadm from version 1.33.x to version 1.34.x, and from version 1.34.x to 1.34.y (where y > x). Skipping MINOR versions when upgrading is unsupported. For more details, please visit Version Skew Policy.To see information about upgrading clusters created using older versions of kubeadm, please refer to following pages instead:Upgrading a kubeadm cluster from 1.32 to 1.33Upgrading a kubeadm cluster from 1.31 to 1.32Upgrading a kubeadm cluster from 1.30 to 1.31Upgrading a kubeadm cluster from 1.29 to 1.30The Kubernetes project recommends upgrading to the latest patch releases promptly, and to ensure that you are running a supported minor release of Kubernetes. Following this recommendation helps you to stay secure.The upgrade workflow at high level is the following:Upgrade a primary control plane node.Upgrade additional control plane nodes.Upgrade worker nodes.Before you beginMake sure you read the release notes carefully.The cluster should use a static control plane and etcd pods or external etcd.Make sure to back up any important components, such as app-level state stored in a database. kubeadm upgrade does not touch your workloads, only components internal to Kubernetes, but backups are always a best practice.Swap must be disabled.Additional informationThe instructions below outline when to drain each node during the upgrade process. If you are performing a minor version upgrade for any kubelet, you must first drain the node (or nodes) that you are upgrading. In the case of control plane nodes, they could be running CoreDNS Pods or other critical workloads. For more information see Draining nodes.The Kubernetes project recommends that you match your kubelet and kubeadm versions. You can instead use a version of kubelet that is older than kubeadm, provided it is within the range of supported versions. For more details, please visit kubeadm's skew against the kubelet.All containers are restarted after upgrade, because the container spec hash value is changed.To verify that the kubelet service has successfully restarted after the kubelet has been upgraded, you can execute systemctl status kubelet or view the service logs with journalctl -xeu kubelet.kubeadm upgrade supports --config with a UpgradeConfiguration API type which can be used to configure the upgrade process.kubeadm upgrade does not support reconfiguration of an existing cluster. Follow the steps in Reconfiguring a kubeadm cluster instead.Considerations when upgrading etcdBecause the kube-apiserver static pod is running at all times (even if you have drained the node), when you perform a kubeadm upgrade which includes an etcd upgrade, in-flight requests to the server will stall while the new etcd static pod is restarting. As a workaround, it is possible to actively stop the kube-apiserver process a few seconds before starting the kubeadm upgrade apply command. This permits to complete in-flight r


Question: How does Upgrading kubeadm clusters work?

Answer: Upgrading kubeadm clustersThis page explains how to upgrade a Kubernetes cluster created with kubeadm from version 1.33.x to version 1.34.x, and from version 1.34.x to 1.34.y (where y > x). Skipping MINOR versions when upgrading is unsupported. For more details, please visit Version Skew Policy.To see information about upgrading clusters created using older versions of kubeadm, please refer to following pages instead:Upgrading a kubeadm cluster from 1.32 to 1.33Upgrading a kubeadm cluster from 1.31 to 1.32Upgrading a kubeadm cluster from 1.30 to 1.31Upgrading a kubeadm cluster from 1.29 to 1.30The Kubernetes project recommends upgrading to the latest patch releases promptly, and to ensure that you are running a supported minor release of Kubernetes. Following this recommendation helps you to stay secure.The upgrade workflow at high level is the following:Upgrade a primary control plane node.Upgrade additional control plane nodes.Upgrade worker nodes.Before you beginMake sure you read the release notes carefully.The cluster should use a static control plane and etcd pods or external etcd.Make sure to back up any important components, such as app-level state stored in a database. kubeadm upgrade does not touch your workloads, only components internal to Kubernetes, but backups are always a best practice.Swap must be disabled.Additional informationThe instructions below outline when to drain each node during the upgrade process. If you are performing a minor version upgrade for any kubelet, you must first drain the node (or nodes) that you are upgrading. In the case of control plane nodes, they could be running CoreDNS Pods or other critical workloads. For more information see Draining nodes.The Kubernetes project recommends that you match your kubelet and kubeadm versions. You can instead use a version of kubelet that is older than kubeadm, provided it is within the range of supported versions. For more details, please visit kubeadm's skew against the kubelet.All containers are restarted after upgrade, because the container spec hash value is changed.To verify that the kubelet service has successfully restarted after the kubelet has been upgraded, you can execute systemctl status kubelet or view the service logs with journalctl -xeu kubelet.kubeadm upgrade supports --config with a UpgradeConfiguration API type which can be used to configure the upgrade process.kubeadm upgrade does not support reconfiguration of an existing cluster. Follow the steps in Reconfiguring a kubeadm cluster instead.Considerations when upgrading etcdBecause the kube-apiserver static pod is running at all times (even if you have drained the node), when you perform a kubeadm upgrade which includes an etcd upgrade, in-flight requests to the server will stall while the new etcd static pod is restarting. As a workaround, it is possible to actively stop the kube-apiserver process a few seconds before starting the kubeadm upgrade apply command. This permits to complete in-flight r


Question: When would you use Upgrading kubeadm clusters?

Answer: Upgrading kubeadm clustersThis page explains how to upgrade a Kubernetes cluster created with kubeadm from version 1.33.x to version 1.34.x, and from version 1.34.x to 1.34.y (where y > x). Skipping MINOR versions when upgrading is unsupported. For more details, please visit Version Skew Policy.To see information about upgrading clusters created using older versions of kubeadm, please refer to following pages instead:Upgrading a kubeadm cluster from 1.32 to 1.33Upgrading a kubeadm cluster from 1.31 to 1.32Upgrading a kubeadm cluster from 1.30 to 1.31Upgrading a kubeadm cluster from 1.29 to 1.30The Kubernetes project recommends upgrading to the latest patch releases promptly, and to ensure that you are running a supported minor release of Kubernetes. Following this recommendation helps you to stay secure.The upgrade workflow at high level is the following:Upgrade a primary control plane node.Upgrade additional control plane nodes.Upgrade worker nodes.Before you beginMake sure you read the release notes carefully.The cluster should use a static control plane and etcd pods or external etcd.Make sure to back up any important components, such as app-level state stored in a database. kubeadm upgrade does not touch your workloads, only components internal to Kubernetes, but backups are always a best practice.Swap must be disabled.Additional informationThe instructions below outline when to drain each node during the upgrade process. If you are performing a minor version upgrade for any kubelet, you must first drain the node (or nodes) that you are upgrading. In the case of control plane nodes, they could be running CoreDNS Pods or other critical workloads. For more information see Draining nodes.The Kubernetes project recommends that you match your kubelet and kubeadm versions. You can instead use a version of kubelet that is older than kubeadm, provided it is within the range of supported versions. For more details, please visit kubeadm's skew against the kubelet.All containers are restarted after upgrade, because the container spec hash value is changed.To verify that the kubelet service has successfully restarted after the kubelet has been upgraded, you can execute systemctl status kubelet or view the service logs with journalctl -xeu kubelet.kubeadm upgrade supports --config with a UpgradeConfiguration API type which can be used to configure the upgrade process.kubeadm upgrade does not support reconfiguration of an existing cluster. Follow the steps in Reconfiguring a kubeadm cluster instead.Considerations when upgrading etcdBecause the kube-apiserver static pod is running at all times (even if you have drained the node), when you perform a kubeadm upgrade which includes an etcd upgrade, in-flight requests to the server will stall while the new etcd static pod is restarting. As a workaround, it is possible to actively stop the kube-apiserver process a few seconds before starting the kubeadm upgrade apply command. This permits to complete in-flight r


Question: What are the benefits of Upgrading kubeadm clusters?

Answer: Upgrading kubeadm clustersThis page explains how to upgrade a Kubernetes cluster created with kubeadm from version 1.33.x to version 1.34.x, and from version 1.34.x to 1.34.y (where y > x). Skipping MINOR versions when upgrading is unsupported. For more details, please visit Version Skew Policy.To see information about upgrading clusters created using older versions of kubeadm, please refer to following pages instead:Upgrading a kubeadm cluster from 1.32 to 1.33Upgrading a kubeadm cluster from 1.31 to 1.32Upgrading a kubeadm cluster from 1.30 to 1.31Upgrading a kubeadm cluster from 1.29 to 1.30The Kubernetes project recommends upgrading to the latest patch releases promptly, and to ensure that you are running a supported minor release of Kubernetes. Following this recommendation helps you to stay secure.The upgrade workflow at high level is the following:Upgrade a primary control plane node.Upgrade additional control plane nodes.Upgrade worker nodes.Before you beginMake sure you read the release notes carefully.The cluster should use a static control plane and etcd pods or external etcd.Make sure to back up any important components, such as app-level state stored in a database. kubeadm upgrade does not touch your workloads, only components internal to Kubernetes, but backups are always a best practice.Swap must be disabled.Additional informationThe instructions below outline when to drain each node during the upgrade process. If you are performing a minor version upgrade for any kubelet, you must first drain the node (or nodes) that you are upgrading. In the case of control plane nodes, they could be running CoreDNS Pods or other critical workloads. For more information see Draining nodes.The Kubernetes project recommends that you match your kubelet and kubeadm versions. You can instead use a version of kubelet that is older than kubeadm, provided it is within the range of supported versions. For more details, please visit kubeadm's skew against the kubelet.All containers are restarted after upgrade, because the container spec hash value is changed.To verify that the kubelet service has successfully restarted after the kubelet has been upgraded, you can execute systemctl status kubelet or view the service logs with journalctl -xeu kubelet.kubeadm upgrade supports --config with a UpgradeConfiguration API type which can be used to configure the upgrade process.kubeadm upgrade does not support reconfiguration of an existing cluster. Follow the steps in Reconfiguring a kubeadm cluster instead.Considerations when upgrading etcdBecause the kube-apiserver static pod is running at all times (even if you have drained the node), when you perform a kubeadm upgrade which includes an etcd upgrade, in-flight requests to the server will stall while the new etcd static pod is restarting. As a workaround, it is possible to actively stop the kube-apiserver process a few seconds before starting the kubeadm upgrade apply command. This permits to complete in-flight r


Question: What is Upgrading kubeadm clusters?

Answer: T h i s   p a g e   e x p l a i n s   h o w   t o   u p g r a d e   a   K u b e r n e t e s   c l u s t e r   c r e a t e d   w i t h   k u b e a d m   f r o m   v e r s i o n   1 . 3 3 . x   t o   v e r s i o n   1 . 3 4 . x ,   a n d   f r o m   v e r s i o n   1 . 3 4 . x   t o   1 . 3 4 . y   ( w h e r e   y   >   x ) .   S k i p p i n g   M I N O R   v e r s i o n s   w h e n   u p g r a d i n g   i s   u n s u p p o r t e d .   F o r   m o r e   d e t a i l s ,   p l e a s e   v i s i t   V e r s i o n   S k e w   P o l i c y .   T o   s e e   i n f o r m a t i o n   a b o u t   u p g r a d i n g   c l u s t e r s   c r e a t e d   u s i n g   o l d e r   v e r s i o n s   o f   k u b e a d m ,   p l e a s e   r e f e r   t o   f o l l o w i n g   p a g e s   i n s t e a d :   U p g r a d i n g   a   k u b e a d m   c l u s t e r   f r o m   1 . 3 2   t o   1 . 3 3 U p g r a d i n g   a   k u b e a d m   c l u s t e r   f r o m   1 . 3 1   t o   1 . 3 2 U p g r a d i n g   a   k u b e a d m   c l u s t e r   f r o m   1 . 3 0   t o   1 . 3 1 U p g r a d i n g   a   k u b e a d m   c l u s t e r   f r o m   1 . 2 9   t o   1 . 3 0   T h e   K u b e r n e t e s   p r o j e c t   r e c o m m e n d s   u p g r a d i n g   t o   t h e   l a t e s t   p a t c h   r e l e a s e s   p r o m p t l y ,   a n d   t o   e n s u r e   t h a t   y o u   a r e   r u n n i n g   a   s u p p o r t e d   m i n o r   r e l e a s e   o f   K u b e r n e t e s .   F o l l o w i n g   t h i s   r e c o m m e n d a t i o n   h e l p s   y o u   t o   s t a y   s e c u r e .   T h e   u p g r a d e   w o r k f l o w   a t   h i g h   l e v e l   i s   t h e   f o l l o w i n g :   U p g r a d e   a   p r i m a r y   c o n t r o l   p l a n e   n o d e . U p g r a d e   a d d i t i o n a l   c o n t r o l   p l a n e   n o d e s . U p g r a d e   w o r k e r   n o d e s .


Question: What is Before you begin?

Answer: M a k e   s u r e   y o u   r e a d   t h e   r e l e a s e   n o t e s   c a r e f u l l y . T h e   c l u s t e r   s h o u l d   u s e   a   s t a t i c   c o n t r o l   p l a n e   a n d   e t c d   p o d s   o r   e x t e r n a l   e t c d . M a k e   s u r e   t o   b a c k   u p   a n y   i m p o r t a n t   c o m p o n e n t s ,   s u c h   a s   a p p - l e v e l   s t a t e   s t o r e d   i n   a   d a t a b a s e .   k u b e a d m   u p g r a d e   d o e s   n o t   t o u c h   y o u r   w o r k l o a d s ,   o n l y   c o m p o n e n t s   i n t e r n a l   t o   K u b e r n e t e s ,   b u t   b a c k u p s   a r e   a l w a y s   a   b e s t   p r a c t i c e . S w a p   m u s t   b e   d i s a b l e d .


Question: What is Additional information?

Answer: T h e   i n s t r u c t i o n s   b e l o w   o u t l i n e   w h e n   t o   d r a i n   e a c h   n o d e   d u r i n g   t h e   u p g r a d e   p r o c e s s .   I f   y o u   a r e   p e r f o r m i n g   a   m i n o r   v e r s i o n   u p g r a d e   f o r   a n y   k u b e l e t ,   y o u   m u s t   f i r s t   d r a i n   t h e   n o d e   ( o r   n o d e s )   t h a t   y o u   a r e   u p g r a d i n g .   I n   t h e   c a s e   o f   c o n t r o l   p l a n e   n o d e s ,   t h e y   c o u l d   b e   r u n n i n g   C o r e D N S   P o d s   o r   o t h e r   c r i t i c a l   w o r k l o a d s .   F o r   m o r e   i n f o r m a t i o n   s e e   D r a i n i n g   n o d e s . T h e   K u b e r n e t e s   p r o j e c t   r e c o m m e n d s   t h a t   y o u   m a t c h   y o u r   k u b e l e t   a n d   k u b e a d m   v e r s i o n s .   Y o u   c a n   i n s t e a d   u s e   a   v e r s i o n   o f   k u b e l e t   t h a t   i s   o l d e r   t h a n   k u b e a d m ,   p r o v i d e d   i t   i s   w i t h i n   t h e   r a n g e   o f   s u p p o r t e d   v e r s i o n s .   F o r   m o r e   d e t a i l s ,   p l e a s e   v i s i t   k u b e a d m ' s   s k e w   a g a i n s t   t h e   k u b e l e t . A l l   c o n t a i n e r s   a r e   r e s t a r t e d   a f t e r   u p g r a d e ,   b e c a u s e   t h e   c o n t a i n e r   s p e c   h a s h   v a l u e   i s   c h a n g e d . T o   v e r i f y   t h a t   t h e   k u b e l e t   s e r v i c e   h a s   s u c c e s s f u l l y   r e s t a r t e d   a f t e r   t h e   k u b e l e t   h a s   b e e n   u p g r a d e d ,   y o u   c a n   e x e c u t e   s y s t e m c t l   s t a t u s   k u b e l e t   o r   v i e w   t h e   s e r v i c e   l o g s   w i t h   j o u r n a l c t l   - x e u   k u b e l e t . k u b e a d m   u p g r a d e   s u p p o r t s   - - c o n f i g   w i t h   a   U p g r a d e C o n f i g u r a t i o n   A P I   t y p e   w h i c h   c a n   b e   u s e d


Question: What is Considerations when upgrading etcd?

Answer: B e c a u s e   t h e   k u b e - a p i s e r v e r   s t a t i c   p o d   i s   r u n n i n g   a t   a l l   t i m e s   ( e v e n   i f   y o u   h a v e   d r a i n e d   t h e   n o d e ) ,   w h e n   y o u   p e r f o r m   a   k u b e a d m   u p g r a d e   w h i c h   i n c l u d e s   a n   e t c d   u p g r a d e ,   i n - f l i g h t   r e q u e s t s   t o   t h e   s e r v e r   w i l l   s t a l l   w h i l e   t h e   n e w   e t c d   s t a t i c   p o d   i s   r e s t a r t i n g .   A s   a   w o r k a r o u n d ,   i t   i s   p o s s i b l e   t o   a c t i v e l y   s t o p   t h e   k u b e - a p i s e r v e r   p r o c e s s   a   f e w   s e c o n d s   b e f o r e   s t a r t i n g   t h e   k u b e a d m   u p g r a d e   a p p l y   c o m m a n d .   T h i s   p e r m i t s   t o   c o m p l e t e   i n - f l i g h t   r e q u e s t s   a n d   c l o s e   e x i s t i n g   c o n n e c t i o n s ,   a n d   m i n i m i z e s   t h e   c o n s e q u e n c e   o f   t h e   e t c d   d o w n t i m e .   T h i s   c a n   b e   d o n e   a s   f o l l o w s   o n   c o n t r o l   p l a n e   n o d e s :   k i l l a l l   - s   S I G T E R M   k u b e - a p i s e r v e r   #   t r i g g e r   a   g r a c e f u l   k u b e - a p i s e r v e r   s h u t d o w n   s l e e p   2 0   #   w a i t   a   l i t t l e   b i t   t o   p e r m i t   c o m p l e t i n g   i n - f l i g h t   r e q u e s t s   k u b e a d m   u p g r a d e   . . .   #   e x e c u t e   a   k u b e a d m   u p g r a d e   c o m m a n d


Question: What is Changing the package repository?

Answer: I f   y o u ' r e   u s i n g   t h e   c o m m u n i t y - o w n e d   p a c k a g e   r e p o s i t o r i e s   ( p k g s . k 8 s . i o ) ,   y o u   n e e d   t o   e n a b l e   t h e   p a c k a g e   r e p o s i t o r y   f o r   t h e   d e s i r e d   K u b e r n e t e s   m i n o r   r e l e a s e .   T h i s   i s   e x p l a i n e d   i n   C h a n g i n g   t h e   K u b e r n e t e s   p a c k a g e   r e p o s i t o r y   d o c u m e n t .


Question: What is Determine which version to upgrade to?

Answer: F i n d   t h e   l a t e s t   p a t c h   r e l e a s e   f o r   K u b e r n e t e s   1 . 3 4   u s i n g   t h e   O S   p a c k a g e   m a n a g e r :   #   F i n d   t h e   l a t e s t   1 . 3 4   v e r s i o n   i n   t h e   l i s t .   #   I t   s h o u l d   l o o k   l i k e   1 . 3 4 . x - * ,   w h e r e   x   i s   t h e   l a t e s t   p a t c h .   s u d o   a p t   u p d a t e   s u d o   a p t - c a c h e   m a d i s o n   k u b e a d m   #   F i n d   t h e   l a t e s t   1 . 3 4   v e r s i o n   i n   t h e   l i s t .   #   I t   s h o u l d   l o o k   l i k e   1 . 3 4 . x - * ,   w h e r e   x   i s   t h e   l a t e s t   p a t c h .   s u d o   a p t   u p d a t e   s u d o   a p t - c a c h e   m a d i s o n   k u b e a d m   F o r   s y s t e m s   w i t h   D N F : #   F i n d   t h e   l a t e s t   1 . 3 4   v e r s i o n   i n   t h e   l i s t .   #   I t   s h o u l d   l o o k   l i k e   1 . 3 4 . x - * ,   w h e r e   x   i s   t h e   l a t e s t   p a t c h .   s u d o   y u m   l i s t   - - s h o w d u p l i c a t e s   k u b e a d m   - - d i s a b l e e x c l u d e s = k u b e r n e t e s   F o r   s y s t e m s   w i t h   D N F 5 : #   F i n d   t h e   l a t e s t   1 . 3 4   v e r s i o n   i n   t h e   l i s t .   #   I t   s h o u l d   l o o k   l i k e   1 . 3 4 . x - * ,   w h e r e   x   i s   t h e   l a t e s t   p a t c h .   s u d o   y u m   l i s t   - - s h o w d u p l i c a t e s   k u b e a d m   - - s e t o p t = d i s a b l e _ e x c l u d e s = k u b e r n e t e s   F o r   s y s t e m s   w i t h   D N F :   #   F i n d   t h e   l a t e s t   1 . 3 4   v e r s i o n   i n   t h e   l i s t .   #   I t   s h o u l d   l o o k   l i k e   1 . 3 4 . x - * ,   w h e r e   x   i s   t h e   l a t e s t   p a t c h .   s u d o   y u m   l i s t   - - s h o w d u p l i c a t e s   k u b e a d m   - - d i s a b l e e x c l u d e s = k u b e r n e t e s   F o r   s y s t e m s   w i t h   D N F 5 :   #


Question: What is Upgrading control plane nodes?

Answer: T h e   u p g r a d e   p r o c e d u r e   o n   c o n t r o l   p l a n e   n o d e s   s h o u l d   b e   e x e c u t e d   o n e   n o d e   a t   a   t i m e .   P i c k   a   c o n t r o l   p l a n e   n o d e   t h a t   y o u   w i s h   t o   u p g r a d e   f i r s t .   I t   m u s t   h a v e   t h e   / e t c / k u b e r n e t e s / a d m i n . c o n f   f i l e .


Question: What is Call "kubeadm upgrade"?

Answer: F o r   t h e   f i r s t   c o n t r o l   p l a n e   n o d e   U p g r a d e   k u b e a d m : #   r e p l a c e   x   i n   1 . 3 4 . x - *   w i t h   t h e   l a t e s t   p a t c h   v e r s i o n   s u d o   a p t - m a r k   u n h o l d   k u b e a d m   & &   \   s u d o   a p t - g e t   u p d a t e   & &   s u d o   a p t - g e t   i n s t a l l   - y   k u b e a d m = ' 1 . 3 4 . x - * '   & &   \   s u d o   a p t - m a r k   h o l d   k u b e a d m   F o r   s y s t e m s   w i t h   D N F : #   r e p l a c e   x   i n   1 . 3 4 . x - *   w i t h   t h e   l a t e s t   p a t c h   v e r s i o n   s u d o   y u m   i n s t a l l   - y   k u b e a d m - ' 1 . 3 4 . x - * '   - - d i s a b l e e x c l u d e s = k u b e r n e t e s   F o r   s y s t e m s   w i t h   D N F 5 : #   r e p l a c e   x   i n   1 . 3 4 . x - *   w i t h   t h e   l a t e s t   p a t c h   v e r s i o n   s u d o   y u m   i n s t a l l   - y   k u b e a d m - ' 1 . 3 4 . x - * '   - - s e t o p t = d i s a b l e _ e x c l u d e s = k u b e r n e t e s   V e r i f y   t h a t   t h e   d o w n l o a d   w o r k s   a n d   h a s   t h e   e x p e c t e d   v e r s i o n : k u b e a d m   v e r s i o n   V e r i f y   t h e   u p g r a d e   p l a n : s u d o   k u b e a d m   u p g r a d e   p l a n   T h i s   c o m m a n d   c h e c k s   t h a t   y o u r   c l u s t e r   c a n   b e   u p g r a d e d ,   a n d   f e t c h e s   t h e   v e r s i o n s   y o u   c a n   u p g r a d e   t o .   I t   a l s o   s h o w s   a   t a b l e   w i t h   t h e   c o m p o n e n t   c o n f i g   v e r s i o n   s t a t e s . N o t e : k u b e a d m   u p g r a d e   a l s o   a u t o m a t i c a l l y   r e n e w s   t h e   c e r t i f i c a t e s   t h a t   i t   m a n a g e s   o n   t h i s   n o d e .   T o   o p t - o u t   o f   c e r t i f i c a t e   r e n e w a l   t h e   f l a g   - - c e r t i f i c a t e - r e n e w a l = f a l s e   c a n   b e   u s e d .   F o r


Question: What is Note:?

Answer: C h o o s e   a   v e r s i o n   t o   u p g r a d e   t o ,   a n d   r u n   t h e   a p p r o p r i a t e   c o m m a n d .   F o r   e x a m p l e :   #   r e p l a c e   x   w i t h   t h e   p a t c h   v e r s i o n   y o u   p i c k e d   f o r   t h i s   u p g r a d e   s u d o   k u b e a d m   u p g r a d e   a p p l y   v 1 . 3 4 . x   O n c e   t h e   c o m m a n d   f i n i s h e s   y o u   s h o u l d   s e e :   [ u p g r a d e / s u c c e s s f u l ]   S U C C E S S !   Y o u r   c l u s t e r   w a s   u p g r a d e d   t o   " v 1 . 3 4 . x " .   E n j o y !   [ u p g r a d e / k u b e l e t ]   N o w   t h a t   y o u r   c o n t r o l   p l a n e   i s   u p g r a d e d ,   p l e a s e   p r o c e e d   w i t h   u p g r a d i n g   y o u r   k u b e l e t s   i f   y o u   h a v e n ' t   a l r e a d y   d o n e   s o .


Question: What is Note:?

Answer: M a n u a l l y   u p g r a d e   y o u r   C N I   p r o v i d e r   p l u g i n .   Y o u r   C o n t a i n e r   N e t w o r k   I n t e r f a c e   ( C N I )   p r o v i d e r   m a y   h a v e   i t s   o w n   u p g r a d e   i n s t r u c t i o n s   t o   f o l l o w .   C h e c k   t h e   a d d o n s   p a g e   t o   f i n d   y o u r   C N I   p r o v i d e r   a n d   s e e   w h e t h e r   a d d i t i o n a l   u p g r a d e   s t e p s   a r e   r e q u i r e d .   T h i s   s t e p   i s   n o t   r e q u i r e d   o n   a d d i t i o n a l   c o n t r o l   p l a n e   n o d e s   i f   t h e   C N I   p r o v i d e r   r u n s   a s   a   D a e m o n S e t .   F o r   t h e   o t h e r   c o n t r o l   p l a n e   n o d e s   S a m e   a s   t h e   f i r s t   c o n t r o l   p l a n e   n o d e   b u t   u s e :   s u d o   k u b e a d m   u p g r a d e   n o d e   i n s t e a d   o f :   s u d o   k u b e a d m   u p g r a d e   a p p l y   A l s o   c a l l i n g   k u b e a d m   u p g r a d e   p l a n   a n d   u p g r a d i n g   t h e   C N I   p r o v i d e r   p l u g i n   i s   n o   l o n g e r   n e e d e d .


Question: What is Drain the node?

Answer: P r e p a r e   t h e   n o d e   f o r   m a i n t e n a n c e   b y   m a r k i n g   i t   u n s c h e d u l a b l e   a n d   e v i c t i n g   t h e   w o r k l o a d s :   #   r e p l a c e   < n o d e - t o - d r a i n >   w i t h   t h e   n a m e   o f   y o u r   n o d e   y o u   a r e   d r a i n i n g   k u b e c t l   d r a i n   < n o d e - t o - d r a i n >   - - i g n o r e - d a e m o n s e t s


Question: What is Upgrade kubelet and kubectl?

Answer: U p g r a d e   t h e   k u b e l e t   a n d   k u b e c t l : #   r e p l a c e   x   i n   1 . 3 4 . x - *   w i t h   t h e   l a t e s t   p a t c h   v e r s i o n   s u d o   a p t - m a r k   u n h o l d   k u b e l e t   k u b e c t l   & &   \   s u d o   a p t - g e t   u p d a t e   & &   s u d o   a p t - g e t   i n s t a l l   - y   k u b e l e t = ' 1 . 3 4 . x - * '   k u b e c t l = ' 1 . 3 4 . x - * '   & &   \   s u d o   a p t - m a r k   h o l d   k u b e l e t   k u b e c t l   F o r   s y s t e m s   w i t h   D N F : #   r e p l a c e   x   i n   1 . 3 4 . x - *   w i t h   t h e   l a t e s t   p a t c h   v e r s i o n   s u d o   y u m   i n s t a l l   - y   k u b e l e t - ' 1 . 3 4 . x - * '   k u b e c t l - ' 1 . 3 4 . x - * '   - - d i s a b l e e x c l u d e s = k u b e r n e t e s   F o r   s y s t e m s   w i t h   D N F 5 : #   r e p l a c e   x   i n   1 . 3 4 . x - *   w i t h   t h e   l a t e s t   p a t c h   v e r s i o n   s u d o   y u m   i n s t a l l   - y   k u b e l e t - ' 1 . 3 4 . x - * '   k u b e c t l - ' 1 . 3 4 . x - * '   - - s e t o p t = d i s a b l e _ e x c l u d e s = k u b e r n e t e s   R e s t a r t   t h e   k u b e l e t : s u d o   s y s t e m c t l   d a e m o n - r e l o a d   s u d o   s y s t e m c t l   r e s t a r t   k u b e l e t   U p g r a d e   t h e   k u b e l e t   a n d   k u b e c t l :   #   r e p l a c e   x   i n   1 . 3 4 . x - *   w i t h   t h e   l a t e s t   p a t c h   v e r s i o n   s u d o   a p t - m a r k   u n h o l d   k u b e l e t   k u b e c t l   & &   \   s u d o   a p t - g e t   u p d a t e   & &   s u d o   a p t - g e t   i n s t a l l   - y   k u b e l e t = ' 1 . 3 4 . x - * '   k u b e c t l = ' 1 . 3 4 . x - * '   & &   \   s u d o   a p t - m a r k   h o l d   k u b e l e t   k u b e c t l   #   r e p l a c e   x   i n   1 . 3 4 . x - *   w i t h   t h e   l a t e s t   p a t c h   v e r s i o n   s u d o   a p t - m a r k   u n h o l d   k u b e l


Question: What is Uncordon the node?

Answer: B r i n g   t h e   n o d e   b a c k   o n l i n e   b y   m a r k i n g   i t   s c h e d u l a b l e :   #   r e p l a c e   < n o d e - t o - u n c o r d o n >   w i t h   t h e   n a m e   o f   y o u r   n o d e   k u b e c t l   u n c o r d o n   < n o d e - t o - u n c o r d o n >


Question: What is Upgrade worker nodes?

Answer: T h e   u p g r a d e   p r o c e d u r e   o n   w o r k e r   n o d e s   s h o u l d   b e   e x e c u t e d   o n e   n o d e   a t   a   t i m e   o r   f e w   n o d e s   a t   a   t i m e ,   w i t h o u t   c o m p r o m i s i n g   t h e   m i n i m u m   r e q u i r e d   c a p a c i t y   f o r   r u n n i n g   y o u r   w o r k l o a d s .   T h e   f o l l o w i n g   p a g e s   s h o w   h o w   t o   u p g r a d e   L i n u x   a n d   W i n d o w s   w o r k e r   n o d e s :   U p g r a d e   L i n u x   n o d e s U p g r a d e   W i n d o w s   n o d e s


Question: What is Verify the status of the cluster?

Answer: A f t e r   t h e   k u b e l e t   i s   u p g r a d e d   o n   a l l   n o d e s   v e r i f y   t h a t   a l l   n o d e s   a r e   a v a i l a b l e   a g a i n   b y   r u n n i n g   t h e   f o l l o w i n g   c o m m a n d   f r o m   a n y w h e r e   k u b e c t l   c a n   a c c e s s   t h e   c l u s t e r :   k u b e c t l   g e t   n o d e s   T h e   S T A T U S   c o l u m n   s h o u l d   s h o w   R e a d y   f o r   a l l   y o u r   n o d e s ,   a n d   t h e   v e r s i o n   n u m b e r   s h o u l d   b e   u p d a t e d .


Question: What is Recovering from a failure state?

Answer: I f   k u b e a d m   u p g r a d e   f a i l s   a n d   d o e s   n o t   r o l l   b a c k ,   f o r   e x a m p l e   b e c a u s e   o f   a n   u n e x p e c t e d   s h u t d o w n   d u r i n g   e x e c u t i o n ,   y o u   c a n   r u n   k u b e a d m   u p g r a d e   a g a i n .   T h i s   c o m m a n d   i s   i d e m p o t e n t   a n d   e v e n t u a l l y   m a k e s   s u r e   t h a t   t h e   a c t u a l   s t a t e   i s   t h e   d e s i r e d   s t a t e   y o u   d e c l a r e .   T o   r e c o v e r   f r o m   a   b a d   s t a t e ,   y o u   c a n   a l s o   r u n   s u d o   k u b e a d m   u p g r a d e   a p p l y   - - f o r c e   w i t h o u t   c h a n g i n g   t h e   v e r s i o n   t h a t   y o u r   c l u s t e r   i s   r u n n i n g .   D u r i n g   u p g r a d e   k u b e a d m   w r i t e s   t h e   f o l l o w i n g   b a c k u p   f o l d e r s   u n d e r   / e t c / k u b e r n e t e s / t m p :   k u b e a d m - b a c k u p - e t c d - < d a t e > - < t i m e > k u b e a d m - b a c k u p - m a n i f e s t s - < d a t e > - < t i m e >   k u b e a d m - b a c k u p - e t c d   c o n t a i n s   a   b a c k u p   o f   t h e   l o c a l   e t c d   m e m b e r   d a t a   f o r   t h i s   c o n t r o l   p l a n e   N o d e .   I n   c a s e   o f   a n   e t c d   u p g r a d e   f a i l u r e   a n d   i f   t h e   a u t o m a t i c   r o l l b a c k   d o e s   n o t   w o r k ,   t h e   c o n t e n t s   o f   t h i s   f o l d e r   c a n   b e   m a n u a l l y   r e s t o r e d   i n   / v a r / l i b / e t c d .   I n   c a s e   e x t e r n a l   e t c d   i s   u s e d   t h i s   b a c k u p   f o l d e r   w i l l   b e   e m p t y .   k u b e a d m - b a c k u p - m a n i f e s t s   c o n t a i n s   a   b a c k u p   o f   t h e   s t a t i c   P o d   m a n i f e s t   f i l e s   f o r   t h i s   c o n t r o l   p l a n e   N o d e .   I n   c a s e   o f   a   u p g r a d e   f a i l u r e


Question: What is How it works?

Answer: k u b e a d m   u p g r a d e   a p p l y   d o e s   t h e   f o l l o w i n g :   C h e c k s   t h a t   y o u r   c l u s t e r   i s   i n   a n   u p g r a d e a b l e   s t a t e : T h e   A P I   s e r v e r   i s   r e a c h a b l e A l l   n o d e s   a r e   i n   t h e   R e a d y   s t a t e T h e   c o n t r o l   p l a n e   i s   h e a l t h y E n f o r c e s   t h e   v e r s i o n   s k e w   p o l i c i e s . M a k e s   s u r e   t h e   c o n t r o l   p l a n e   i m a g e s   a r e   a v a i l a b l e   o r   a v a i l a b l e   t o   p u l l   t o   t h e   m a c h i n e . G e n e r a t e s   r e p l a c e m e n t s   a n d / o r   u s e s   u s e r   s u p p l i e d   o v e r w r i t e s   i f   c o m p o n e n t   c o n f i g s   r e q u i r e   v e r s i o n   u p g r a d e s . U p g r a d e s   t h e   c o n t r o l   p l a n e   c o m p o n e n t s   o r   r o l l b a c k s   i f   a n y   o f   t h e m   f a i l s   t o   c o m e   u p . A p p l i e s   t h e   n e w   C o r e D N S   a n d   k u b e - p r o x y   m a n i f e s t s   a n d   m a k e s   s u r e   t h a t   a l l   n e c e s s a r y   R B A C   r u l e s   a r e   c r e a t e d . C r e a t e s   n e w   c e r t i f i c a t e   a n d   k e y   f i l e s   o f   t h e   A P I   s e r v e r   a n d   b a c k s   u p   o l d   f i l e s   i f   t h e y ' r e   a b o u t   t o   e x p i r e   i n   1 8 0   d a y s .   T h e   A P I   s e r v e r   i s   r e a c h a b l e A l l   n o d e s   a r e   i n   t h e   R e a d y   s t a t e T h e   c o n t r o l   p l a n e   i s   h e a l t h y   k u b e a d m   u p g r a d e   n o d e   d o e s   t h e   f o l l o w i n g   o n   a d d i t i o n a l   c o n t r o l   p l a n e   n o d e s :   F e t c h e s   t h e   k u b e a d m   C l u s t e r C o n f i g u r a t i o n   f r o m   t h e   c l u s t e r . O p t i o n a l l y   b a c k u p s   t h e   k u b e - a p i s e r v e r   c e r t i f i c a t e . U p g r a d e s   t h e


Question: What is Storage Classes?

Answer: Storage ClassesThis document describes the concept of a StorageClass in Kubernetes. Familiarity with volumes and persistent volumes is suggested.A StorageClass provides a way for administrators to describe the classes of storage they offer. Different classes might map to quality-of-service levels, or to backup policies, or to arbitrary policies determined by the cluster administrators. Kubernetes itself is unopinionated about what classes represent.The Kubernetes concept of a storage class is similar to “profiles” in some other storage system designs.StorageClass objectsEach StorageClass contains the fields provisioner, parameters, and reclaimPolicy, which are used when a PersistentVolume belonging to the class needs to be dynamically provisioned to satisfy a PersistentVolumeClaim (PVC).The name of a StorageClass object is significant, and is how users can request a particular class. Administrators set the name and other parameters of a class when first creating StorageClass objects.As an administrator, you can specify a default StorageClass that applies to any PVCs that don't request a specific class. For more details, see the PersistentVolumeClaim concept.Here's an example of a StorageClass:storage/storageclass-low-latency.yaml apiVersion: storage.k8s.io/v1 kind: StorageClass metadata: name: low-latency annotations: storageclass.kubernetes.io/is-default-class: "false" provisioner: csi-driver.example-vendor.example reclaimPolicy: Retain # default value is Delete allowVolumeExpansion: true mountOptions: - discard # this might enable UNMAP / TRIM at the block storage layer volumeBindingMode: WaitForFirstConsumer parameters: guaranteedReadWriteLatency: "true" # provider-specific Default StorageClassYou can mark a StorageClass as the default for your cluster. For instructions on setting the default StorageClass, see Change the default StorageClass.When a PVC does not specify a storageClassName, the default StorageClass is used.If you set the storageclass.kubernetes.io/is-default-class annotation to true on more than one StorageClass in your cluster, and you then create a PersistentVolumeClaim with no storageClassName set, Kubernetes uses the most recently created default StorageClass.Note:You should try to only have one StorageClass in your cluster that is marked as the default. The reason that Kubernetes allows you to have multiple default StorageClasses is to allow for seamless migration.You can create a PersistentVolumeClaim without specifying a storageClassName for the new PVC, and you can do so even when no default StorageClass exists in your cluster. In this case, the new PVC creates as you defined it, and the storageClassName of that PVC remains unset until a default becomes available.You can have a cluster without any default StorageClass. If you don't mark any StorageClass as default (and one hasn't been set for you by, for example, a cloud provider), then Kubernetes cannot apply that defaulting for PersistentVolumeClaims that need it.If or


Question: How does Storage Classes work?

Answer: Storage ClassesThis document describes the concept of a StorageClass in Kubernetes. Familiarity with volumes and persistent volumes is suggested.A StorageClass provides a way for administrators to describe the classes of storage they offer. Different classes might map to quality-of-service levels, or to backup policies, or to arbitrary policies determined by the cluster administrators. Kubernetes itself is unopinionated about what classes represent.The Kubernetes concept of a storage class is similar to “profiles” in some other storage system designs.StorageClass objectsEach StorageClass contains the fields provisioner, parameters, and reclaimPolicy, which are used when a PersistentVolume belonging to the class needs to be dynamically provisioned to satisfy a PersistentVolumeClaim (PVC).The name of a StorageClass object is significant, and is how users can request a particular class. Administrators set the name and other parameters of a class when first creating StorageClass objects.As an administrator, you can specify a default StorageClass that applies to any PVCs that don't request a specific class. For more details, see the PersistentVolumeClaim concept.Here's an example of a StorageClass:storage/storageclass-low-latency.yaml apiVersion: storage.k8s.io/v1 kind: StorageClass metadata: name: low-latency annotations: storageclass.kubernetes.io/is-default-class: "false" provisioner: csi-driver.example-vendor.example reclaimPolicy: Retain # default value is Delete allowVolumeExpansion: true mountOptions: - discard # this might enable UNMAP / TRIM at the block storage layer volumeBindingMode: WaitForFirstConsumer parameters: guaranteedReadWriteLatency: "true" # provider-specific Default StorageClassYou can mark a StorageClass as the default for your cluster. For instructions on setting the default StorageClass, see Change the default StorageClass.When a PVC does not specify a storageClassName, the default StorageClass is used.If you set the storageclass.kubernetes.io/is-default-class annotation to true on more than one StorageClass in your cluster, and you then create a PersistentVolumeClaim with no storageClassName set, Kubernetes uses the most recently created default StorageClass.Note:You should try to only have one StorageClass in your cluster that is marked as the default. The reason that Kubernetes allows you to have multiple default StorageClasses is to allow for seamless migration.You can create a PersistentVolumeClaim without specifying a storageClassName for the new PVC, and you can do so even when no default StorageClass exists in your cluster. In this case, the new PVC creates as you defined it, and the storageClassName of that PVC remains unset until a default becomes available.You can have a cluster without any default StorageClass. If you don't mark any StorageClass as default (and one hasn't been set for you by, for example, a cloud provider), then Kubernetes cannot apply that defaulting for PersistentVolumeClaims that need it.If or


Question: When would you use Storage Classes?

Answer: Storage ClassesThis document describes the concept of a StorageClass in Kubernetes. Familiarity with volumes and persistent volumes is suggested.A StorageClass provides a way for administrators to describe the classes of storage they offer. Different classes might map to quality-of-service levels, or to backup policies, or to arbitrary policies determined by the cluster administrators. Kubernetes itself is unopinionated about what classes represent.The Kubernetes concept of a storage class is similar to “profiles” in some other storage system designs.StorageClass objectsEach StorageClass contains the fields provisioner, parameters, and reclaimPolicy, which are used when a PersistentVolume belonging to the class needs to be dynamically provisioned to satisfy a PersistentVolumeClaim (PVC).The name of a StorageClass object is significant, and is how users can request a particular class. Administrators set the name and other parameters of a class when first creating StorageClass objects.As an administrator, you can specify a default StorageClass that applies to any PVCs that don't request a specific class. For more details, see the PersistentVolumeClaim concept.Here's an example of a StorageClass:storage/storageclass-low-latency.yaml apiVersion: storage.k8s.io/v1 kind: StorageClass metadata: name: low-latency annotations: storageclass.kubernetes.io/is-default-class: "false" provisioner: csi-driver.example-vendor.example reclaimPolicy: Retain # default value is Delete allowVolumeExpansion: true mountOptions: - discard # this might enable UNMAP / TRIM at the block storage layer volumeBindingMode: WaitForFirstConsumer parameters: guaranteedReadWriteLatency: "true" # provider-specific Default StorageClassYou can mark a StorageClass as the default for your cluster. For instructions on setting the default StorageClass, see Change the default StorageClass.When a PVC does not specify a storageClassName, the default StorageClass is used.If you set the storageclass.kubernetes.io/is-default-class annotation to true on more than one StorageClass in your cluster, and you then create a PersistentVolumeClaim with no storageClassName set, Kubernetes uses the most recently created default StorageClass.Note:You should try to only have one StorageClass in your cluster that is marked as the default. The reason that Kubernetes allows you to have multiple default StorageClasses is to allow for seamless migration.You can create a PersistentVolumeClaim without specifying a storageClassName for the new PVC, and you can do so even when no default StorageClass exists in your cluster. In this case, the new PVC creates as you defined it, and the storageClassName of that PVC remains unset until a default becomes available.You can have a cluster without any default StorageClass. If you don't mark any StorageClass as default (and one hasn't been set for you by, for example, a cloud provider), then Kubernetes cannot apply that defaulting for PersistentVolumeClaims that need it.If or


Question: What are the benefits of Storage Classes?

Answer: Storage ClassesThis document describes the concept of a StorageClass in Kubernetes. Familiarity with volumes and persistent volumes is suggested.A StorageClass provides a way for administrators to describe the classes of storage they offer. Different classes might map to quality-of-service levels, or to backup policies, or to arbitrary policies determined by the cluster administrators. Kubernetes itself is unopinionated about what classes represent.The Kubernetes concept of a storage class is similar to “profiles” in some other storage system designs.StorageClass objectsEach StorageClass contains the fields provisioner, parameters, and reclaimPolicy, which are used when a PersistentVolume belonging to the class needs to be dynamically provisioned to satisfy a PersistentVolumeClaim (PVC).The name of a StorageClass object is significant, and is how users can request a particular class. Administrators set the name and other parameters of a class when first creating StorageClass objects.As an administrator, you can specify a default StorageClass that applies to any PVCs that don't request a specific class. For more details, see the PersistentVolumeClaim concept.Here's an example of a StorageClass:storage/storageclass-low-latency.yaml apiVersion: storage.k8s.io/v1 kind: StorageClass metadata: name: low-latency annotations: storageclass.kubernetes.io/is-default-class: "false" provisioner: csi-driver.example-vendor.example reclaimPolicy: Retain # default value is Delete allowVolumeExpansion: true mountOptions: - discard # this might enable UNMAP / TRIM at the block storage layer volumeBindingMode: WaitForFirstConsumer parameters: guaranteedReadWriteLatency: "true" # provider-specific Default StorageClassYou can mark a StorageClass as the default for your cluster. For instructions on setting the default StorageClass, see Change the default StorageClass.When a PVC does not specify a storageClassName, the default StorageClass is used.If you set the storageclass.kubernetes.io/is-default-class annotation to true on more than one StorageClass in your cluster, and you then create a PersistentVolumeClaim with no storageClassName set, Kubernetes uses the most recently created default StorageClass.Note:You should try to only have one StorageClass in your cluster that is marked as the default. The reason that Kubernetes allows you to have multiple default StorageClasses is to allow for seamless migration.You can create a PersistentVolumeClaim without specifying a storageClassName for the new PVC, and you can do so even when no default StorageClass exists in your cluster. In this case, the new PVC creates as you defined it, and the storageClassName of that PVC remains unset until a default becomes available.You can have a cluster without any default StorageClass. If you don't mark any StorageClass as default (and one hasn't been set for you by, for example, a cloud provider), then Kubernetes cannot apply that defaulting for PersistentVolumeClaims that need it.If or


Question: What is Storage Classes?

Answer: T h i s   d o c u m e n t   d e s c r i b e s   t h e   c o n c e p t   o f   a   S t o r a g e C l a s s   i n   K u b e r n e t e s .   F a m i l i a r i t y   w i t h   v o l u m e s   a n d   p e r s i s t e n t   v o l u m e s   i s   s u g g e s t e d .   A   S t o r a g e C l a s s   p r o v i d e s   a   w a y   f o r   a d m i n i s t r a t o r s   t o   d e s c r i b e   t h e   c l a s s e s   o f   s t o r a g e   t h e y   o f f e r .   D i f f e r e n t   c l a s s e s   m i g h t   m a p   t o   q u a l i t y - o f - s e r v i c e   l e v e l s ,   o r   t o   b a c k u p   p o l i c i e s ,   o r   t o   a r b i t r a r y   p o l i c i e s   d e t e r m i n e d   b y   t h e   c l u s t e r   a d m i n i s t r a t o r s .   K u b e r n e t e s   i t s e l f   i s   u n o p i n i o n a t e d   a b o u t   w h a t   c l a s s e s   r e p r e s e n t .   T h e   K u b e r n e t e s   c o n c e p t   o f   a   s t o r a g e   c l a s s   i s   s i m i l a r   t o   “ p r o f i l e s ”   i n   s o m e   o t h e r   s t o r a g e   s y s t e m   d e s i g n s .


Question: What is StorageClass objects?

Answer: E a c h   S t o r a g e C l a s s   c o n t a i n s   t h e   f i e l d s   p r o v i s i o n e r ,   p a r a m e t e r s ,   a n d   r e c l a i m P o l i c y ,   w h i c h   a r e   u s e d   w h e n   a   P e r s i s t e n t V o l u m e   b e l o n g i n g   t o   t h e   c l a s s   n e e d s   t o   b e   d y n a m i c a l l y   p r o v i s i o n e d   t o   s a t i s f y   a   P e r s i s t e n t V o l u m e C l a i m   ( P V C ) .   T h e   n a m e   o f   a   S t o r a g e C l a s s   o b j e c t   i s   s i g n i f i c a n t ,   a n d   i s   h o w   u s e r s   c a n   r e q u e s t   a   p a r t i c u l a r   c l a s s .   A d m i n i s t r a t o r s   s e t   t h e   n a m e   a n d   o t h e r   p a r a m e t e r s   o f   a   c l a s s   w h e n   f i r s t   c r e a t i n g   S t o r a g e C l a s s   o b j e c t s .   A s   a n   a d m i n i s t r a t o r ,   y o u   c a n   s p e c i f y   a   d e f a u l t   S t o r a g e C l a s s   t h a t   a p p l i e s   t o   a n y   P V C s   t h a t   d o n ' t   r e q u e s t   a   s p e c i f i c   c l a s s .   F o r   m o r e   d e t a i l s ,   s e e   t h e   P e r s i s t e n t V o l u m e C l a i m   c o n c e p t .   H e r e ' s   a n   e x a m p l e   o f   a   S t o r a g e C l a s s :   a p i V e r s i o n :   s t o r a g e . k 8 s . i o / v 1   k i n d :   S t o r a g e C l a s s   m e t a d a t a :   n a m e :   l o w - l a t e n c y   a n n o t a t i o n s :   s t o r a g e c l a s s . k u b e r n e t e s . i o / i s - d e f a u l t - c l a s s :   " f a l s e "   p r o v i s i o n e r :   c s i - d r i v e r . e x a m p l e - v e n d o r . e x a m p l e   r e c l a i m P o l i c y :   R e t a i n   #   d e f a u l t   v a l u e   i s   D e l e t e   a l l o w V o l u m e E x p a n s i o n :   t r u e   m o u n t O p t i o n s :   -   d i s c a r d   #   t h i s   m i g h t   e n a b l e   U N M A P   /   T R I M   a t   t h e   b l o c k   s t o r a g e   l a y e r   v o l u m e B i n d i n


Question: What is Default StorageClass?

Answer: Y o u   c a n   m a r k   a   S t o r a g e C l a s s   a s   t h e   d e f a u l t   f o r   y o u r   c l u s t e r .   F o r   i n s t r u c t i o n s   o n   s e t t i n g   t h e   d e f a u l t   S t o r a g e C l a s s ,   s e e   C h a n g e   t h e   d e f a u l t   S t o r a g e C l a s s .   W h e n   a   P V C   d o e s   n o t   s p e c i f y   a   s t o r a g e C l a s s N a m e ,   t h e   d e f a u l t   S t o r a g e C l a s s   i s   u s e d .   I f   y o u   s e t   t h e   s t o r a g e c l a s s . k u b e r n e t e s . i o / i s - d e f a u l t - c l a s s   a n n o t a t i o n   t o   t r u e   o n   m o r e   t h a n   o n e   S t o r a g e C l a s s   i n   y o u r   c l u s t e r ,   a n d   y o u   t h e n   c r e a t e   a   P e r s i s t e n t V o l u m e C l a i m   w i t h   n o   s t o r a g e C l a s s N a m e   s e t ,   K u b e r n e t e s   u s e s   t h e   m o s t   r e c e n t l y   c r e a t e d   d e f a u l t   S t o r a g e C l a s s .


Question: What is Note:?

Answer: Y o u   c a n   c r e a t e   a   P e r s i s t e n t V o l u m e C l a i m   w i t h o u t   s p e c i f y i n g   a   s t o r a g e C l a s s N a m e   f o r   t h e   n e w   P V C ,   a n d   y o u   c a n   d o   s o   e v e n   w h e n   n o   d e f a u l t   S t o r a g e C l a s s   e x i s t s   i n   y o u r   c l u s t e r .   I n   t h i s   c a s e ,   t h e   n e w   P V C   c r e a t e s   a s   y o u   d e f i n e d   i t ,   a n d   t h e   s t o r a g e C l a s s N a m e   o f   t h a t   P V C   r e m a i n s   u n s e t   u n t i l   a   d e f a u l t   b e c o m e s   a v a i l a b l e .   Y o u   c a n   h a v e   a   c l u s t e r   w i t h o u t   a n y   d e f a u l t   S t o r a g e C l a s s .   I f   y o u   d o n ' t   m a r k   a n y   S t o r a g e C l a s s   a s   d e f a u l t   ( a n d   o n e   h a s n ' t   b e e n   s e t   f o r   y o u   b y ,   f o r   e x a m p l e ,   a   c l o u d   p r o v i d e r ) ,   t h e n   K u b e r n e t e s   c a n n o t   a p p l y   t h a t   d e f a u l t i n g   f o r   P e r s i s t e n t V o l u m e C l a i m s   t h a t   n e e d   i t .   I f   o r   w h e n   a   d e f a u l t   S t o r a g e C l a s s   b e c o m e s   a v a i l a b l e ,   t h e   c o n t r o l   p l a n e   i d e n t i f i e s   a n y   e x i s t i n g   P V C s   w i t h o u t   s t o r a g e C l a s s N a m e .   F o r   t h e   P V C s   t h a t   e i t h e r   h a v e   a n   e m p t y   v a l u e   f o r   s t o r a g e C l a s s N a m e   o r   d o   n o t   h a v e   t h i s   k e y ,   t h e   c o n t r o l   p l a n e   t h e n   u p d a t e s   t h o s e   P V C s   t o   s e t   s t o r a g e C l a s s N a m e   t o   m a t c h   t h e   n e w   d e f a u l t   S t o r a g e C l a s s .   I f   y o u   h a v e   a n   e x i s t i n g   P V C   w h e r e   t h e   s t o r a g e C l a s s N a m e   i s   " " ,   a n d   y o u   c o n f i g u r e   a   d e f a u l t   S t o r a g e C l a s s ,   t h e n   t h


Question: What is Provisioner?

Answer: E a c h   S t o r a g e C l a s s   h a s   a   p r o v i s i o n e r   t h a t   d e t e r m i n e s   w h a t   v o l u m e   p l u g i n   i s   u s e d   f o r   p r o v i s i o n i n g   P V s .   T h i s   f i e l d   m u s t   b e   s p e c i f i e d .   Y o u   a r e   n o t   r e s t r i c t e d   t o   s p e c i f y i n g   t h e   " i n t e r n a l "   p r o v i s i o n e r s   l i s t e d   h e r e   ( w h o s e   n a m e s   a r e   p r e f i x e d   w i t h   " k u b e r n e t e s . i o "   a n d   s h i p p e d   a l o n g s i d e   K u b e r n e t e s ) .   Y o u   c a n   a l s o   r u n   a n d   s p e c i f y   e x t e r n a l   p r o v i s i o n e r s ,   w h i c h   a r e   i n d e p e n d e n t   p r o g r a m s   t h a t   f o l l o w   a   s p e c i f i c a t i o n   d e f i n e d   b y   K u b e r n e t e s .   A u t h o r s   o f   e x t e r n a l   p r o v i s i o n e r s   h a v e   f u l l   d i s c r e t i o n   o v e r   w h e r e   t h e i r   c o d e   l i v e s ,   h o w   t h e   p r o v i s i o n e r   i s   s h i p p e d ,   h o w   i t   n e e d s   t o   b e   r u n ,   w h a t   v o l u m e   p l u g i n   i t   u s e s   ( i n c l u d i n g   F l e x ) ,   e t c .   T h e   r e p o s i t o r y   k u b e r n e t e s - s i g s / s i g - s t o r a g e - l i b - e x t e r n a l - p r o v i s i o n e r   h o u s e s   a   l i b r a r y   f o r   w r i t i n g   e x t e r n a l   p r o v i s i o n e r s   t h a t   i m p l e m e n t s   t h e   b u l k   o f   t h e   s p e c i f i c a t i o n .   S o m e   e x t e r n a l   p r o v i s i o n e r s   a r e   l i s t e d   u n d e r   t h e   r e p o s i t o r y   k u b e r n e t e s - s i g s / s i g - s t o r a g e - l i b - e x t e r n a l - p r o v i s i o n e r .   F o r   e x a m p l e ,   N F S   d o e s n ' t   p r o v i d e   a n   i n t e r n a l   p r o v i s i o n e r ,   b u t   a n   e x t e r n a l   p r o v i s i o n e r   c a n   b e   u s e d .   T h e r e   a r e


Question: What is Reclaim policy?

Answer: P e r s i s t e n t V o l u m e s   t h a t   a r e   d y n a m i c a l l y   c r e a t e d   b y   a   S t o r a g e C l a s s   w i l l   h a v e   t h e   r e c l a i m   p o l i c y   s p e c i f i e d   i n   t h e   r e c l a i m P o l i c y   f i e l d   o f   t h e   c l a s s ,   w h i c h   c a n   b e   e i t h e r   D e l e t e   o r   R e t a i n .   I f   n o   r e c l a i m P o l i c y   i s   s p e c i f i e d   w h e n   a   S t o r a g e C l a s s   o b j e c t   i s   c r e a t e d ,   i t   w i l l   d e f a u l t   t o   D e l e t e .   P e r s i s t e n t V o l u m e s   t h a t   a r e   c r e a t e d   m a n u a l l y   a n d   m a n a g e d   v i a   a   S t o r a g e C l a s s   w i l l   h a v e   w h a t e v e r   r e c l a i m   p o l i c y   t h e y   w e r e   a s s i g n e d   a t   c r e a t i o n .


Question: What is Volume expansion?

Answer: P e r s i s t e n t V o l u m e s   c a n   b e   c o n f i g u r e d   t o   b e   e x p a n d a b l e .   T h i s   a l l o w s   y o u   t o   r e s i z e   t h e   v o l u m e   b y   e d i t i n g   t h e   c o r r e s p o n d i n g   P V C   o b j e c t ,   r e q u e s t i n g   a   n e w   l a r g e r   a m o u n t   o f   s t o r a g e .   T h e   f o l l o w i n g   t y p e s   o f   v o l u m e s   s u p p o r t   v o l u m e   e x p a n s i o n ,   w h e n   t h e   u n d e r l y i n g   S t o r a g e C l a s s   h a s   t h e   f i e l d   a l l o w V o l u m e E x p a n s i o n   s e t   t o   t r u e .


Question: What is Mount options?

Answer: P e r s i s t e n t V o l u m e s   t h a t   a r e   d y n a m i c a l l y   c r e a t e d   b y   a   S t o r a g e C l a s s   w i l l   h a v e   t h e   m o u n t   o p t i o n s   s p e c i f i e d   i n   t h e   m o u n t O p t i o n s   f i e l d   o f   t h e   c l a s s .   I f   t h e   v o l u m e   p l u g i n   d o e s   n o t   s u p p o r t   m o u n t   o p t i o n s   b u t   m o u n t   o p t i o n s   a r e   s p e c i f i e d ,   p r o v i s i o n i n g   w i l l   f a i l .   M o u n t   o p t i o n s   a r e   n o t   v a l i d a t e d   o n   e i t h e r   t h e   c l a s s   o r   P V .   I f   a   m o u n t   o p t i o n   i s   i n v a l i d ,   t h e   P V   m o u n t   f a i l s .


Question: What is Volume binding mode?

Answer: T h e   v o l u m e B i n d i n g M o d e   f i e l d   c o n t r o l s   w h e n   v o l u m e   b i n d i n g   a n d   d y n a m i c   p r o v i s i o n i n g   s h o u l d   o c c u r .   W h e n   u n s e t ,   I m m e d i a t e   m o d e   i s   u s e d   b y   d e f a u l t .   T h e   I m m e d i a t e   m o d e   i n d i c a t e s   t h a t   v o l u m e   b i n d i n g   a n d   d y n a m i c   p r o v i s i o n i n g   o c c u r s   o n c e   t h e   P e r s i s t e n t V o l u m e C l a i m   i s   c r e a t e d .   F o r   s t o r a g e   b a c k e n d s   t h a t   a r e   t o p o l o g y - c o n s t r a i n e d   a n d   n o t   g l o b a l l y   a c c e s s i b l e   f r o m   a l l   N o d e s   i n   t h e   c l u s t e r ,   P e r s i s t e n t V o l u m e s   w i l l   b e   b o u n d   o r   p r o v i s i o n e d   w i t h o u t   k n o w l e d g e   o f   t h e   P o d ' s   s c h e d u l i n g   r e q u i r e m e n t s .   T h i s   m a y   r e s u l t   i n   u n s c h e d u l a b l e   P o d s .   A   c l u s t e r   a d m i n i s t r a t o r   c a n   a d d r e s s   t h i s   i s s u e   b y   s p e c i f y i n g   t h e   W a i t F o r F i r s t C o n s u m e r   m o d e   w h i c h   w i l l   d e l a y   t h e   b i n d i n g   a n d   p r o v i s i o n i n g   o f   a   P e r s i s t e n t V o l u m e   u n t i l   a   P o d   u s i n g   t h e   P e r s i s t e n t V o l u m e C l a i m   i s   c r e a t e d .   P e r s i s t e n t V o l u m e s   w i l l   b e   s e l e c t e d   o r   p r o v i s i o n e d   c o n f o r m i n g   t o   t h e   t o p o l o g y   t h a t   i s   s p e c i f i e d   b y   t h e   P o d ' s   s c h e d u l i n g   c o n s t r a i n t s .   T h e s e   i n c l u d e ,   b u t   a r e   n o t   l i m i t e d   t o ,   r e s o u r c e   r e q u i r e m e n t s ,   n o d e   s e l e c t o r s ,   p o d   a f f i n i t y   a n d   a n t i - a f f i n i t y ,   a n d   t a i n t s   a n d   t o l e r a t i o


Question: What is Note:?

Answer: I f   y o u   c h o o s e   t o   u s e   W a i t F o r F i r s t C o n s u m e r ,   d o   n o t   u s e   n o d e N a m e   i n   t h e   P o d   s p e c   t o   s p e c i f y   n o d e   a f f i n i t y .   I f   n o d e N a m e   i s   u s e d   i n   t h i s   c a s e ,   t h e   s c h e d u l e r   w i l l   b e   b y p a s s e d   a n d   P V C   w i l l   r e m a i n   i n   p e n d i n g   s t a t e .   I n s t e a d ,   y o u   c a n   u s e   n o d e   s e l e c t o r   f o r   k u b e r n e t e s . i o / h o s t n a m e :   a p i V e r s i o n :   v 1   k i n d :   P o d   m e t a d a t a :   n a m e :   t a s k - p v - p o d   s p e c :   n o d e S e l e c t o r :   k u b e r n e t e s . i o / h o s t n a m e :   k u b e - 0 1   v o l u m e s :   -   n a m e :   t a s k - p v - s t o r a g e   p e r s i s t e n t V o l u m e C l a i m :   c l a i m N a m e :   t a s k - p v - c l a i m   c o n t a i n e r s :   -   n a m e :   t a s k - p v - c o n t a i n e r   i m a g e :   n g i n x   p o r t s :   -   c o n t a i n e r P o r t :   8 0   n a m e :   " h t t p - s e r v e r "   v o l u m e M o u n t s :   -   m o u n t P a t h :   " / u s r / s h a r e / n g i n x / h t m l "   n a m e :   t a s k - p v - s t o r a g e


Question: What is Allowed topologies?

Answer: W h e n   a   c l u s t e r   o p e r a t o r   s p e c i f i e s   t h e   W a i t F o r F i r s t C o n s u m e r   v o l u m e   b i n d i n g   m o d e ,   i t   i s   n o   l o n g e r   n e c e s s a r y   t o   r e s t r i c t   p r o v i s i o n i n g   t o   s p e c i f i c   t o p o l o g i e s   i n   m o s t   s i t u a t i o n s .   H o w e v e r ,   i f   s t i l l   r e q u i r e d ,   a l l o w e d T o p o l o g i e s   c a n   b e   s p e c i f i e d .   T h i s   e x a m p l e   d e m o n s t r a t e s   h o w   t o   r e s t r i c t   t h e   t o p o l o g y   o f   p r o v i s i o n e d   v o l u m e s   t o   s p e c i f i c   z o n e s   a n d   s h o u l d   b e   u s e d   a s   a   r e p l a c e m e n t   f o r   t h e   z o n e   a n d   z o n e s   p a r a m e t e r s   f o r   t h e   s u p p o r t e d   p l u g i n s .   a p i V e r s i o n :   s t o r a g e . k 8 s . i o / v 1   k i n d :   S t o r a g e C l a s s   m e t a d a t a :   n a m e :   s t a n d a r d   p r o v i s i o n e r :   e x a m p l e . c o m / e x a m p l e   p a r a m e t e r s :   t y p e :   p d - s t a n d a r d   v o l u m e B i n d i n g M o d e :   W a i t F o r F i r s t C o n s u m e r   a l l o w e d T o p o l o g i e s :   -   m a t c h L a b e l E x p r e s s i o n s :   -   k e y :   t o p o l o g y . k u b e r n e t e s . i o / z o n e   v a l u e s :   -   u s - c e n t r a l - 1 a   -   u s - c e n t r a l - 1 b


Question: What is Parameters?

Answer: S t o r a g e C l a s s e s   h a v e   p a r a m e t e r s   t h a t   d e s c r i b e   v o l u m e s   b e l o n g i n g   t o   t h e   s t o r a g e   c l a s s .   D i f f e r e n t   p a r a m e t e r s   m a y   b e   a c c e p t e d   d e p e n d i n g   o n   t h e   p r o v i s i o n e r .   W h e n   a   p a r a m e t e r   i s   o m i t t e d ,   s o m e   d e f a u l t   i s   u s e d .   T h e r e   c a n   b e   a t   m o s t   5 1 2   p a r a m e t e r s   d e f i n e d   f o r   a   S t o r a g e C l a s s .   T h e   t o t a l   l e n g t h   o f   t h e   p a r a m e t e r s   o b j e c t   i n c l u d i n g   i t s   k e y s   a n d   v a l u e s   c a n n o t   e x c e e d   2 5 6   K i B .


Question: What is AWS EBS?

Answer: K u b e r n e t e s   1 . 3 4   d o e s   n o t   i n c l u d e   a   a w s E l a s t i c B l o c k S t o r e   v o l u m e   t y p e .   T h e   A W S E l a s t i c B l o c k S t o r e   i n - t r e e   s t o r a g e   d r i v e r   w a s   d e p r e c a t e d   i n   t h e   K u b e r n e t e s   v 1 . 1 9   r e l e a s e   a n d   t h e n   r e m o v e d   e n t i r e l y   i n   t h e   v 1 . 2 7   r e l e a s e .   T h e   K u b e r n e t e s   p r o j e c t   s u g g e s t s   t h a t   y o u   u s e   t h e   A W S   E B S   o u t - o f - t r e e   s t o r a g e   d r i v e r   i n s t e a d .   H e r e   i s   a n   e x a m p l e   S t o r a g e C l a s s   f o r   t h e   A W S   E B S   C S I   d r i v e r :   a p i V e r s i o n :   s t o r a g e . k 8 s . i o / v 1   k i n d :   S t o r a g e C l a s s   m e t a d a t a :   n a m e :   e b s - s c   p r o v i s i o n e r :   e b s . c s i . a w s . c o m   v o l u m e B i n d i n g M o d e :   W a i t F o r F i r s t C o n s u m e r   p a r a m e t e r s :   c s i . s t o r a g e . k 8 s . i o / f s t y p e :   x f s   t y p e :   i o 1   i o p s P e r G B :   " 5 0 "   e n c r y p t e d :   " t r u e "   t a g S p e c i f i c a t i o n _ 1 :   " k e y 1 = v a l u e 1 "   t a g S p e c i f i c a t i o n _ 2 :   " k e y 2 = v a l u e 2 "   a l l o w e d T o p o l o g i e s :   -   m a t c h L a b e l E x p r e s s i o n s :   -   k e y :   t o p o l o g y . e b s . c s i . a w s . c o m / z o n e   v a l u e s :   -   u s - e a s t - 2 c   t a g S p e c i f i c a t i o n :   T a g s   w i t h   t h i s   p r e f i x   a r e   a p p l i e d   t o   d y n a m i c a l l y   p r o v i s i o n e d   E B S   v o l u m e s .


Question: What is AWS EFS?

Answer: T o   c o n f i g u r e   A W S   E F S   s t o r a g e ,   y o u   c a n   u s e   t h e   o u t - o f - t r e e   A W S _ E F S _ C S I _ D R I V E R .   k i n d :   S t o r a g e C l a s s   a p i V e r s i o n :   s t o r a g e . k 8 s . i o / v 1   m e t a d a t a :   n a m e :   e f s - s c   p r o v i s i o n e r :   e f s . c s i . a w s . c o m   p a r a m e t e r s :   p r o v i s i o n i n g M o d e :   e f s - a p   f i l e S y s t e m I d :   f s - 9 2 1 0 7 4 1 0   d i r e c t o r y P e r m s :   " 7 0 0 "   p r o v i s i o n i n g M o d e :   T h e   t y p e   o f   v o l u m e   t o   b e   p r o v i s i o n e d   b y   A m a z o n   E F S .   C u r r e n t l y ,   o n l y   a c c e s s   p o i n t   b a s e d   p r o v i s i o n i n g   i s   s u p p o r t e d   ( e f s - a p ) . f i l e S y s t e m I d :   T h e   f i l e   s y s t e m   u n d e r   w h i c h   t h e   a c c e s s   p o i n t   i s   c r e a t e d . d i r e c t o r y P e r m s :   T h e   d i r e c t o r y   p e r m i s s i o n s   o f   t h e   r o o t   d i r e c t o r y   c r e a t e d   b y   t h e   a c c e s s   p o i n t .   F o r   m o r e   d e t a i l s ,   r e f e r   t o   t h e   A W S _ E F S _ C S I _ D r i v e r   D y n a m i c   P r o v i s i o n i n g   d o c u m e n t a t i o n .


Question: What is NFS?

Answer: T o   c o n f i g u r e   N F S   s t o r a g e ,   y o u   c a n   u s e   t h e   i n - t r e e   d r i v e r   o r   t h e   N F S   C S I   d r i v e r   f o r   K u b e r n e t e s   ( r e c o m m e n d e d ) .   a p i V e r s i o n :   s t o r a g e . k 8 s . i o / v 1   k i n d :   S t o r a g e C l a s s   m e t a d a t a :   n a m e :   e x a m p l e - n f s   p r o v i s i o n e r :   e x a m p l e . c o m / e x t e r n a l - n f s   p a r a m e t e r s :   s e r v e r :   n f s - s e r v e r . e x a m p l e . c o m   p a t h :   / s h a r e   r e a d O n l y :   " f a l s e "   s e r v e r :   S e r v e r   i s   t h e   h o s t n a m e   o r   I P   a d d r e s s   o f   t h e   N F S   s e r v e r . p a t h :   P a t h   t h a t   i s   e x p o r t e d   b y   t h e   N F S   s e r v e r . r e a d O n l y :   A   f l a g   i n d i c a t i n g   w h e t h e r   t h e   s t o r a g e   w i l l   b e   m o u n t e d   a s   r e a d   o n l y   ( d e f a u l t   f a l s e ) .   K u b e r n e t e s   d o e s n ' t   i n c l u d e   a n   i n t e r n a l   N F S   p r o v i s i o n e r .   Y o u   n e e d   t o   u s e   a n   e x t e r n a l   p r o v i s i o n e r   t o   c r e a t e   a   S t o r a g e C l a s s   f o r   N F S .   H e r e   a r e   s o m e   e x a m p l e s :   N F S   G a n e s h a   s e r v e r   a n d   e x t e r n a l   p r o v i s i o n e r N F S   s u b d i r   e x t e r n a l   p r o v i s i o n e r


Question: What is vSphere?

Answer: T h e r e   a r e   t w o   t y p e s   o f   p r o v i s i o n e r s   f o r   v S p h e r e   s t o r a g e   c l a s s e s :   C S I   p r o v i s i o n e r :   c s i . v s p h e r e . v m w a r e . c o m v C P   p r o v i s i o n e r :   k u b e r n e t e s . i o / v s p h e r e - v o l u m e   I n - t r e e   p r o v i s i o n e r s   a r e   d e p r e c a t e d .   F o r   m o r e   i n f o r m a t i o n   o n   t h e   C S I   p r o v i s i o n e r ,   s e e   K u b e r n e t e s   v S p h e r e   C S I   D r i v e r   a n d   v S p h e r e V o l u m e   C S I   m i g r a t i o n .


Question: What is CSI Provisioner?

Answer: T h e   v S p h e r e   C S I   S t o r a g e C l a s s   p r o v i s i o n e r   w o r k s   w i t h   T a n z u   K u b e r n e t e s   c l u s t e r s .   F o r   a n   e x a m p l e ,   r e f e r   t o   t h e   v S p h e r e   C S I   r e p o s i t o r y .


Question: What is vCP Provisioner?

Answer: T h e   f o l l o w i n g   e x a m p l e s   u s e   t h e   V M w a r e   C l o u d   P r o v i d e r   ( v C P )   S t o r a g e C l a s s   p r o v i s i o n e r .   C r e a t e   a   S t o r a g e C l a s s   w i t h   a   u s e r   s p e c i f i e d   d i s k   f o r m a t . a p i V e r s i o n :   s t o r a g e . k 8 s . i o / v 1   k i n d :   S t o r a g e C l a s s   m e t a d a t a :   n a m e :   f a s t   p r o v i s i o n e r :   k u b e r n e t e s . i o / v s p h e r e - v o l u m e   p a r a m e t e r s :   d i s k f o r m a t :   z e r o e d t h i c k   d i s k f o r m a t :   t h i n ,   z e r o e d t h i c k   a n d   e a g e r z e r o e d t h i c k .   D e f a u l t :   " t h i n " . C r e a t e   a   S t o r a g e C l a s s   w i t h   a   d i s k   f o r m a t   o n   a   u s e r   s p e c i f i e d   d a t a s t o r e . a p i V e r s i o n :   s t o r a g e . k 8 s . i o / v 1   k i n d :   S t o r a g e C l a s s   m e t a d a t a :   n a m e :   f a s t   p r o v i s i o n e r :   k u b e r n e t e s . i o / v s p h e r e - v o l u m e   p a r a m e t e r s :   d i s k f o r m a t :   z e r o e d t h i c k   d a t a s t o r e :   V S A N D a t a s t o r e   d a t a s t o r e :   T h e   u s e r   c a n   a l s o   s p e c i f y   t h e   d a t a s t o r e   i n   t h e   S t o r a g e C l a s s .   T h e   v o l u m e   w i l l   b e   c r e a t e d   o n   t h e   d a t a s t o r e   s p e c i f i e d   i n   t h e   S t o r a g e C l a s s ,   w h i c h   i n   t h i s   c a s e   i s   V S A N D a t a s t o r e .   T h i s   f i e l d   i s   o p t i o n a l .   I f   t h e   d a t a s t o r e   i s   n o t   s p e c i f i e d ,   t h e n   t h e   v o l u m e   w i l l   b e   c r e a t e d   o n   t h e   d a t a s t o r e   s p e c i f i e d   i n   t h e   v S p h e r e   c o n f i g   f i l e   u s e d   t o   i n i t i a l i z e   t h e   v S p h e r e   C l o u d   P r o v i d e r . S t o r a g e   P o l i c y   M a n a g e m e n


Question: What is Note:?

Answer: T h i s   i n t e r n a l   p r o v i s i o n e r   o f   C e p h   R B D   i s   d e p r e c a t e d .   P l e a s e   u s e   C e p h F S   R B D   C S I   d r i v e r .   a p i V e r s i o n :   s t o r a g e . k 8 s . i o / v 1   k i n d :   S t o r a g e C l a s s   m e t a d a t a :   n a m e :   f a s t   p r o v i s i o n e r :   k u b e r n e t e s . i o / r b d   #   T h i s   p r o v i s i o n e r   i s   d e p r e c a t e d   p a r a m e t e r s :   m o n i t o r s :   1 9 8 . 1 9 . 2 5 4 . 1 0 5 : 6 7 8 9   a d m i n I d :   k u b e   a d m i n S e c r e t N a m e :   c e p h - s e c r e t   a d m i n S e c r e t N a m e s p a c e :   k u b e - s y s t e m   p o o l :   k u b e   u s e r I d :   k u b e   u s e r S e c r e t N a m e :   c e p h - s e c r e t - u s e r   u s e r S e c r e t N a m e s p a c e :   d e f a u l t   f s T y p e :   e x t 4   i m a g e F o r m a t :   " 2 "   i m a g e F e a t u r e s :   " l a y e r i n g "   m o n i t o r s :   C e p h   m o n i t o r s ,   c o m m a   d e l i m i t e d .   T h i s   p a r a m e t e r   i s   r e q u i r e d . a d m i n I d :   C e p h   c l i e n t   I D   t h a t   i s   c a p a b l e   o f   c r e a t i n g   i m a g e s   i n   t h e   p o o l .   D e f a u l t   i s   " a d m i n " . a d m i n S e c r e t N a m e :   S e c r e t   N a m e   f o r   a d m i n I d .   T h i s   p a r a m e t e r   i s   r e q u i r e d .   T h e   p r o v i d e d   s e c r e t   m u s t   h a v e   t y p e   " k u b e r n e t e s . i o / r b d " . a d m i n S e c r e t N a m e s p a c e :   T h e   n a m e s p a c e   f o r   a d m i n S e c r e t N a m e .   D e f a u l t   i s   " d e f a u l t " . p o o l :   C e p h   R B D   p o o l .   D e f a u l t   i s   " r b d " . u s e r I d :   C e p h   c l i e n t   I D   t h a t   i s   u s e d   t o   m a p   t h e   R B D   i m a g e .   D e f a u l t   i s   t h e   s a m e   a s   a d m i n I d . u s e r S e c r e t N a m e :   T h e   n a m e   o f


Question: What is Azure Disk?

Answer: K u b e r n e t e s   1 . 3 4   d o e s   n o t   i n c l u d e   a   a z u r e D i s k   v o l u m e   t y p e .   T h e   a z u r e D i s k   i n - t r e e   s t o r a g e   d r i v e r   w a s   d e p r e c a t e d   i n   t h e   K u b e r n e t e s   v 1 . 1 9   r e l e a s e   a n d   t h e n   r e m o v e d   e n t i r e l y   i n   t h e   v 1 . 2 7   r e l e a s e .   T h e   K u b e r n e t e s   p r o j e c t   s u g g e s t s   t h a t   y o u   u s e   t h e   A z u r e   D i s k   t h i r d   p a r t y   s t o r a g e   d r i v e r   i n s t e a d .


Question: What is Azure File (deprecated)?

Answer: a p i V e r s i o n :   s t o r a g e . k 8 s . i o / v 1   k i n d :   S t o r a g e C l a s s   m e t a d a t a :   n a m e :   a z u r e f i l e   p r o v i s i o n e r :   k u b e r n e t e s . i o / a z u r e - f i l e   p a r a m e t e r s :   s k u N a m e :   S t a n d a r d _ L R S   l o c a t i o n :   e a s t u s   s t o r a g e A c c o u n t :   a z u r e _ s t o r a g e _ a c c o u n t _ n a m e   #   e x a m p l e   v a l u e   s k u N a m e :   A z u r e   s t o r a g e   a c c o u n t   S K U   t i e r .   D e f a u l t   i s   e m p t y . l o c a t i o n :   A z u r e   s t o r a g e   a c c o u n t   l o c a t i o n .   D e f a u l t   i s   e m p t y . s t o r a g e A c c o u n t :   A z u r e   s t o r a g e   a c c o u n t   n a m e .   D e f a u l t   i s   e m p t y .   I f   a   s t o r a g e   a c c o u n t   i s   n o t   p r o v i d e d ,   a l l   s t o r a g e   a c c o u n t s   a s s o c i a t e d   w i t h   t h e   r e s o u r c e   g r o u p   a r e   s e a r c h e d   t o   f i n d   o n e   t h a t   m a t c h e s   s k u N a m e   a n d   l o c a t i o n .   I f   a   s t o r a g e   a c c o u n t   i s   p r o v i d e d ,   i t   m u s t   r e s i d e   i n   t h e   s a m e   r e s o u r c e   g r o u p   a s   t h e   c l u s t e r ,   a n d   s k u N a m e   a n d   l o c a t i o n   a r e   i g n o r e d . s e c r e t N a m e s p a c e :   t h e   n a m e s p a c e   o f   t h e   s e c r e t   t h a t   c o n t a i n s   t h e   A z u r e   S t o r a g e   A c c o u n t   N a m e   a n d   K e y .   D e f a u l t   i s   t h e   s a m e   a s   t h e   P o d . s e c r e t N a m e :   t h e   n a m e   o f   t h e   s e c r e t   t h a t   c o n t a i n s   t h e   A z u r e   S t o r a g e   A c c o u n t   N a m e   a n d   K e y .   D e f a u l t   i s   a z u r e - s t o r a g e - a c c o u n t - < a c c o u n t N a m e > - s e c r e t r e a d O n l y :   a   f l a g   i n d i c a t i n g   w h e t h e r   t h e   s t o


Question: What is Portworx volume (deprecated)?

Answer: a p i V e r s i o n :   s t o r a g e . k 8 s . i o / v 1   k i n d :   S t o r a g e C l a s s   m e t a d a t a :   n a m e :   p o r t w o r x - i o - p r i o r i t y - h i g h   p r o v i s i o n e r :   k u b e r n e t e s . i o / p o r t w o r x - v o l u m e   #   T h i s   p r o v i s i o n e r   i s   d e p r e c a t e d   p a r a m e t e r s :   r e p l :   " 1 "   s n a p _ i n t e r v a l :   " 7 0 "   p r i o r i t y _ i o :   " h i g h "   f s :   f i l e s y s t e m   t o   b e   l a i d   o u t :   n o n e / x f s / e x t 4   ( d e f a u l t :   e x t 4 ) . b l o c k _ s i z e :   b l o c k   s i z e   i n   K b y t e s   ( d e f a u l t :   3 2 ) . r e p l :   n u m b e r   o f   s y n c h r o n o u s   r e p l i c a s   t o   b e   p r o v i d e d   i n   t h e   f o r m   o f   r e p l i c a t i o n   f a c t o r   1 . . 3   ( d e f a u l t :   1 )   A   s t r i n g   i s   e x p e c t e d   h e r e   i . e .   " 1 "   a n d   n o t   1 . p r i o r i t y _ i o :   d e t e r m i n e s   w h e t h e r   t h e   v o l u m e   w i l l   b e   c r e a t e d   f r o m   h i g h e r   p e r f o r m a n c e   o r   a   l o w e r   p r i o r i t y   s t o r a g e   h i g h / m e d i u m / l o w   ( d e f a u l t :   l o w ) . s n a p _ i n t e r v a l :   c l o c k / t i m e   i n t e r v a l   i n   m i n u t e s   f o r   w h e n   t o   t r i g g e r   s n a p s h o t s .   S n a p s h o t s   a r e   i n c r e m e n t a l   b a s e d   o n   d i f f e r e n c e   w i t h   t h e   p r i o r   s n a p s h o t ,   0   d i s a b l e s   s n a p s   ( d e f a u l t :   0 ) .   A   s t r i n g   i s   e x p e c t e d   h e r e   i . e .   " 7 0 "   a n d   n o t   7 0 . a g g r e g a t i o n _ l e v e l :   s p e c i f i e s   t h e   n u m b e r   o f   c h u n k s   t h e   v o l u m e   w o u l d   b e   d i s t r i b u t e d   i n t o ,   0   i n d i c a t e s   a   n o n - a g g r e g a t e d   v o l u m e   ( d e f a u l t :   0 ) .   A   s t r i n g


Question: What is Local?

Answer: a p i V e r s i o n :   s t o r a g e . k 8 s . i o / v 1   k i n d :   S t o r a g e C l a s s   m e t a d a t a :   n a m e :   l o c a l - s t o r a g e   p r o v i s i o n e r :   k u b e r n e t e s . i o / n o - p r o v i s i o n e r   #   i n d i c a t e s   t h a t   t h i s   S t o r a g e C l a s s   d o e s   n o t   s u p p o r t   a u t o m a t i c   p r o v i s i o n i n g   v o l u m e B i n d i n g M o d e :   W a i t F o r F i r s t C o n s u m e r   L o c a l   v o l u m e s   d o   n o t   s u p p o r t   d y n a m i c   p r o v i s i o n i n g   i n   K u b e r n e t e s   1 . 3 4 ;   h o w e v e r   a   S t o r a g e C l a s s   s h o u l d   s t i l l   b e   c r e a t e d   t o   d e l a y   v o l u m e   b i n d i n g   u n t i l   a   P o d   i s   a c t u a l l y   s c h e d u l e d   t o   t h e   a p p r o p r i a t e   n o d e .   T h i s   i s   s p e c i f i e d   b y   t h e   W a i t F o r F i r s t C o n s u m e r   v o l u m e   b i n d i n g   m o d e .   D e l a y i n g   v o l u m e   b i n d i n g   a l l o w s   t h e   s c h e d u l e r   t o   c o n s i d e r   a l l   o f   a   P o d ' s   s c h e d u l i n g   c o n s t r a i n t s   w h e n   c h o o s i n g   a n   a p p r o p r i a t e   P e r s i s t e n t V o l u m e   f o r   a   P e r s i s t e n t V o l u m e C l a i m .