We raise an AirflowException to fail the task instance. To delete its pod, we delete it KubernetesPodOperator.process_pod_deletion>. Indicating that the pod failed and should not be “reattached to” in a retry. IfĪdditionally the task is configured not to delete the pod after termination, we apply a label KubernetesPodOperator.patch_already_checked> If the pod terminates unsuccessfully, we attempt to log the pod events PodLauncher.read_pod_events>. after a worker failure) orĬreated anew, the waiting logic may have occurred in either handle_pod_overlap or create_new_pod_for_operator.Īfter the pod terminates, we execute different cleanup tasks depending on whether the pod terminated successfully. Previously, depending on whether the pod was “reattached to” (e.g. Value from the base container, we await pod completion. Logs, the operator will instead KubernetesPodOperator.await_container_completionĮither way, we must await container completion before harvesting xcom. The operator will follow the base container logs and forward these logs to the task logger until Pending phase ( ~.KubernetesPodOperator.await_pod_start). The first step is to wait for the pod to leave the The “waiting” part of execution has three components. The package supports the following python versions: 3.7,3.8,3.9,3.10 Requirements Pip install apache-airflow-providers-cncf-kubernetes You can install this package on top of an existing Airflow 2 installation (see Requirements belowįor the minimum Airflow version supported) via You can find package information and changelog for the provider All classes for this provider packageĪre in python package. This is a provider package for cncf.kubernetes provider. Package apache-airflow-providers-cncf-kubernetes
0 Comments
Leave a Reply. |