providers/cncf/kubernetes/docs/changelog.rst
.. Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements. See the NOTICE file distributed with this work for additional information regarding copyright ownership. The ASF licenses this file to you under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at
.. http://www.apache.org/licenses/LICENSE-2.0
.. Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.
.. NOTE TO CONTRIBUTORS: Please, only add notes to the Changelog just below the "Changelog" header when there are some breaking changes and you want to add an explanation to the users on how they are supposed to deal with them. The changelog is updated and maintained semi-automatically by release manager.
apache-airflow-providers-cncf-kubernetes
.. warning::
KubernetesJobOperator no longer supports setting parallelism = 0 with wait_until_job_complete=True.
Previously this would create a job that would never complete and always fail the task.
Executing a task with parallelism = 0 and wait_until_job_complete=True will now raise a validation error.
10.14.0 .......
Features
* ``Add multi-team support for KubernetesExecutor (#61798)``
* ``Executor Synchronous callback workload (#61153)``
Bug Fixes
fixed an issue that caused a state mismatch (#63061)Misc
* ``Bump minimum cryptography to 44.0.3 and paramiko to 3.4.0 (#62723)``
* ``Move determine_kwargs and KeywordParameters to SDK DecoratedOperator (#62746)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
10.13.0
.......
Features
Add Kubernetes Secrets Backend to cncf.kubernetes provider (#61527)Bug Fixes
* ``Fix EKSPodOperator credential refresh errors and improve error handling (#57585) (#58743)``
* ``fix: pod_override existing init_containers (#62284)``
* ``fix: Transient error state caused by rate limits from the container registry in 'KubernetesPodOperator' (#62215)``
Misc
~~~~
* ``[Part 2] Migrate connection UI metadata to YAML for more providers (#62109)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``(doc only) Update 'parallelism' parameter description for KubernetesJobOperator (#62468)``
* ``Add 'lifecycle' field to provider.yaml schema and all providers per AIP-95 (#62190)``
10.12.4
.......
Bug Fixes
Fix ModuleNotFoundError in kubernetes cleanup cronjob (#61673)Avoid KeyError when Kubernetes omits optional waiting status fields (#60805)Prevent duplicate Spark Kubernetes pods (#61110).. Below changes are excluded from the changelog. Move them to appropriate section above if needed. Do not delete the lines(!):
Clarify find_spark_job selection logic and intent (#61640)CI: Upgrade important CI environment (#61417)10.12.3 .......
Bug Fixes
* ``AsyncKubernetesHook.watch_pod_events could silently stop emitting events when (#60532)``
* ``improved the event which is thrown in the event log tab when a pod failes for k8s exec (#60800)``
* ``Ensure deterministic Spark driver pod selection during reattach. Added unit tests. (#60717)``
* ``Repair k8 async connection getter (#61138)``
Misc
~~~~
* ``Define 'TaskInstanceKey' in task-sdk to support client server separation (#60776)``
* ``Use common provider's get_async_connection in other providers (#56791)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
10.12.2
.......
Bug Fixes
Handle backwards-compatibility for older Google provider (#60730)Kubernetes Pod Operator: Skip async defferal when pod already complete (#58684).. Below changes are excluded from the changelog. Move them to appropriate section above if needed. Do not delete the lines(!):
10.12.1 .......
Bug Fixes
* ``KubernetesPodOperator: Fix hanging API calls (#60254)``
* ``KubernetesPodOperator check xcom sidecar running before trying to read xcom (#60319)``
* ``Prevent transient error in case when Pod start_time parameter is None (#59097)``
* ``Add support for creating jobs with parallelism=0 to KubernetesJobOperator (#60372)``
* ``Fix duplicate pod creation in KubernetesJobOperator (#53368)``
* ``Kubernetes Pod Operator callbacks repeating log line (#59372)``
* ``Fix job_name normalization in KubernetesJobOperator (#60231)``
Misc
~~~~
* ``Replace deprecated import for utcnow() to the new one (#60317)``
* ``Fix mypy error in provider (#60395)``
* ``New year means updated Copyright notices (#60344)``
* ``Making kubernetes executor ResourceVersion a self contained singleton (#60324)``
* ``Re-apply PriorityWeightStrategy SDK work (#60112)``
* ``Introduce a "cli" section in provider metadata (#59805)``
Doc-only
~~~~~~~~
* ``Improve changelog descriptions in PR #59947 (latest versions only) (#60036)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``revert: remove k8s namespace and worker image deprecations (#60273)``
* ``Remove TaskInstance and TaskLogReader unused methods (#59922)``
10.12.0
.......
Features
~~~~~~~~
* ``Add 'delete_active_pod' cleanup option and corresponding unit tests (#59160)``
Bug Fixes
Fix '@task.kubernetes_cmd' TaskGroup.expand mappings by templating TaskFlow args (#59292)Fix 'KubernetesPodOperator' deferrable mode with env-defined connection (#41706) (#58841)Fix deferred mode KubernetesPodOperator: fast-fail pod start errors (ErrImagePull/ImagePullBackOff) (#59010)Fix XCom directory creation logic in Kubernetes decorator (#56545) (#59347)Misc
* ``TaskInstance unused method cleanup (#59835)``
* ``Remove top-level SDK reference in Core (#59817)``
* ``Add and fix SIM107 and B012 Ruff rule (#59770)``
* ``Refactor/sqla2 providers(celery, kubernetes, databricks, mysql) to remove SQLA query usage (#59537)``
* ``Optimize Kubernetes API usage for watching events (#59080)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Revert "Remove PriorityWeightStrategy reference in SDK" (#59828)``
* ``Remove PriorityWeightStrategy reference in SDK (#59780)``
10.11.1
.......
Bug Fixes
Fix finally return handling (#58998)Misc
* ``Convert the exclusion on urllib3 to != for 2.6.0 (#59203)``
* ``Add backcompat for exceptions in providers (#58727)``
* ``Limit urllib3 to < 2.6.0 to handle kubernetes client breaking with it (#59108)``
* ``Move the traces and metrics code under a common observability package (#56187)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
10.11.0
.......
.. note::
This release of provider is only available for Airflow 2.11+ as explained in the
Apache Airflow providers support policy <https://github.com/apache/airflow/blob/main/PROVIDERS.rst#minimum-supported-version-of-airflow-for-community-managed-providers>_.
Bug Fixes
Fix Account for job- prefix when truncating job names (#58391)KubernetesPodOperator: Rework of Kubernetes API retry behavior (#58397)Fix KuberetesPodTriggerer use correct parameter name to read pod logs. (#58489)KubernetesPodOperator pushes XCom on successful execution. (#58488)KubernetesPodOperator PodManager retries during create pod on too many requests error (#58033)Add JSON serialization for kubeconfig in AsyncKubernetesHook (#57169)Make the launcher a cached_property and minor change to improve how pod name is retrieved (#58646)Add retry handling for Kubernetes API client operations in KubernetesPodOperator (#58778)Misc
* ``Move out some exceptions to TaskSDK (#54505)``
* ``Bump minimum Airflow version in providers to Airflow 2.11.0 (#58612)``
* ``Fix lower bound dependency to common-compat provider (#58833)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Updates to release process of providers (#58316)``
* ``Send executor integration info in workload (#57800)``
* ``Fixes #57515 - Fix test_async_write_logs_should_execute_successfully test (#58276)``
* ``Prepare release for 2025-11-27 wave of providers (#58697)``
10.10.0
.......
Features
KubernetesPodTriggerer reads pod logs instead of KubernetesPodOperator (#57531)Bug Fixes
* ``Fix 'KubernetesPodOperator' fails to delete pods with None value labels (#53477)``
* ``Fix KubernetesExecutor open slots metric (#55797)``
* ``improve deferrable KPO handling of deleted pods in between polls (#56976)``
* ``KubernetesExecutor: retry pod creation on Kubernetes API 500 errors (#57054)``
Misc
~~~~
* ``Convert all airflow distributions to be compliant with ASF requirements (#58138)``
* ``Unify Pod Startup Tracking: KubernetesPodTriggerer and KubernetesPodOperator Now Share Common Startup Logic (#56875)``
* ``Relax Kubernetes client version support to <35.0.0 (#57413)``
* ``Identify duplicate kubernetes section airflow configuration and mark them as deprecated (#57028)``
Doc-only
~~~~~~~~
* ``CHG: image (#56593)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Fix main failing on cross-merged PR (#58270)``
* ``Delete all unnecessary LICENSE Files (#58191)``
* ``Enable PT006 rule to 19 files in providers (cncf,common) (#57995)``
* ``Fix docstring typos (#57840)``
* ``Fix MyPy type errors in providers in cncf/kubernetes provider (#57563)``
* ``Fix mypy static errors in main (#57755)``
* ``Attempt to resolve pip "ResolutionTooDeep" on cffi conflict (#57697)``
* ``Enable ruff PLW1641 rule (#57679)``
* ``Fix code formatting via ruff preview (#57641)``
* ``Enable ruff PLW0129 rule (#57516)``
10.9.0
......
Features
~~~~~~~~
* ``Move container-related functions from PodManager to a separate file (#56700)``
* ``Add KubernetesPodOperator deferred callbacks (#47108)``
Bug Fixes
Fix KubernetesPodOperator termination_grace_period parameter not being applied to pod spec (#56402)SparkKubernetesOperator: preserve existing metadata labels in SparkApplication manifest (#56063)Misc
* ``Migrate cncf/kubernetes provider to ''common.compat'' (#57023)``
Doc-only
Correct 'Dag' to 'DAG' for code snippets in provider docs (#56727).. Below changes are excluded from the changelog. Move them to appropriate section above if needed. Do not delete the lines(!):
Remove placeholder Release Date in changelog and index files (#56056)Enable PT011 rule to provider tests (#56578)10.8.2 ......
Bug Fixes
* ``Don't check db migration needlessly for 'airflow celery' cli commands. (#55878)``
* ``Relax Kubernetes client version support to <34.0.0 (#55932)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
10.8.1
......
Bug Fixes
Fix: Add task context labels to driver and executor pods for SparkKubernetesOperator reattach_on_restart functionality (#50803)Add more error handling in pod_manager consume_logs (#55479)Add more robust check of the container statuses (#55371)Fix circular import in version_compat (#55809)Misc
* ``Move the KubernetesPodOperator 'convert_config_file_to_dict' call (#55064)``
* ``Fix kpo log_events_on_failure logs warnings at warning level (#54967)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Switch all airflow logging to structlog (#52651)``
10.8.0
......
Features
Add customizable log prefix and formatter to KubernetesPodOperator (#53598)Enhanced Pod Failure Logging in KubernetesExecutor (#54115)Bug Fixes
* ``fix: Handle Kubernetes API responses with non-JSON bodies (#55107)``
* ``Fix KubernetesExecutor retry on 409 conflict (#54777)``
* ``KubernetesPodOperator logs pod and container state after error occurred (#54828)``
* ``Throttle HTTPError during consume pod logs (#54761)``
Misc
~~~~
* ``Remove airflow.models.DAG (#54383)``
* ``Refactor Kubernetes Executor Types to NamedTuples (#54858)``
* ``Move some items in 'airflow.utils.context' to appropriate places (#53600)``
Doc-only
~~~~~~~~
* ``Make term Dag consistent in providers docs (#55101)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Remove Legacy Query Object Usage from airflow-models (#52325)``
* ``Fix k8s pod yaml test to expect redacted sensitive data (#54883)``
* ``Move secrets_masker over to airflow_shared distribution (#54449)``
* ``Replace API server's direct Connection access workaround in BaseHook (#54083)``
* ``Switch pre-commit to prek (#54258)``
* ``make bundle_name not nullable (#47592)``
* ``Bump pytest-asyncio to 1.1.0 (#54123)``
* ``Fix Airflow 2 reference in README/index of providers (#55240)``
10.7.0
......
Features
~~~~~~~~
* ``Add support for taking the config file as a dict for KubernetesHook (#53126)``
Bug Fixes
Kill kube watcher instance if it doesnt terminate gracefully in 60 seconds (#52662).. Below changes are excluded from the changelog. Move them to appropriate section above if needed. Do not delete the lines(!):
10.6.2 ......
Bug Fixes
* ``Pass cluster context to AsyncKubernetesHook (#53504)``
* ``Handle multiple pods to prevent KubernetesJobOperator falls with parallelism option (#49899)``
* ``(fix): Handle pod evictions correctly during retry in KubernetesPodOperator (#53059)``
Misc
~~~~
* ``Deprecate decorators from Core (#53629)``
* ``Use asyncio.run instead of loop.run_until_complete. (#53475)``
* ``Add Python 3.13 support for Airflow. (#46891)``
* ``Remove 'airflow.utils.xcom' module and add backcompat shim (#53187)``
* ``Cleanup mypy ignores cncf provider where possible (#53264)``
* ``Remove type ignore across codebase after mypy upgrade (#53243)``
* ``Replace usages of XCOM_RETURN_KEY in providers to not be from utils (#53170)``
* ``Make cncf provider compatible with mypy 1.16.1 (#53121)``
* ``Remove upper-binding for "python-requires" (#52980)``
* ``Temporarily switch to use >=,< pattern instead of '~=' (#52967)``
* ``Move all BaseHook usages to version_compat in cncf (#52798)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Making some brittle tests related to log assertion more robust (#53743)``
* ``Make dag_version_id in TI non-nullable (#50825)``
10.6.1
......
Bug Fixes
Fix deferrable mode for SparkKubernetesOperator (#51956)Reduce log noise from K8s Pod Operator for XCom (#51812)Prevent legacy static hybrid executors to be running in Airflow 3 (#51760)Misc
* ``Move 'BaseHook' implementation to task SDK (#51873)``
* ``Update Kubernetes provider for Airflow 3.0 compatibility (#52664)``
* ``Upgrade ruff to latest version (0.12.1) (#52562)``
* ``Drop support for Python 3.9 (#52072)``
* ``Use BaseSensorOperator from task sdk in providers (#52296)``
* ``Move type-ignores up one line (#52195)``
* ``Ignore mypy errors for deprecated executors (#52187)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Make sure all test version imports come from test_common (#52425)``
* ``Separate out creation of default Connections for tests and non-tests (#52129)``
* ``Remove @pytest.mark.db_test for cncf (#52153)``
* ``Remove residual occurences of 'merge_conn' from cncf tests (#52064)``
* ``Introducing fixture to create 'Connections' without DB in provider tests (#51930)``
10.6.0
......
Features
KubernetesPodOperator push xcom after failed pod (#51475)[KubernetesPodOperator] Reads Kubernetes events and writes them into log (#50192)Added detection of terminated pod during get_or_create_pod (#51158)Bug Fixes
* ``Add xcom sidecar terminated detection (#51144)``
* ``Fix 'EksPodOperator' in deferrable mode (#51255)``
* ``Fix a bug where Kube config "worker_pod_pending_fatal_container_state_reasons" is parsed wrongly (#50931)``
Misc
~~~~
* ``Relax Kubernetes client version support to <33.0.0 (#51195)``
* ``Adjust code path in executors to be compatible with airflow task run (#51009)``
* ``Port ''ti.run'' to Task SDK execution path (#50141)``
* ``Bump some provider dependencies for faster resolution (#51727)``
* ``Prevent legacy static hybrid executors to be running in Airflow 3 (#51733)``
Doc-only
~~~~~~~~
* ``Update the executor and provider doc to highlight the two statically coded hybrid executors are no longer supported in Airflow 3.0.0+ (#51715)``
* ``Update operators.rst - fix typo Kubernetes Pod Operator doc (#51574)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
10.5.0
......
.. note::
This release of provider is only available for Airflow 2.10+ as explained in the
Apache Airflow providers support policy <https://github.com/apache/airflow/blob/main/PROVIDERS.rst#minimum-supported-version-of-airflow-for-community-managed-providers>_.
Features
~~~~~~~~
* ``Add fast fail for ErrImagePull and InvalidImageName for KubernetesPodOperator (#49867)``
* ``KubernetesPodOperator uses different timeouts to check for schedule timeout and startup timeout (#49784)``
* ``Add configurable automountServiceAccountToken for the KubernetesPodOperator (#50223)``
* ``Add 'test_connection' method to 'KubernetesHook' (#47881)``
* ``Add '@task.kuberenetes_cmd' (#46913)``
Bug Fixes
Pass workload to KubernetesExecutor using command args instead of init container (#50448)Fix KubernetesPodOperator AutomountServiceAccountToken from Pod Template (#50800)Fix broken imports of cncf.kubernetes for Airflow 2 (#50651)Misc
* ``Move SQS message queue to Amazon provider (#50057)``
* ``Remove AIRFLOW_2_10_PLUS conditions (#49877)``
* ``Bump min Airflow version in providers to 2.10 (#49843)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Update description of provider.yaml dependencies (#50231)``
* ``Avoid committing history for providers (#49907)``
* ``capitalize the term airflow (#49450)``
* ``Prepare release for providers May 2025 (#50531)``
10.4.3
......
Bug Fixes
Remove 'subdir' arg from CLI commands (#49317)Misc
* ``Use contextlib.suppress(exception) instead of try-except-pass and add SIM105 ruff rule (#49251)``
* ``remove superfluous else block (#49199)``
* ``Remove unused db method in k8s provider (#49186)``
10.4.2
......
Misc
Make '@task' import from airflow.sdk (#48896)Update ECS executor to support Task SDK (#48513).. Below changes are excluded from the changelog. Move them to appropriate section above if needed. Do not delete the lines(!):
Remove unnecessary entries in get_provider_info and update the schema (#48849)Remove fab from preinstalled providers (#48457)Improve documentation building iteration (#48760)10.4.1 ......
Bug Fixes
* ``Handle missing container_statuses in pod_manager.get_container_status (#47936)``
Misc
~~~~
* ``Remove change_sensor_mode_to_reschedule from base executor (#48649)``
* ``No need to exclude executor_config specifically for KE (#48826)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Simplify tooling by switching completely to uv (#48223)``
* ``Fix broken ci on main for k8s cli test (#48595)``
* ``Upgrade ruff to latest version (#48553)``
* ``update kubernetes decorator comment (#48447)``
* ``Remove old comment about excluding 'executor_config' (#48830)``
10.4.0
......
Features
~~~~~~~~
* ``KubernetesPodOperator: add base_container_name to the templated fields (#47864)``
Bug Fixes
cncf.kubernetes: make the base container status check polling interval configurable (#47774)Switch to non-interactive mode where stdin is disabled (#47568)Retry k8s API requests in 'KubernetesPodTrigger' (#47187)Misc
* ``Remove extra method for async hook getting (#47313)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Upgrade providers flit build requirements to 3.12.0 (#48362)``
* ``Move airflow sources to airflow-core package (#47798)``
* ``Bump various providers in preparation for Airflow 3.0.0b4 (#48013)``
* ``AIP-72: Handle Custom XCom Backend on Task SDK (#47339)``
* ``Remove links to x/twitter.com (#47801)``
10.3.1
......
Misc
Get rid of google-re2 as dependency (#47493)AIP-72: Port over executor_config for K8sExecutor when using task sdk (#46926)Update templated fields in KPO doc-string + wording (#46970)Upgrade flit to 3.11.0 (#46938).. Below changes are excluded from the changelog. Move them to appropriate section above if needed. Do not delete the lines(!):
Move tests_common package to devel-common project (#47281)Fix codespell issues detected by new codespell (#47259)Improve documentation for updating provider dependencies (#47203)Add legacy namespace packages to airflow.providers (#47064)Remove extra whitespace in provider readme template (#46975)10.3.0 ......
.. note:: This version has no code changes. It's released due to yank of previous version due to packaging issues.
10.2.0 ......
Features
* ``KubernetesPodOperator new callbacks and allow multiple callbacks (#44357)``
Bug Fixes
(fix): Render a pod spec using the pod_template_file override, if passed to the executor (#46374)fix: kpo async kube_config_path (#45571)Allow passing empty labels in the spark kubernetes driver config (#45864)fix: spark operator label (#45353)Allow internal retries when pending k8s pod is deleted (#45184)fix: correctly shutdown xcom after job is complete (#45455)Fix kubernetes executor watcher kube_client_request_args shadowing (#45528)Misc
* ``Fix wrong operator name in doc string of @task.kubernetes (#46873)``
* ``AIP-83 amendment: Add logic for generating run_id when logical date is None. (#46616)``
* ``Remove overlooked 'pod_generator_deprecated.py' (#46587)``
* ``More meaningful '@task.kubernetes' pod naming (#46535)``
* ``chore(kubernetes): reduce redundant code (#46574)``
* ``Add dynamic task mapping into TaskSDK runtime (#46032)``
* ``Expand KPO template_fields, fix Spark k8s operator tests (#46268)``
* ``Swap CeleryExecutor over to use TaskSDK for execution. (#46265)``
* ``Move Pod*Exceptions to separate module (#45759)``
* ``Add other instances of Context type hints (#45657)``
* ``AIP-72: Support better type-hinting for Context dict in SDK (#45583)``
* ``AIP-72: Swap KubernetesExecutor to use taskSDK for execution (#46860)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Move provider_tests to unit folder in provider tests (#46800)``
* ``Removed the unused provider's distribution (#46608)``
* ``Move CNCF Kubernetes to new provider structure (#46436)``
10.1.0
......
.. note::
This release of provider is only available for Airflow 2.9+ as explained in the
`Apache Airflow providers support policy <https://github.com/apache/airflow/blob/main/PROVIDERS.rst#minimum-supported-version-of-airflow-for-community-managed-providers>`_.
Features
Add logging support for init containers in KubernetesPodOperator (#42498) (#43853)Implement KubernetesInstallKueueOperator + (#44568)support grouping of log lines for KubernetesPodOperator (#44428)Bug Fixes
* ``Compare k8s executor against alias, not full ExecutorName repr (#44967)``
* ``Fix failing KubernetesExecutor (#44931)``
Misc
~~~~
* ``Remove references to AIRFLOW_V_2_9_PLUS (#44987)``
* ``Bump minimum Airflow version in providers to Airflow 2.9.0 (#44956)``
* ``Consistent way of checking Airflow version in providers (#44686)``
* ``Fix yoda-conditions (#44466)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``fix: Get the pid of xcom command dynamically (#45053)``
10.0.1
......
Bug Fixes
Bugfix KubernetesJobOperator.on_kill() by removing unexpected 'job' argument from the k8s job client method 'delete_namespaced_job' invocation (#44131)Re-queue tassk when they are stuck in queued (#43520)Misc
* ``Rename execution_date to logical_date across codebase (#43902)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Use Python 3.9 as target version for Ruff & Black rules (#44298)``
10.0.0
......
Breaking changes
.. warning:: All deprecated classes, parameters and features have been removed from the Kubernetes provider package. The following breaking changes were introduced:
Helpers
add_pod_suffix method from kubernetes_helper_functions.py. Use add_unique_suffix instead.make_unique_pod_id method from PodGenerator. Use add_unique_suffix in kubernetes_helper_functions instead.create_pod_id method from kubernetes_helper_functions.py. Use create_unique_id instead.gen_pod method from PodGenerator.add_xcom_sidecar method from PodGenerator. Use airflow.providers.cncf.kubernetes.utils.xcom_sidecar.add_xcom_sidecar instead.from_obj function in PodGenerator. Use a kubernetes.client.models.V1Pod class with a "pod_override" key.from_legacy_obj method from PodGenerator.airflow.providers.cncf.kubernetes.pod_launcher_deprecated module. Use airflow.providers.cncf.kubernetes.utils.pod_manager instead.Operators
airflow.providers.cncf.kubernetes.operators.kubernetes_pod. Use airflow.providers.cncf.kubernetes.operators.pod instead.is_delete_operator_pod parameters from KubernetesPodOperator. Use on_finish_action instead.progress_callback parameters from KubernetesPodOperator. Use callbacks instead.execute_complete method from KubernetesPodOperator. Use trigger_reentry instead.xcom_push parameter from SparkKubernetesOperator. Use do_xcom_push.Triggers
should_delete_pod parameter from KubernetesPodTrigger. Use on_finish_action instead.Utils
progress_callback parameter from PodManager.follow_container_logs method from PodManager. Use fetch_container_logs instead... warning::
Set the default value of namespace in @task.kubernetes to None, so it uses the cluster namespace when in_cluster is True. Be sure to specify a namespace when using this decorator. To retain the previous behavior, set namespace="default"
Remove deprecations cncf.kubernetes (#43689)Change default value of 'namespace' in 'task.kubernetes' to be None (#43402)Bug Fixes
* ``Add random_name_suffix to SparkKubernetesOperator (#43847)``
* ``terminate kubernetes watch in case of unknown error (#43645)``
* ``Update 'namespace' priority for 'find_pod' function (#43762)``
Misc
~~~~
* ``AIP-72: Remove DAG pickling (#43667)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Start porting DAG definition code to the Task SDK (#43076)``
9.0.1
.....
Bug Fixes
(fix): HybridExecutor tasks of other executor rescheduled in kubernetes executor (#43003)(fix): use instance base_container_name to fetch logs on trigger_reentry (#42960)Misc
* ``Add kubernetes_conn_id to templated fields (#42786)``
* ``Allow node_selector templating in KPO (#43051)``
* ``Bump max version of Kubernetes Python SDK to 31.0.0 (#42907)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Split providers out of the main "airflow/" tree into a UV workspace project (#42624)``
* ``Split providers out of the main "airflow/" tree into a UV workspace project (#42505)``
9.0.0
.....
Breaking changes
.. warning:: Support for identifying pods by execution_date during the upgrade from Airflow 1 to 2 has been removed. This may result in duplicate pods being launched for tasks originally started by Airflow 1, but only one of the task pods will succeed.
kubernetes executor cleanup_stuck_queued_tasks optimization (#41220)Bug Fixes
* ``All executors should inherit from BaseExecutor (#41904)``
* ``Fix mark as success when pod fails while fetching log (#42815)``
* ``Fix SparkKubernetesOperator spark name. (#42427)``
* ``KubernetesPodOperator never stops if credentials are refreshed (#42361)``
* ``Restructured 'await_xcom_sidecar_container_start' method. (#42504)``
* ``KubernetesHook kube_config extra can take dict (#41413)``
Misc
~~~~
* ``Drop python3.8 support core and providers (#42766)``
* ``Remove airflow_version from k8s executor pod selector (#42751)``
8.4.2
.....
Misc
~~~~
* ``Deprecated configuration removed (#42129)``
* ``docstring update in AsyncKubernetesHook (#41929)``
* ``Remove Airflow 2.7 support from Kubernetes Provider (#41746)``
* ``remove deprecated soft_fail from providers (#41710)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Add TODOs in providers code for Subdag code removal (#41963)``
8.4.1
.....
Bug Fixes
fix: 'KubernetesExecutor' failing the task in case the watcher receives an event with the reason ProviderFailed (#41186)fix: 'do_xcom_push' and 'get_logs' functionality for KubernetesJobOperator (#40814)fix: 'KubernetesHook' loading config file with '_is_in_cluster' set as False (#41464)fix: Missing 'slots_occupied' in 'CeleryKubernetesExecutor' and 'LocalKubernetesExecutor' (#41602)8.4.0 .....
.. note::
This release of provider is only available for Airflow 2.8+ as explained in the
Apache Airflow providers support policy <https://github.com/apache/airflow/blob/main/PROVIDERS.rst#minimum-supported-version-of-airflow-for-community-managed-providers>_.
Misc
* ``Bump minimum Airflow version in providers to Airflow 2.8.0 (#41396)``
* ``Describe behaviour in docstring correctly (#41458)``
* ``Remove deprecated SubDags (#41390)``
* ``reorder docstring of 'SparkKubernetesOperator' (#41372)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
8.3.4
.....
Bug Fixes
Pass content of kube/config file to triggerer as a dictionary (#41178)Fix confusing log message in kubernetes executor (#41035)Fix ApiException handling when adopting completed pods (#41109).. Below changes are excluded from the changelog. Move them to appropriate section above if needed. Do not delete the lines(!):
8.3.3 .....
Bug Fixes
* ``Solve failing KPO task with task decorator and imported typing elements (#40642)``
Misc
~~~~
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Enable enforcing pydocstyle rule D213 in ruff. (#40448)``
8.3.2
.....
Bug Fixes
Fix Scheduler restarting due to too many completed pods in cluster (#40183)Misc
* ``Bump minimum kubernetes lib version to kubernetes 29.0.0 (#40253)``
8.3.1
.....
Bug Fixes
Fixes KubernetesPodTrigger failing running pods with timeout (#40019)Refresh properties on KubernetesPodOperator on token expiration also when logging (#39789)Fix reattach_on_restart parameter for the sync mode (#39329)Avoid resetting adopted task instances when retrying for kubernetes executor (#39406)Misc
* ``Include fatal reason for pod pending events (#39924)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``iMPlement per-provider tests with lowest-direct dependency resolution (#39946)``
* ``Resolve common providers deprecations in tests (#40036)``
8.3.0
.....
Features
Add timeout when watching pod events in k8s executor (#39551)Add retry logic for KubernetesCreateResourceOperator and KubernetesJobOperator (#39201)Bug Fixes
* ``Fix deprecated calls in 'cncf.kubernetes' provider (#39381)``
* ``Handling exception getting logs when pods finish success (#39296)``
* ``fix wrong arguments in read_namespaced_pod_log call (#39874)``
Misc
~~~~
* ``Move Kubernetes cli to provider package (#39587)``
* ``Remove compat code for 2.7.0 - its now the min Airflow version (#39591)``
* ``Simplify 'airflow_version' imports (#39497)``
* ``Replace pod_manager.read_pod_logs with client.read_namespaced_pod_log in KubernetesPodOperator._write_logs (#39112)``
* ``Add a warning message to KPO to warn of one second interval logs duplication (#39861)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Reapply templates for all providers (#39554)``
* ``Faster 'airflow_version' imports (#39552)``
* ``Prepare docs 3rd wave May 2024 (#39738)``
8.2.0
.....
.. note::
This release of provider is only available for Airflow 2.7+ as explained in the
`Apache Airflow providers support policy <https://github.com/apache/airflow/blob/main/PROVIDERS.rst#minimum-supported-version-of-airflow-for-community-managed-providers>`_.
Features
~~~~~~~~
* ``Add missing informative logs in KPO trigger until container has not finished (#37546)``
Bug Fixes
fixes templated env vars for k8s pod operator (#39139)Fix SparkKubernetesOperator when using initContainers (#38119)Refresh properties on KubernetesPodOperator when k8s fails due to token expiration (#39325)Misc
* ``Bump minimum Airflow version in providers to Airflow 2.7.0 (#39240)``
* ``Remove unnecessary validation from cncf provider. (#39238)``
* ``Moves airflow import in deprecated pod_generator to local (#39062)``
* ``KPO xcom sidecar PodDefault usage (#38951)``
8.1.1
.....
Bug Fixes
Avoid logging empty line KPO (#38247)8.1.0 .....
Features
* ``KPO Add follow log in termination step (#38081)``
* ``Add GKECreateCustomResourceOperator and GKEDeleteCustomResourceOperator operators (#37616)``
* ``Implement deferrable mode for KubernetesJobOperator (#38251)``
* ``Create KubernetesPatchJobOperator operator (#38146)``
* ``Implement delete_on_status parameter for KubernetesDeleteJobOperator (#38458)``
* ``Implement deferrable mode for GKEStartJobOperator (#38454)``
* ``Use startup_check_interval_seconds instead of poll_interval to check pod while startup (#38075)``
* ``Implement wait_until_job_complete parameter for KubernetesJobOperator (#37998)``
Bug Fixes
Use SIGINT signal number instead of signal name (#37905)Fix spark operator log retrieval from driver (#38106)Fix dynamic allocation specs handling for custom launcher (#38223)Fix case if 'SparkKubernetesOperator.application_file' is templated file (#38035)fix: reduce irrelevant error logs for pod events. (#37944)Misc
* ``Add GKEListJobsOperator and GKEDescribeJobOperator (#37598)``
* ``removed usage of deprecated function for naming the pod in provider k8s pod.py (#38638)``
* ``Create DeleteKubernetesJobOperator and GKEDeleteJobOperator operators (#37793)``
* ``Refactor GKE hooks (#38404)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``fix: try002 for provider cncf kubernetes (#38799)``
* ``Update yanked versions in providers changelogs (#38262)``
* ``Bump ruff to 0.3.3 (#38240)``
8.0.1
.....
Bug Fixes
Immediately fail the task in case of worker pod having a fatal container state (#37670)Skip pod cleanup in case of pod creation failed (#37671)Misc
* ``Avoid non-recommended usage of logging (#37792)``
* ``Migrate executor docs to respective providers (#37728)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Avoid to use too broad 'noqa' (#37862)``
8.0.0
.....
Breaking changes
In the case of Kube API exceeded quota errors, we have introduced the task_publish_max_retries
flag to control the re-queuing task behavior. Changed the default behavior from unlimited
retries to 0. The default behavior is no retries (task_publish_max_retries==0). For
unlimited retries, set task_publish_max_retries=-1. For a fixed number of retries, set
task_publish_max_retries to any positive integer.
Fix: The task is stuck in a queued state forever in case of pod launch errors (#36882)Features
* ``Add logging_interval in KubernetesPodOperator to log container log periodically (#37279)``
* ``Create GKEStartJobOperator and KubernetesJobOperator (#36847)``
Bug Fixes
Fix occasional attr-undefined for the python_kubernetes_script (#37318)Fix hanging KPO on deferrable task with do_xcom_push (#37300)Fix rendering 'SparkKubernetesOperator.template_body' (#37271)Fix assignment of template field in '__init__' in 'KubernetesPodOperator' (#37010)KPO Maintain backward compatibility for execute_complete and trigger run method (#37454)Fix KPO task hanging when pod fails to start within specified timeout (#37514)Fix KeyError when KPO exits too soon (#37508)Misc
* ``feat: Switch all class, functions, methods deprecations to decorators (#36876)``
* ``Kubernetes version bump (#37040)``
* ``Add GKEStartKueueInsideClusterOperator (#37072)``
* ``Convert Kubernetes ApiException status code to string to ensure it's correctly checked (#37405)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Add d401 support to kubernetes provider (#37301)``
* ``Revert "KPO Maintain backward compatibility for execute_complete and trigger run method (#37363)" (#37446)``
* ``KPO Maintain backward compatibility for execute_complete and trigger run method (#37363)``
* ``Prepare docs 1st wave of Providers February 2024 (#37326)``
* ``Prepare docs 1st wave (RC2) of Providers February 2024 (#37471)``
* ``Add comment about versions updated by release manager (#37488)``
7.14.0
......
Features
Add SparkKubernetesOperator crd implementation (#22253)Template field support for configmaps in the KubernetesPodOperator (#36922)Create a generic callbacks class for KubernetesPodOperator (#35714)Bug Fixes
* ``fix: Avoid retrying after KubernetesPodOperator has been marked as failed (#36749)``
* ``Fix stacklevel in warnings.warn into the providers (#36831)``
* ``Increase tenacity wait in read_pod_logs (#36955)``
* ``36888-Fix k8 configmap issue in 7.14.0rc1 (#37001)``
Misc
~~~~
* ``Change field type for kube_config (#36752)``
* ``Changing wording in docstring for CNCF provider (#36547)``
* ``Add support of Pendulum 3 (#36281)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Prepare docs 1st wave of Providers January 2024 (#36640)``
* ``Speed up autocompletion of Breeze by simplifying provider state (#36499)``
* ``Prepare docs 2nd wave of Providers January 2024 (#36945)``
7.13.0
......
Features
~~~~~~~~
* ``Allow changing of 'config_file' in 'KubernetesResourceBaseOperator' (#36397)``
Misc
~~~~
* ``Add reminder about update stub file in case of change KubernetesPodOperator's arguments (#36434)``
* ``Don't get pod status in KubernetesPodOperator if skip_on_exit_code is not set (#36355)``
* ``Remove deprecated input parameters in the k8s pod operator (#36433)``
* ``Delete get_python_source from Kubernetes decorator after bumping min airflow version to 2.6.0 (#36426)``
* ``Remove duplicated methods in K8S pod operator module and import them from helper function (#36427)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
7.12.0
......
Features
~~~~~~~~
* ``Add _request_timeout to KPO log fetch calls (#36297)``
* ``Add 'pod_template_dict' field to 'KubernetesPodOperator' (#33174)``
* ``KubernetesPodTrigger: add exception stack trace in TriggerEvent (#35716)``
* ``Make pod_name length equal to HOST_NAME_MAX (#36332)``
* ``Move KubernetesPodTrigger hook to a cached property (#36290)``
Bug Fixes
Kubernetes executor running slots leak fix (#36240)Follow BaseHook connection fields method signature in child classes (#36086)list pods performance optimization (#36092).. Below changes are excluded from the changelog. Move them to appropriate section above if needed. Do not delete the lines(!):
7.11.0 ......
.. note::
This release of provider is only available for Airflow 2.6+ as explained in the
Apache Airflow providers support policy <https://github.com/apache/airflow/blob/main/PROVIDERS.rst#minimum-supported-version-of-airflow-for-community-managed-providers>_.
Bug Fixes
* ``fix: KPO typing env_vars (#36048)``
* ``Stop converting state to TaskInstanceState when it's None (#35891)``
* ``Feature pass dictionary configuration in application_file in SparkKubernetesOperator (#35848)``
Misc
~~~~
* ``Bump minimum Airflow version in providers to Airflow 2.6.0 (#36017)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Drive-by improvements to convert_env_vars (#36062)``
* ``Use fail instead of change_state(failed) in K8S executor (#35900)``
7.10.0
......
Features
~~~~~~~~
* ``Add annotations field into in KubernetesPodOperator (#35641)``
* ``Add custom_resource_definition to KubernetesResourceBaseOperator (#35600)``
Bug Fixes
Revert Remove PodLoggingStatus object #35422 (#35822)Fix K8S executor override config using pod_override_object (#35185)Fix and reapply templates for provider documentation (#35686)Misc
* ``Remove inconsequential code bits in KPO logging (#35416)``
* ``Remove non existing params from 'KubernetesResourceBaseOperator' docstring``
* ``KubernetesExecutor observability Improvements (#35579)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Add bandit to pre-commit to detect common security issues (#34247)``
* ``Use reproducible builds for providers (#35693)``
7.9.0
.....
Features
Add verificationy that provider docs are as expected (#35424)Add startup_check_interval_seconds to PodManager's await_pod_start (#34231)Bug Fixes
* ``Remove before_log in KPO retry and add traceback when interrupted (#35423)``
* ``Remove tenancity on KPO logs inner func consume_logs (#35504)``
Misc
~~~~
* ``Simplify KPO multi container log reconciliation logic (#35450)``
* ``Remove PodLoggingStatus object (#35422)``
* ``Improve clear_not_launched_queued_tasks call duration (#34985)``
* ``Use constant for empty xcom result sentinel (#35451)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Switch from Black to Ruff formatter (#35287)``
7.8.0
.....
Features
~~~~~~~~
* ``Added to the rendering of KubernetesOperator V1VolumeMount, sub_path (#35129)``
* ``feat: add hostAliases to pod spec in KubernetesPodOperator (#35063)``
Bug Fixes
Replace blocking IO with async IO in AsyncKubernetesHook (#35162)Consolidate the warning stacklevel in KubernetesPodTrigger (#35079).. Below changes are excluded from the changelog. Move them to appropriate section above if needed. Do not delete the lines(!):
Pre-upgrade 'ruff==0.0.292' changes in providers (#35053)Upgrade pre-commits (#35033)D401 Support - A thru Common (Inclusive) (#34934)Prepare docs 3rd wave of Providers October 2023 (#35187)7.7.0 .....
.. note::
This release of provider is only available for Airflow 2.5+ as explained in the
Apache Airflow providers support policy <https://github.com/apache/airflow/blob/main/PROVIDERS.rst#minimum-supported-version-of-airflow-for-community-managed-providers>_.
Bug Fixes
* ``Fix parsing KubernetesPodOperator multiline logs (#34412)``
* ``Fix KubernetesPodTrigger startup timeout (#34579)``
* ``Fix Pod not being removed after istio-sidecar is removed (#34500)``
* ``Remove duplicated logs by reusing PodLogsConsumer (#34127)``
Misc
~~~~
* ``Bump min airflow version of providers (#34728)``
* ``warn level for deprecated set to stacklevel 2 (#34530)``
* ``Use 'airflow.exceptions.AirflowException' in providers (#34511)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Refactor usage of str() in providers (#34320)``
* ``Update CHANGELOG.rst (#34625)``
* ``Refactor shorter defaults in providers (#34347)``
7.6.0
.....
Features
~~~~~~~~
* ``Add 'progress_callback' parameter to 'KubernetesPodOperator' (#34153)``
Bug Fixes
Move definition of Pod*Exceptions to pod_generator (#34346)Push to xcom before 'KubernetesPodOperator' deferral (#34209)Misc
* ``Refactor: Consolidate import textwrap in providers (#34220)``
7.5.1
.....
Bug Fixes
fix(providers/spark-kubernetes): respect soft_fail argument when exception is raised (#34167)Use 'cached_property' for hook in SparkKubernetesSensor (#34106)Use cached property for hook in SparkKubernetesOperator (#34130)Misc
* ``Combine similar if logics in providers (#33987)``
* ``Remove useless string join from providers (#33968)``
* ``Refactor unneeded jumps in providers (#33833)``
* ``replace loop by any when looking for a positive value in providers (#33984)``
* ``Move the try outside the loop when this is possible in kubernetes provider (#33977)``
* ``Replace sequence concatenation by unpacking in Airflow providers (#33933)``
* ``Replace dict.items by values when key is not used in providers (#33939)``
* ``Refactor: Consolidate import datetime (#34110)``
7.5.0
.....
Features
Add istio test, use curl /quitquitquit to exit sidecar, and some othe… (#33306)Add 'active_deadline_seconds' parameter to 'KubernetesPodOperator' (#33379)Make cluster_context templated (#33604)Bug Fixes
* ``Fix KubernetesPodOperator duplicating logs when interrupted (#33500)``
* ``Fix 2.7.0 db migration job errors (#33652)``
* ``Inspect container state rather than last_state when deciding whether to skip (#33702)``
* ``Fix kill istio proxy logic (#33779)``
Misc
~~~~
* ``Introducing class constant to make worker pod log lines configurable (#33378)``
* ``Adding typing for KPO SCC objects (#33381)``
* ``Refactor: Remove useless str() calls (#33629)``
* ``Refactor: Improve detection of duplicates and list sorting (#33675)``
* ``Refactor Sqlalchemy queries to 2.0 style (Part 7) (#32883)``
* ``Consolidate import and usage of itertools (#33479)``
* ``Simplify conditions on len() in other providers (#33569)``
* ``Import utc from datetime and normalize its import (#33450)``
* ``Always use 'Literal' from 'typing_extensions' (#33794)``
* ``Use literal dict instead of calling dict() in providers (#33761)``
* ``Improve modules import in cncf.kubernetes probvider by move some of them into a type-checking block (#33781)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Fix typos (double words and it's/its) (#33623)``
* ``Exclude deprecated "operators.kubernetes_pod" module from provider.yaml (#33641)``
* ``D205 Support - Providers - Final Pass (#33303)``
* ``Prepare docs for Aug 2023 3rd wave of Providers (#33730)``
7.4.2
.....
Misc
~~~~
* ``Add missing re2 dependency to cncf.kubernetes and celery providers (#33237)``
* ``Make the 'OnFinishAction' enum inherit from str to support passing it to 'KubernetesPodOperatpor' (#33228)``
* ``Refactor: Simplify code in providers/cncf (#33230)``
* ``Replace State by TaskInstanceState in Airflow executors (#32627)``
7.4.1
.....
Bug Fixes
Fix waiting the base container when reading the logs of other containers (#33127)Fix: Configurable Docker image of 'xcom_sidecar' (#32858)Fix 'KubernetesPodOperator' sub classes default container_logs (#33090)Consider custom pod labels on pod finding process on 'KubernetesPodOperator' (#33057)Misc
* ``add documentation generation for CLI commands from executors (#33081)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Revert "Fix waiting the base container when reading the logs of other containers (#33092)" (#33125)``
* ``Fix waiting the base container when reading the logs of other containers (#33092)``
7.4.0
.....
.. note::
This provider release is the first release that has Kubernetes Executor and
Local Kubernetes Executor moved from the core ``apache-airflow`` package to the ``cncf.kubernetes``
provider package.
Features
Move all k8S classes to cncf.kubernetes provider (#32767)[AIP-51] Executors vending CLI commands (#29055)Add 'termination_message_policy' parameter to 'KubernetesPodOperator' (#32885)Misc
* ``Update the watcher resource version in SparkK8SOp when it's too old (#32768)``
* ``Add deprecation info to the providers modules and classes docstring (#32536)``
* ``Raise original import error in CLI vending of executors (#32931)``
7.3.0
.....
Features
Logging from all containers in KubernetesOperatorPod (#31663)Bug Fixes
* ``Fix async KPO by waiting pod termination in 'execute_complete' before cleanup (#32467)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``D205 Support - Providers: Stragglers and new additions (#32447)``
7.2.0
.....
Features
~~~~~~~~
* ``Add 'on_finish_action' to 'KubernetesPodOperator' (#30718)``
Bug Fixes
Fix KubernetesPodOperator validate xcom json and add retries (#32113)Fix 'KubernetesPodTrigger' waiting strategy (#31348)fix spark-kubernetes-operator compatibality (#31798)Misc
* ``Add default_deferrable config (#31712)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``D205 Support - Providers: Apache to Common (inclusive) (#32226)``
* ``Improve provider documentation and README structure (#32125)``
* ``Remove spurious headers for provider changelogs (#32373)``
* ``Prepare docs for July 2023 wave of Providers (#32298)``
7.1.0
.....
.. note::
This release dropped support for Python 3.7
Features
KubernetesResourceOperator - KubernetesDeleteResourceOperator & KubernetesCreateResourceOperator (#29930)add a return when the event is yielded in a loop to stop the execution (#31985)Add possibility to disable logging the pod template in a case when task fails (#31595)Bug Fixes
* ``Remove return statement after yield from triggers class (#31703)``
* ``Fix Fargate logging for AWS system tests (#31622)``
Misc
~~~~
* ``Remove Python 3.7 support (#30963)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Add D400 pydocstyle check (#31742)``
* ``Add discoverability for triggers in provider.yaml (#31576)``
* ``Add D400 pydocstyle check - Providers (#31427)``
* ``Add note about dropping Python 3.7 for providers (#32015)``
7.0.0
.....
.. note::
This release of provider is only available for Airflow 2.4+ as explained in the
`Apache Airflow providers support policy <https://github.com/apache/airflow/blob/main/PROVIDERS.rst#minimum-supported-version-of-airflow-for-community-managed-providers>`_.
Breaking changes
.. note:: Return None when namespace is not defined in the Kubernetes connection
Remove deprecated features from KubernetesHook (#31402)Features
.. note::
If ``kubernetes_default`` connection is not defined, then KubernetesHook / KubernetesPodOperator will behave as though given ``conn_id=None``.
This should make it easier to mitigate breaking change introduced in 6.0.0
* ``K8s hook should still work with missing default conn (#31187)``
* ``Add protocol to define methods relied upon by KubernetesPodOperator (#31298)``
Bug Fixes
Fix kubernetes task decorator pickle error (#31110)Misc
* ``Bump minimum Airflow version in providers (#30917)``
* ``Empty xcom result file log message more specific (#31228)``
* ``Add options to KubernetesPodOperator (#30992)``
* ``add missing read for K8S config file from conn in deferred 'KubernetesPodOperator' (#29498)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Use 'AirflowProviderDeprecationWarning' in providers (#30975)``
* ``Upgrade ruff to 0.0.262 (#30809)``
* ``Add full automation for min Airflow version for providers (#30994)``
* ``Add cli cmd to list the provider trigger info (#30822)``
* ``Fix pod describing on system test failure (#31191)``
* ``Docstring improvements (#31375)``
* ``Use '__version__' in providers not 'version' (#31393)``
* ``Prepare docs for May 2023 wave of Providers (#31252)``
* ``Fixing circular import error in providers caused by airflow version check (#31379)``
6.1.0
.....
Features
Add multiple exit code handling in skip logic for 'DockerOperator' and 'KubernetesPodOperator' (#30769)Skip KubernetesPodOperator task when it returns a provided exit code (#29000).. Below changes are excluded from the changelog. Move them to appropriate section above if needed. Do not delete the lines(!):
Deprecate 'skip_exit_code' in 'DockerOperator' and 'KubernetesPodOperator' (#30733)Remove skip_exit_code from KubernetesPodOperator (#30788)6.0.0 .....
Breaking changes
Use ``kubernetes_default`` connection by default in the ``KubernetesPodOperator``.
* ``Use default connection id for KubernetesPodOperator (#28848)``
Features
~~~~~~~~
* ``Allow to set limits for XCOM container (#28125)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Add mechanism to suspend providers (#30422)``
5.3.0
.....
Features
~~~~~~~~
* ``enhance spark_k8s_operator (#29977)``
Bug Fixes
~~~~~~~~~
* ``Fix KubernetesPodOperator xcom push when 'get_logs=False' (#29052)``
* ``Fixed hanged KubernetesPodOperator (#28336)``
Misc
~~~~
* ``Align cncf provider file names with AIP-21 (#29905)``
* ``Remove "boilerplate" from all taskflow decorators (#30118)``
* ``Ensure setup/teardown work on a previously decorated function (#30216)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``adding trigger info to provider yaml (#29950)``
5.2.2
.....
Bug Fixes
~~~~~~~~~
* ``'KubernetesPodOperator._render_nested_template_fields' improved by changing the conditionals for a map (#29760)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Fix and augment 'check-for-inclusive-language' CI check (#29549)``
5.2.1
.....
Bug Fixes
~~~~~~~~~
* ``Fix @task.kubernetes to receive input and send output (#28942)``
5.2.0
.....
Features
~~~~~~~~
* ``Add deferrable mode to ''KubernetesPodOperator'' (#29017)``
* ``Allow setting the name for the base container within K8s Pod Operator (#28808)``
Bug Fixes
~~~~~~~~~
* ``Patch only single label when marking KPO checked (#29279)``
5.1.1
.....
Bug Fixes
~~~~~~~~~
* ``Fix Incorrect 'await_container_completion' (#28771)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Switch to ruff for faster static checks (#28893)``
5.1.0
.....
Features
~~~~~~~~
* ``Add Flink on K8s Operator (#28512)``
* ``Add volume-related nested template fields for KPO (#27719)``
* ``Allow longer pod names for k8s executor / KPO (#27736)``
* ``Use labels instead of pod name for pod log read in k8s exec (#28546)``
Bug Fixes
~~~~~~~~~
* ``Patch "checked" when pod not successful (#27845)``
* ``Keep pod name for k8s executor under 63 characters (#28237)``
Misc
~~~~
* ``Remove outdated compat imports/code from providers (#28507)``
* ``Restructure Docs (#27235)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Updated docs for RC3 wave of providers (#27937)``
* ``Prepare for follow-up relase for November providers (#27774)``
5.0.0
.....
.. note::
This release of provider is only available for Airflow 2.3+ as explained in the
`Apache Airflow providers support policy <https://github.com/apache/airflow/blob/main/PROVIDERS.rst#minimum-supported-version-of-airflow-for-community-managed-providers>`_.
Breaking changes
Previously KubernetesPodOperator considered some settings from the Airflow config's kubernetes section.
Such consideration was deprecated in 4.1.0 and is now removed. If you previously relied on the Airflow
config, and you want client generation to have non-default configuration, you will need to define your
configuration in an Airflow connection and set KPO to use the connection. See kubernetes provider
documentation on defining a kubernetes Airflow connection for details.
Drop support for providing resource as dict in KubernetesPodOperator. You
should use container_resources with V1ResourceRequirements.
Param node_selectors has been removed in KubernetesPodOperator; use node_selector instead.
The following backcompat modules for KubernetesPodOperator are removed and you must now use the corresponding objects from the kubernetes library:
airflow.kubernetes.backcompat.pod
airflow.kubernetes.backcompat.pod_runtime_info_env
airflow.kubernetes.backcompat.volume
airflow.kubernetes.backcompat.volume_mount
Remove deprecated backcompat objects for KPO (#27518)
Remove support for node_selectors param in KPO (#27515)
Remove unused backcompat method in k8s hook (#27490)
Drop support for providing ''resource'' as dict in ''KubernetesPodOperator'' (#27197)
Don't consider airflow core conf for KPO (#26849)
Misc
* ``Move min airflow version to 2.3.0 for all providers (#27196)``
* ``Use log.exception where more economical than log.error (#27517)``
Features
KubernetesPodOperator argument name is now optional. Previously, name was a
required argument for KubernetesPodOperator when also not supplying pod
template or full pod spec. Now, if name is not supplied, task_id will be used.
KubernetesPodOperator argument namespace is now optional. If not supplied via KPO param or pod
template file or full pod spec, then we'll check the airflow conn,
then if in a k8s pod, try to infer the namespace from the container, then finally
will use the default namespace.
When using an Airflow connection of type kubernetes, if defining the connection in an env var
or secrets backend, it's no longer necessary to prefix the "extra" fields with extra__kubernetes__.
If extra contains duplicate fields (one with prefix, one without) then the non-prefixed
one will be used.
Remove extra__kubernetes__ prefix from k8s hook extras (#27021)Add container_resources as KubernetesPodOperator templatable (#27457)add container_name option for SparkKubernetesSensor (#26560)Allow xcom sidecar container image to be configurable in KPO (#26766)Improve task_id to pod name conversion (#27524)Make pod name optional in KubernetesPodOperator (#27120)Make namespace optional for KPO (#27116)Enable template rendering for env_vars field for the @task.kubernetes decorator (#27433)Bug Fixes
* ``Fix KubernetesHook fail on an attribute absence (#25787)``
* ``Fix log message for kubernetes hooks (#26999)``
* ``KPO should use hook's get namespace method to get namespace (#27516)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Update old style typing (#26872)``
* ``Enable string normalization in python formatting - providers (#27205)``
* ``Update docs for September Provider's release (#26731)``
New deprecations
KubernetesHook.get_namespace, if a connection is defined but a namespace isn't set, we
currently return 'default'; this behavior is deprecated (#27202). In the next release, we'll return None.Deprecate use of core get_kube_client in PodManager (#26848)4.4.0 .....
Features
* ``feat(KubernetesPodOperator): Add support of container_security_context (#25530)``
* ``Add @task.kubernetes taskflow decorator (#25663)``
* ``pretty print KubernetesPodOperator rendered template env_vars (#25850)``
Bug Fixes
Avoid calculating all elements when one item is needed (#26377)Wait for xcom sidecar container to start before sidecar exec (#25055).. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* Apply PEP-563 (Postponed Evaluation of Annotations) to non-core airflow (#26289)
* Prepare to release cncf.kubernetes provider (#26588)
4.3.0 .....
Features
* ``Improve taskflow type hints with ParamSpec (#25173)``
Bug Fixes
Fix xcom_sidecar stuck problem (#24993)4.2.0 .....
Features
* ``Add 'airflow_kpo_in_cluster' label to KPO pods (#24658)``
* ``Use found pod for deletion in KubernetesPodOperator (#22092)``
Bug Fixes
Revert "Fix await_container_completion condition (#23883)" (#24474)Update providers to use functools compat for ''cached_property'' (#24582)Misc
* ``Rename 'resources' arg in Kub op to k8s_resources (#24673)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Only assert stuff for mypy when type checking (#24937)``
* ``Remove 'xcom_push' flag from providers (#24823)``
* ``More typing and minor refactor for kubernetes (#24719)``
* ``Move provider dependencies to inside provider folders (#24672)``
* ``Use our yaml util in all providers (#24720)``
* ``Remove 'hook-class-names' from provider.yaml (#24702)``
4.1.0
.....
Features
Previously, KubernetesPodOperator relied on core Airflow configuration (namely setting for kubernetes executor) for certain settings used in client generation. Now KubernetesPodOperator uses KubernetesHook, and the consideration of core k8s settings is officially deprecated.
If you are using the Airflow configuration settings (e.g. as opposed to operator params) to configure the kubernetes client, then prior to the next major release you will need to add an Airflow connection and set your KPO tasks to use that connection.
Use KubernetesHook to create api client in KubernetesPodOperator (#20578)
[FEATURE] KPO use K8S hook (#22086)
Add param docs to KubernetesHook and KubernetesPodOperator (#23955) (#24054)
Bug Fixes
* ``Use "remote" pod when patching KPO pod as "checked" (#23676)``
* ``Don't use the root logger in KPO _suppress function (#23835)``
* ``Fix await_container_completion condition (#23883)``
Misc
~~~~
* ``Migrate Cncf.Kubernetes example DAGs to new design #22441 (#24132)``
* ``Clean up f-strings in logging calls (#23597)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Add explanatory note for contributors about updating Changelog (#24229)``
* ``pydocstyle D202 added (#24221)``
* ``Prepare docs for May 2022 provider's release (#24231)``
* ``Update package description to remove double min-airflow specification (#24292)``
4.0.2
.....
Bug Fixes
Fix: Exception when parsing log #20966 (#23301)Fixed Kubernetes Operator large xcom content Defect (#23490)Clarify 'reattach_on_restart' behavior (#23377).. Below changes are excluded from the changelog. Move them to appropriate section above if needed. Do not delete the lines(!):
Add YANKED to yanked releases of the cncf.kubernetes (#23378)
Fix k8s pod.execute randomly stuck indefinitely by logs consumption (#23497) (#23618)
Revert "Fix k8s pod.execute randomly stuck indefinitely by logs consumption (#23497) (#23618)" (#23656)
4.0.1 .....
Bug Fixes
* ``Add k8s container's error message in airflow exception (#22871)``
* ``KubernetesHook should try incluster first when not otherwise configured (#23126)``
* ``KubernetesPodOperator should patch "already checked" always (#22734)``
* ``Delete old Spark Application in SparkKubernetesOperator (#21092)``
* ``Cleanup dup code now that k8s provider requires 2.3.0+ (#22845)``
* ``Fix ''KubernetesPodOperator'' with 'KubernetesExecutor'' on 2.3.0 (#23371)``
* ``Fix KPO to have hyphen instead of period (#22982)``
* ``Fix new MyPy errors in main (#22884)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Use new Breese for building, pulling and verifying the images. (#23104)``
* ``Prepare documentation for cncf.kubernetes 4.0.1 release (#23374)``
4.0.0
.....
Breaking changes
The provider in version 4.0.0 only works with Airflow 2.3+. Please upgrade Airflow to 2.3 version if you want to use the features or fixes in 4.* line of the provider.
The main reason for the incompatibility is using latest Kubernetes Libraries.
The cncf.kubernetes provider requires newer version of libraries than
Airflow 2.1 and 2.2 used for Kubernetes Executor and that makes the provider
incompatible with those Airflow versions.
Features
* ``Log traceback only on ''DEBUG'' for KPO logs read interruption (#22595)``
* ``Update our approach for executor-bound dependencies (#22573)``
* ``Optionally not follow logs in KPO pod_manager (#22412)``
Bug Fixes
Stop crashing when empty logs are received from kubernetes client (#22566)3.1.2 (YANKED) ..............
.. warning:: This release has been yanked with a reason: Installing on Airflow 2.1, 2.2 allows to install unsupported kubernetes library > 11.0.0
Bug Fixes
* ``Fix mistakenly added install_requires for all providers (#22382)``
* ``Fix "run_id" k8s and elasticsearch compatibility with Airflow 2.1 (#22385)``
Misc
~~~~
* ``Remove RefreshConfiguration workaround for K8s token refreshing (#20759)``
3.1.1 (YANKED)
..............
.. warning:: This release has been **yanked** with a reason: ``Installing on Airflow 2.1, 2.2 allows to install unsupported kubernetes library > 11.0.0``
Misc
~~~~~
* ``Add Trove classifiers in PyPI (Framework :: Apache Airflow :: Provider)``
3.1.0 (YANKED)
..............
.. warning:: This release has been **yanked** with a reason: ``Installing on Airflow 2.1, 2.2 allows to install unsupported kubernetes library > 11.0.0``
Features
~~~~~~~~
* ``Add map_index label to mapped KubernetesPodOperator (#21916)``
* ``Change KubernetesPodOperator labels from execution_date to run_id (#21960)``
Misc
~~~~
* ``Support for Python 3.10``
* ``Fix Kubernetes example with wrong operator casing (#21898)``
* ``Remove types from KPO docstring (#21826)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Add pre-commit check for docstring param types (#21398)``
3.0.2 (YANKED)
..............
.. warning:: This release has been **yanked** with a reason: ``Installing on Airflow 2.1, 2.2 allows to install unsupported kubernetes library > 11.0.0``
Bug Fixes
Add missed deprecations for cncf (#20031).. Below changes are excluded from the changelog. Move them to appropriate section above if needed. Do not delete the lines(!):
Remove ':type' lines now sphinx-autoapi supports typehints (#20951)Make ''delete_pod'' change more prominent in K8s changelog (#20753)Fix MyPy Errors for providers: Tableau, CNCF, Apache (#20654)Add optional features in providers. (#21074)Add documentation for January 2021 providers release (#21257)3.0.1 (YANKED) ..............
.. warning:: This release has been yanked with a reason: Installing on Airflow 2.1, 2.2 allows to install unsupported kubernetes library > 11.0.0
Misc
* ``Update Kubernetes library version (#18797)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
3.0.0
.....
Breaking changes
Parameter is_delete_operator_pod default is changed to True (#20575)Simplify KubernetesPodOperator (#19572)Move pod_mutation_hook call from PodManager to KubernetesPodOperator (#20596)Rename ''PodLauncher'' to ''PodManager'' (#20576)Parameter is_delete_operator_pod has new default
Previously, the default for param ``is_delete_operator_pod`` was ``False``, which means that
after a task runs, its pod is not deleted by the operator and remains on the
cluster indefinitely. With this release, we change the default to ``True``.
Notes on changes KubernetesPodOperator and PodLauncher
.. warning:: Many methods in KubernetesPodOperator and PodLauncher have been renamed.
If you have subclassed KubernetesPodOperator you will need to update your subclass to reflect
the new structure. Additionally PodStatus enum has been renamed to PodPhase.
Overview ''''''''
Generally speaking if you did not subclass KubernetesPodOperator and you did not use the PodLauncher class directly,
then you don't need to worry about this change. If however you have subclassed KubernetesPodOperator, what
follows are some notes on the changes in this release.
One of the principal goals of the refactor is to clearly separate the "get or create pod" and
"wait for pod completion" phases. Previously the "wait for pod completion" logic would be invoked
differently depending on whether the operator were to "attach to an existing pod" (e.g. after a
worker failure) or "create a new pod" and this resulted in some code duplication and a bit more
nesting of logic. With this refactor we encapsulate the "get or create" step
into method KubernetesPodOperator.get_or_create_pod, and pull the monitoring and XCom logic up
into the top level of execute because it can be the same for "attached" pods and "new" pods.
The KubernetesPodOperator.get_or_create_pod tries first to find an existing pod using labels
specific to the task instance (see KubernetesPodOperator.find_pod).
If one does not exist it creates a pod <~.PodManager.create_pod>.
The "waiting" part of execution has three components. The first step is to wait for the pod to leave the
Pending phase (~.KubernetesPodOperator.await_pod_start). Next, if configured to do so,
the operator will follow the base container logs and forward these logs to the task logger until
the base container is done. If not configured to harvest the
logs, the operator will instead KubernetesPodOperator.await_container_completion
either way, we must await container completion before harvesting xcom. After (optionally) extracting the xcom
value from the base container, we await pod completion <~.PodManager.await_pod_completion>.
Previously, depending on whether the pod was "reattached to" (e.g. after a worker failure) or
created anew, the waiting logic may have occurred in either handle_pod_overlap or create_new_pod_for_operator.
After the pod terminates, we execute different cleanup tasks depending on whether the pod terminated successfully.
If the pod terminates unsuccessfully, we attempt to log the pod events PodLauncher.read_pod_events>. If
additionally the task is configured not to delete the pod after termination, we apply a label KubernetesPodOperator.patch_already_checked>
indicating that the pod failed and should not be "reattached to" in a retry. If the task is configured
to delete its pod, we delete it KubernetesPodOperator.process_pod_deletion>. Finally,
we raise an AirflowException to fail the task instance.
If the pod terminates successfully, we delete the pod KubernetesPodOperator.process_pod_deletion>
(if configured to delete the pod) and push XCom (if configured to push XCom).
Details on method renames, refactors, and deletions '''''''''''''''''''''''''''''''''''''''''''''''''''
In KubernetesPodOperator:
create_pod_launcher is converted to cached property pod_managerCoreV1Api client is now encapsulated within cached property clientexecute and into method find_pod.handle_pod_overlap is removed. Previously it monitored a "found" pod until completion. With this change the pod monitoring (and log following) is orchestrated directly from execute and it is the same whether it's a "found" pod or a "new" pod. See methods await_pod_start, follow_container_logs, await_container_completion and await_pod_completion.create_pod_request_obj is renamed build_pod_request_obj. It now takes argument context in order to add TI-specific pod labels; previously they were added after return.create_labels_for_pod is renamed _get_ti_pod_labels. This method doesn't return all labels, but only those specific to the TI. We also add parameter include_try_number to control the inclusion of this label instead of possibly filtering it out later._get_pod_identifying_label_string is renamed _build_find_pod_label_selector_try_numbers_match is removed.create_new_pod_for_operator is removed. Previously it would mutate the labels on self.pod, launch the pod, monitor the pod to completion etc. Now this logic is in part handled by get_or_create_pod, where a new pod will be created if necessary. The monitoring etc is now orchestrated directly from execute. Again, see the calls to methods await_pod_start, follow_container_logs, await_container_completion and await_pod_completion.In class PodManager (formerly PodLauncher):
start_pod is removed and split into two methods: create_pod and await_pod_start.monitor_pod is removed and split into methods follow_container_logs, await_container_completion, await_pod_completionpod_not_started, pod_is_running, process_status, and _task_status are removed. These were needed due to the way in which pod phase was mapped to task instance states; but we no longer do such a mapping and instead deal with pod phases directly and untransformed._extract_xcom is renamed extract_xcom.read_pod_logs now takes kwarg container_nameOther changes in pod_manager.py (formerly pod_launcher.py):
pod_launcher.PodLauncher renamed to pod_manager.PodManagerPodStatus is renamed PodPhase, and the values are no longer lower-cased.airflow.settings.pod_mutation_hook is no longer called in
cncf.kubernetes.utils.pod_manager.PodManager.run_pod_async. For KubernetesPodOperator,
mutation now occurs in build_pod_request_obj.is_delete_operator_pod default is changed to True so that pods are deleted after task
completion and not left to accumulate. In practice it seems more common to disable pod deletion only on a
temporary basis for debugging purposes and therefore pod deletion is the more sensible default.Features
* ``Add params config, in_cluster, and cluster_context to KubernetesHook (#19695)``
* ``Implement dry_run for KubernetesPodOperator (#20573)``
* ``Clarify docstring for ''build_pod_request_obj'' in K8s providers (#20574)``
Bug Fixes
Fix Volume/VolumeMount KPO DeprecationWarning (#19726).. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* Fix cached_property MyPy declaration and related MyPy errors (#20226)
* Use typed Context EVERYWHERE (#20565)
* Fix template_fields type to have MyPy friendly Sequence type (#20571)
* Even more typing in operators (template_fields/ext) (#20608)
* Update documentation for provider December 2021 release (#20523)
2.2.0 .....
Features
* ``Added namespace as a template field in the KPO. (#19718)``
* ``Decouple name randomization from name kwarg (#19398)``
Bug Fixes
Checking event.status.container_statuses before filtering (#19713)Coalesce 'extra' params to None in KubernetesHook (#19694)Change to correct type in KubernetesPodOperator (#19459).. Below changes are excluded from the changelog. Move them to appropriate section above if needed. Do not delete the lines(!):
Fix duplicate changelog entries (#19759)2.1.0 .....
Features
* ``Add more type hints to PodLauncher (#18928)``
* ``Add more information to PodLauncher timeout error (#17953)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Update docstring to let users use 'node_selector' (#19057)``
* ``Add pre-commit hook for common misspelling check in files (#18964)``
2.0.3
.....
Bug Fixes
Fix KubernetesPodOperator reattach when not deleting pods (#18070)Make Kubernetes job description fit on one log line (#18377)Do not fail KubernetesPodOperator tasks if log reading fails (#17649).. Below changes are excluded from the changelog. Move them to appropriate section above if needed. Do not delete the lines(!):
Add August 2021 Provider's documentation (#17890)Static start_date and default arg cleanup for misc. provider example DAGs (#18597)Remove all deprecation warnings in providers (#17900)2.0.2 .....
Bug Fixes
* ``Fix using XCom with ''KubernetesPodOperator'' (#17760)``
* ``Import Hooks lazily individually in providers manager (#17682)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Fix messed-up changelog in 3 providers (#17380)``
* ``Fix static checks (#17256)``
* ``Update spark_kubernetes.py (#17237)``
2.0.1
.....
Features
~~~~~~~~
* ``Enable using custom pod launcher in Kubernetes Pod Operator (#16945)``
Bug Fixes
BugFix: Using 'json' string in template_field causes issue with K8s Operators (#16930).. Below changes are excluded from the changelog. Move them to appropriate section above if needed. Do not delete the lines(!):
Simplify 'default_args' in Kubernetes example DAGs (#16870)Updating task dependencies (#16624)Removes pylint from our toolchain (#16682)Prepare documentation for July release of providers. (#17015)Fixed wrongly escaped characters in amazon's changelog (#17020)2.0.0 .....
Breaking changes
* ``Auto-apply apply_default decorator (#15667)``
.. warning:: Due to apply_default decorator removal, this version of the provider requires Airflow 2.1.0+.
If your Airflow version is < 2.1.0, and you want to install this provider version, first upgrade
Airflow to at least version 2.1.0. Otherwise your Airflow package version will be upgraded
automatically and you will have to manually run ``airflow upgrade db`` to complete the migration.
Features
~~~~~~~~
* ``Add 'KubernetesPodOperator' 'pod-template-file' jinja template support (#15942)``
* ``Save pod name to xcom for KubernetesPodOperator (#15755)``
Bug Fixes
~~~~~~~~~
* ``Bug Fix Pod-Template Affinity Ignored due to empty Affinity K8S Object (#15787)``
* ``Bug Pod Template File Values Ignored (#16095)``
* ``Fix issue with parsing error logs in the KPO (#15638)``
* ``Fix unsuccessful KubernetesPodOperator final_state call when 'is_delete_operator_pod=True' (#15490)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Bump pyupgrade v2.13.0 to v2.18.1 (#15991)``
* ``Updated documentation for June 2021 provider release (#16294)``
* ``More documentation update for June providers release (#16405)``
* ``Synchronizes updated changelog after buggfix release (#16464)``
1.2.0
.....
Features
~~~~~~~~
* ``Require 'name' with KubernetesPodOperator (#15373)``
* ``Change KPO node_selectors warning to proper deprecationwarning (#15507)``
Bug Fixes
~~~~~~~~~
* ``Fix timeout when using XCom with KubernetesPodOperator (#15388)``
* ``Fix labels on the pod created by ''KubernetesPodOperator'' (#15492)``
1.1.0
.....
Features
~~~~~~~~
* ``Separate Kubernetes pod_launcher from core airflow (#15165)``
* ``Add ability to specify api group and version for Spark operators (#14898)``
* ``Use libyaml C library when available. (#14577)``
1.0.2
.....
Bug fixes
~~~~~~~~~
* ``Allow pod name override in KubernetesPodOperator if pod_template is used. (#14186)``
* ``Allow users of the KPO to *actually* template environment variables (#14083)``
1.0.1
.....
Updated documentation and readme files.
Bug fixes
~~~~~~~~~
* ``Pass image_pull_policy in KubernetesPodOperator correctly (#13289)``
1.0.0
.....
Initial version of the provider.