Back to Airflow

Changelog

providers/yandex/docs/changelog.rst

3.2.121.4 KB
Original Source

.. Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements. See the NOTICE file distributed with this work for additional information regarding copyright ownership. The ASF licenses this file to you under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at

.. http://www.apache.org/licenses/LICENSE-2.0

.. Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.

.. NOTE TO CONTRIBUTORS: Please, only add notes to the Changelog just below the "Changelog" header when there are some breaking changes and you want to add an explanation to the users on how they are supposed to deal with them. The changelog is updated and maintained semi-automatically by release manager.

apache-airflow-providers-yandex

Changelog

4.4.0 .....

Features


* ``Support Python 3.13 in Yandex provider (#61380)``

.. Below changes are excluded from the changelog. Move them to
   appropriate section above if needed. Do not delete the lines(!):

4.3.3
.....

Misc
~~~~

* ``Define 'TaskInstanceKey' in task-sdk to support client server separation (#60776)``

.. Below changes are excluded from the changelog. Move them to
   appropriate section above if needed. Do not delete the lines(!):
   * ``Rework ProvidersManager to separate runtime and infrastructure focus (#60218)``

4.3.2
.....

Misc
~~~~

* ``New year means updated Copyright notices (#60344)``
* ``Check team boundaries in connections (#59476)``
* ``Migrate yandex provider to use airflow.sdk.configuration.conf (#59992)``

.. Below changes are excluded from the changelog. Move them to
   appropriate section above if needed. Do not delete the lines(!):

4.3.1
.....

Misc
~~~~

* ``Check team boundaries in variables (#58905)``

.. Below changes are excluded from the changelog. Move them to
   appropriate section above if needed. Do not delete the lines(!):
   * ``TaskInstance unused method cleanup (#59835)``

4.3.0
.....

.. note::
    This release of provider is only available for Airflow 2.11+ as explained in the
    Apache Airflow providers support policy <https://github.com/apache/airflow/blob/main/PROVIDERS.rst#minimum-supported-version-of-airflow-for-community-managed-providers>_.

Misc
~~~~

* ``Bump minimum Airflow version in providers to Airflow 2.11.0 (#58612)``

.. Below changes are excluded from the changelog. Move them to
   appropriate section above if needed. Do not delete the lines(!):
   * ``Updates to release process of providers (#58316)``

4.2.1
.....

Misc
~~~~

* ``Convert all airflow distributions to be compliant with ASF requirements (#58138)``
* ``Migrate 'yandex' provider to 'common.compat' (#57116)``

.. Below changes are excluded from the changelog. Move them to
   appropriate section above if needed. Do not delete the lines(!):
   * ``Delete all unnecessary LICENSE Files (#58191)``
   * ``Prepare release for Oct 2025 wave of providers (#57029)``
   * ``Remove placeholder Release Date in changelog and index files (#56056)``
   * ``Prepare release for Sep 2025 2nd wave of providers (#55688)``
   * ``Enable pt011 rule 1 (#55706)``
   * ``Prepare release for Sep 2025 1st wave of providers (#55203)``
   * ``Fix Airflow 2 reference in README/index of providers (#55240)``
   * ``Make term Dag consistent in providers docs (#55101)``
   * ``Move trigger_rule utils from 'airflow/utils'  to 'airflow.task'and integrate with Execution API spec (#53389)``
   * ``Switch pre-commit to prek (#54258)``

4.2.0
.....

Features
  • Add environment and oslogin for yandex dataproc create cluster (#52973)

Misc


* ``Fix unreachable code errors in yandex provider (#53453)``
* ``Add Python 3.13 support for Airflow. (#46891)``
* ``Remove type ignore across codebase after mypy upgrade (#53243)``
* ``Remove upper-binding for "python-requires" (#52980)``
* ``Temporarily switch to use >=,< pattern instead of '~=' (#52967)``
* ``Moving BaseHook usages to version_compat for yandex (#52963)``

.. Below changes are excluded from the changelog. Move them to
   appropriate section above if needed. Do not delete the lines(!):
   * ``Deprecate decorators from Core (#53629)``
   * ``Cleanup type ignores in yandex provider where possible (#53251)``
   * ``Make dag_version_id in TI non-nullable (#50825)``

4.1.1
.....

Misc
  • Move 'BaseHook' implementation to task SDK (#51873)
  • Provider Migration: Update yandex provider for Airflow 3.0 compatibility (#52422)
  • Drop support for Python 3.9 (#52072)

.. Below changes are excluded from the changelog. Move them to appropriate section above if needed. Do not delete the lines(!):

4.1.0 .....

.. note:: This release of provider is only available for Airflow 2.10+ as explained in the Apache Airflow providers support policy https://github.com/apache/airflow/blob/main/PROVIDERS.rst#minimum-supported-version-of-airflow-for-community-managed-providers_.

Misc


* ``Bump min Airflow version in providers to 2.10 (#49843)``

.. Below changes are excluded from the changelog. Move them to
   appropriate section above if needed. Do not delete the lines(!):
   * ``Update description of provider.yaml dependencies (#50231)``
   * ``Avoid committing history for providers (#49907)``
   * ``Prepare docs for Apr 2nd wave of providers (#49051)``
   * ``Remove unnecessary entries in get_provider_info and update the schema (#48849)``
   * ``Remove fab from preinstalled providers (#48457)``
   * ``Improve documentation building iteration (#48760)``
   * ``Prepare docs for Apr 1st wave of providers (#48828)``
   * ``Simplify tooling by switching completely to uv (#48223)``

4.0.3
.....

Misc
  • AIP-72: Handle Custom XCom Backend on Task SDK (#47339)

.. Below changes are excluded from the changelog. Move them to appropriate section above if needed. Do not delete the lines(!):

  • Upgrade providers flit build requirements to 3.12.0 (#48362)
  • Move airflow sources to airflow-core package (#47798)
  • Remove links to x/twitter.com (#47801)

4.0.2 .....

Misc


* ``AIP-72: Moving BaseOperatorLink to task sdk (#47008)``
* ``Remove yandexcloud exclusions (#47309)``
* ``Replace ydb limitation with yandexcloud exclusion (#47142)``
* ``Upgrade flit to 3.11.0 (#46938)``

.. Below changes are excluded from the changelog. Move them to
   appropriate section above if needed. Do not delete the lines(!):
   * ``Move tests_common package to devel-common project (#47281)``
   * ``Improve documentation for updating provider dependencies (#47203)``
   * ``Add legacy namespace packages to airflow.providers (#47064)``
   * ``Remove extra whitespace in provider readme template (#46975)``

4.0.1
.....

Misc
  • AIP-72: Support better type-hinting for Context dict in SDK (#45583)

.. Below changes are excluded from the changelog. Move them to appropriate section above if needed. Do not delete the lines(!):

  • Move provider_tests to unit folder in provider tests (#46800)
  • Removed the unused provider's distribution (#46608)
  • Moving yandex provider to new provider structure (#46525)
  • Fix doc issues found with recent moves (#46372)
  • Move TERADATA provider to new structure (#46060)

4.0.0 .....

.. note:: This release of provider is only available for Airflow 2.9+ as explained in the Apache Airflow providers support policy <https://github.com/apache/airflow/blob/main/PROVIDERS.rst#minimum-supported-version-of-airflow-for-community-managed-providers>_.

Breaking changes


.. warning::
  All deprecated classes, parameters and features have been removed from the {provider_name} provider package.
  The following breaking changes were introduced:

  * removed ``YandexCloudBaseHook.provider_user_agent`` . Use ``utils.user_agent.provider_user_agent`` instead.
  * removed ``connection_id`` parameter from ``YandexCloudBaseHook``. Use ``yandex_conn_id`` parameter.
  * removed ``yandex.hooks.yandexcloud_dataproc`` module.
  * removed ``yandex.operators.yandexcloud_dataproc`` module.
  * removed implicit passing of ``yandex_conn_id``  in ``DataprocBaseOperator``. Please pass it as a parameter.

* ``Remove Provider Deprecations in Yandex provider (#44754)``

Misc
~~~~

* ``Bump minimum Airflow version in providers to Airflow 2.9.0 (#44956)``
* ``Update DAG example links in multiple providers documents (#44034)``


.. Below changes are excluded from the changelog. Move them to
   appropriate section above if needed. Do not delete the lines(!):
   * ``Use Python 3.9 as target version for Ruff & Black rules (#44298)``
   * ``Prepare docs for Nov 1st wave of providers (#44011)``
   * ``Split providers out of the main "airflow/" tree into a UV workspace project (#42505)``
   * ``Update path of example dags in docs (#45069)``

3.12.0
......

.. note::
  This release of provider is only available for Airflow 2.8+ as explained in the
  `Apache Airflow providers support policy <https://github.com/apache/airflow/blob/main/PROVIDERS.rst#minimum-supported-version-of-airflow-for-community-managed-providers>`_.

Bug Fixes
~~~~~~~~~

* ``providers/yandex: fix typing (#40997)``

Misc
~~~~

* ``Bump minimum Airflow version in providers to Airflow 2.8.0 (#41396)``

.. Below changes are excluded from the changelog. Move them to
   appropriate section above if needed. Do not delete the lines(!):
   * ``Prepare docs for Aug 1st wave of providers (#41230)``
   * ``Prepare docs 1st wave July 2024 (#40644)``
   * ``Enable enforcing pydocstyle rule D213 in ruff. (#40448)``

3.11.2
......

Bug Fixes
~~~~~~~~~

* ``Exclude yandex versions 0.289.0, 0.290.0 (#39974)``

Misc
~~~~

* ``Fix typos in Providers docs and Yandex hook (#40277)``

.. Below changes are excluded from the changelog. Move them to
   appropriate section above if needed. Do not delete the lines(!):
   * ``Limit yandex provider to avoid mypy errors (#39990)``
   * ``Workaround new yandexcloud breaking dataproc integration (#39964)``

3.11.1
......

Misc
~~~~

* `` AIP-21: yandexcloud: rename files, emit deprecation warning (#39618)``
* ``yandex provider: bump version for yq http client package (#39548)``
* ``Faster 'airflow_version' imports (#39552)``
* ``add doc about Yandex Query operator (#39445)``
* ``Simplify 'airflow_version' imports (#39497)``

.. Below changes are excluded from the changelog. Move them to
   appropriate section above if needed. Do not delete the lines(!):
   * ``Reapply templates for all providers (#39554)``

3.11.0
......

.. note::
  This release of provider is only available for Airflow 2.7+ as explained in the
  `Apache Airflow providers support policy <https://github.com/apache/airflow/blob/main/PROVIDERS.rst#minimum-supported-version-of-airflow-for-community-managed-providers>`_.

Misc
~~~~

* ``Bump minimum Airflow version in providers to Airflow 2.7.0 (#39240)``

3.10.0
......

Features
~~~~~~~~

* ``Add Yandex Query support from Yandex.Cloud (#37458)``

Misc
~~~~

* ``support iam token from metadata, simplify code (#38411)``
* ``Avoid use of 'assert' outside of the tests (#37718)``

.. Below changes are excluded from the changelog. Move them to
   appropriate section above if needed. Do not delete the lines(!):
   * ``Prepare docs 1st wave (RC1) April 2024 (#38863)``
   * ``docs: yandex provider grammatical improvements (#38589)``
   * ``Bump ruff to 0.3.3 (#38240)``
   * ``Prepare docs 1st wave (RC1) March 2024 (#37876)``
   * ``Add comment about versions updated by release manager (#37488)``

3.9.0
.....

Features
~~~~~~~~

* ``Add secrets-backends section into the Yandex provider yaml definition (#37065)``

Bug Fixes
~~~~~~~~~

* ``fix: using endpoint from connection if not specified (#37076)``

.. Below changes are excluded from the changelog. Move them to
   appropriate section above if needed. Do not delete the lines(!):
   * ``D401 Support in Providers (simple) (#37258)``
   * ``docs: update description in airflow provider.yaml (#37096)``

3.8.0
.....

Features
~~~~~~~~

* ``feat: add Yandex Cloud Lockbox secrets backend (#36449)``


Bug Fixes
~~~~~~~~~

* ``Fix stacklevel in warnings.warn into the providers (#36831)``

.. Below changes are excluded from the changelog. Move them to
   appropriate section above if needed. Do not delete the lines(!):
   * ``Prepare docs 1st wave of Providers January 2024 (#36640)``
   * ``Speed up autocompletion of Breeze by simplifying provider state (#36499)``
   * ``Provide the logger_name param in providers hooks in order to override the logger name (#36675)``
   * ``Revert "Provide the logger_name param in providers hooks in order to override the logger name (#36675)" (#37015)``
   * ``Prepare docs 2nd wave of Providers January 2024 (#36945)``

3.7.1
.....

Bug Fixes
~~~~~~~~~

* ``Follow BaseHook connection fields method signature in child classes (#36086)``

.. Below changes are excluded from the changelog. Move them to
   appropriate section above if needed. Do not delete the lines(!):

3.7.0
.....

.. note::
  This release of provider is only available for Airflow 2.6+ as explained in the
  `Apache Airflow providers support policy <https://github.com/apache/airflow/blob/main/PROVIDERS.rst#minimum-supported-version-of-airflow-for-community-managed-providers>`_.

Misc
~~~~

* ``Bump minimum Airflow version in providers to Airflow 2.6.0 (#36017)``

.. Below changes are excluded from the changelog. Move them to
   appropriate section above if needed. Do not delete the lines(!):
   * ``Fix and reapply templates for provider documentation (#35686)``
   * ``Prepare docs 2nd wave of Providers November 2023 (#35836)``
   * ``Use reproducible builds for providers (#35693)``

3.6.0
.....

Features
~~~~~~~~

* ``Yandex dataproc deduce default service account (#35059)``

.. Below changes are excluded from the changelog. Move them to
   appropriate section above if needed. Do not delete the lines(!):
   * ``Prepare docs 3rd wave of Providers October 2023 - FIX (#35233)``
   * ``Prepare docs 3rd wave of Providers October 2023 (#35187)``
   * ``Pre-upgrade 'ruff==0.0.292' changes in providers (#35053)``

3.5.0
.....

.. note::
  This release of provider is only available for Airflow 2.5+ as explained in the
  `Apache Airflow providers support policy <https://github.com/apache/airflow/blob/main/PROVIDERS.rst#minimum-supported-version-of-airflow-for-community-managed-providers>`_.

Misc
~~~~

* ``Bump min airflow version of providers (#34728)``

3.4.0
.....

.. note::
  This release dropped support for Python 3.7

Features
~~~~~~~~

* ``add support for Yandex Dataproc cluster labels (#29811)``

.. Below changes are excluded from the changelog. Move them to
   appropriate section above if needed. Do not delete the lines(!):
   * ``Add note about dropping Python 3.7 for providers (#32015)``
   * ``Add D400 pydocstyle check - Providers (#31427)``
   * ``Add full automation for min Airflow version for providers (#30994)``
   * ``Add mechanism to suspend providers (#30422)``
   * ``Resume yandex provider (#33574)``
   * ``Remove spurious headers for provider changelogs (#32373)``
   * ``Improve provider documentation and README structure (#32125)``
   * ``Use '__version__' in providers not 'version' (#31393)``
   * ``Use 'AirflowProviderDeprecationWarning' in providers (#30975)``
   * ``Bump minimum Airflow version in providers (#30917)``
   * ``Suspend Yandex provider due to protobuf limitation (#30667)``

3.3.0
.....

Features
~~~~~~~~

* ``support Yandex SDK feature "endpoint" (#29635)``

3.2.0
.....

.. note::
  This release of provider is only available for Airflow 2.3+ as explained in the
  Apache Airflow providers support policy <https://github.com/apache/airflow/blob/main/PROVIDERS.rst#minimum-supported-version-of-airflow-for-community-managed-providers>`_.

Features
~~~~~~~~

* In YandexCloudBaseHook, non-prefixed extra fields are supported and are preferred (#27040).  E.g. ``folder_id`` will be preferred if ``extra__yandexcloud__folder_id`` is also present.

Misc
~~~~

* ``Move min airflow version to 2.3.0 for all providers (#27196)``

.. Below changes are excluded from the changelog. Move them to
   appropriate section above if needed. Do not delete the lines(!):
   * ``Enable string normalization in python formatting - providers (#27205)``
   * ``Update docs for September Provider's release (#26731)``
   * ``Apply PEP-563 (Postponed Evaluation of Annotations) to non-core airflow (#26289)``
   * ``pRepare docs for November 2022 wave of Providers (#27613)``
   * ``Prepare for follow-up release for November providers (#27774)``

3.1.0
.....

Features
~~~~~~~~

* ``YandexCloud provider: Support new Yandex SDK features for DataProc (#25158)``

.. Below changes are excluded from the changelog. Move them to
   appropriate section above if needed. Do not delete the lines(!):
   * ``Add documentation for July 2022 Provider's release (#25030)``
   * ``Move provider dependencies to inside provider folders (#24672)``
   * ``Remove 'hook-class-names' from provider.yaml (#24702)``

3.0.0
.....

Breaking changes

.. note:: This release of provider is only available for Airflow 2.2+ as explained in the Apache Airflow Apache Airflow providers support policy https://github.com/apache/airflow/blob/main/PROVIDERS.rst#minimum-supported-version-of-airflow-for-community-managed-providers`_.

.. Below changes are excluded from the changelog. Move them to appropriate section above if needed. Do not delete the lines(!):

  • Migrate Yandex example DAGs to new design AIP-47 (#24082)
  • Add explanatory note for contributors about updating Changelog (#24229)
  • Prepare docs for May 2022 provider's release (#24231)
  • Update package description to remove double min-airflow specification (#24292)

2.2.3 .....

Bug Fixes


* ``Fix mistakenly added install_requires for all providers (#22382)``

2.2.2
.....

Misc
~~~~~

* ``Add Trove classifiers in PyPI (Framework :: Apache Airflow :: Provider)``

2.2.1
.....

Misc
~~~~

* ``Support for Python 3.10``

.. Below changes are excluded from the changelog. Move them to
   appropriate section above if needed. Do not delete the lines(!):
   * ``Fixed changelog for January 2022 (delayed) provider's release (#21439)``
   * ``Add documentation for January 2021 providers release (#21257)``
   * ``Add optional features in providers. (#21074)``
   * ``Remove ':type' lines now sphinx-autoapi supports typehints (#20951)``
   * ``Fix spelling (#22054)``

2.2.0
.....

Features
~~~~~~~~

* ``YandexCloud provider: Support new Yandex SDK features: log_group_id, user-agent, maven packages (#20103)``


.. Below changes are excluded from the changelog. Move them to
   appropriate section above if needed. Do not delete the lines(!):
   * ``Fix mypy for providers: elasticsearch, oracle, yandex (#20344)``
   * ``Fixup string concatenations (#19099)``
   * ``Update documentation for November 2021 provider's release (#19882)``
   * ``Prepare documentation for October Provider's release (#19321)``
   * ``Update documentation for September providers release (#18613)``
   * ``Static start_date and default arg cleanup for misc. provider example DAGs (#18597)``
   * ``Inclusive Language (#18349)``
   * ``Use typed Context EVERYWHERE (#20565)``
   * ``Fix template_fields type to have MyPy friendly Sequence type (#20571)``
   * ``Update documentation for provider December 2021 release (#20523)``

2.1.0
.....

Misc
~~~~

* ``Optimise connection importing for Airflow 2.2.0``


Features
~~~~~~~~

* ``Add autoscaling subcluster support and remove defaults (#17033)``


.. Below changes are excluded from the changelog. Move them to
   appropriate section above if needed. Do not delete the lines(!):
   * ``Update description about the new ''connection-types'' provider meta-data (#17767)``
   * ``Import Hooks lazily individually in providers manager (#17682)``
   * ``Prepares docs for Rc2 release of July providers (#17116)``
   * ``Remove/refactor default_args pattern for miscellaneous providers (#16872)``
   * ``Prepare documentation for July release of providers. (#17015)``
   * ``Removes pylint from our toolchain (#16682)``

2.0.0
.....

Breaking changes
  • Auto-apply apply_default decorator (#15667)

.. warning:: Due to apply_default decorator removal, this version of the provider requires Airflow 2.1.0+. If your Airflow version is < 2.1.0, and you want to install this provider version, first upgrade Airflow to at least version 2.1.0. Otherwise your Airflow package version will be upgraded automatically and you will have to manually run airflow upgrade db to complete the migration.

.. Below changes are excluded from the changelog. Move them to appropriate section above if needed. Do not delete the lines(!):

  • Adds interactivity when generating provider documentation. (#15518)
  • Prepares provider release after PIP 21 compatibility (#15576)
  • Update docstrings to adhere to sphinx standards (#14918)
  • Remove Backport Providers (#14886)
  • Update documentation for broken package releases (#14734)
  • Updated documentation for June 2021 provider release (#16294)
  • Fix Sphinx Issues with Docstrings (#14968)
  • More documentation update for June providers release (#16405)
  • Synchronizes updated changelog after buggfix release (#16464)

1.0.1 .....

Updated documentation and readme files.

1.0.0 .....

Initial version of the provider.