Back to Airflow

Changelog

providers/jdbc/docs/changelog.rst

3.2.122.6 KB
Original Source

.. Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements. See the NOTICE file distributed with this work for additional information regarding copyright ownership. The ASF licenses this file to you under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at

.. http://www.apache.org/licenses/LICENSE-2.0

.. Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.

.. NOTE TO CONTRIBUTORS: Please, only add notes to the Changelog just below the "Changelog" header when there are some breaking changes and you want to add an explanation to the users on how they are supposed to deal with them. The changelog is updated and maintained semi-automatically by release manager.

apache-airflow-providers-jdbc

Changelog

5.4.1 .....

Misc


* `` Migrate JDBC connection UI metadata to YAML (#62427)``

.. Below changes are excluded from the changelog. Move them to
   appropriate section above if needed. Do not delete the lines(!):

5.4.0
.....

Features
  • feat: Add Hook Level Lineage to SQL hooks (#61535)

Bug Fixes


* ``Providers: JDBC provider updated for conf import migration (#61413)``

.. Below changes are excluded from the changelog. Move them to
   appropriate section above if needed. Do not delete the lines(!):
   * ``Add 'lifecycle' field to provider.yaml schema and all providers per AIP-95 (#62190)``
   * ``Cleanup SQLA1.4 related code (#61408)``

5.3.2
.....

Misc
~~~~

* ``New year means updated Copyright notices (#60344)``

.. Below changes are excluded from the changelog. Move them to
   appropriate section above if needed. Do not delete the lines(!):

5.3.1
.....

Misc
~~~~

* ``Add backcompat for exceptions in providers (#58727)``

.. Below changes are excluded from the changelog. Move them to
   appropriate section above if needed. Do not delete the lines(!):

5.3.0
.....

.. note::
    This release of provider is only available for Airflow 2.11+ as explained in the
    Apache Airflow providers support policy <https://github.com/apache/airflow/blob/main/PROVIDERS.rst#minimum-supported-version-of-airflow-for-community-managed-providers>_.

Misc
~~~~

* ``Bump minimum Airflow version in providers to Airflow 2.11.0 (#58612)``

.. Below changes are excluded from the changelog. Move them to
   appropriate section above if needed. Do not delete the lines(!):
   * ``Updates to release process of providers (#58316)``

5.2.5
.....

Misc
~~~~

* ``Convert all airflow distributions to be compliant with ASF requirements (#58138)``

.. Below changes are excluded from the changelog. Move them to
   appropriate section above if needed. Do not delete the lines(!):
   * ``Delete all unnecessary LICENSE Files (#58191)``
   * ``Enable PT006 rule to jdbc Provider test (#57919)``

5.2.4
.....

Misc
~~~~

* ``Migrate jdbc and jenkins providers to ''common.compat'' (#57012)``

Doc-only
~~~~~~~~

* ``Remove placeholder Release Date in changelog and index files (#56056)``

.. Below changes are excluded from the changelog. Move them to
   appropriate section above if needed. Do not delete the lines(!):

5.2.3
.....


Bug Fixes
  • Fixed resolving of dialect name when host of JdbcHook is an JDBC URL (#54446)

Doc-only


* ``Make term Dag consistent in providers docs (#55101)``

.. Below changes are excluded from the changelog. Move them to
   appropriate section above if needed. Do not delete the lines(!):
   * ``Add rudimentary support for psycopg3 (#52976)``
   * ``Switch pre-commit to prek (#54258)``
   * ``Add CI support for SQLAlchemy 2.0 (#52233)``
   * ``Fix Airflow 2 reference in README/index of providers (#55240)``

5.2.2
.....

Misc
~~~~

* ``Add Python 3.13 support for Airflow. (#46891)``
* ``Add type ignore unreachable for get_autocommit in jdbc provider (#53434)``
* ``Remove type ignore across codebase after mypy upgrade (#53243)``
* ``Remove upper-binding for "python-requires" (#52980)``
* ``Temporarily switch to use >=,< pattern instead of '~=' (#52967)``

.. Below changes are excluded from the changelog. Move them to
   appropriate section above if needed. Do not delete the lines(!):

5.2.1
.....

Misc
~~~~

* ``Move 'BaseHook' implementation to task SDK (#51873)``
* ``Drop support for Python 3.9 (#52072)``

.. Below changes are excluded from the changelog. Move them to
   appropriate section above if needed. Do not delete the lines(!):
   * ``Remove pytest.mark.db_test: jdbc (#52061)``
   * ``Introducing fixture to create 'Connections' without DB in provider tests (#51930)``

5.2.0
.....

.. note::
    This release of provider is only available for Airflow 2.10+ as explained in the
    Apache Airflow providers support policy <https://github.com/apache/airflow/blob/main/PROVIDERS.rst#minimum-supported-version-of-airflow-for-community-managed-providers>_.

Misc
~~~~

* ``Bump min Airflow version in providers to 2.10 (#49843)``

.. Below changes are excluded from the changelog. Move them to
   appropriate section above if needed. Do not delete the lines(!):
   * ``Update description of provider.yaml dependencies (#50231)``
   * ``Avoid committing history for providers (#49907)``

5.1.0
.....

Features
  • feat: overwrite 'get_uri' for 'JDBC' (#48915)

.. Below changes are excluded from the changelog. Move them to appropriate section above if needed. Do not delete the lines(!):

  • Prepare docs for Apr 2nd wave of providers (#49051)
  • Remove unnecessary entries in get_provider_info and update the schema (#48849)
  • Remove fab from preinstalled providers (#48457)
  • Improve documentation building iteration (#48760)
  • Prepare docs for Apr 1st wave of providers (#48828)
  • Simplify tooling by switching completely to uv (#48223)
  • Prepare docs for Mar 2nd wave of providers (#48383)
  • Upgrade providers flit build requirements to 3.12.0 (#48362)
  • Move airflow sources to airflow-core package (#47798)
  • Remove links to x/twitter.com (#47801)

5.0.1 .....

Misc


* ``Upgrade flit to 3.11.0 (#46938)``

.. Below changes are excluded from the changelog. Move them to
   appropriate section above if needed. Do not delete the lines(!):
   * ``Move tests_common package to devel-common project (#47281)``
   * ``Improve documentation for updating provider dependencies (#47203)``
   * ``Add legacy namespace packages to airflow.providers (#47064)``
   * ``Remove extra whitespace in provider readme template (#46975)``
   * ``Prepare docs for Feb 1st wave of providers (#46893)``
   * ``Move provider_tests to unit folder in provider tests (#46800)``
   * ``Removed the unused provider's distribution (#46608)``
   * ``Moving EmptyOperator to standard provider (#46231)``
   * ``Fix doc issues found with recent moves (#46372)``
   * ``Move jdbc Provider to the new structure (#46269)``

5.0.0
.....

.. note::
  This release of provider is only available for Airflow 2.9+ as explained in the
  `Apache Airflow providers support policy <https://github.com/apache/airflow/blob/main/PROVIDERS.rst#minimum-supported-version-of-airflow-for-community-managed-providers>`_.

Breaking changes

.. warning:: All deprecated classes, parameters and features have been removed from the JDBC provider package. The following breaking changes were introduced:

  • Operators

    • Remove airflow.providers.jdbc.operators.jdbc.JdbcOperator. Please use airflow.providers.common.sql.operators.sql.SQLExecuteQueryOperator instead.
  • Remove Provider Deprecations in JDBC (#44662)

Bug Fixes


* ``Made get_conn in JdbcHook threadsafe to avoid OSError: JVM is already started (#44718)``
* ``Suppress JException when get_autocommit and set_autocommit methods aren't supported on JDBC driver (#43786)``

Misc
~~~~

* ``Bump minimum Airflow version in providers to Airflow 2.9.0 (#44956)``
* ``Update DAG example links in multiple providers documents (#44034)``


.. Below changes are excluded from the changelog. Move them to
   appropriate section above if needed. Do not delete the lines(!):
   * ``Use Python 3.9 as target version for Ruff & Black rules (#44298)``
   * ``Update path of example dags in docs (#45069)``
   * ``Allow configuration of sqlalchemy query parameter for JdbcHook and PostgresHook through extras (#44910)``

4.5.3
.....

Misc
~~~~

* ``Add support for semicolon stripping to DbApiHook, PrestoHook, and TrinoHook (#41916)``


.. Below changes are excluded from the changelog. Move them to
   appropriate section above if needed. Do not delete the lines(!):
   * ``Start porting DAG definition code to the Task SDK (#43076)``
   * ``Split providers out of the main "airflow/" tree into a UV workspace project (#42505)``

4.5.2
.....

Bug Fixes
  • FIX: Only pass connection to sqlalchemy engine in JdbcHook (#42705)

.. Below changes are excluded from the changelog. Move them to appropriate section above if needed. Do not delete the lines(!):

4.5.1 .....

Misc


* ``Generalize caching of connection in DbApiHook to improve performance (#40751)``


.. Below changes are excluded from the changelog. Move them to
   appropriate section above if needed. Do not delete the lines(!):

4.5.0
.....

.. note::
  This release of provider is only available for Airflow 2.8+ as explained in the
  `Apache Airflow providers support policy <https://github.com/apache/airflow/blob/main/PROVIDERS.rst#minimum-supported-version-of-airflow-for-community-managed-providers>`_.

Misc
  • Bump minimum Airflow version in providers to Airflow 2.8.0 (#41396)

.. Below changes are excluded from the changelog. Move them to appropriate section above if needed. Do not delete the lines(!):

4.4.0 .....

Features


* ``Create SQLAlchemy engine from connection in DB Hook and added autocommit param to insert_rows method (#40669)``

Misc
~~~~

* ``Clean up remaining getattr connection DbApiHook (#40665)``


.. Below changes are excluded from the changelog. Move them to
   appropriate section above if needed. Do not delete the lines(!):
   * ``Prepare docs 1st wave July 2024 (#40644)``
   * ``Enable enforcing pydocstyle rule D213 in ruff. (#40448)``

4.3.1
.....

Misc
~~~~

* ``Faster 'airflow_version' imports (#39552)``
* ``Simplify 'airflow_version' imports (#39497)``

.. Below changes are excluded from the changelog. Move them to
   appropriate section above if needed. Do not delete the lines(!):
   * ``Reapply templates for all providers (#39554)``

4.3.0
.....

.. note::
  This release of provider is only available for Airflow 2.7+ as explained in the
  `Apache Airflow providers support policy <https://github.com/apache/airflow/blob/main/PROVIDERS.rst#minimum-supported-version-of-airflow-for-community-managed-providers>`_.

Bug Fixes
  • Suppress jaydebeapi.Error when setAutoCommit or getAutoCommit is unsupported by JDBC driver (#38707)

Misc


* ``Bump minimum Airflow version in providers to Airflow 2.7.0 (#39240)``
* ``Add stacklevel into the 'suppress_and_warn' warning (#39263)``

.. Below changes are excluded from the changelog. Move them to
   appropriate section above if needed. Do not delete the lines(!):
   * ``Add comment about versions updated by release manager (#37488)``
   * ``Prepare docs 1st wave (RC1) April 2024 (#38863)``
   * ``Prepare docs 1st wave (RC1) March 2024 (#37876)``

4.2.2
.....

Misc
  • feat: Switch all class, functions, methods deprecations to decorators (#36876)

.. Below changes are excluded from the changelog. Move them to appropriate section above if needed. Do not delete the lines(!):

  • Add docs for RC2 wave of providers for 2nd round of Jan 2024 (#37019)
  • Prepare docs 2nd wave of Providers January 2024 (#36945)
  • Prepare docs 1st wave of Providers January 2024 (#36640)
  • Speed up autocompletion of Breeze by simplifying provider state (#36499)

4.2.1 .....

Bug Fixes


* ``Follow BaseHook connection fields method signature in child classes (#36086)``

.. Below changes are excluded from the changelog. Move them to
   appropriate section above if needed. Do not delete the lines(!):

4.2.0
.....

.. note::
  This release of provider is only available for Airflow 2.6+ as explained in the
  `Apache Airflow providers support policy <https://github.com/apache/airflow/blob/main/PROVIDERS.rst#minimum-supported-version-of-airflow-for-community-managed-providers>`_.

Misc
~~~~

* ``Bump minimum Airflow version in providers to Airflow 2.6.0 (#36017)``
* ``Add configuration ref to "providers.jdbc" (#35580)``

.. Below changes are excluded from the changelog. Move them to
   appropriate section above if needed. Do not delete the lines(!):
   * ``Fix and reapply templates for provider documentation (#35686)``
   * ``Prepare docs 3rd wave of Providers October 2023 - FIX (#35233)``
   * ``Prepare docs 2nd wave of Providers November 2023 (#35836)``
   * ``Use reproducible builds for providers (#35693)``
   * ``Prepare docs 1st wave of Providers November 2023 (#35537)``
   * ``Prepare docs 3rd wave of Providers October 2023 (#35187)``
   * ``Pre-upgrade 'ruff==0.0.292' changes in providers (#35053)``

4.1.0
.....

.. note::
  This release of provider is only available for Airflow 2.5+ as explained in the
  `Apache Airflow providers support policy <https://github.com/apache/airflow/blob/main/PROVIDERS.rst#minimum-supported-version-of-airflow-for-community-managed-providers>`_.

Misc
~~~~

* ``Bump min airflow version of providers (#34728)``

4.0.2
.....

Misc
~~~~~

* ``Improve modules import in Airflow providers by some of them into a type-checking block (#33754)``


4.0.1
.....

Misc
~~~~

* ``Add deprecation info to the providers modules and classes docstring (#32536)``

.. Below changes are excluded from the changelog. Move them to
   appropriate section above if needed. Do not delete the lines(!):
   * ``Prepare docs for July 2023 wave of Providers (RC2) (#32381)``
   * ``Remove spurious headers for provider changelogs (#32373)``
   * ``Prepare docs for July 2023 wave of Providers (#32298)``
   * ``Improve provider documentation and README structure (#32125)``

4.0.0
.....

.. note::
  This release dropped support for Python 3.7

Breaking changes

To configure driver parameters (driver path and driver class), you can use the following methods:

  1. Supply them as constructor arguments when instantiating the hook.
  2. Set the driver_path and/or driver_class parameters in the hook_params dictionary when creating the hook using SQL operators.
  3. Set the driver_path and/or driver_class extra in the connection and correspondingly enable the allow_driver_path_in_extra and/or allow_driver_class_in_extra options in the providers.jdbc section of the Airflow configuration.
  4. Patch the JdbcHook.default_driver_path and/or JdbcHook.default_driver_class values in the local_settings.py file.
  • Restrict direct usage of driver params via extras for JDBC connection (#31849)

.. Below changes are excluded from the changelog. Move them to appropriate section above if needed. Do not delete the lines(!):

  • Improve docstrings in providers (#31681)
  • Add D400 pydocstyle check - Providers (#31427)
  • Add note about dropping Python 3.7 for providers (#32015)

3.4.0 .....

.. note:: This release of provider is only available for Airflow 2.4+ as explained in the Apache Airflow providers support policy <https://github.com/apache/airflow/blob/main/PROVIDERS.rst#minimum-supported-version-of-airflow-for-community-managed-providers>_.

Misc


* ``Bump minimum Airflow version in providers (#30917)``

.. Below changes are excluded from the changelog. Move them to
   appropriate section above if needed. Do not delete the lines(!):
   * ``Add full automation for min Airflow version for providers (#30994)``
   * ``Add mechanism to suspend providers (#30422)``
   * ``Use 'AirflowProviderDeprecationWarning' in providers (#30975)``
   * ``Use '__version__' in providers not 'version' (#31393)``
   * ``Fixing circular import error in providers caused by airflow version check (#31379)``
   * ``Prepare docs for May 2023 wave of Providers (#31252)``

3.3.0
.....

.. note::
  This release of provider is only available for Airflow 2.3+ as explained in the
  `Apache Airflow providers support policy <https://github.com/apache/airflow/blob/main/PROVIDERS.rst#minimum-supported-version-of-airflow-for-community-managed-providers>`_.

Misc
  • Move min airflow version to 2.3.0 for all providers (#27196)

Features


In JdbcHook, non-prefixed extra fields are supported and are preferred.  E.g. ``drv_path`` will
be preferred if ``extra__jdbc__drv_path`` is also present.

* ``Allow and prefer non-prefixed extra fields for JdbcHook (#27044)``
* ``Add SQLExecuteQueryOperator (#25717)``

Bug Fixes
  • Bump common.sql provider to 1.3.1 (#27888)

.. Below changes are excluded from the changelog. Move them to appropriate section above if needed. Do not delete the lines(!):

  • Look for 'extra__' instead of 'extra_' in 'get_field' (#27489)
  • Update old style typing (#26872)
  • Enable string normalization in python formatting - providers (#27205)
  • pRepare docs for November 2022 wave of Providers (#27613)
  • Prepare for follow-up release for November providers (#27774)

3.2.1 .....

Misc


* ``Add common-sql lower bound for common-sql (#25789)``

.. Below changes are excluded from the changelog. Move them to
   appropriate section above if needed. Do not delete the lines(!):
   * ``Apply PEP-563 (Postponed Evaluation of Annotations) to non-core airflow (#26289)``

3.2.0
.....

Features
  • Adding configurable fetch_all_handler for JdbcOperator (#25412)
  • Unify DbApiHook.run() method with the methods which override it (#23971)

3.1.0 .....

Features


* ``Move all SQL classes to common-sql provider (#24836)``

.. Below changes are excluded from the changelog. Move them to
   appropriate section above if needed. Do not delete the lines(!):
   * ``Move provider dependencies to inside provider folders (#24672)``
   * ``Remove 'hook-class-names' from provider.yaml (#24702)``

3.0.0
.....

Breaking changes

.. note:: This release of provider is only available for Airflow 2.2+ as explained in the Apache Airflow providers support policy <https://github.com/apache/airflow/blob/main/PROVIDERS.rst#minimum-supported-version-of-airflow-for-community-managed-providers>_.

Features


* ``Handler parameter from 'JdbcOperator' to 'JdbcHook.run' (#23817)``

.. Below changes are excluded from the changelog. Move them to
   appropriate section above if needed. Do not delete the lines(!):
   * ``Add explanatory note for contributors about updating Changelog (#24229)``
   * ``Migrate JDBC example DAGs to new design #22450 (#24137)``
   * ``Prepare provider documentation 2022.05.11 (#23631)``
   * ``Use new Breese for building, pulling and verifying the images. (#23104)``
   * ``Replace usage of 'DummyOperator' with 'EmptyOperator' (#22974)``
   * ``Prepare docs for May 2022 provider's release (#24231)``
   * ``Update package description to remove double min-airflow specification (#24292)``

2.1.3
.....

Bug Fixes
  • Fix mistakenly added install_requires for all providers (#22382)

2.1.2 .....

Misc


* ``Add Trove classifiers in PyPI (Framework :: Apache Airflow :: Provider)``

2.1.1
.....

Misc
~~~~

* ``Support for Python 3.10``


.. Below changes are excluded from the changelog. Move them to
   appropriate section above if needed. Do not delete the lines(!):

2.1.0
.....

Features
  • Add more SQL template fields renderers (#21237)
  • Add optional features in providers. (#21074)

.. Below changes are excluded from the changelog. Move them to appropriate section above if needed. Do not delete the lines(!):

  • Fix K8S changelog to be PyPI-compatible (#20614)
  • Fix template_fields type to have MyPy friendly Sequence type (#20571)
  • Remove ':type' lines now sphinx-autoapi supports typehints (#20951)
  • Update documentation for provider December 2021 release (#20523)
  • Even more typing in operators (template_fields/ext) (#20608)
  • Use typed Context EVERYWHERE (#20565)
  • Update documentation for November 2021 provider's release (#19882)
  • Prepare documentation for October Provider's release (#19321)
  • Update documentation for September providers release (#18613)
  • Static start_date and default arg cleanup for misc. provider example DAGs (#18597)
  • Add documentation for January 2021 providers release (#21257)

2.0.1 .....

Bug Fixes


* ``Fix type annotations in OracleOperator,  JdbcOperator, SqliteOperator (#17406)``

Misc
~~~~

* ``Optimise connection importing for Airflow 2.2.0``

.. Below changes are excluded from the changelog. Move them to
   appropriate section above if needed. Do not delete the lines(!):
   * ``Update description about the new ''connection-types'' provider meta-data (#17767)``
   * ``Import Hooks lazily individually in providers manager (#17682)``
   * ``Prepares docs for Rc2 release of July providers (#17116)``
   * ``Remove/refactor default_args pattern for miscellaneous providers (#16872)``

2.0.0
.....

Breaking changes
  • Auto-apply apply_default decorator (#15667)

.. warning:: Due to apply_default decorator removal, this version of the provider requires Airflow 2.1.0+. If your Airflow version is < 2.1.0, and you want to install this provider version, first upgrade Airflow to at least version 2.1.0. Otherwise your Airflow package version will be upgraded automatically and you will have to manually run airflow upgrade db to complete the migration.

.. Below changes are excluded from the changelog. Move them to appropriate section above if needed. Do not delete the lines(!):

  • Fix some small typos also TESTING.rst (#14594)
  • Adds interactivity when generating provider documentation. (#15518)
  • Prepares provider release after PIP 21 compatibility (#15576)
  • Remove Backport Providers (#14886)
  • Update documentation for broken package releases (#14734)
  • Updated documentation for June 2021 provider release (#16294)
  • More documentation update for June providers release (#16405)
  • Synchronizes updated changelog after buggfix release (#16464)

1.0.1 .....

Updated documentation and readme files.

1.0.0 .....

Initial version of the provider.