providers/apache/druid/docs/changelog.rst
.. Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements. See the NOTICE file distributed with this work for additional information regarding copyright ownership. The ASF licenses this file to you under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at
.. http://www.apache.org/licenses/LICENSE-2.0
.. Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.
.. NOTE TO CONTRIBUTORS: Please, only add notes to the Changelog just below the "Changelog" header when there are some breaking changes and you want to add an explanation to the users on how they are supposed to deal with them. The changelog is updated and maintained semi-automatically by release manager.
apache-airflow-providers-apache-druid
4.5.0 .....
Features
* ``feat: Add Hook Level Lineage to SQL hooks (#61535)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Add 'lifecycle' field to provider.yaml schema and all providers per AIP-95 (#62190)``
4.4.2
.....
Misc
~~~~
* ``New year means updated Copyright notices (#60344)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Remove TaskInstance and TaskLogReader unused methods (#59922)``
* ``TaskInstance unused method cleanup (#59835)``
4.4.1
.....
Misc
~~~~
* ``Add backcompat for exceptions in providers (#58727)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
4.4.0
.....
.. note::
This release of provider is only available for Airflow 2.11+ as explained in the
Apache Airflow providers support policy <https://github.com/apache/airflow/blob/main/PROVIDERS.rst#minimum-supported-version-of-airflow-for-community-managed-providers>_.
Misc
~~~~
* ``Bump minimum Airflow version in providers to Airflow 2.11.0 (#58612)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Updates to release process of providers (#58316)``
4.3.1
.....
Misc
~~~~
* ``Convert all airflow distributions to be compliant with ASF requirements (#58138)``
* ``Migrate 'dingding' provider to 'common.compat' (#57076)``
* ``Migrate 'apache/druid' provider to 'common.compat' (#57072)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Delete all unnecessary LICENSE Files (#58191)``
* ``Enable PT006 rule to 13 files in providers (apache) (#57998)``
* ``Prepare release for Oct 2025 wave of providers (#57029)``
* ``Remove placeholder Release Date in changelog and index files (#56056)``
* ``Prepare release for Sep 2025 2nd wave of providers (#55688)``
* ``Prepare release for Sep 2025 1st wave of providers (#55203)``
* ``Fix Airflow 2 reference in README/index of providers (#55240)``
* ``Make term Dag consistent in providers docs (#55101)``
* ``Switch pre-commit to prek (#54258)``
4.3.0
.....
Features
add ssl_verify_cert support to DruidDbApiHook.get_conn (#52926)Misc
* ``Add Python 3.13 support for Airflow. (#46891)``
* ``Remove type ignore across codebase after mypy upgrade (#53243)``
* ``Remove upper-binding for "python-requires" (#52980)``
* ``Temporarily switch to use >=,< pattern instead of '~=' (#52967)``
* ``Replace 'BaseHook' to Task SDK for 'apache/druid' (#52690)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
4.2.1
.....
Misc
Move 'BaseHook' implementation to task SDK (#51873)Provider Migration: Update Apache Druid for Airflow 3.0 compatibility (#52498)Drop support for Python 3.9 (#52072).. Below changes are excluded from the changelog. Move them to appropriate section above if needed. Do not delete the lines(!):
4.2.0 .....
.. note:: This release of provider is only available for Airflow 2.10+ as explained in the Apache Airflow providers support policy https://github.com/apache/airflow/blob/main/PROVIDERS.rst#minimum-supported-version-of-airflow-for-community-managed-providers_.
Misc
* ``Lower bind pyspark and pydruid to relatively new versions (#50205)``
* ``Migrate HiveServer2Hook to use get_df (#50070)``
* ``test: migrate 'get_pandas_df' to 'get_df' in 'provider' test (#49339)``
* ``Bump min Airflow version in providers to 2.10 (#49843)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Update description of provider.yaml dependencies (#50231)``
* ``Avoid committing history for providers (#49907)``
4.1.1
.....
Misc
remove superfluous else block (#49199)Doc-only
* ``Improve example docs around SQLExecuteQueryOperator in Druid/Hive/Impala/Kylin/Pinot (#48856)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Prepare docs for Apr 2nd wave of providers (#49051)``
* ``Remove unnecessary entries in get_provider_info and update the schema (#48849)``
* ``Remove fab from preinstalled providers (#48457)``
* ``Improve documentation building iteration (#48760)``
* ``Prepare docs for Apr 1st wave of providers (#48828)``
* ``Simplify tooling by switching completely to uv (#48223)``
* ``Upgrade ruff to latest version (#48553)``
* ``Prepare docs for Mar 2nd wave of providers (#48383)``
* ``Upgrade providers flit build requirements to 3.12.0 (#48362)``
* ``Move airflow sources to airflow-core package (#47798)``
* ``Remove links to x/twitter.com (#47801)``
* ``Set 'catchup_by_default' config to False by default (#47354)``
4.1.0
.....
Features
Add method to retrieve Druid task status URL based on ingestion type (#47238)Misc
* ``Upgrade flit to 3.11.0 (#46938)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Move tests_common package to devel-common project (#47281)``
* ``Improve documentation for updating provider dependencies (#47203)``
* ``Add legacy namespace packages to airflow.providers (#47064)``
* ``Remove extra whitespace in provider readme template (#46975)``
* ``Prepare docs for Feb 1st wave of providers (#46893)``
* ``Move provider_tests to unit folder in provider tests (#46800)``
* ``Removed the unused provider's distribution (#46608)``
* ``Fix doc issues found with recent moves (#46372)``
* ``Migrate Druid provider to the new structure (#46294)``
4.0.0
.....
.. note::
This release of provider is only available for Airflow 2.9+ as explained in the
`Apache Airflow providers support policy <https://github.com/apache/airflow/blob/main/PROVIDERS.rst#minimum-supported-version-of-airflow-for-community-managed-providers>`_.
Breaking changes
.. warning:: All deprecated classes, parameters and features have been removed from the Apache Druid provider package. The following breaking changes were introduced:
Operators
DruidCheckOperator. Please use airflow.providers.common.sql.operators.sql.SQLCheckOperator instead.Remove DruidCheckOperator (#44765)
Misc
* ``Bump minimum Airflow version in providers to Airflow 2.9.0 (#44956)``
* ``Update DAG example links in multiple providers documents (#44034)``
* ``Rename execution_date to logical_date across codebase (#43902)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Use Python 3.9 as target version for Ruff & Black rules (#44298)``
* ``Update path of example dags in docs (#45069)``
3.12.1
......
Misc
Add support for semicolon stripping to DbApiHook, PrestoHook, and TrinoHook (#41916).. Below changes are excluded from the changelog. Move them to appropriate section above if needed. Do not delete the lines(!):
3.12.0 ......
Features
* ``Add possibility to override the conn type for Druid (#42793)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Split providers out of the main "airflow/" tree into a UV workspace project (#42505)``
3.11.0
......
.. note::
This release of provider is only available for Airflow 2.8+ as explained in the
`Apache Airflow providers support policy <https://github.com/apache/airflow/blob/main/PROVIDERS.rst#minimum-supported-version-of-airflow-for-community-managed-providers>`_.
Misc
~~~~
* ``Bump minimum Airflow version in providers to Airflow 2.8.0 (#41396)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
3.10.2
......
Misc
~~~~
* ``Clean up remaining getattr connection DbApiHook (#40665)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Prepare docs 1st wave July 2024 (#40644)``
* ``Enable enforcing pydocstyle rule D213 in ruff. (#40448)``
3.10.1
......
Bug Fixes
Pass SSL arg to all requests in DruidOperator (#39066)Misc
* ``Faster 'airflow_version' imports (#39552)``
* ``Simplify 'airflow_version' imports (#39497)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Reapply templates for all providers (#39554)``
3.10.0
......
.. note::
This release of provider is only available for Airflow 2.7+ as explained in the
`Apache Airflow providers support policy <https://github.com/apache/airflow/blob/main/PROVIDERS.rst#minimum-supported-version-of-airflow-for-community-managed-providers>`_.
Misc
Bump minimum Airflow version in providers to Airflow 2.7.0 (#39240).. Below changes are excluded from the changelog. Move them to appropriate section above if needed. Do not delete the lines(!):
Prepare docs 1st wave (RC1) April 2024 (#38863)Bump ruff to 0.3.3 (#38240)3.9.0 .....
Features
* ``Adding optional SSL verification for druid operator (#37629)``
Bug Fixes
Fix SSL verification in druid operator (#37673)Misc
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Add comment about versions updated by release manager (#37488)``
3.8.1
.....
Misc
feat: Switch all class, functions, methods deprecations to decorators (#36876)3.8.0 .....
Features
* ``Provide the logger_name param in providers hooks in order to override the logger name (#36675)``
Bug Fixes
Fix successful Apache Druid task submissions reported as failed (#36813).. Below changes are excluded from the changelog. Move them to appropriate section above if needed. Do not delete the lines(!):
Add documentation for 3rd wave of providers in Deember (#36464)Run mypy checks for full packages in CI (#36638)Prepare docs 1st wave of Providers January 2024 (#36640)Speed up autocompletion of Breeze by simplifying provider state (#36499)Re-apply updated version numbers to 2nd wave of providers in December (#36380)Revert "Provide the logger_name param in providers hooks in order to override the logger name (#36675)" (#37015)Prepare docs 2nd wave of Providers January 2024 (#36945)3.7.0 .....
.. note::
This release of provider is only available for Airflow 2.6+ as explained in the
Apache Airflow providers support policy <https://github.com/apache/airflow/blob/main/PROVIDERS.rst#minimum-supported-version-of-airflow-for-community-managed-providers>_.
Misc
* ``Bump minimum Airflow version in providers to Airflow 2.6.0 (#36017)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Fix and reapply templates for provider documentation (#35686)``
* ``Prepare docs 3rd wave of Providers October 2023 - FIX (#35233)``
* ``Prepare docs 2nd wave of Providers November 2023 (#35836)``
* ``Use reproducible builds for providers (#35693)``
* ``Prepare docs 1st wave of Providers November 2023 (#35537)``
* ``Prepare docs 3rd wave of Providers October 2023 (#35187)``
* ``Pre-upgrade 'ruff==0.0.292' changes in providers (#35053)``
* ``Upgrade pre-commits (#35033)``
3.6.0
.....
.. note::
This release of provider is only available for Airflow 2.5+ as explained in the
`Apache Airflow providers support policy <https://github.com/apache/airflow/blob/main/PROVIDERS.rst#minimum-supported-version-of-airflow-for-community-managed-providers>`_.
Bug Fixes
Allow passing context to DruidDbApiHook (#34603)Misc
* ``Bump min airflow version of providers (#34728)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Prepare docs for Aug 2023 3rd wave of Providers (#33730)``
* ``D401 Support - Providers: Airbyte to Atlassian (Inclusive) (#33354)``
3.5.0
.....
Features
DruidHook add SQL-based task support (#32795)3.4.2 .....
Misc
* ``Add deprecation info to the providers modules and classes docstring (#32536)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Prepare docs for July 2023 wave of Providers (RC2) (#32381)``
* ``Remove spurious headers for provider changelogs (#32373)``
* ``Prepare docs for July 2023 wave of Providers (#32298)``
* ``D205 Support - Providers: Apache to Common (inclusive) (#32226)``
* ``Improve provider documentation and README structure (#32125)``
3.4.1
.....
.. note::
This release dropped support for Python 3.7
Misc
Add note about dropping Python 3.7 for providers (#32015).. Below changes are excluded from the changelog. Move them to appropriate section above if needed. Do not delete the lines(!):
Apache provider docstring improvements (#31730)Add D400 pydocstyle check - Apache providers only (#31424)3.4.0 .....
.. note::
This release of provider is only available for Airflow 2.4+ as explained in the
Apache Airflow providers support policy <https://github.com/apache/airflow/blob/main/PROVIDERS.rst#minimum-supported-version-of-airflow-for-community-managed-providers>_.
Misc
* ``Bump minimum Airflow version in providers (#30917)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Use 'AirflowProviderDeprecationWarning' in providers (#30975)``
* ``Add full automation for min Airflow version for providers (#30994)``
* ``Add mechanism to suspend providers (#30422)``
* ``Use '__version__' in providers not 'version' (#31393)``
* ``Fixing circular import error in providers caused by airflow version check (#31379)``
* ``Prepare docs for May 2023 wave of Providers (#31252)``
3.3.1
.....
Bug Fixes
Bump common.sql provider to 1.3.1 (#27888).. Below changes are excluded from the changelog. Move them to appropriate section above if needed. Do not delete the lines(!):
Prepare for follow-up release for November providers (#27774)3.3.0 .....
.. note::
This release of provider is only available for Airflow 2.3+ as explained in the
Apache Airflow providers support policy <https://github.com/apache/airflow/blob/main/PROVIDERS.rst#minimum-supported-version-of-airflow-for-community-managed-providers>_.
Misc
* ``Move min airflow version to 2.3.0 for all providers (#27196)``
Bug Fixes
BugFix - Druid Airflow Exception to about content (#27174).. Below changes are excluded from the changelog. Move them to appropriate section above if needed. Do not delete the lines(!):
Enable string normalization in python formatting - providers (#27205)3.2.1 .....
Misc
* ``Add common-sql lower bound for common-sql (#25789)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Apply PEP-563 (Postponed Evaluation of Annotations) to non-core airflow (#26289)``
3.2.0
.....
Features
Move all "old" SQL operators to common.sql providers (#25350)3.1.0 .....
Features
* ``Move all SQL classes to common-sql provider (#24836)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Move provider dependencies to inside provider folders (#24672)``
* ``Remove 'hook-class-names' from provider.yaml (#24702)``
3.0.0
.....
Breaking changes
.. note::
This release of provider is only available for Airflow 2.2+ as explained in the
Apache Airflow providers support policy <https://github.com/apache/airflow/blob/main/PROVIDERS.rst#minimum-supported-version-of-airflow-for-community-managed-providers>_.
Misc
* ``chore: Refactoring and Cleaning Apache Providers (#24219)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``AIP-47 - Migrate druid DAGs to new design #22439 (#24207)``
* ``Add explanatory note for contributors about updating Changelog (#24229)``
* ``Prepare docs for May 2022 provider's release (#24231)``
* ``Update package description to remove double min-airflow specification (#24292)``
2.3.3
.....
Bug Fixes
Fix mistakenly added install_requires for all providers (#22382)2.3.2 .....
Misc
* ``Add Trove classifiers in PyPI (Framework :: Apache Airflow :: Provider)``
2.3.1
.....
Misc
~~~~
* ``Support for Python 3.10``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
2.3.0
.....
Features
Add more SQL template fields renderers (#21237)Bug Fixes
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Remove ':type' lines now sphinx-autoapi supports typehints (#20951)``
* ``Add documentation for January 2021 providers release (#21257)``
2.2.0
.....
Features
~~~~~~~~
* ``Add timeout parameter to DruidOperator (#19984)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Fix MyPy Errors for Apache Druid provider. (#20270)``
* ``Fix MyPy errors in Apache Providers (#20422)``
* ``Fix template_fields type to have MyPy friendly Sequence type (#20571)``
* ``Even more typing in operators (template_fields/ext) (#20608)``
* ``Update documentation for provider December 2021 release (#20523)``
2.1.0
.....
Features
~~~~~~~~
* ``Add DruidOperator template_fields_renderers fields (#19420)``
* ``Add max_ingestion_time to DruidOperator docstring (#18693)``
* ``Add guide for Apache Druid operators (#18527)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Cleanup of start_date and default arg use for Apache example DAGs (#18657)``
* ``Prepare documentation for October Provider's release (#19321)``
* ``Update documentation for September providers release (#18613)``
2.0.2
.....
Misc
~~~~
* ``Optimise connection importing for Airflow 2.2.0``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Fix messed-up changelog in 3 providers (#17380)``
* ``Update description about the new ''connection-types'' provider meta-data (#17767)``
* ``Import Hooks lazily individually in providers manager (#17682)``
2.0.1
.....
Bug Fixes
Fix error in Druid connection attribute retrieval (#17095).. Below changes are excluded from the changelog. Move them to appropriate section above if needed. Do not delete the lines(!):
Fixed wrongly escaped characters in amazon's changelog (#17020)Prepare documentation for July release of providers. (#17015)Removes pylint from our toolchain (#16682)2.0.0 .....
Breaking changes
* ``Auto-apply apply_default decorator (#15667)``
.. warning:: Due to apply_default decorator removal, this version of the provider requires Airflow 2.1.0+.
If your Airflow version is < 2.1.0, and you want to install this provider version, first upgrade
Airflow to at least version 2.1.0. Otherwise your Airflow package version will be upgraded
automatically and you will have to manually run ``airflow upgrade db`` to complete the migration.
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Bump pyupgrade v2.13.0 to v2.18.1 (#15991)``
* ``Adds interactivity when generating provider documentation. (#15518)``
* ``Fix string concatenation using 'f-strings' (#15200)``
* ``Prepares provider release after PIP 21 compatibility (#15576)``
* ``Remove Backport Providers (#14886)``
* ``Updated documentation for June 2021 provider release (#16294)``
* ``More documentation update for June providers release (#16405)``
* ``Synchronizes updated changelog after buggfix release (#16464)``
1.1.0
.....
Features
~~~~~~~~
* ``Refactor SQL/BigQuery/Qubole/Druid Check operators (#12677)``
Bugfixes
~~~~~~~~
* ``Bugfix: DruidOperator fails to submit ingestion tasks (#14418)``
1.0.1
.....
Updated documentation and readme files.
1.0.0
.....
Initial version of the provider.