dev/changelog/45.0.0.md
This release consists of 258 commits from 83 contributors. See credits at the end of this changelog for more information.
Breaking changes:
EquivalenceProperties #14040 (alamb)EquivalenceGroup #14039 (alamb)LexOrdering::inner non pub, add comments, update usages #14155 (alamb)Performance related:
like expressions (prefix matching) #12978 (adriangb)median by implementing special GroupsAccumulator #13681 (Rachelint)Implemented enhancements:
RightAnti for SortMergeJoin #13680 (irenjj)AsyncCatalogProvider helpers for asynchronous catalogs #13800 (westonpace)LogicalPlan::DML(...) serde #14079 (milenkovicm)alias() method for DataFrame #14127 (jonahgao)SchemaRef in JoinFilter #14182 (irenjj)Fixed bugs:
ctx.enable_url_table() #14004 (milenkovicm)Documentation updates:
user_doc macro, port trim to use new macro #13952 (delamarch3)AsyncSchemaProvider #14062 (alamb)ScalarUDFImpl docs #14248 (alamb)array_has_any) #14217 (erenavsarogullari)DataFrame::join #14393 (rkrishn7)45.0.0 release: Version and Changelog #14397 (alamb)Other:
UNNEST plan to SQL text #13824 (goldmedal)UserDefinedLogicalNodeUnparser for User-defined Logical Plan unparsing #13880 (goldmedal)get_record_batch_memory_size for calculating RecordBatch memory size in topK #13906 (getChan)arrow-distinct now work with null rows #13966 (rluvaton)hash_collision.yml to extended.yml and add comments #13988 (alamb)Last function's merge_batch #13980 (jayzhan211)url dependancy update #14019 (vadimpiven)MemTable #14024 (jonahgao)StringArrayType #14023 (tlm365)array_distinct when input is empty #13810 #14034 (cht42)OrderingEquivalenceClass (make field non pub) #14037 (alamb)reverse function #14025 (tlm365)nth_value when ignoreNulls is true and no nulls in values #14042 (cht42)ctor to 0.2.9 #14069 (mbrobbel)LexOrdering::collapse, LexRequirement::collapse avoid clone #14038 (alamb)wasm-bindgen-* crates #14068 (mbrobbel)group_schema as PhysicalGroupBy method #14064 (jayzhan211)LimitPushdown tests to be in the same file as the code #14076 (alamb)ValuesExec in favour of MemoryExec #14032 (jonathanc-n)find_in_set function #14020 (tlm365)physical_exprs_contains and move PhysicalExprRef to physical-expr-common #14081 (jayzhan211)sql_select_to_rex() #14088 (jonahgao)SendableRecordBatchStream #14084 (alamb)OrderingEquivalenceClass #14138 (alamb)get_final_indices_from_shared_bitmap #14145 (lewiszlw)on expressions values in HashJoinExec #14131 (lewiszlw)SanityChecker into physical-optimizer crate #14083 (mnpw)54.0.0 and pyo3 to 0.23.3 #14153 (Owen-CH-Leung)ScalarValue::try_as_str to get str value from logical strings #14167 (alamb)<=>) support (alias for IS NOT DISTINCT FROM #14187 (Spaarsh)case expr constant handling for when <scalar> #14159 (alamb)return_type_from_args for ScalarFunction. #14094 (jayzhan211)EnforceDistribution into datafusion-physical-optimizer crate #14190 (logan-keede)simplify for the starts_with function to convert it into a LIKE expression. #14119 (jatin510)count to Int64 in array_repeat function to ensure consistent integer type handling #14236 (jatin510)datafusion-physical-optimizer #14300 (berkaysynnada)datafusion_physical_optimizer, only use datafusion crate in the examples #14305 (alamb)convert_schema_to_types #14313 (xudong963)BooleanBufferBuilder to NullBufferBuilder in unit tests of multi_group_by #14325 (Chen-Yuan-Lai)BooleanBufferBuilder to NullBufferBuilder in an unit test of common_scalar #14339 (Chen-Yuan-Lai)ColumnStatistics::Sum #14074 (gatesn)BooleanBufferBuilder to NullBufferBuilder in unit tests for unnest #14321 (Chen-Yuan-Lai)sum_value in initializer of ColumnStatistics" #14345 (alamb)datafusion-cli/Dockerfile to 1.81 #14344 (alamb)merge_batch #14299 (rluvaton)BooleanBufferBuilder to NullBufferBuilder in binary_map #14341 (Chen-Yuan-Lai)BooleanBufferBuilder to NullBufferBuilder in single_group_by #14360 (Chen-Yuan-Lai)datafusion-cli #14361 (alamb)is_sorted removal, deprecate instead #14388 (alamb)CASE #14384 (alamb)TableProvider::insert_into into FFI Bindings #14391 (davisp)arrow/parquet 54.1.0 and fix clippy/ci (#14415) #14453 (alamb)Utf8View to numeric coercion (#14377) #14455 (alamb)Thank you to everyone who contributed to this release. Here is a breakdown of commits (PRs merged) per contributor.
52 Andrew Lamb
22 Ian Lai
20 dependabot[bot]
8 Bruce Ritchie
8 xudong.w
6 Sergey Zhukov
6 logan-keede
5 Burak Şen
5 Jay Zhan
5 Jonah Gao
4 Berkay Şahin
4 Qi Zhu
4 Raz Luvaton
4 Spaarsh
4 cht42
4 张林伟
3 Aleksey Kirilishin
3 Jagdish Parihar
3 Matthijs Brobbel
3 Namgung Chan
3 Piotr Findeisen
3 Tai Le Manh
3 niebayes
3 wiedld
3 zjregee
2 Dharan Aditya
2 Goksel Kabadayi
2 Jax Liu
2 Marko Milenković
2 Oleks V
2 Tim Saucer
2 Victor Barua
2 Will Golioto
2 Xiangpeng Hao
2 irenjj
2 mertak-synnada
2 nuno-faria
1 Adam Binford
1 Adrian Garcia Badaracco
1 Alihan Çelikcan
1 Andre Weltsch
1 Andrew Kane
1 Andy Grove
1 Chunchun Ye
1 Daniel Hegberg
1 Daniel Mesejo
1 Edmondo Porcu
1 Eren Avsarogullari
1 Eugene Marushchenko
1 Gabriel
1 Himadri Pal
1 Jack Park
1 Jeffrey Vo
1 Jonas Björk
1 Jonathan Chen
1 Lordworms
1 Matthew Turner
1 Mehmet Ozan Kabak
1 Mohamed Abdeen
1 Mrinal Paliwal
1 Nicholas Gates
1 Owen Leung
1 Paul J. Davis
1 Qianqian
1 Rohan Krishnaswamy
1 Ruihang Xia
1 Sergei Grebnov
1 Takahiro Ebato
1 TheBuilderJR
1 Tim Van Wassenhove
1 Tobias Schwarzinger
1 Trevor Hilton
1 UBarney
1 Vadim Piven
1 Wendell Smith
1 Weston Pace
1 Yongting You
1 Zhang Li
1 delamarch3
1 ding-young
1 kamille
1 kosiew
1 phisn
Thank you also to everyone who contributed in other ways such as filing issues, reviewing PRs, and providing feedback on this release.