ContextQMD
Back to Opensearch

Opensearch.Release Notes 2.17.0

release-notes/opensearch.release-notes-2.17.0.md

3.6.012.9 KB
Original Source

2024-09-17 Version 2.17.0 Release Notes

[2.17.0]

Added

  • [Workload Management] Add Settings for Workload Management feature (#15028)
  • Fix for hasInitiatedFetching to fix allocation explain and manual reroute APIs ((#14972)
  • [Workload Management] Add queryGroupId to Task (14708)
  • Add setting to ignore throttling nodes for allocation of unassigned primaries in remote restore (#14991)
  • [Workload Management] Add Delete QueryGroup API Logic (#14735)
  • [Streaming Indexing] Enhance RestClient with a new streaming API support (#14437)
  • Add basic aggregation support for derived fields (#14618)
  • [Workload Management] Add Create QueryGroup API Logic (#14680)- [Workload Management] Add Create QueryGroup API Logic (#14680)
  • Add ThreadContextPermission for markAsSystemContext and allow core to perform the method (#15016)
  • Add ThreadContextPermission for stashAndMergeHeaders and stashWithOrigin (#15039)
  • [Concurrent Segment Search] Support composite aggregations with scripting (#15072)
  • Add rangeQuery and regexpQuery for constant_keyword field type (#14711)
  • Add took time to request nodes stats (#15054)
  • [Workload Management] Add Get QueryGroup API Logic (14709)
  • [Workload Management] Add Update QueryGroup API Logic (#14775)
  • [Workload Management] QueryGroup resource tracking framework changes (#13897)
  • Support filtering on a large list encoded by bitmap (#14774)
  • Add slice execution listeners to SearchOperationListener interface (#15153)
  • Make balanced shards allocator timebound (#15239)
  • Add allowlist setting for ingest-geoip and ingest-useragent (#15325)
  • Adding access to noSubMatches and noOverlappingMatches in Hyphenation (#13895)
  • Star tree mapping changes (#14605)
  • Add support for index level max slice count setting for concurrent segment search (#15336)
  • Support cancellation for cat shards and node stats API.(#13966)
  • [Streaming Indexing] Introduce bulk HTTP API streaming flavor (#15381)
  • Add support for centralize snapshot creation with pinned timestamp (#15124)
  • Add concurrent search support for Derived Fields (#15326)
  • [Workload Management] Add query group stats constructs (#15343))
  • Add limit on number of processors for Ingest pipeline(#15460).
  • Add runAs to Subject interface and introduce IdentityAwarePlugin extension point (#14630)
  • [Workload Management] Add rejection logic for co-ordinator and shard level requests (#15428))
  • Adding translog durability validation in index templates (#15494)
  • [Range Queries] Add new approximateable query framework to short-circuit range queries (#13788)
  • [Workload Management] Add query group level failure tracking (#15227)
  • [Reader Writer Separation] Add experimental search replica shard type to achieve reader writer separation (#15237)
  • Add index creation using the context field (#15290)
  • [Remote Publication] Add remote download stats (#15291)
  • Add support to upload snapshot shard blobs with hashed prefix (#15426)
  • Add prefix support to hashed prefix & infix path types on remote store (#15557)
  • Add canRemain method to TargetPoolAllocationDecider to move shards from local to remote pool for hot to warm tiering (#15010)
  • Add support for pluggable deciders for concurrent search (#15363)
  • Optimise snapshot deletion to speed up snapshot deletion and creation (#15568)
  • [Remote Publication] Added checksum validation for cluster state behind a cluster setting (#15218)
  • Optimize NodeIndicesStats output behind flag (#14454)
  • Add support for comma-separated list of index names to be used with Snapshot Status API (#15409)[SnapshotV2] Snapshot Status API changes (#15409))
  • ClusterManagerTaskThrottler Improvements (#15508)
  • Relax the join validation for Remote State publication (#15471)
  • Reset DiscoveryNodes in all transport node actions request (#15131)
  • [Remote Publication] Upload incremental cluster state on master re-election (#15145)
  • Static RemotePublication setting added, removed experimental feature flag (#15478)
  • Making _cat/allocation API use indexLevelStats (#15292)
  • Memory optimisations in _cluster/health API (#15492)

Dependencies

  • Bump netty from 4.1.111.Final to 4.1.112.Final (#15081)
  • Bump org.apache.commons:commons-lang3 from 3.14.0 to 3.15.0 (#14861)
  • OpenJDK Update (July 2024 Patch releases) (#14998)
  • Bump com.microsoft.azure:msal4j from 1.16.1 to 1.17.0 (#14995, #15420)
  • Bump actions/github-script from 6 to 7 (#14997)
  • Bump org.tukaani:xz from 1.9 to 1.10 (#15110)
  • Bump org.apache.avro:avro from 1.11.3 to 1.12.0 in /plugins/repository-hdfs (#15119)
  • Bump org.bouncycastle:bcpg-fips from 1.0.7.1 to 2.0.9 (#15103, #15299)
  • Bump com.azure:azure-core from 1.49.1 to 1.51.0 (#15111)
  • Bump org.xerial.snappy:snappy-java from 1.1.10.5 to 1.1.10.6 (#15207)
  • Bump com.azure:azure-xml from 1.0.0 to 1.1.0 (#15206)
  • Bump reactor from 3.5.19 to 3.5.20 (#15262)
  • Bump reactor-netty from 1.1.21 to 1.1.22 (#15262)
  • Bump org.apache.kerby:kerb-admin from 2.0.3 to 2.1.0 (#15301)
  • Bump com.azure:azure-core-http-netty from 1.15.1 to 1.15.3 (#15300)
  • Bump com.gradle.develocity from 3.17.6 to 3.18 (#15297)
  • Bump commons-cli:commons-cli from 1.8.0 to 1.9.0 (#15298)
  • Bump opentelemetry from 1.40.0 to 1.41.0 (#15361)
  • Bump opentelemetry-semconv from 1.26.0-alpha to 1.27.0-alpha (#15361)
  • Bump tj-actions/changed-files from 44 to 45 (#15422)
  • Bump dnsjava:dnsjava from 3.6.0 to 3.6.1 (#15418)
  • Bump com.netflix.nebula.ospackage-base from 11.9.1 to 11.10.0 (#15419)
  • Bump org.roaringbitmap:RoaringBitmap from 1.1.0 to 1.2.1 (#15423)
  • Bump icu4j from 70.1 to 75.1 (#15469)

Changed

  • Add lower limit for primary and replica batch allocators timeout (#14979)
  • Optimize regexp-based include/exclude on aggregations when pattern matches prefixes (#14371)
  • Replace and block usages of org.apache.logging.log4j.util.Strings (#15238)
  • Remote publication using minimum node version for backward compatibility (#15216)

Deprecated

Removed

  • Remove some unused code in the search backpressure package (#15518)

Fixed

  • Fix constraint bug which allows more primary shards than average primary shards per index (#14908)
  • Fix NPE when bulk ingest with empty pipeline (#15033)
  • Fix missing value of FieldSort for unsigned_long (#14963)
  • Fix delete index template failed when the index template matches a data stream but is unused (#15080)
  • Fix array_index_out_of_bounds_exception when indexing documents with field name containing only dot (#15126)
  • Fixed array field name omission in flat_object function for nested JSON (#13620)
  • Fix incorrect parameter names in MinHash token filter configuration handling (#15233)
  • Fix range aggregation optimization ignoring top level queries (#15287)
  • Fix indexing error when flat_object field is explicitly null (#15375)
  • Fix split response processor not included in allowlist (#15393)
  • Fix unchecked cast in dynamic action map getter (#15394)
  • Fix null values indexed as "null" strings in flat_object field (#14069)
  • Fix terms query on wildcard field returns nothing (#15607)