Opensearch.Release Notes 2.14.0

2024-05-07 Version 2.14.0 Release Notes

[2.14.0]

Added

• Add explicit dependency to validatePom and generatePom tasks (#12909)
• Constant Keyword Field (#12285)
• [Concurrent Segment Search] Perform buildAggregation concurrently and support Composite Aggregations (#12697)
• Convert ingest processor supports ip type (#12818)
• Allow setting KEYSTORE_PASSWORD through env variable (#12865)
• Add a counter to node stat (and _cat/shards) api to track shard going from idle to non-idle (#12768)
• [Concurrent Segment Search] Disable concurrent segment search for system indices and throttled requests (#12954)
• Rename ingest processor supports overriding target field if exists (#12990)
• [Tiered Caching] Make took time caching policy setting dynamic (#13063)
• Detect breaking changes on pull requests (#9044)
• Add cluster primary balance contraint for rebalancing with buffer (#12656)
• [Remote Store] Make translog transfer timeout configurable (#12704)
• Derived fields support to derive field values at query time without indexing (#12569)
• Add support for more than one protocol for transport (#12967)
• [Tiered Caching] Add dimension-based stats to ICache implementations. (#12531)
• Add changes for overriding remote store and replication settings during snapshot restore. (#11868)
• Reject Resize index requests (i.e, split, shrink and clone), While DocRep to SegRep migration is in progress.(#12686)
• Add an individual setting of rate limiter for segment replication (#12959)
• [Tiered Caching] Add dimension-based stats to TieredSpilloverCache (#13236)
• [Tiered Caching] Expose new cache stats API (#13237)
• [Streaming Indexing] Ensure support of the new transport by security plugin (#13174)
• Add cluster setting to dynamically configure the buckets for filter rewrite optimization. (#13179)
• [Tiered caching] Make Indices Request Cache Stale Key Mgmt Threshold setting dynamic (#12941)
• Make search query counters dynamic to support all query types (#12601)
• [Tiered Caching] Gate new stats logic behind FeatureFlags.PLUGGABLE_CACHE (#13238)
• [Tiered Caching] Add a dynamic setting to disable/enable disk cache. (#13373)
• Batch mode for async fetching shard information in GatewayAllocator for unassigned shards (#8746)
• [Remote Store] Add settings for remote path type and hash algorithm (#13225)
• [Remote Store] Upload remote paths during remote enabled index creation (#13386)
• [Search Pipeline] Handle default pipeline for multiple indices (#13276)
• [Batch Ingestion] Add batch_size to _bulk API. (#12457)
• [Remote Store] Add capability of doing refresh as determined by the translog (#12992)
• Support multi ranges traversal when doing date histogram rewrite optimization. (#13317)

Dependencies

• Bump org.apache.commons:commons-configuration2 from 2.10.0 to 2.10.1 (#12896)
• Bump asm from 9.6 to 9.7 (#12908)
• Bump net.minidev:json-smart from 2.5.0 to 2.5.1 (#12893, #13117)
• Bump netty from 4.1.107.Final to 4.1.109.Final (#12924, #13233)
• Bump commons-io:commons-io from 2.15.1 to 2.16.0 (#12996, #12998, #12999)
• Bump org.apache.commons:commons-compress from 1.24.0 to 1.26.1 (#12627)
• Bump org.apache.commons:commonscodec from 1.15 to 1.16.1 (#12627)
• Bump org.apache.commons:commonslang from 3.13.0 to 3.14.0 (#12627)
• Bump Apache Tika from 2.6.0 to 2.9.2 (#12627)
• Bump com.gradle.enterprise from 3.16.2 to 3.17.2 (#13116, #13191, #13327)
• Bump gradle/wrapper-validation-action from 2 to 3 (#13192)
• Bump joda from 2.12.2 to 2.12.7 (#13193)
• Bump bouncycastle from 1.77 to 1.78 (#13243)
• Update google dependencies in repository-gcs and discovery-gce (#13213)
• Bump com.google.apis:google-api-services-compute from v1-rev235-1.25.0 to v1-rev20240407-2.0.0 (#13333)
• Bump com.github.spullara.mustache.java:compiler from 0.9.10 to 0.9.11 (#13329)
• Bump commons-cli:commons-cli from 1.6.0 to 1.7.0 (#13331)
• Bump jakarta.enterprise:jakarta.enterprise.cdi-api from 4.0.1 to 4.1.0 (#13328)
• Bump com.google.api.grpc:proto-google-iam-v1 from 0.12.0 to 1.33.0 (#13332)
• Bump com.squareup.okio:okio from 3.8.0 to 3.9.0 (#12997)
• OpenJDK Update (April 2024 Patch releases), update to Eclipse Temurin 21.0.3+9 (#13389)
• Bump org.bouncycastle:bc-fips from 1.0.2.4 to 1.0.2.5 (#13446)
• Bump lycheeverse/lychee-action from 1.9.3 to 1.10.0 (#13447)
• Bump com.netflix.nebula.ospackage-base from 11.8.1 to 11.9.0 (#13440)

Changed

• [BWC and API enforcement] Enforcing the presence of API annotations at build time (#12872)
• Improve built-in secure transports support (#12907)
• Update links to documentation in rest-api-spec (#13043)
• Ignoring unavailable shards during search request execution with ignore_available parameter (#13298)
• Refactoring globMatch using simpleMatchWithNormalizedStrings from Regex (#13104)
• [BWC and API enforcement] Reconsider the breaking changes check policy to detect breaking changes against released versions (#13292)
• Switch to macos-13 runner for precommit and assemble github actions due to macos-latest is now arm64 (#13412)
• [Revert] Prevent unnecessary fetch sub phase processor initialization during fetch phase execution (#12503)

Fixed

• Fix bulk API ignores ingest pipeline for upsert (#12883)
• Fix issue with feature flags where default value may not be honored (#12849)
• Fix UOE While building Exists query for nested search_as_you_type field (#12048)
• Enabled mockTelemetryPlugin for IT and fixed OOM issues (#13054)
• Fix from and size parameter can be negative when searching (#13047)
• Fix implement mark() and markSupported() in class FilterStreamInput (#13098)
• Fix IndicesRequestCache Stale calculation (#13070]
• Fix snapshot _status API to return correct status for partial snapshots (#12812)
• Improve the error messages for _stats with closed indices (#13012)
• Ignore BaseRestHandler unconsumed content check as it's always consumed. (#13290)
• Fix mapper_parsing_exception when using flat_object fields with names longer than 11 characters (#13259)
• DATETIME_FORMATTER_CACHING_SETTING experimental feature should not default to 'true' (#13532)
• Fix negative RequestStats metric issue (#13553)