ContextQMD
Back to Opensearch

Opensearch.Release Notes 2.0.0

release-notes/opensearch.release-notes-2.0.0.md

3.6.024.5 KB
Original Source

2022-05-19 Version 2.0.0 Release Notes

Breaking Changes in 2.0

Remove Mapping types

  • [Type removal] Remove redundant _type in pipeline simulate action (#3371)
  • [Type removal] Remove _type deprecation from script and conditional processor (#3239)
  • [Type removal] Remove _type from _bulk yaml test, scripts, unused constants (#3372)
  • [Type removal] _type removal from mocked responses of scroll hit tests (#3377)
  • [Remove] TypeFieldMapper (#3196)
  • [Type Removal] Remove TypeFieldMapper usage, remove support of _type in searches and from LeafFieldsLookup (#3016)
  • [Type removal] Remove _type support in NOOP bulk indexing from client benchmark (#3076)
  • [Type removal] Remove deprecation warning on use of _type in doc scripts (#2564)
  • [Remove] AliasesExistAction (#3149)
  • [Remove] TypesExist Action (#3139)
  • [Remove] Type from nested fields using new metadata field mapper(#3004)
  • [Remove] types from rest-api-spec endpoints (#2689)
  • [Remove] Types from PutIndexTemplateRequest and builder to reduce mapping to a string (#2510)
  • [Remove] Type from Percolate query API (#2490)
  • [Remove] types from CreateIndexRequest and companion Builder's mapping method (#2498)
  • [Remove] Type from PutIndexTemplateRequest and PITRB (#2497)
  • [Remove] Type metadata from ingest documents (#2491)
  • [Remove] type from CIR.mapping and CIRB.mapping (#2478)
  • [Remove] types based addMapping method from CreateIndexRequest and Builder (#2460)
  • [Remove] type from TaskResults index and IndexMetadata.getMappings (#2469)
  • [Remove] Type query (#2448)
  • [Remove] Type from TermsLookUp (#2459)
  • [Remove] types from Uid and remaining types/Uid from translog (#2450)
  • [Remove] types from translog (#2439)
  • [Remove] Multiple Types from IndexTemplateMetadata (#2400)
  • Remove type mapping from document index API (#2026)
  • [Remove] Type mapping parameter from document update API (#2204)
  • [Remove] Types from DocWrite Request and Response (#2239)
  • [Remove] Types from GET/MGET (#2168)
  • [Remove] types from SearchHit and Explain API (#2205)
  • [Remove] type support from Bulk API (#2215)
  • Remove type end-points from no-op bulk and search action (#2261)
  • Remove type end-points from search and related APIs (#2263)
  • [Remove] Type mapping end-points from RestMultiSearchTemplateAction (#2433)
  • Removes type mappings from mapping APIs (#2238)
  • Remove type end-points from count action (#2379)
  • Remove type from validate query API (#2255)
  • [Remove] Type parameter from TermVectors API (#2104)
  • Remove inclue_type_name parameter from rest api spec (#2410)
  • [Remove] include_type_name from HLRC (#2397)
  • [Remove] Type mappings from GeoShapeQueryBuilder (#2322)
  • [Remove] types from PutMappingRequest (#2335)
  • [Remove] deprecated getMapping API from IndicesClient (#2262)
  • [Remove] remaining type usage in Client and AbstractClient (#2258)
  • [Remove] Type from Client.prepare(Index,Delete,Update) (#2253)
  • [Remove] Type Specific Index Stats (#2198)
  • [Remove] Type from Search Internals (#2109)

Upgrades

  • [Upgrade] Lucene 9.1 release (#2560)
  • [Upgrade] ICU4j from 68.2 to 70.1 (#2504)

Deprecations

  • Deprecate setting 'cluster.no_master_block' and introduce the alternative setting 'cluster.no_cluster_manager_block' (#2453)
  • Deprecate setting 'cluster.service.slow_master_task_logging_threshold' and introduce the alternative setting 'cluster.service.slow_cluster_manager_task_logging_threshold' (#2451)
  • Deprecate setting 'cluster.initial_master_nodes' and introduce the alternative setting 'cluster.initial_cluster_manager_nodes' (#2463)
  • Deprecated reserved node id 'must_join_elected_master' that used by DetachClusterCommand and replace with 'must_join_elected_cluster_manager' (#3138)

Security Fixes

  • [CVE-2020-36518] Update jackson-databind to 2.13.2.2 (#2599)

Features/Enhancements

  • Removing hard coded value of max concurrent shard requests (#3364)
  • Update generated ANTLR lexer/parser to match runtime version (#3297)
  • Rename BecomeMasterTask to BecomeClusterManagerTask in JoinTaskExecutor (#3099)
  • Replace 'master' terminology with 'cluster manager' in log messages in 'server/src/main' directory - Part 2 (#3174)
  • Remove deprecation warning of using REST API request parameter 'master_timeout' (#2920)
  • Add deprecated API for creating History Ops Snapshot from translog (#2886)
  • Add request parameter 'cluster_manager_timeout' and deprecate 'master_timeout' - in Ingest APIs and Script APIs (#2682)
  • Change deprecation message for API parameter value 'master_node' of parameter 'metric' (#2880)
  • Add request parameter 'cluster_manager_timeout' and deprecate 'master_timeout' - in Snapshot APIs (#2680)
  • Add request parameter 'cluster_manager_timeout' and deprecate 'master_timeout' - in Index Template APIs (#2678)
  • Change deprecation message for REST API parameter 'master_timeout' to specify the version of removal (#2863)
  • Decouple IndexSettings from IncludeExclude (#2860)
  • Remove endpoint_suffix dependency on account key (#2485)
  • Replace remaining 'blacklist' with 'denylist' in internal class and method names (#2784)
  • Make discovered_master field optional on the client to support compatibility for opensearch client with odfe (#2641)
  • Add request parameter 'cluster_manager_timeout' and deprecate 'master_timeout' - in Index APIs except index template APIs (#2660)
  • Add request parameter 'cluster_manager_timeout' and deprecate 'master_timeout' - in Cluster APIs (#2658)
  • Make Rest-High-Rest-Level tests allow deprecation warning temporarily, during deprecation of request parameter 'master_timeout' (#2702)
  • Add request parameter 'cluster_manager_timeout' as the alternative for 'master_timeout', and deprecate 'master_timeout' - in CAT APIs (#2717)
  • Add mapping method back referenced in other repos (#2636)
  • Replaced "master" terminology in Log message (#2575)
  • Introduce QueryPhaseSearcher extension point (SearchPlugin) (#1931)
  • Support for geo_bounding_box queries on geo_shape fields (#2506)
  • Updating repository commons logging version (#2541)
  • Support for geo_distance queries on geo_shape fields (#2516)
  • Add 'cluster_manager_node' into ClusterState Metric as an alternative to 'master_node' (#2415)
  • Add a new node role 'cluster_manager' as the alternative for 'master' role and deprecate 'master' role (#2424)
  • Replace 'master' with 'cluster_manager' in 'GET Cat Nodes' API (#2441)
  • Replace 'discovered_master' with 'discovered_cluster_manager' in 'GET Cat Health' API (#2438)
  • Add a field discovered_cluster_manager in get cluster health api (#2437)
  • Add request parameter 'cluster_manager_timeout' as the alternative for 'master_timeout', and deprecate 'master_timeout' - in CAT Nodes API (#2435)
  • Add a new REST API endpoint 'GET _cat/cluster_manager' as the replacement of 'GET _cat/master' (#2404)
  • Add default for EnginePlugin.getEngineFactory (#2419)

Bug Fixes

  • Fixing PublishTests tests (running against unclean build folders) (#3253)
  • Fixing Scaled float field mapper to respect ignoreMalformed setting (#2918)
  • Fixing plugin installation URL to consume build qualifier (#3193)
  • Fix minimum index compatibility error message (#3159)
  • Added explicit 'null' check for response listener to prevent obscure NullPointerException issues (#3048)
  • Adding a null pointer check to fix index_prefix query (#2879)
  • Bugfix to guard against stack overflow errors caused by very large reg-ex input (#2816)
  • Fix InboundDecoder version compat check (#2570)
  • ignore_malformed parameter on ip_range data_type throws mapper_parsing_exception (#2429)
  • Discrepancy in result from _validate/query API and actual query validity (#2416)

Build & Infrastructure

  • Allow to configure POM for ZIP publication (#3252)
  • Gradle plugin opensearch.pluginzip Add implicit dependency. (#3189)
  • Gradle custom java zippublish plugin (#2988)
  • Added Adoptium JDK8 support and updated DistroTestPlugin JDK version used by Gradle (#3324)
  • Update bundled JDK to 17.0.3+7 (#3093)
  • Use G1GC on JDK11+ (#2964)
  • Removed java11 source folders since JDK-11 is the baseline now (#2898)
  • Changed JAVA_HOME to jdk-17 (#2656)
  • Fix build-tools/reaper source/target compatibility to be JDK-11 (#2596)
  • Adding workflow to create documentation related issues in documentation-website repo (#2929)
  • Fix issue that deprecated setting 'cluster.initial_master_nodes' is not identified in node bootstrap check (#2779)
  • Replace blacklist in Gradle build environment configuration (#2752)
  • Update ThirdPartyAuditTask to check for and list pointless exclusions. (#2760)
  • Add Shadow jar publication to lang-painless module. (#2681)
  • Add 1.3.2 to main causing gradle check failures (#2679)
  • Added jenkinsfile to run gradle check in OpenSearch (#2166)
  • Gradle check retry (#2638)
  • Override Default Distribution Download Url with Custom Distribution Url when it is passed from Plugin (#2420)

Documentation

  • [Javadocs] add remaining internal classes and reenable missingJavadoc on server (#3296)
  • [Javadocs] add to o.o.cluster (#3170)
  • [Javadocs] add to o.o.bootstrap, cli, and client (#3163)
  • [Javadocs] add to o.o.search.rescore,searchafter,slice, sort, and suggest (#3264)
  • [Javadocs] add to o.o.transport (#3220)
  • [Javadocs] add to o.o.action, index, and transport (#3277)
  • [Javadocs] add to internal classes in o.o.http, indices, and search (#3288)
  • [Javadocs] Add to remaining o.o.action classes (#3182)
  • [Javadocs] add to o.o.rest, snapshots, and tasks packages (#3219)
  • [Javadocs] add to o.o.common (#3289)
  • [Javadocs] add to o.o.dfs,fetch,internal,lookup,profile, and query packages (#3261)
  • [Javadocs] add to o.o.search.aggs, builder, and collapse packages (#3254)
  • [Javadocs] add to o.o.index and indices (#3209)
  • [Javadocs] add to o.o.monitor,persistance,plugins,repo,script,threadpool,usage,watcher (#3186)
  • [Javadocs] Add to o.o.disovery, env, gateway, http, ingest, lucene and node pkgs (#3185)
  • [Javadocs] add to o.o.action.admin (#3155)
  • [Javadocs] Add missing package-info.java files to server (#3128)

Maintenance

  • Bump re2j from 1.1 to 1.6 in /plugins/repository-hdfs (#3337)
  • Bump google-oauth-client from 1.33.1 to 1.33.2 in /plugins/discovery-gce (#2828)
  • Bump protobuf-java-util from 3.19.3 to 3.20.0 in /plugins/repository-gcs (#2834)
  • Bump cdi-api from 1.2 to 2.0 in /qa/wildfly (#2835)
  • Bump azure-core from 1.26.0 to 1.27.0 in /plugins/repository-azure (#2837)
  • Bump asm-analysis from 9.2 to 9.3 in /test/logger-usage (#2829)
  • Bump protobuf-java from 3.19.3 to 3.20.0 in /plugins/repository-hdfs (#2836)
  • Bump joni from 2.1.41 to 2.1.43 in /libs/grok (#2832)
  • Bump geoip2 from 2.16.1 to 3.0.1 in /modules/ingest-geoip (#2646)
  • Bump jettison from 1.1 to 1.4.1 in /plugins/discovery-azure-classic (#2614)
  • Bump google-oauth-client from 1.31.0 to 1.33.1 in /plugins/repository-gcs (#2616)
  • Bump jboss-annotations-api_1.2_spec in /qa/wildfly (#2615)
  • Bump forbiddenapis in /buildSrc/src/testKit/thirdPartyAudit (#2611)
  • Bump json-schema-validator from 1.0.67 to 1.0.68 in /buildSrc (#2610)
  • Bump htrace-core4 from 4.1.0-incubating to 4.2.0-incubating in /plugins/repository-hdfs (#2618)
  • Bump asm-tree from 7.2 to 9.2 in /modules/lang-painless (#2617)
  • Bump antlr4 from 4.5.3 to 4.9.3 in /modules/lang-painless (#2537)
  • Bump commons-lang3 from 3.7 to 3.12.0 in /plugins/repository-hdfs (#2552)
  • Bump gson from 2.8.9 to 2.9.0 in /plugins/repository-gcs (#2550)
  • Bump google-oauth-client from 1.31.0 to 1.33.1 in /plugins/discovery-gce (#2524)
  • Bump google-cloud-core from 1.93.3 to 2.5.10 in /plugins/repository-gcs (#2536)
  • Bump wiremock-jre8-standalone from 2.23.2 to 2.32.0 in /buildSrc (#2525)
  • Bump com.gradle.enterprise from 3.8.1 to 3.9 (#2523)
  • Bump commons-io from 2.7 to 2.11.0 in /plugins/discovery-azure-classic (#2527)
  • Bump asm-analysis from 7.1 to 9.2 in /test/logger-usage (#2273)
  • Bump asm-commons from 7.2 to 9.2 in /modules/lang-painless (#2234)
  • Bump jna from 5.5.0 to 5.10.0 in /buildSrc (#2512)
  • Bump jsr305 from 1.3.9 to 3.0.2 in /plugins/discovery-gce (#2137)
  • Bump json-schema-validator from 1.0.36 to 1.0.67 in /buildSrc (#2454)
  • Bump woodstox-core from 6.1.1 to 6.2.8 in /plugins/repository-azure (#2456)
  • Bump commons-lang3 from 3.4 to 3.12.0 in /plugins/repository-azure (#2455)
  • Update azure-storage-blob to 12.15.0 (#2774)
  • Move Jackson-databind to 2.13.2 (#2548)
  • Add trademark notice (#2473)
  • adds ToC (#2546)
  • Sync maintainers with actual permissions. (#3127)

Refactoring

  • [Remove] remaining AllFieldMapper references (#3007)
  • Clear up some confusing code in IndexShardHotSpotTests (#1534)
  • [Remove] ShrinkAction, ShardUpgradeRequest, UpgradeSettingsRequestBuilder (#3169)
  • [Rename] ESTestCase stragglers to OpenSearchTestCase (#3053)
  • [Remove] MainResponse version override cluster setting (#3031)
  • [Version] Don't spoof major for 3.0+ clusters (#2722)
  • Centralize codes related to 'master_timeout' deprecation for eaiser removal - in CAT Nodes API (#2670)
  • Rename reference to project OpenSearch was forked from (#2483)
  • Remove the IndexCommitRef class (#2421)
  • Refactoring gated and ref-counted interfaces and their implementations (#2396)
  • [Refactor] LuceneChangesSnapshot to use accurate ops history (#2452)

Tests

  • Add type mapping removal bwc tests for indexing, searching, snapshots (#2901)
  • Removing SLM check in tests for OpenSearch versions (#2604)
  • [Unmute] NumberFieldTypeTests (#2531)
  • Use Hamcrest matchers and assertThat() in ReindexRenamedSettingTests (#2503)
  • [Unmute] IndexPrimaryRelocationIT (#2488)
  • Fixing PluginsServiceTests (post Lucene 9 update) (#2484)