docs/en/release_notes/release-2.5.md
Release date: June 20, 2024
Fixed the following issues:
Release date: May 15, 2024
s3a:// and s3:// can be used to access data in AWS S3. #42460Fixed the following issues:
information_schema, the database lock is held for an unexpectedly long time, which prolongs the overall query time. #45392set enable_query_cache=false. #43823All slotIds should be remapped. #42861Release date: March 22, 2024
replace_if_not_null supports BITMAP columns in an Aggregate table. Users can specify replace_if_not_null as the aggregate function for BITMAP columns in an Aggregate table. #42104update_compaction_size_threshold is changed from 256 MB to 64 MB to accelerate compaction. #42776Fixed the following issues:
Release date: February 8, 2024
yyyy-MM-ddTHH:mm and yyyy-MM-dd HH:mm to support TIMESTAMP partition fields in Apache Iceberg tables. #39986Fixed the following issues:
storage_page_cache_limit in certain circumstances. #37740array<string> data from ORC files into StarRocks (array<json>) may cause BEs to crash. #39233Release date: Jan 10, 2024
enable_materialized_view_for_insert, which controls whether materialized views rewrite the queries in INSERT INTO SELECT statements. The default value is false. #37505enable_strict_order_by. When this variable is set to the default value TRUE, an error is reported for such a query pattern: Duplicate alias is used in different expressions of the query and this alias is also a sorting field in ORDER BY, for example, select distinct t1.* from tbl1 t1 order by t1.k1;. The logic is the same as that in v2.3 and earlier. When this variable is set to FALSE, a loose deduplication mechanism is used, which processes such queries as valid SQL queries. #37910transaction_read_only and tx_read_only to specify the transaction access mode, which are compatible with MySQL versions 5.7.20 and above. #37249routine_load_unstable_threshold_second. #36222http_worker_threads_num, which specifies the number of threads for HTTP server to deal with HTTP requests. The default value is 0. If the value for this parameter is set to a negative value or 0, the actual thread number is twice the number of CPU cores. #37530pindex_major_compaction_limit_per_disk to configure the maximum concurrency of compaction on a disk. This addresses the issue of uneven I/O across disks due to compaction. This issue can cause excessively high I/O for certain disks. The default value is 1. #37695Fixed the following issues:
SELECT ... FROM ... INTO OUTFILE is executed to export data into CSV files, the error "Unmatched number of columns" is reported if the FROM clause contains multiple constants. #38045bitmap_to_string may return incorrect result due to data type overflow. #37405Release date: December 19, 2023
max_tablet_rowset_num for setting the maximum allowed number of rowsets. This metric helps detect possible compaction issues and thus reduces the occurrences of the error "too many versions". #36539OtherMsg, which shows information about the last failed task. #35806query_timeout. This prevents query failures caused by RPC request expiration. #36778enable_stream_load_verbose_log is added. The default value is false. With this parameter set to true, StarRocks can record the HTTP requests and responses for Stream Load jobs, making troubleshooting easier. #36113update_compaction_per_tablet_min_interval_seconds becomes mutable. #36819Fixed the following issues:
enable_collect_query_detail_info is set to true. #35945./agentctl.sh stop be is used to stop a BE. #35108Release date: December 1, 2023
Fixed the following issues:
Release date: November 29, 2023
enable_new_publish_mechanism is changed to a static parameter. You must restart the FE after you modify the parameter settings. #35338recover_with_empty_tablet to true may cause FEs to crash. #33071show proc '/statistic' may cause a deadlock. #34237INFORMATION_SCHEMA is queried by using the database driver MariaDB ODBC, the CATALOG_NAME column returned in the schemata view holds only null values. #34627/) at the end of the HDFS storage path causes the backup and restore of the data from HDFS to fail. #34601Release date: November 14, 2023
COLUMNS table in the system database INFORMATION_SCHEMA can display ARRAY, MAP, and STRUCT columns. #33431cbo_decimal_cast_string_strict, which controls how the CBO converts data from the DECIMAL type to the STRING type. If this variable is set to true, the logic built in v2.5.x and later versions prevails and the system implements strict conversion (namely, the system truncates the generated string and fills 0s based on the scale length). If this variable is set to false, the logic built in versions earlier than v2.5.x prevails and the system processes all valid digits to generate a string. The default value is true. #34208cbo_eq_base_type, which specifies the data type used for data comparison between DECIMAL-type data and STRING-type data. The default value is VARCHAR, and DECIMAL is also a valid value. #34208Fixed the following issues:
java.lang.IllegalStateException: null is reported if the ON condition is nested with a subquery. #30876INSERT INTO SELECT ... LIMIT is successfully executed. #24435msg:Fail to parse columnsFromPath, expected: [rec_dt]. #32721Analyze columnDef error: No aggregate function specified for 'userid'. #31763Release date: September 28, 2023
Fixed the following issues:
Release date: September 4, 2023
Fixed the following issues:
When Broker Load is used to load data, the NOT NULL attribute of some fields may cause BEs to crash or cause the "msg:mismatched row count" error. #29832
Queries against ORC-formatted files fail because the bugfix ORC-1304 (apache/orc#1299) from Apache ORC is not merged. #29804
Restoring Primary Key tables causes metadata inconsistency after BEs are restarted. #30135
Release date: August 28, 2023
enable_strict_type. The default value is false. #21870hive.metastore.uri when they create an Iceberg Catalog. The error prompt is more accurate. #16543xxx too many versions xxx. #28397year. #28386Fixed the following issues:
information_schema.task_runs table. #28060/apache_hdfs_broker/lib/log4j-1.2.17.jar. #28866Release date: August 7, 2023
Fixed the following issues:
An exception occurred when using the current long link to access metastore. msg: Failed to get next notification based on last event id: 707602 is reported in FE logs if event listener is configured on the HMS to incrementally update Hive metadata. #21056[42000][1064] Dict Decode failed, Dict can't take cover all key :0 if low-cardinality optimization is enabled. #26463"hadoop.security.authentication" = "simple" in their Broker Load jobs created to load data from HDFS, the job fails. #27774Release date: July 19, 2023
table_id to the table tables_config in the database Information_schema. You can join tables_config with be_tablets on the column table_id to query the names of the database and table to which a tablet belongs. #24061Fixed the following issues:
Release date: June 30, 2023
Fixed the following issues:
Release date: June 14, 2023
ALTER MATERIALIZED VIEW <mv_name> ACTIVE. You can use this SQL command to activate materialized views whose base tables were dropped and then recreated. For more information, see ALTER MATERIALIZED VIEW. #24001VersionCount field returned by SHOW TABLET contains Rowsets that are in the Pending state. #23847Fixed the following issues:
information_schema becomes ineffective. As a result, users can view tables they do not have permission to. #23804Release date: May 19, 2023
thrift_server_max_worker_thread value. #21964partition_refresh_number property specified may fail to completely refresh. #21619Release date: April 28, 2023
Added a metric to monitor the tablet status of Primary Key tables:
err_state_metric.ErrorStateTabletNum column to the output of SHOW PROC '/statistic/' to display the number of err_state tablets.ErrorStateTablets column to the output of SHOW PROC '/statistic/<db_id>/' to display the IDs of err_state tablets.For more information, see SHOW PROC.
storage_medium. When BEs use both SSD and HDD as storage devices, if the property storage_cooldown_time is specified, StarRocks sets storage_medium to SSD. Otherwise, StarRocks sets storage_medium to HDD. #18649bad by using statements like ADMIN SET REPLICA STATUS PROPERTIES ("tablet_id" = "10003", "backend_id" = "10001", "status" = "bad");. If the number of BEs is less than or equal to the number of replicas, the corrupted replica cannot be repaired. # 17876auto_refresh_partitions_limit does not take effect when the materialized view (MV) is refreshed for the first time. As a result, all the partitions are refreshed. # 19759Release date: April 4, 2023
SELECT sum(CASE WHEN XXX); contains a constant 0, such as SELECT sum(CASE WHEN k1 = 1 THEN v1 ELSE 0 END) FROM test;, pre-aggregation is automatically enabled to accelerate the query. #19474SHOW CREATE VIEW to view the creation statement of a materialized view. #19999The following bugs are fixed:
PROPERTIES of the table creation statement, and moreover the rewriting of queries on materialized views created on that table fails. #19780"storage_medium" = "SSD" at the creation of materialized views causes the refresh of the materialized views to fail. #19539 #19626Release date: March 10, 2023
The following bugs are fixed:
[] in ARRAY data. #18563Release date: February 21, 2023
The following bugs are fixed:
enable_experimental_mv from false to true, which means asynchronous materialized view is enabled by default.Release date: February 5, 2023
default_storage_medium. If storage_medium is not explicitly specified when users create a table, the system automatically infers the storage medium of the table based on BE disk type. For more information, see description of storage_medium in CREATE TABLE. #14394The following bugs are fixed:
default_storage_medium. The storage medium of a table is automatically inferred by the system. #14394Release date: January 22, 2023
replicated_storage in CREATE TABLE. #10138information_schema database and the tables and columns tables within. Adds a new table table_config. For more information, see Information Schema. #10033INCREASE for the window_funnel function to avoid computing duplicate timestamps. #10134current_date, current_timestamp, current_time, localtimestamp, and localtime functions can be executed without using (), for example, you can directly run select current_date;. # 14319The following bugs are fixed:
waiting_stable state cannot be canceled. #12530SHOW PROC '/statistic'; command on a Leader FE and non-Leader FE returns different results. #12491AWS_EC2_METADATA_DISABLED parameter to False, which means that the metadata of Amazon EC2 is obtained to access AWS resources.is_report_success to enable_profile, which can be queried using the SHOW VARIABLES statement.CURRENT_DATE, CURRENT_TIME, LOCALTIME, and LOCALTIMESTAMP. # 14319enable_event_based_compaction_framework and enable_size_tiered_compaction_strategy are set to true by default, which significantly reduces compaction overheads when there are a large number of tablets or a single tablet has large data volume.