v2.1 Series release notes

Included here are the release notes for all releases in the v2.1 release series.

v2.1.0

Released February 25, 2020.

Downloads

Binaries

Docker

docker pull yugabytedb/yugabyte:2.1.0.0-b18

YSQL Changes

• [YSQL] Fix table location cache for system and colocated tables. #3416
• [YSQL] Enable ALTER TABLE IF EXISTS syntax. #3417
• [YSQL] Use std::future in PgDocOp to fetch RPC result. #3240
• [YSQL] Cleanup unique index if its creation fails. #3462
• [YSQL] Eliminate redundant foreign key checks. #3328
• [YSQL] Batch all write operations when possible. #2934
• [YSQL] allow CREATE DATABASE ENCODING unicode/utf8 #3595
• [YSQL] Fixed test wrong assumption in yb_dml_systable_scan.
• [YSQL] Use smart pointers for YBqlOp and YBPgsqlOp. #3641
• [YSQL] Provide a GFLAG to suppress unsupported error. #3633

YCQL Changes

• [YCQL] Add gflag to create CQL tables as transactional by default; change GROUP from reserved word to keyword; fix duplicate column error message. #3313
• [YCQL] Fixed unexpected 'Duplicate Object' error from the CatalogManager. #2475
• [YCQL] Fixed: signal 11: seg fault: yb::ql::PreparedResult::PreparedResult. #3415
• [YCQL] Application stuck in BoundStatement execution if a variable was not bound. #3419

System improvements

• Set the default history retention duration to 120 seconds. #3373
• Fix metrics error after resetting percentiles.. #3362
• Extract classes from transaction_participant.cc to separate files. #1032
• Recover after write stop. #3331
• Fix issue with yugabyted process restart loop. #3207
• Track replicated batches at transaction participant. #3220
• Backfill Index Table. #448
• [Colocation] Use 4 byte PG table ID as dockey prefix. #3365
• YB inbound RPCs throttling on soft memory limit. #2563
• BlockBasedMemory mem-trackers should use the "tablet" MetricsEntity instead of "servers". #3364
• Mean for metrics histograms should be based on the current values, not historic values. #3470
• Make yugabyted work with docker volume mounts. #3513
• Added Graph to track Rocksdb write rejections. #2871
• Fsync before WAL close. #3490
• Enable percentiles for redis metrics. #3362
• BlockBasedMemory mem-trackers may already exist in OpenKeyValueTablet. #3364
• [cdc] Avoid race condition with CDCReadRpc. #3441
• Call TransactionParticipant shutdown from Tablet shutdown. #3495
• Point yugabyted to system conf file if present. #3169
• Backfill Index Table - TServer side implementation for backfilling non-unique indices. #448
• colocation: make reads aware of table tombstone #3359
• Add ability to set hybrid time filter to existing rocksdb files. #1032
• Server crash on startup after table truncate. #3524
• Move all yugabyted modified data under central var dir. #3524
• Add physical time to cdc_state table. #2837
• docdb: iterate over intents past kTransactionId #3482
• Prevent callback from detached rocksdb instance; prevent race condition between insert and truncate; disable rocksdb flush on truncate. #3288
• Persist cdc min replicated index in the superblock. #3418
• [CDC] Clean up cdc_state rows for deleted streams. #2529
• yugabyted does not start with custom config file. #3634
• [2DC] Create new BootstrapProducer API. #3319
• Fix key processing on CDCProducer. #3582
• Make yb-docker-ctl compatible with python3
• Backfill index: handle failed master -> TS rpc. #3627
• [cdc] Add Last Consumer Checkpoint to CDC Producer Metrics. #2154
• Evict log cache at follower after operation was appended to log. #3665
• Implement transaction sealing w/o abort. #3220
• [Colocated] Master should issue AddTableToTable only for subsequent tables. #3681
• Extract HeartbeatDataProvider from Heartbeater. #3571
• Avoid sending apply intents from the follower. #3698

Platform

• YW Alerting improvements. #2892
• Add the 'snooze alerts status' of a universe to the health check panel. #2891
• Added UI support to be able to snooze and enable alerts. #2891
• Add toggle to take backup button. #3341
• Redirect yugaware logs from yugabyted into yugabyte-logs dir. #3516
• Add features for the read only user.
• Add endpoint to support creation of user roles in YB database(s).
• Add ability to specify list of tables to backup. #3614
• Fix metrics url check. #3653
• Do not merge flags during a gflag update. #3533
• Add option to add, delete users
• [YW] Add ESC key binding to document to close any modal on the screen by calling the onHide callback.#3211
• [YW] Add default value for currentProvider and fix eslint warnings. #3332
• [YW] Enable multi-table backups in CreateBackups modal. #3680
• Add authentication for registering new users.
• [YW][OSS] Add support to disable the Enable/Disable Backup button on the Tables tab, and change color of disabled TableActions
• Handle overall exceptions in a better way. #3676

v2.1.1

Released March 03, 2020.

Downloads

Binaries

Docker

docker pull yugabytedb/yugabyte:2.1.1.0-b2

YSQL Changes

• [YSQL] Improve performance when running index scan to query data. #3103

System improvements

• colocation: handle table tombstone compaction #3360
• Decrease log segment size for transaction status tablet. #3699
• Fix data race between ~Tablet and yb::tablet::Tablet::RegularDbFilesChanged(). #3519
• MiniMaster should set master_addresses on restart. #3336
• [cdc] Alter Replication Command for CDC. #2838
• Modify ldb Tool to be Encryption Aware. #3455
• Create database fails inside docker yugabyted. #3742

Platform

• [YW] Change the Disk Usage widget on Universe overview page to show the latest value instead of the average

v2.1.2

Released March 10, 2020.

Downloads

Binaries

Docker

docker pull yugabytedb/yugabyte:2.1.2.0-b10

YSQL Changes

• [YSQL] Framework for expression pushdown. #3297
• [YSQL] Optimize relcache preloading by reducing the number of master RPCs. #3049
• [YSQL][Diesel ORM] Fix crash for nested SELECT with set-returning function and LIMIT. #3811
• [YSQL] Fix error when ybctid value matches the partition boundary. #3833
• [YSQL][Hasura] Fix 'Missing base table ybctid' error for UPDATE with RETURNING clause. #3805
• [YSQL] Update on table with multiple FK tables crashes postgres. #3583

System improvements

• [cdc] Fix DeleteTableWithCDCStream
• Ensure only Tablet leaders can confirm alter table. #2236
• Make OpenSSL usage thread-safe. #3454
• Revert removed timeout from RequestConsensusVote. #3390
• colocation: fix DFATAL on UI tables page (#3726). #3726
• Ignore writes from the same transaction while updating CQL indexes. #3718
• Update setting for default number of compaction threads. #3561
• Add functionality of resolving intents to transaction participant. #1032
• [cdc] Ability to Delete & List CDC Streams in yb-admin. #3638
• Set default manifest preallocation to 64k. #3666
• A workaround for encryption counter overflow. #3707
• Fixed SecureStream OOM during network partition. #3842
• Transactions could hang at transaction participant after write stopped. #3823
• Show backfill progress at master/tasks. #3668
• Fix apply of transaction with deleted tablets. #3828
• Comment out Connection::Shutdown info log. #3842

Platform

• Fix health check failures when YSQL auth is enabled. #3737
• Adding under-replicated tablet servers to the master health check. #1374
• Fix Tab problem when going into Tables page on YugabyteDB Aeon. #3749
• Only save usable AWS instance types. #3626
• Added APIs for querying audit table. #3792
• Generate Client Certificate for TLS enabled Universes. #3839
• Onprem - allow specifying homeDir, automatically exclude installing s3cmd and ntp. #3834
• Add sorting by default to the releases list and also a search bar to allow users to quickly access the desired release by entering part of the string. #3563
• Correctly disable ntp install for onprem

v2.1.3

Released April 09, 2020.

Downloads

Binaries

Docker

docker pull yugabytedb/yugabyte:2.1.3.0-b26

YSQL Changes

• [YSQL] Parallel queries across tablets for SELECT COUNT|MIN|MAX|SUM (*|col_id) FROM. #3624
• [YSQL] Fixed bug when processing PgsqlConditionPB::operands::column_id. #3937
• [YSQL] IndexScan returns all rows when there is no match. #3896
• [YSQL] Partial support for operator families, ALTER OPERATOR and ALTER EXTENSION. #2711
• [YSQL] Handle transaction conflict status in case of parallel read operations. #3991
• [YSQL][YCQL] Wrong results when using DocDB reverse scans with paging #4004
• [YSQL] Flush buffered operations before calculating query time. #3696

YCQL Changes

• [YCQL] Send proper error when we query system.peers_v2 table. #3862

System improvements

• Implement paging for index backfill. #3879
• Rename indices to indexes in the context of index-backfill. #3901
• Cleaner error reporting from process main. #3876
• Fix determining the oldest SST file for intent cleanup. #3917
• Fix the TS UI transactions link. #3922
• Fix transaction status resolution with old peer version. #3916
• Add nodiscard attribute to Status class. #3918
• [docdb] Deregister callback for common mem trackers from root mem tracker in destructor of vector. #3750
• First phase of transaction aware snapshot. #1032
• [cdc] Fix data races in CDC Poller. #3771
• [YSQL] Fix for PgGate shutdown race on shutdown_done flag. #3779
• Initial multi node yugabyted version. 2057
• Enable checksum verification for meta blocks of encrypted files. #3974
• Batch copy table operations that happen during create database. #3743
• yb-admin: flush_table_by_id, compact_table_by_id #3814
• [docdb][ysql] Reuse iterators during txn conflict resolution. #3521
• Persist backfilling timestamp across master failures. #3611
• Relax requirement on number of log segments in QLTransactionTest.PreserveLogs. #3989
• Fix encryption format for newly created files. #3976
• Move remote bootstrap call to OpenTablet to the threadpool. #3012
• Support the ability to fetch the oldest timestamp record that is more recent than a specified time. #4019
• A flag for veryfing meta block checksums. #4023
• Stop cleaning intents SST files if previous file was not actually deleted. #3917
• Fix MakeFuture utility. #3781
• Restore transaction aware snapshot. #1032
• Fix demo destroy behavior with Python 2.7.5. #3993
• Adding health check for the Tserver. #3540
• Don't block remote bootstrap service during session init. #4035
• YBClient sbould wait for all sync operation to complete upon shutdown. #3989
• Inherited permissions shouldn't replace granted permissions in the client's cache. #4062
• Fix race condition on ParseTree::stale_. #3083
• Handle RPC register failure in TransactionStatusResolver. #4064
• Handle tablet not running in /transactions page. #4071
• Propagate history cutoff from leader. #1032
• Allow yb-admin to work with any non-leader master. #4000
• Transaction aware snapshot persistence. #1032
• Optimize returning results from tserver to postgres. #3926
• Allow tracing recent operations in MvccManager. #4108
• Persist ALTER ROLE changes to disk. #4105
• colocation: cache db colocated in postgres #4101

Platform

• Fix edit flow to show encryption at rest flags properly. #3910
• Add support for disabling readonly users. #3794
• Add API to get client certificate. #3984
• Create GCP provider with shared VPC and allow specifying subnets per region. #3383
• Update AWS price info && stop auto-running update script.
• Remove devops subnetId requirement when specifying a VPC when creating GCP provider.
• Add node ip to all created universes
• Omit master servers from being counted toward total node/pod count. #4009
• Update master selection logic. #3999
• Prevent data move if there is no data to move. #4046
• UI to set region-subnet mapping when creating GCP provider for existing VPCs. #3381

v2.1.4

Released April 15, 2020.

Downloads

Binaries

Docker

docker pull yugabytedb/yugabyte:2.1.4.0-b5

YSQL Changes

• [YSQL] Buffer writes to postgres system tables, reorder table creation on yb-master. #4013
• [YSQL] Single row update overwrites unmodified columns with default values to null #4127
• [YSQL] Read restarts are not done transparently in JDBC "simple" query mode. #4094
• [YSQL] Remove redundant call of YBOnPostgresBackendShutdown. #3236
• [YSQL] Allowing a deletion of a table when the DocDB returns a 'NotFound' error. #3305
• [YSQL] Use higher priority for transactions with explicit locking statements. #4136
• [YSQL] Made pg_notify a NOOP emitting warning. #3875

YCQL Changes

• [YCQL] Backing up table should back up its indexes. #3836

System improvements

• Fix memory leak on transaction abort. #3631
• colocation: enforce colocated reloption behavior.
• Implement backfilling for YCQL Unique Index. #3891
• yb-admin hangs for full timeout of 60s when no leader master is present/specified. #209
• Use QLExprResult during expression evaluation to avoid unneccesary memory allocations and copies. #3926
• Fix LB interaction with Preferred Regions. #3461
• [yb-admin] list_all_masters does not list dead hosts. #4070
• Delete a transaction aware snapshot. #1032
• Prevent read-write data race on field in DBImpl. #4025
• [docdb] Master heartbeat writes should be batch written to raft. #2236
• TServer-side tablet splitting. #1459
• Better descripton for BackfillTableJob. #4143
• Bump max threads in the RPC thread pool to 1024. #4058
• Avoid extra fsyncs of tombstoned tablets during startup. #4006
• Fixed tablet log prefix. #4188
• Remove peers when its tablet is in the FAILED state so that they can be remote bootstrapped. #3539
• Index deletion upon backfill failure. #3978
• More resilient multi node yugabyted. #2057
• Added split-tablet RPC support into yb-admin and yb-master. #1461
• Fix master bootstrap after snapshot operations. #1032
• TabletIterator Hangs during Shutdown. #4081
• Enable Move From Leader LB. #3461
• [ybase] Set default value of copy_table_batch_size to 10K. #3743
• Retain delete markers on index tables only during backfill. #4211

Platform

• Ability to attach multiple security groups to yugabyte nodes. #1598
• Remove psql from bin and fix get_clients.sh. #3928
• Set replication_factor gflag on master when creating universe. #4099
• Support for GCS backups. #3405
• Show node name in alert emails. #4102
• [YW] Add Scheduled backups to universe level Backups tab and remove from top-right dropdown. #3591
• Disable standalone backups for YCQL indexes. #3848
• [YW] Fix map markers not showing up in expanded view of node placement map in Universe overview. #4200

v2.1.5

Released: April 27, 2020 (2.1.5.0-b17).

New to YugabyteDB? Follow Quick start to get started and running in less than five minutes.

Downloads

Binaries

Docker

docker pull yugabytedb/yugabyte:2.1.5.0-b17

YSQL Changes

• [BETA] The CREATE TABLE statement now supports the SPLIT AT VALUES clause. #1486
• Read restart for EXECUTE statement if the prepared statement is SELECT. #4205
• Find and list YSQL tables in yb-admin commands now use table ID instead of table names. #1687
• The DROP INDEX statement now ignores index backfill.
• The DROP INDEX statement now ignores DocDB NotFound errors when it doesn't have table metadata, but postgres does. #4249
• Force single row update prepare statements to use a custom plan that requires boundParams to be sent for creation and execution. #4219
• Improve performance of multi-column primary keys by generating scanspec for range partitioned tables using condition expression. #4033

System improvements

• Improve tablet splitting #4169, including:
  • Add support for transaction-enabled tables.
  • Add WAL index flush before copying WAL during table splitting.
• [colocation] Optimization that pushes index lookup down to DocDB. #3609
• [colocation] Use range keys by default for colocated tables and indexes. #3034
• [colocation] Avoid excessive RPC requests for drop and truncate #3387
• On starting a new yb-master (in edit and add node), update master addresses correctly in yb-master and yb-tserver configuration files. #3636, #4242, and #4245
• Add backup-related code changes for snapshots #3836, including:
  • Change yb-admin import_snapshot to return an error if there are less new table names than backed up tables. For example, if you rename only two of three tables, an error will be generated.
  • Change yb-admin restore_snapshot and yb-admin list_snapshot to output restoration-id (useful for verifying completed restorations).
• Support yb-admin import_snapshot renaming only a few tables (but not all), but keeping the specified table name the same as the old table name. #4280
• Deprecate table_flush_timeout in the yb-admin create_snapshot command.
• Do not return error in output of yb-admin get_is_load_balancer_idle if load balancer is busy. [#3949]
• Change yb-tserver /utilz endpoint page to display "Live Ops" instead of "RPCs" and add YSQL statements link #4106
• Fix access to reset tablet peer during shutdown. #3989
• GetSafeTime should wait instead of adding to safe time. #3977
• Add retry logic to snapshot operations. #1032
• Add TLS encryption support to yb-ts-cli (adds --certs_dir_name flag) for sending secure RPC requests to the servers. #2877
• Fix yb-ctl failing when passing vmodule in --master_flags . #4234
• The yugabyte-client package now includes a share folder (containing .sql files) for use by YugabyteDB Aeon and other remote client users. #4264

Yugabyte Platform

• When shrinking a universe, remove nodes in descending index order. #3292
• Add back up and restore of Yugabyte Platform using yb_platform_backup.sh script. #4208
• Change yb_backup.py to use the yb-admin changes for backup-related changes for snapshot (see System improvements above).
• Fix expected restoration state in the yb_backup.py script.
• Allow users to select multiple single tables to backup in addition to specifying a full universe backup. #3680
• Customize the SMTP server for sending alert messages using configuration entries for smtpData (smtpServer, smtpPort, emailFrom, smtpUsername, smtpPassword, useSSL, and useTLS). #4201
• [YW] Add option to specify table keyspace when creating manual or scheduled backups. #3342
• For Azure Storage blob backups, use SAS tokens instead of Service Principal client secrets.
• Add create and restore backup support for Azure Blob Storage with SAS tokens. #3721
• [YW] Add IAM Role toggle in provider storage configuration to use the IAM role instead of requiring an Access Key and Secret. #4204
• [YW] When creating a universe and AWS provider is selected, display new Use IAM Profile toggle and ARN String text field. #4199
• Use Raft configuration as a source for master addresses in server.conf for master. #4089
• [YW] If a node appears as unreachable, it can be removed or released without generating errors. #4171
• [YW] Create GCP providers with any combination of host credentials and host (or shared) VPC. #4177

v2.1.6

Released: May 8, 2020 (2.1.6.0-b17).

New to YugabyteDB? Follow Quick start to get started and running in less than five minutes.

Downloads

Binaries

Docker

docker pull yugabytedb/yugabyte:2.1.6.0-b17

YSQL

• Wait for tserver to finish creating the transaction table during the initial cluster startup (when the transaction table is first created) before issuing requests that require it to exist. This was more likely an issue for CI/CD, where requests can be issued immediately. Most users would not encounter this issue. #4056
• Avoid redundant read for non-unique index inserts. For non-unique indexes, the primary key of the main table is implicitly added to the DocDB key, guaranteeing uniqueness of the full DocDB key (indexed columns plus encoded base table primary key). This fix executes such inserts as upserts and avoid the read and uniqueness check. #4363
• Enhance automatic query read restart to avoid recreating portal. Instead of recreating a portal, reset an existing one to the state which allows it to be re-executed. Eliminate memory overhead for storing potential big bind variable values (for example, long strings). #4254
• For CREATE DATABASE statements, improves fault tolerance by making CREATE API requests asynchronously and adds a state machine on namespaces to be the authority for processing these modifications. #3097
• Display current query runtime (process_running_for_ms), in milliseconds (ms), on <tserver_ip>:13000/rpcz endpoint. #4382

YCQL

• Allow system.peers_v2 table to be readable for cassandra-driver-core:3.8.0-yb-2-RC1 so that expected errors are returned to the driver. #4309

System improvements

• [DocDB] Improve fault tolerance by enabling exponential backoff mechanics for the leader attempting to catch up the follower. If this causes any issues, you set the --enable_consensus_exponential_backoff flag (enabled by default) to false. #4042
• [DocDB] Improve row scanning by using SeekForward for intents. In testing, performance of SELECT COUNT(*) has improved by 66%. #4277
• [DocDB] Add asynchronous transaction status resolution to conflict detection. #4058

Yugabyte Platform

• When performing a full move or add node on a universe that has a yb-master, the server.conf file is now being updated with the new master_addresses. #4242
• In the Backups tab, individual YSQL tables can no longer be selected. Previously, attempting to back up a YSQL table would create a failed task. #3848
• In the Metrics view, transactions have been added to the YSQL and YCQL operations charts. #3827
• Create Read Replica and Edit Read Replica pages are no longer in beta. #4313
• In the Certificates page, you can now download certificates. #3985
• In the Universes overview page, add a button to toggle on metrics graph widgets to auto-refresh or to set refresh interval. #2296

v2.1.8

Released: June 19, 2020 (2.1.8.2-b1).

New to YugabyteDB? Follow Quick start to get started and running in less than five minutes.

Downloads

Binaries

Docker

docker pull yugabytedb/yugabyte:2.1.8.2-b1

YSQL

• Add support for SPLIT INTO clause for CREATE INDEX statement. #3047
• Fix aggregate functions pushdown for columns with default values added after table creation. #4376
• Resolve timeout frequently encountered when batch-loading data in YSQL by using client-specified timeouts for RPC requests instead of hardcoded values. #4045
• Fix incorrect cross-component dependency in DocDB found in builds using ninja. #4474
• Fix operation buffering in stored procedures to handle transactions correctly. #4268
• [DocDB] Ensure that fast path (pushed down) single row writes honor higher priority transactions and get aborted or retired instead. #4316
• [DocDB] Split copy table operations into smaller chunks (using byte size instead of count) for CREATE DATABASE statement. #3743
• Correctly push down IS NULL condition to DocDB. #4499
• Avoid ASAN failures after a large data set is uploaded by rearranging files and test functionalities. #4488
• Fix memory leaks by using memory context to manage object alloc and free. #4490
• Fix multi-touch cache and improve caching logic for read and write operations. #4379
• Improve index cost estimates by considering index uniqueness, included columns (index scan vs. index only scan), scan direction, and partial indexes. Also, disable merge joins for unsupported cases. #4494 and #4496
• Add support for deferrable foreign key constraints. #3995
• Prevent dropping primary key constraint. #3163
• Push down SELECT <aggregate>(<const>), for example, SELECT COUNT(1) , to DocDB. #4276
• Fix rare core dumps due to concurrency issues in metrics webserver during shutdown. #4092

YCQL

• Rename cqlsh to ycqlsh. #3935
• Update Cassandra Java driver version to 3.8.0-yb-4 and adds support for guava 26 or later. The latest release of the driver is available in the Yugabyte cassandra-java-driver repository. #3897
• YB-TServers should not crash when attempting to log in using YCQL authentication without a password. #4459
• Performance degradation in CassandraSecondaryIndex workload resolved. #4401
• Add yb-admin import_snapshot support for renaming a few tables (not all), but the specified name is equal to the old table name: yb-admin import_snapshot <meta-file> ks old_table_name. #4280
• For DDL creation with Spring Data Cassandra, change the Enum value from JSON to JSONB to allow schema creation to succeed programmatically involving JSON column types and update the cassandra-java-driver to 3.8.0-yb-5. #4481
• Use the same timestamp for current time to compute multiple runtimes in output of <tserver-ip>:13000/rpcz. #4418
• Correctly push down = NULL condition to DocDB. #4499
• Reduce YCQL unprepared statement execution time by up to 98% (example: reduced time to insert a 5 MB string from 18 seconds to 0.25 seconds). #4397 and #3586
  • Special thanks to @ouvai59 for your contribution!

YEDIS

• For yugabyted, do not start redis server by default. Resolves port conflict during startup. #4057

System improvements

• New yb-admin command get_load_balancer_state to get the cluster load balancer state. #4509
• Avoid creating intent iterator when no transactions are running. #4500
• Increase default memory limit for yb-master for running in low-memory setups (<=4 GB). #3742
• Improve RocksDB checkpoint directory cleanup if a tserver crashes or is restarted while performing a snapshot operation. #4352
• [DocDB] Use bloom filters for range-partitioned tables. The first primary key column is added to the bloom filter. #4437
• [DocDB] Fix snapshots bootstrap order bu altering the load for transaction-aware snapshots. #4470
• [DocDB] Add yb-admin master_leader_stepdown command. #4135
• [DocDB] Reduce impact on CPU and throughput during node failures. #4042
• [DocDB] Add yb-ts-cli commands, flush_all_tablets and flush_tablet <tablet_id>, to flush tablets. When used with rolling restarts, less time is spent applying WAL records to rocksdb. #2785
  • Special thanks to mirageyjd for your contribution.
• [DocDB] Fix deadlock during tablet splitting. #4312
• Introduced load balancing throttle on the total number of tablets being remote bootstrapped, across the cluster. #4053 and #4436
• [DocDB] Remove applied intent doc hybrid time during compaction. #4535
• [DocDB] Fixed BoundedRocksDbIterator::SeekToLast works incorrectly for 2nd post-split tablet. #4542
• [DocDB] Abort snapshot if table was deleted. #4610
• [DocDB] Backfill index without waiting indefinitely for pending transactions. #3471
• [DocDB] Fix yb-master rerunning snapshot operations after upgrade. #4816
• [Colocation] During load balancing operations, load balance each colocated tablet once. This fix removes unnecessary load balancing for every user table sharing that table and the parent table.
• Fix YB-Master hangs due to transaction status resolution. #4410
• Redirect the master UI to the master leader UI without failing when one master is down. #4442 and #3869
• Avoid race in change_metadata_operation. Use atomic<P*> to avoid race between Finish() and ToString from updating or accessing request. #3912
• Refactor RaftGroupMetadata to avoid keeping unnecessary TableInfo objects in memory. #4354
• Fix missing rows in unidirectional replication and fix race conditions with CDC and TransactionManager. #4257
• Change intent iterator creation logic. #4543
• Upgrade all Python scripts used to build and package the code to Python 3. #1442

Yugabyte Platform

• Fix failure when adding a node on a TLS-enabled universe. #4482
• Improve latency tracking by splitting overall operation metrics into individual rows for each API. #3825
  • YCQL and YEDIS metrics include ops, avg latency, and P99 latency.
  • YSQL metrics include only ops and avg latency.
• Add metrics for RPC queue sizes of services, including YB-Master, YB-TServer, YCQL, and YEDIS. #4294
• Add option to edit configuration flags without requiring server restart. #4433
• When configuration flags are deleted in the YugabyteDB Admin Console, remove the flags from server.conf file. #4341
• When creating GCP instances, only use host project when specifying network.
• When creating a cloud provider configuration, display provider-level (non-k8s) settings for SSH ports and enabling airgapped installations. #3615, #4243, and #4240.
• After removing a node and then adding a node, check for certificate and key files and create the files if needed. #4551
• Update to support Helm 3 deployments. Note: Helm 2 is no longer supported. #4416
• Change QLTableRow representation. #4427
• Fix CDC-related race conditions using CDCServiceTxnTest.TestGetChangesForPendingTransaction. #4544
• Revert validation on alerting email field to allow comma-separated emails in the form. #4639
• Add Custom SMTP Configuration section to Health & Alerting tab on customer profile page. #4443
• Fix Kubernetes pod container metrics not displaying in Metrics panel. #4652
• Fix Backups tab not rendering when there are no backups. #4661