What's new in the v2.7 release series

{{< warning title="Use v2.7.1.1 or later" >}}

YugabyteDB version 2.7.1.1 contains an important fix for a bug in a downstream dependency (the gperftools package). This tcmalloc memory allocation bug could lead to process crashes. If you're using a previous 2.7 version, please upgrade as soon as possible.

Refer to issue 8531 for details.

{{< /warning >}}

v2.7.2.0 - July 29, 2021

Build: 2.7.2.0-b216

Downloads

Docker

docker pull yugabytedb/yugabyte:2.7.2.0-b216

Improvements

Yugabyte Platform

• [3452] [Platform] Allow TLS Encryption to be enabled on existing universes
• [6857] [Platform] Preflight checks for encryption-at-rest keys (#8737)
• [7349] [Platform] Support for multiple backup configs. (#7668)
• [7732] [Platform] [UI] remove beta tag from Azure provider tab
• [8108] [Platform] Optimize playbook run time
• [8141] [Platform] Disable backup button is moved to the universe action list. (#8788)
• [8144] [Platform] Validate custom certs on the node
• [8211] [Platform] Alerts configuration per a universe basis (notification channels)
• [7942] [8246] EncryptionAtRest json aliases and UniverseController json request
• [8281] [Platform] Change alert and alert definition to better match Prometheus data model
• [8282] [Platform] Generate alert rules configuration files based on configured alert definitions
• [8283] [Platform] Query alerts from prometheus
• [8313] [Platform] Don't download all node logs at once
• [8324] [Platform] Disabled the query monitoring under Quries tab. (#8576)
• [8380] [Platform] modified replicated.yml to add support origin field
• [8406] [Platform] Add deviceInfo validation on universe/read replica cluster create operations
• [8433] [Platform] Python script to create/get and delete universe (#8523)
• [8487] [Platform] Add indices on customer_task and task_info to improve Tasks page performance
• [8662] [Platform] Release pause universe and multiple provider feature
• [8758] [Platform] RuntimeConfigController improvements
• [8767] [Platform] Remove Beta tag from RedHat OpenShift provider config tab.
• [8775] [Platform] [UI] Remove Beta tag from Platform HA
• [8789] Add support for certificate chaining in platform/yb-client.
• [8813] [Platform] requesting Email alerts uptime in days, hours, minutes, seconds.
• [8824] [Platform] S3 backup preflight check while updating the backups. (#8926)
• [8883] [Platform] Support smart instance type upgrade for AWS
• [8917] [Platform] Add task to sync platform with cluster state
• [8990] [Platform] UniverseController split
• [8990] Split Universe controller
• [9054] [Platform] To implement AlertReceivers group entity
• [9056] [Platform] Alert definition groups implementation + APIs for groups and templates
• [9090] Support gzipped responses in webserver
• [9120] [Platform] Default alert route functionality
• [9197] [platform] Adding SSL mode to YSQL client
• [9331] [Platform] Allow editing "Configuration Name" for backup storage provider without security credentials
• [9365] [Platform] Optimise CertificateInfo.getAll by populating universe details in batch rather than individually
• [7721] [8479] [Platform] Platform logs - latest logs first & fixed height issue
• [8108] [Platform] Use mitogen to speed up ansible
• [8434] [Platform] Activate cert_node_filename flag to the node IP.
• [8631] [Platform] Add ability to use different certificates for node to node and client to node connections.
• [8632] [Platform] Add ability to take custom certificates in platform for client to server connections.
• [8921] [Platform] ReadOnly and BackupAdmin roles to change their password
• [Platform] [CLOUDGA-422] custom boot scripts
• [Platform] [CLOUDGA-97] VM image upgrades
• [9103] [Platform] Update "preflight_checks.sh" from ping to tcp check. (#9133)
• [8769] [Platform] Create AsyncReplicationRelationship table
• [Platform] Remove commons-collections4 and use guava instead (#8856)
• [Platform] Use .equals for UUID comparison in toggleTls

Core Database

• [1127] [YSQL] Collation Support (part 1)
• [2272] [YSQL] Creating system and shared system catalog tables
• [2318] [2DC] yb-admin should prevent setup_universe_replication from self-referencing.
• [3375] [DocDB] Add multi drives and env to TS servers for MiniCluster
• [3785] [DocDB] Add support for LZ4 compression
• [4014] [YSQL] Indexes on Enum based columns
• [4437] [DocDB] disabled bloom filters for master tablet and fixed DocDBAwareV2FilterPolicy compatibility for range-partitioned co-located tables
• [4519] [YSQL] Re-enable merge join
• [5026] [9001] [YCQL] Run operations within a transaction block in serial
• [7110] [DocDB] Add Clang thread safety annotations to YQLPartitionsVTable (#8364)
• [7213] [DocDB] Potential deadlock in yb::client::YBTable::MaybeRefreshPartitions
• [7349]Change ToString to TextVlue for json node (#8792)
• [7509] [YCQL] Allow both = and != operator in partial indexes.
• [7509] [YCQL] Support partial indexes
• [7530] YB-Master HTML page should show the tablespace and tablespace replication info for a table
• [7535] [YSQL] Use geo-location (tablespace) to cost index scans
• [7719] [DocDB] Introduce Aggregation Function for Metrics
• [7794] [YSQL] Add option to forward pggate RPCs to local tserver
• [7835] [YCQL] Prohibit NULL value in the collections.
• [7863] [YSQL] Single row optimization for Updates is not being used for partitioned tables even when only one partition is being updated.
• [7877] Some raw json cleanup across the board
• [8010] Handle creation of tables in a tablespace with invalid placement policy gracefully
• [8011] [YBase] Don't abort replica assignment for other tables if one table has an invalid placement
• [8039] [DocDB] Rename flag controlling forced tablet split threshold for very large tablets
• [8039] Implement phased ramp-up of tablet splitting rate
• [8076] [YBase] Master skips deleting tablet data on restarted tservers
• [8084] Remove dependence of client to server TLS on node to node TLS.
• [8170] Correct fix for removing tablet in ProcessTabletAssignment
• [8204] [YBase] GetLoadMoveCompletionPercent returns an incorrect 100% if tservers haven't
• [8225] Disable automatic tablet splitting for YEDIS tables
• [8234] [DocDB] Remove tablet_split_heartbeat_data_provider and delegate all split decisions to yb-master
• [8249] [YSQL] Allow any hash column in index to be an expression based column
• [8254] No leader lease needed for BackfillIndex
• [8257] [YBase] Disable tablet splitting for PITR tracked tables
• [8271] YB-Master should not periodically read the pg_class table if there are no tablespaces.
• [8282] Fix commons-lang deps.
• [8294] Fix missing conflict when creating row using multiple inserts
• [8295] [DocDB] Improved tablet RocksDBs shutdown process
• [8323] [YSQL] Add support for USING INDEX TABLESPACE
• [8330] [YCQL] Provide capability to skip writing null jsonb attribute in UPDATE stmt
• [8347] Wait until executor finish executing async calls on shutdown
• [8382] [YSQL] Import Fix mishandling of resjunk columns in ON CONFLICT ... UPDATE tlists.
• [8390] Fix NPE Handling for indexed_table_id
• [8392] [YSQL] Use negative cache elements to avoid read catalog entries from master
• [8473] [YBase] Log the requested memory size in the assertion for allocation failure
• [8485] Convert OperationCompletionCallback into std::function
• [8485] Simplify MVCCManager to allow aborting only last operation
• [8485] Unify ConsensusRound callbacks
• [8496] Downgrade gperftools to 2.7
• [8512] [YCQL] Added CQL metric for USE statement and tests for Prepared INSERT.
• [8519] [YSQL] Optimize FK check
• [8575] [YSQL] Optimize row locking in case of using IN operator for single range key column
• [8584] [DocDB] fixed RocksDB manual compaction abort on shutdown
• [8591] [DocDB] Add protection against missing UserFrontiers in older SST files during intents cleanup
• [8619] Log index table name instead of index id (#8693)
• [8666] [DocDB] Fix tserver response to SplitTablet RPC in case tablet is not in ready state
• [8672] [YSQL] Check status of YBCPgResetOperationsBuffering function
• [8691] Remove dump-statistics related code from db_impl.cc;
• [8696] Fix potential deadlock in WaitLoaded and WaitAllLoaded
• [8709] fix yb-ctl start_node to wait for tserver startup instead… (#8711)
• [8712] Reduce space consumed by HdrHistogram metrics for per-table metrics
• [8723] Simplify RemoteMethodsCache code
• [8749] [YSQL] Import Don't leak rd_statlist when a relcache entry is dropped.
• [8757] xCluster Replication: Make setting up replication synchronous
• [8783] [YSQL] Import Fix CREATE INDEX CONCURRENTLY for simultaneous prepared transactions.
• [8784] Set session timeout in PgTxnManager
• [8805] [YSQL] Import Fix incautious handling of possibly-miscoded strings in client code.
• [8806] [YBase] Add global client gflag to specify number of tablets for a table
• [8817] Add mechanism to report number of rows backfilled to master
• [8867] [YBase] Add endpoint for LB pretty display
• [8871] [YBase] Pass timeout to the Session object in FlushIndexBatchIfRequired()
• [8872] Merge Operation and OperationState
• [8873] [YSQL] Import Work around portability issue with newer versions of mktime().
• [8878] [YBase] Reduce scope of lock in CatalogManager::DumpState()
• [8905] Replace gscoped_ptr with std::unique_ptr
• [8962] [YSQL] Import Fix plancache refcount leak after error in ExecuteQuery.
• [8986] [YSQL] Import Fix misbehavior of DROP OWNED BY with duplicate polroles entries.
• [9007] [5380] Allow using clangd-indexer to fully index C/C++ code
• [9041] [YSQL] Import Fix minor violations of FunctionCallInvoke usage protocol.
• [9056] Remove extension operations from migration code.
• [9063] Support metrics filtering for /prometheus-metrics endpoint
• [9101] [YSQL] Import backpatch "jit: Add support for LLVM 12."
• [9128] [DocDB] Converted MetaCache::DoLookupAllTablets excessive INFO logs to VLOGs
• [9146] [YSQL] add "/HASH" to "ASC/DESC" errmsg
• [9154] [2519] [1973] Initial changes for supporting the aarch64 architecture
• [9185] Use atomic write for created table and its tablets
• [9208] [YSQL] Change function call information to be fixed length
• [9265] [YBase] Return error if tablet is not removed by RemoveRunningTablet
• [adhoc] [DocDB] Remove unused argument from Tablet::NewRowIterator
• [DocDB] Add Clang thread safety annotations to catalog_entity_info (#8186)
• [SMARTDRIVER] [YSQL] Function to fetch database servers #7879
• [YBase] Use SharedLock in GetNumRelevantReplicas
• [YSQL] Import Fix incorrect return value in pg_size_pretty(bigint)
• [YSQL] Import Reduce the cost of planning deeply-nested views.
• [YSQL] Import Relax transactional restrictions on ALTER TYPE ... ADD VALUE (redux).
• [YSQL] improve ALTER TABLE [NOT] OF errmsg
• [YSQL] improve ALTER TABLE [RE]SET errmsg

Point-in-time recovery

• [8417] PITR: Implement delete_snapshot_schedule
• [8418] Add filter to list_snapshot_schedules
• [8419] Consistent restore failover
• [8419] Consistent restore for non transactional writes
• [8419] Consistent restore for transactional writes
• [8543] PITR: Add test for need to increase table version on restore
• [8773] PITR: Add DDL log
• [8855] Logging improvements for backup restore issue.
• [8892] backups: Add timing summary to end of yb_backup
• [8894] backups: Allow disabling of checksums in yb_backup
• [9046] PITR: Fix crash when using multiple masters
• [9157] [DocDB] PITR: Fix operations filters data race
• [9171] PITR: Fix restoring snapshot to time before history cutoff
• [backup] Added a check for 'num_tablets' in CatalogManager::ImportSnapshot.

Bug fixes

Yugabyte Platform

• [6645] [Platform] AZ rendering issue when API throws bad request in case of same instance type. (#8367)
• [7594] [Platform] Assign universe UUID instead of backup UUID to target UUID while creating delete backup task. (#8529)
• [7859] Fix '< 1 min' uptime shown intermittently
• [7877] [8460] [8514] [Platform] More raw json usage cleanup
• [8029] [Platform] Fix slow queries failing to fetch on client-to-node TLS encrypted universes
• [8322] [Platform] No HA config exists is now logged as INFO
• [8345] [Platform] Remove hard coded cert filepath
• [8399] [Platform] Fix read replica cluster addition failure
• [8400] [Platform] when universe is in pending state (inprogress) upgrade on the card should also be disabled
• [8426] [Platform] Alert spam for message "Clock Skew Alert Resolved"
• [8426] [Platform] Alert spam for message "Clock Skew Alert Resolved"
• [8426] [Platform] Alert spam for message "Clock Skew Alert Resolved"
• [8460] [Platform] Add proxy request timeout
• [8461] [Platform] Added fix for redirecting user to intended url. (#8520)
• [8462] [Platform] Added preflight check to check if there is adequate disk space before installation
• [8481] [Platform] Added check to disable backups if it is in progress. (#8482)
• [8487] [Platform] Update index sql version number to prevent conflicts
• [8503] [Platform] Fix Add instance modal form to allow for adding instances in isolated region case.
• [8525] [Platform] Audit migration failed on AWS portal
• [8539] [Platform] [UI] remove toast about auth token expiration
• [8540] [Platform] Fix the allowed actions logic
• [8541] [Platform] Returns bad request as a response when trying to create a provider with an existing name
• [8697] [Platform] Fix client certs not being included when adding custom CA cert.
• [8725] Add uid to GetLoggedInUser error message
• [8739] [Platform] Cleanup raw Json from CloudProviderController
• [8739] Cleanup CloudProviderController and Skip JsonBackrefs
• [8795] [Platform] Retain placeholder text while editing the CA certificate fields. (#9051)
• [8814] [Platform] Email alerts incorrectly label Nodes as Clusters.
• [8830] [Platform] Get rid of raw json in AlertReceiver
• [8836] [Platform] [UI] Do not reverse the logs
• [8841] [Platform] Fetch KMS configs when user has enabled encryption at rest
• [8855] [Platform] Restore backup - Selected S3 Default but BackupParams point to NFS
• [8858] [Platform] fix playbook for python 3.7 + multiline config value
• [8875] [Platform] On failure task runner updates task_info.details.errorString
• [8958] [Platform] Fix incorrect sample app command.
• [9080] [Platform] Fix certificate value being used for client to server conns
• [9109] Deduplicate hostnames in PickResolvedAddress
• [9113] [9114] [Platform] Populate the task id field in the backup table
• [9162] Fix stack overflow in filtering iterator
• [9165] [Platform] Minor fixes to edit universe script
• [9190] [Platform] - Create Backup Failing on 2.7 portal
• [9198] [Platform] Alerts: Repeat notifications after previous failures + code cleanup
• [9205] Fix health check parse failing on universe overview.
• [9209] [Platform] Fix downloadNodeLogs and add Unit tests for universe
• [9209] [Platform] Use current http execution context to do work so that we can use response object.
• [9260] [Platform] Fix Health Check UI not rendering
• [9263] [Platform] Node status shows as Unreachable, after restarting a node process
• [9292] [Platform] Fix preflight check for backup configurations
• [9334] [Platform] Fix provider creation in yugabundle by using correct version of python
• [Platform] [CLOUDGA-422] fix formatting
• [Platform] [UI] Fixed connect button for K8s-based universes. (#8404)
• [Platform] Capture all failed ansible logs in stdout instead of just the first

Core database

• [8719] [8594] [DocDB] Don't send TabletPathInfo for non data ready tablets
• [8721] [YSQL] Skip iteration of bucket when YugaByte is enabled
• [8722] [YSQL] Remove autogenerated files as a part of orafce source tree
• [8726] Fix yb-admin change_config REMOVE_SERVER on stepdown
• [8748] Every executable should link tcmalloc directly
• [8766] [DocDB] recreate table with the same name could cause insert to fail
• [8774] [8780] Fix DeleteTable interaction with backfill
• [8799] [DocDB] Fix core dump when applying split operation for subtablet with existing tablet-meta directory
• [8827] [DocDB] Remove deadlock from SetIsBackfiling/IsBackfilling
• [8835] [YSQL] Disallow PRIMARY KEY on expression
• [8861] [DocDB] Do not remove flush tasks on shutdown if disable_flush_on_shutdown is not set
• [8891] [DocDB] Do not remote bootstrap newly split tablets to raft peers who have accepted split op in parent tablet
• [8915] YSQL Fix initdb in ASAN
• [8919] [DocDB] Fixed DBImpl::BackgroundFlush
• [8987] [DocDB] fixed YQLPartitionsVTable::RetrieveData TSAN issue
• [8990] Extract service class and fix some raw json and annotations
• [8998] [DocDB] Fixed TabletPeer::Shutdown to shutdown strand_
• [9005] [YSQL] Verify pid corresponds to postgres process before killing leftover postgres processes
• [9016] [YSQL] Avoid timestamp overflow in the ConcurrentPod::Load method
• [9056] Fix DB migrations
• [9072] [YSQL] Close ifstream when read operation is done
• [9076] [YSQL] Fixing a wrong child process exit code for initdb
• [9096] [DocDB] Tablet::GetRegularDbStat can mislead to unexpected return type
• [9108] Tablespace task in YB-Master should skip system_postgres namespace
• [9116] [DocDB] Wait for non-abortable operations to complete before starting RocksDB shutdown
• [9118] [YCQL] Fixing ALTER TABLE which resets table properties like is_transactional_.
• [9141] [DocDB] fixed Strand shutdown
• [9166] Fix concurrency issues with applying large transactions
• [9176] [YSQL] Fix the column filter for index only scan
• [9179] Fix state check in RetryingTSRpcTask::Run
• [9182] Fix return from CatalogManager::ProcessTabletReport
• [9202] [DocDB] fixed rocksdb DB::DeleteFile vs compaction race
• [9215] Fix repeatable DDL migration
• [9231] [DocDB] fixed TabletPeer::CanBeDeleted TSAN issue
• [9257] [DocDB] replaced unsafe MiniCluster::leader_mini_master() with MiniCluster::GetLeaderMiniMaster returning Result
• [adhoc] [YBase] Fix behavior of BackgroundTask configured with interval wake.
• [YSQL] add newline b/w errmsg and YBCGetStackTrace

v2.7.1.1 - May 25, 2021

Build: 2.7.1.1-b1

Downloads

Docker

docker pull yugabytedb/yugabyte:2.7.1.1-b1

New Features

Yugabyte Platform

Core Database

N/A

Improvements

Yugabyte Platform

• [5041] Added a health check for total memory(RAM) usage.
• [6555] Similar to scheduled backups, added an ability to provide retention duration for manual backups as well.
• [6913] For slow query monitoring, added an ability to reset stats with the new ‘Reset Stats’ button.
• [6913] [6914] Add ability to reset slow query data and hide slow queries.
• [6914] Added an ability to turn on query monitoring for slow queries. By default, query monitoring is turned off.
• [7215] Added an ability to select multiple backups for deletion rather than deleting individual backups.
• [7223] [7224] Added a new “Show Universes” action in the Actions menu. This provides a way for users to see all the associated universes that are using a particular KMS config. We are now also showing the list of universes as a modal dialog box associated with the certificate.
• [7278] [7446] Improved search usability for Live and Slow queries by adding autocomplete suggestions, better filtering and navigation.
• [7726] Health check now runs in parallel on all the universes rather than sequential.
• [7799] Added support for AWS GP3 volumes during universe creation from the Platform. The disk size and IOPS configuration for GP3 drives are configurable, whereas throughput is not configurable and is set to default value of 125MiB/sec.
• [7913] When upgrading a universe with read replica clusters, nodes in primary clusters are now always upgraded first, then read replica cluster nodes.
• [7967] Added ‘Download logs’ action under Nodes tab.
• [7970] Added a new ‘Backup Type’ label to distinguish YSQL and YCQL scheduled backups. For Yedis back type this field will be an empty string.
• [8038] Default metrics button now points to the Prometheus metrics endpoint.
• [8081] Added support for searching certificates by universe name in the Encryption-at-Rest. If there are more than 10 certificates, the user has to use pagination to search one page at a time to find the right certificate.

Core Database

Point-in-time recovery progress

• [7126] Add restore_snapshot_schedule to admin
• [7126] Add yb-admin commands to create and list snapshot schedules
• [7126] PITR: Cleanup not restored tables and tablets
• [7126] PITR: Cleanup outdated snapshots
• [7126] PITR: Correct history retention for newly added tablets
• [7126] PITR: Load snapshot schedules during bootstrap
• [7126] PITR: Restore deleted table
• [7126] PITR: Special history retention mechanism
• [7126] PITR: Take system catalog snapshot
• [7126] [7135] PITR: Restore table schema
• [7137] PITR: Provide ability to create snapshot schedule for YSQL database and YCQL keyspace

TLS-related

• [6845] [YSQL] Introduce the 'use_node_hostname_for_local_tserver' gflag to use DNS name instead of IP for local tserver connection
• [7756] Make Encryption at Rest Code Openssl 1.1.1 Compatible
• [8052] Add ability to configure cipher list and cipher suites.

UI improvements

• [docdb] Added a max_depth param to the mem-trackers view (#7903)
• [7620] Refactor scoped leader shared lock instantiation
• [7199] track and display heartbeat roundtrip time from each yb-tserver in yb-master UI (#7239)
• [7543] docdb: Add uptime into master home UI
• [7484] docdb - Sort the hosts of tablet replicas consistently in Admin UI
• [7617] docdb: Record and display disk usage by drive
• [7647] docdb: Adds Num SST Files to TS tablets view

Performance improvements

• [7487] docdb - Remove unnecessary Value decoding and TTL calculation in doc_reader.cc
• [7661] docdb - Run manually triggered compactions concurrently
• [7798] DocDB: Only the YB-Master Leader should refresh the tablespace info in memory
• [7844] Set tcmalloc max cache bytes for yb-master similar to the yb-tserver.
• [7873] docdb - Initialize block cache for master/sys_catalog
• [7894] Don't create long operation tracker for empty ScopedRWOperation
• [8002] docdb: Increase thresholds for master long lock warnings
• [8015] Remove tablets belonging to the same table by taking table lock once
• [8037] docdb - Refactor memory management for tablets into a separate class
• [8071] Lookup HostPort in blacklist for TSManager::IsTsBlacklisted
• [8061] Iterate over copy of namespace_ids_map_ when listing namespaces
• [8133] remove CatalogManager::CheckOnline()
• [8167] Properly scope namespace read lock in CatalogManager::CreateTable()
• [8170] ybase: Check dirty bit of tablet metadata before issuing removal
• [8260] ybase: Use shared lock when checking table truncation / deletion

Tablet splitting

• [5854] docdb: Handling tablet splitting errors at YBSession level
• [6719] docdb: Added YBOperation table_partition_list_version checking
• [7108] [docdb] Disable tablet splitting during index backfill
• [8201] docdb: YBSession API cleanup

Load balancer and placement improvements

• [1479] ybase: Allow normal load balancing for DEAD+BLACKLISTED TS
• [3040] ybase: Allow global leader load balancing
• [6631] ybase: Allow support for prefixes while specifying placement info
• [6947] ybase: Allow leader balancing for DEAD nodes
• [7369] ysql: Respect leader affinity on master sys catalog tablet

T-server memory overhead

• [7804] docdb: Make WritableFileWriter buffer gflag controllable
• [7805] Share Histograms across tablets belonging to a table instead of having Histograms (in TabletMetrics and other objects) separately for each tablet.
• [8073] Drop rocksdb memstore arena from 128kb to 64kb

YCQL deferred index backfill

• [8069] YCQL: Basic support for deferred/batched index backfill
• [6290] [8069] Pt 2 & 3: CQL Handle partial-failures in a batch of index backfills.
• [8069] Add a yb-admin command to backfill tables with deferred indexes

Other core database improvements

• [1248] ysql: Create background task for verifying tablet data integrity
• [3460] YSQL: Integrate Orafce extension with Yugabyte
• [4580] add metric for wal files size (#7260)
• [4934] [7922] Thread safety improvements in the Transaction class
• [6636] docdb: Cache table->tablespace->placement information in YB-Master
• [6672] docdb: added explicit initialization of libbacktrace into InitYB.
• [7068] Allow reloading of the config file with 'ts-cli'
• [7324] YSQL: Early bailout when bind condition is an empty search array
• [7557] YCQL: Support != operator
• [7564] ybase: Auto tune ysql_num_shards_per_tserver similar to yb_num_shards_per_tserver
• [7632] ycql: Support upsert for jsonb column field values
• [7724] ysql: add YSQL parameter yb_index_state_flags_update_delay
• [7916] CQL call timeout
• [7937] YSQL: Avoid unnecessary secondary index writes for UPDATE on table with
• [7977] [docdb] Send per tablet disk usage to the master via heartbeats
• [8026] Bump up timestamp_history_retention_interval_sec to 900s
• [8027] A separate YSQL flag for yb_client_timeout

Bug Fixes

Yugabyte Platform

• [5246] Fixed cluster_health to examine only local volumes and exclude nfs from consideration so that false alerts are not generated.
• [5733] Disabled "stop process" and "remove node" for a single node universe
• [5946] Clock sync is now checked while creating or expanding the universe. Clock sync is added to health checks now.
• [6019] Added an init container to yugabyte helm charts to wait for container to be ready
• [6924] When a node is removed/released from a universe, hide the "Show Live Queries" button.
• [7007] Fixed an issue where Restore backup dialog allowed empty/no universe name selected.
• [7171] Added a validation that on-prem instance type name cannot be same for different customers on the same platform.
• [7172] Added visual feedback for certain universe creation failures such as pre-flight validation failures or bad request response from API, etc.
• [7193] Fixed issues with Run sample apps to have the deterministic payload and unify behaviour of YCQL and YSQL app.
• [7311] Added appropriate warnings while using ephemeral storage for the cases like stopping a VM or pausing an universe as it will potentially lead to data loss.
• [7408] Retry Task button should not be visible for tasks other than "Create Universe" Task, as it’s the only task that supports retry.
• [7412] Make footer link buttons clickable
• [7415] Made secure the default configuration of SSH daemon by avoiding password authentication and PermitRootLogin in VMs
• [7416] Platform: Changed default port of On-Prem provider to 22 (#7599)
• [7421] Encryption is enabled by default for both client to node and node to node cases.
• [7432] In the case of the AWS provider, fixing an issue of ssh key name and private key were getting ignored.
• [7437] Since Kubernetes currently doesn't support read replicas, disabled it from the UI; k8s providers are also not shown when configuring a read-replica.
• [7441] Added field-level validation for User Tags to disallow "Name" as a key for a tag
• [7442] Only include the queries run by the user under slow queries
• [7444] Fixed an issue in Edit Universe, as user was able to edit User Tags but not save them
• [7447] When universe creation is in progress, other operations which require the Universe in "ready" state should be disabled like "Edit universe", "Read replicas", "Run sample apps", etc.
• [7536] You can now specify an SSH username even when not using a custom key-pair.
• [7554] Fixed an issue where error toaster appears even when the Provider is added successfully
• [7561] [7699] [7717] Fixed an issue in trying to force-delete a universe and you will be redirected to an error page on success.
• [7562] In case of Encryption at rest configuration fixed an error in configuring KMS provider.
• [7591] Added labeling for the Azure Instance Type dropdown similar to GCP/AWS.
• [7624] Removed refetch on window focus for slow queries
• [7656] After manually provisioning an on-premises node, create universe tries to use "centos" user, not "yugabyte"
• [7659] Non-replicated flow fails due to package requiring python3
• [7672] Cannot read property 'data' of undefined on Tasks -> Retry Task
• [7687] YSQL health check fails when YSQL auth is enabled
• [7698] Custom SMTP Configuration API returns unmasked SMTP password
• [7703] Can't send email for custom SMTP settings without authentication (empty username)
• [7704] Backup to S3 fails using Yugaware instance's IAM role
• [7727] [7728] Fix UI issues with k8s provider creation and deletion
• [7736] Change the username help info for certificate based authentication
• [7740] Prometheus going down silently after YW upgrade thru replicated
• [7769] Prevent adding on-prem node instance with duplicate IP
• [7779] Health check fails on k8s portal for all the universes on clock synchronization with FailedClock synchronization and Error getting NTP state
• [7780] Fixed an issue causing old backups to not get deleted by a schedule.
• [7810] Health check emails not working with default SMTP configuration
• [7811] Slow queries is not displaying all queries on k8s universe pods
• [7908] Added a fix caused while deleting a universe with a stopped node
• [7909] Fix issue with signature could not be verified for google-cloud-sdk for GCP VMs
• [7950] Navigating to a universe with KMS enabled will show this error due if something has been misconfigured
• [7959] Disabling Node-to-Node TLS during universe creation causes universe creation to fail
• [7988] Backup deletion failure should not cause retries
• [8020] To handle auth token expiration, added a global interceptor to catch all 403-code responses and redirect to the login page with a session expiration message in error toast. So when auth token expires background API calls won't fail silently anymore.
• [8051] Redact sensitive data and secrets from audit logs
• [8176] Fixed an issue of setting the max number of processes properly when deploying universes in GCP
• [8189] Make sure AWS instances with no EBS volume do not pass "Scratch" as default value
• [8243] Make Persistent storage default for GCP universe

Core Database

• [2977] docdb: CountIntents() should use shared tablet pointer
• [4250] ybase: Stop Load balancing for deleting/deleted tables
• [4412] docdb: Fix LB State for Move Operations
• [5380] Add re-try in postgres build when encountering transient error.
• [6096] ysql: Fix crash during bootstrap when replaying WAL of deleted colocated table
• [6615] [7693] [YCQL] Manifest generation for YCQL command for sample apps. kubectl command and docker command to run sample apps will be created automatically.
• [6672] docdb: fix for deadlock in GlobalBacktraceState constructor
• [6789] YSQL: Fix ysql_dumpall and ysql_dump to work with Tablespaces
• [6821] [7069] [7344] (YCQL) Fix issues when selecting optimal scan path
• [6951] [YSQL] Fix missed check of YBStatus
• [6972] Update local limit in case of a successful read
• [6982] [YSQL] Specify read time for catalog tables to guarantee consistent state of catalog cache
• [7047] [YSQL] Read minimal possible number of columns in case of index scan
• [7355] ysql: check backfill bad connection status
• [7390] Preflight checks should handle sudo passwords when given
• [7390] Rename V65 migration with R prefix
• [7398] docdb - Crashing after CopyTo from parent to child causes child bootstrap failure
• [7398] docdb - Forcing remote bootstrap to replay split operation causes seg fault
• [7455] [YCQL] Update index from transaction with cross-key statements.
• [7499] ysql: Import pg_dump: label INDEX ATTACH ArchiveEntries with an owner.
• [7534] YSQL: Support ALTER TABLE ADD PRIMARY KEY for colocated tables
• [7547] Set flags automatically based on the node's available resources
• [7600] [YSQL] Explain --masters in ysql_dump cli.
• [7602] docdb: FlushTablets rpc causes SEGV of the tserver process
• [7603] rocksdb: Calling memset on atomic variable generates warning (#7604)
• [7628] Add ldap libraries as special case for yb client packaging
• [7641] YCQL: Fix checks in index update path that determine full row removal.
• [7649] YCQL: Block secondary index creation on static columns.
• [7651] YSQL: Always listen on UNIX domain socket
• [7678] ysql: Import Fix race condition in psql \e's detection of file modification.
• [7682] ysql: Import Forbid marking an identity column as nullable.
• [7702] ysql: Import Avoid corner-case memory leak in SSL parameter processing.
• [7705] ysql: prioritize internal HBA config
• [7715] YSQL: Prevent DocPgsqlScanSpec and DocQLScanSpec from accepting rvalue reference to hash and range components
• [7729] Avoid recreating aborted transaction
• [7729] Fix checking ABORTED txn status at follower
• [7741] ysql: Import Don't leak malloc'd strings when a GUC setting is rejected.
• [7748] YSQL: ALTER ADD PK should do column checks
• [7791] ysql: Import Fix psql's \connect command some more.
• [7802] ysql: Import Fix connection string handling in psql's \connect command.
• [7806] ysql: Import Fix recently-introduced breakage in psql's \connect command.
• [7812] ysql: Import Fix connection string handling in src/bin/scripts/ programs.
• [7813] [YSQL] YSQL dump should always include HASH/ASC/DESC modifier for indexes/pkey.
• [7835] Don't crash when trying to append ValueType::kTombstone to a key
• [7848] Fix for yb-prof for python3
• [7872] Remove flashcache-related code
• [7894] Keep ScopedRWOperation while applying intents for large transaction
• [7939] Enforce password policy
• [7940] docdb: Unregister BlockBasedTable memtrackers from parent on tablet deletion
• [7944] ysql: deprecate flag ysql_wait_until_index_permissions_timeout_ms
• [7979] ysql Import Fix handling of -d "connection string" in pg_dump/pg_restore.
• [8065] docdb: Fix Sys Catalog Leader Affinity with Full Move
• [8006] ysql: Import Fix out-of-bound memory access for interval -> char conversion
• [8024] YSQL: Redundant read for create table with primary key
• [8030] ysql: Import Redesign the caching done by get_cached_rowtype().
• [8047] ysql: Import Fix some inappropriately-disallowed uses of ALTER ROLE/DATABASE SET.
• [8079] Ensure leadership before handling catalog version
• [8101] YCQL: Fixed CQLServiceImpl::Shutdown
• [8102] Traverse pgsql_ops_ once in PgDocOp::ProcessResponseResult()
• [8112] Correct string substitution in UpdateTablet()
• [8114] [YSQL] [backup] Partial index syntax error in the ysql_dump output
• [8118] ysql: Import 'Fix memory leak when rejecting bogus DH parameters.'
• [8119] ycql: Properly compare BigDecimals for equality
• [8150] [8196] Fix preceding op id in case of empty ops sent to the follower
• [8183] ysql: Import Always call ExecShutdownNode() if appropriate.
• [8225] YQL: Add missing makefile dependency
• [8496] Downgrade gperftools to 2.7

Known Issues

Yugabyte Platform

N/A

Core Database

N/A

v2.7.0 - May 5, 2021

Yugabyte release 2.7.0 builds on our work in the 2.5 series, which fed into the 2.4 stable release. With release 2.7.0, we're planning development on a number of new features, as well as refinements to existing functionality.

Build: 2.7.0.0-b17

Downloads

Docker

docker pull yugabytedb/yugabyte:2.7.0.0-b17

New Features

Yugabyte Platform

• Yugabyte Platform High Availability is now available in BETA. With this feature, you can deploy multiple platforms in an active-standby cluster, ensuring you can always monitor and manage your platform-managed universes regardless of outages to any particular platform in the HA cluster.
• [7225] [7228] [UI] Enable the OpenShift tab, marked as beta

Core Database

• [2717] YSQL: Support ALTER FUNCTION command
• [6985] YSQL: Add simple UNIQUE column
• Point in time restore:
  • [7121] Extend yb-admin restore_snapshot to use a custom time
  • [7126] PITR: Introduce snapshot schedule

Improvements

Yugabyte Platform

• [5535] [Platform] Remove stale instance configs after cloud provider is deleted (#6975)
• [5624] Show pricing info for Azure
• [5626] Enable Hosted Zone for Azure
• [5628] [Azure] Support regions with no availability zones
• [5807] Add toggle to show deleted backups
• [5838] [Platform] Add node link to corresponding Azure portal URL
• [5840] Add user tags for Azure universes
• [5841] Show only Azure VMs that meet minimum requirements
• [6321] [Platform] Support using Shared Gallery Images when creating Azure universes
• [6681] [Platform] Show kubectl command for Kubernetes pods in Connect modal (#7506)
• [6712] Fix issue with JDK incompatibility in Java RPC client
• [6756] [Platform] Created date showing up as "Invalid Date". (#7158)
• [7024] [Platform] Unable to edit number of nodes in AZ section (#7350)
• [7054] [YW] Add conditional checks for hiding specific platform elements in non-platform mode.
• [7372] [Platform] Skip running periodic schedules when in follower mode
• [7433] [Platform] Standby instances backup time not consistent after restoring active instance
• [7443] [Platform] Fixed live query details side panel doesn’t go away after unchecked
• [7445] [Platform] Add pagination for slow queries
• [7472] [Platform] Hide the Upgrade button from info card on Pause universe. (#7504)
• [7475] Use more recent CentOS-7 base image for GCP universe VMs
• [7493] [Platform] Menu shows 0 appended to "Upgrade Software0" - Removed 0
• [7548] [Platform] Set versions for google modules in requirements.txt
• [7549] [Platform] Platform uses public IP instead of private IP to connect to Azure universes
• [7576] Ensure rsync is available on latest GCP image
• [Platform] Use more recent CentOS-7 base image for GCP universe VMs #7475
• [Platform] parsing of df output is fragile and may fail in case of "safe" error in df #7402

Core Database

• [4944] YSQL performance improvements in TTL-related computations
• [5922] YCQL: Improve audit logging
• [7359] YSQL: Support adding primary key to a table with tablespace
• [7366] YSQL: Allow getting current SQL query in pggate for debug logging
• [7404] YSQL: Extend CHECKPOINT to have beta noop functionality
• [7418] [7463] YSQL: Import the 'force' option for the Drop Database command
• [7532] Master performance improvements: reduce the scope of catalog manager state lock in ScopedLeaderSharedLock constructor

Bug Fixes

Core Database

• [5383] YSQL bug fixes for Jepsen

Known Issues

Yugabyte Platform

N/A

Core Database

N/A

Notes

{{< note title="New release versioning" >}}

Starting with v2.2, Yugabyte release versions follow a new release versioning convention. The preview release series, denoted by MAJOR.ODD, incrementally introduces new features and changes and is intended for development and testing only. Revision releases, denoted by MAJOR.ODD.REVISION versioning, can include new features and changes that might break backwards compatibility.

{{< /note >}}