What's new in the v2.11 release series
Included here are the release notes for all releases in the v2.11 release series. Content will be added as new notable features and changes are available in the patch releases of the v2.11 release series.
For an RSS feed of all release series, point your feed reader to the RSS feed for releases.
v2.11.2.0 - January 26, 2022
Build: 2.11.2.0-b89
Downloads
Docker
docker pull yugabytedb/yugabyte:2.11.2.0-b89
New Features
Yugabyte Platform
- [PLAT-1885] Hashicorp Vault Integration
- [PLAT-2341] UI support for Multiple on-prem provider instances
- [PLAT-2362] Maintenance windows API and backend
- [PLAT-2382] New backups API
- [PLAT-2401] [PLAT-2404] New GFlag form component and validation for user entries
- [PLAT-2402] UI form for user to add/edit gflags in more accurate way
- [PLAT-2403] Add Multiple G-flags from free text(json)
- [PLAT-2479] LDAP Integration with Platform
- [PLAT-2535] Add API endpoint for aborting tasks
- [PLAT-2553] Node Comparison Feature in Metrics Page (Backend)
- [PLAT-2562] UI support for abort task capability
- [PLAT-2658] Integrate t3 instance type support
- [PLAT-2750] YSQL_DUMP based backup-create and backup-restore
- [PLAT-2766] Can now delete paused GCP instances
Database
- [8032] [YSQL] Add support for ALTER TYPE .. RENAME TO
- [10451] [ysql] Add support for ADD CONSTRAINT .. UNIQUE .. USING INDEX
- [10509] [10510] [YSQL] Add support for CREATE, DROP, and REFRESH MATERIALIZED VIEW
Improvements
Yugabyte Platform
- [PLAT-501] [PLAT-1850] Add Custom CA cert start and expiry in backend and add extra validations for custom certs
- [PLAT-580] Add API to sync platform XClusterConfig state with universe
- [PLAT-2058] Add Custom Port UI Validation
- [PLAT-2066] Read write alert
- [PLAT-2131] Addition of Default GFlags while GFlags updating
- [PLAT-2152] Task Improvement - changes in task framework to wait for previous subtask, ability to send abort signal to a task
- [PLAT-2236] Add leader blacklisting to kubernetesUpgradeTaskBase
- [PLAT-2296] Timezone Selector on user profile (UI)
- [PLAT-2324] Universe with RF=3 and 3 nodes could be updated to have 2 nodes only
- [PLAT-2362] Active alert notification period
- [PLAT-2435] Task Improvement - Make CreateUniverse retryable.
- [PLAT-2460] Task Improvement - Make EditUniverse retryable
- [PLAT-2461] [UI] Enhance KMS Config listing UI
- [PLAT-2467] [UI] XCluster UI Changes
- [PLAT-2480] Change in request payload and response format for G-Flag validation API
- [PLAT-2500] [UI] Add support to edit KMS configs
- [PLAT-2501] [Alerts-UI] Rename the "Edit" button to "Save" in Edit Notification Channels
- [PLAT-2572] Task Improvement - Move/Include retryable and abortable in CustomerTask API response payload
- [PLAT-2577] UI - Edit KMS, handling values that user want to empty and masked values.
- [PLAT-2613] Adding a runtime config flag to retain shellprocess cmdOutputLogs.
- [PLAT-2641] Task Improvement - CreateUniverse retry for onprem nodes does not work due to precheck failure
- [PLAT-2690] Run upgrade_ysql during universe upgrade
- [PLAT-2719] Allow path style access for non-standard endpoints in S3 backup configs
- [PLAT-2784] Add support for dev db-versions while listing gflags
- [PLAT-2821] Change default instance type to c5.4xlarge in universe creation
- [Platform] GFlags validation Improvements
Database
- [5755] [DocDB] Transaction cleanup improvements
- [7977] [DocDB] Load balance leaders across disks
- [8730] [dst] Enable compaction and flush of sys catalog tablet from admin CLI.
- [8978] [docdb] Generate system.partitions vtable proactively instead of via a background task
- [9468] [YSQL] Perform indefinite retries on kReadRestart for each statement in READ COMMITTED isolation (Part-2)
- [9956] [ysql] support ybgin index in hstore extension
- [10076] [docdb] [DST] Enhance rocksdb UI page with info about OPTIONS
- [10159] [ysql] Tablegroup placement
- [10168] [ysql] support tablegroup dumps
- [10217] [10791] [docdb] Bootstrap from tablet with leader in same AZ, remove skip leader code.
- [10456] [ysql] Import Fix detaching partitions with cloned row triggers
- [10479] [docdb] Multi-RAFT V0 - Batch Heartbeat Requests (Bypass Heartbeats)
- [10510] [YSQL] Improve performance of concurrent refreshes for matviews
- [10527] [ycql] Upgrade Cassandra driver to 4.6.0-yb-10
- [10548] [Spark Connector] Upgrade to Spark Connector 3.0-yb-10
- [10571] A separate flag to check for large clock skew on hybrid clock reads
- [10584] [DocDB] Add support for precompiled headers
- [10584] [DocDB] Generate protobuf forward headers
- [10584] [DocDB] Split complex proto files into smaller parts
- [10584] [DocDB] Split master service into multiple services
- [10643] [10642] Create tool to modify hybrid time in SST and WAL files
- [10668] [ysql] Import Adjust pg_dump's priority ordering for casts.
- [10717] [YSQL] Reduce execution time of OpenTable by table_id
- [10748] [ysql] Import Warning on SET of nonexisting setting with a prefix reserved by an extension
- [10775] [ysql] Import Avoid leaking memory during large-scale REASSIGN OWNED BY operations.
- [10857] [DocDB] Lightweight protobuf generation
- [10862] [ysql] Tab Completion for Tablegroups
- [10883] [YSQL] Rename the GUC for disabling transactional writes
- [10920] Support build with Clang 12 and Linuxbrew
Bug Fixes
Yugabyte Platform
- [PLAT-32] provision_instance.py should not have any version specific dir paths (#5538)
- [PLAT-580] Fix sync api bug with previously-existing xcluster configs
- [PLAT-1955] Preflight checks also take into account free space
- [PLAT-2007] Do not enable leader blacklisting for RF1 clusters
- [PLAT-2055] [UI] Fix UI on clicking Retry Task button
- [PLAT-2080] Set Universe keys before starting tserver on encryption at rest enabled universes.
- [PLAT-2099] Fix abort Multi-namespace backup task
- [PLAT-2241] Replace non-unicode symbols in a tool output decode
- [PLAT-2252] fixing Oracle8 ntpd health check
- [PLAT-2316] Fix local privilege escalation issue with collect_metrics script
- [PLAT-2331] Install s3cmd/gsutil on graviton
- [PLAT-2342] [UI] Make sure "Desired Home Directory" and Mount path are different for on-prem providers
- [PLAT-2420] ".local" as a TLD in AWS host base
- [PLAT-2424] [UI] Encryption At Rest setting is not persistent while configuring Read replica
- [PLAT-2434] Disabling logging config customization
- [PLAT-2434] Fix omitted log configurations after application start
- [PLAT-2457] Fix overwriting of username and password for slow queries
- [PLAT-2478] Add synchronization to release APIs
- [PLAT-2481] Fix log filtering error
- [PLAT-2484] Set incrementVersion to false in unlockUniverseUpdate
- [PLAT-2497] Disable cert checking when using s3client for backups
- [PLAT-2498] Fix for Wrong timestamps in Health Check and Users Tab
- [PLAT-2514] Fix leaderless and underreplicated tablet alerts in case master quorum is missing
- [PLAT-2517] Fix typo (missing backslash) in the priority-regex for Prometheus in
replicated.yaml
- [PLAT-2521] Health checks failing for universe with read replica after full move
- [PLAT-2528] adding architecture suffix to node_exporter role
- [PLAT-2530] Use DB transaction to lock Universe and any DB changes in the callback during the locking
- [PLAT-2533] Fix build version health check for invalid build names
- [PLAT-2537] Fix alert count for read-only user Summary: Alert count endpoint is using POST request, which is not available by default for read-only user. Need to add it manually to the exclusion list.
- [PLAT-2541] CreateUniverse retry - ServerSetup state match missing
- [PLAT-2568]
universe_configure
doesn't return a good/detailed message in case of errors - [PLAT-2569] ignoring squashfs in disk utilization health check
- [PLAT-2570] Add run_node_action.py and node_client_utils.py scripts to platform release
- [PLAT-2579] Disable strict host checking for run_node_action.py
- [PLAT-2580] When decrypt universe key is called, also attempt to renew token and update KMSConfig.
- [PLAT-2586] Fix logs download
- [PLAT-2587] Error during create universe for yugabundle
- [PLAT-2590] Some tasks create multiple SubTaskGroupQueue in the same run() method with the expectation to run only the subtasks added to the queue.
- [PLAT-2602] Fix various write read table creation issues
- [PLAT-2612] Health check not stopped for the Universe being edited
- [PLAT-2626] Fix backup deletion issue during destroy universe
- [PLAT-2634] Fix xcluster APIs for HA-enabled platform deployments
- [PLAT-2634] Log exception on cluster config version increment failure
- [PLAT-2658] [Hc-Vault] Validation for vault address field not working
- [PLAT-2672] Skip system_platform DB in 'All namespaces' YSQL backup
- [PLAT-2681] Hashicorp config - attempting to add a config fails when transit mount path specified does not have any keys
- [PLAT-2700] Fix OOM kills alert for cron universe + fix QueryAlerts execution
- [PLAT-2701] Instances getting added to incorrect provider in onprem multi-provider config
- [PLAT-2752] Increase running task beating time interval from 1sec to 10secs.
- [PLAT-2754] Add run_node_action.py to the bin section of yb_release_manifest.json
- [PLAT-2765] Redact GCP creds in provider creation audit log
- [PLAT-2791] RunYsqlUpgrade subtask should not be run on upgrades of universes with YSQL disabled
- [Platform] [10950] [Backups] Allow TS to have no tablets for the table
- [Platform] Reset pg_stat_statements after creating/updating db credentials
- [Platorm] [CLOUDGA-2711] wait for boot script completion + save vm console output if provisioning fails
- [Platorm] Wait for boot script completion + save vm console output if provisioning fails
Database
- [2266] [YSQL] Fix YSQL PG crypto function crash issue
- [6149] [10587] [YSQL] Partitioned table primary key is not correctly inherited by partitions
- [10096] [ycql] Error out when ignore_null_jsonb_attributes is misspelled
- [10482] [DST] Rate-limit Create/Delete Snapshot requests
- [10547] [YBASE] [DocDB] Avoid unnecessary GetTransactionStatus calls during reads #10547
- [10589] [YSQL] ysql_dump duplicates primary key for partition table
- [10602] [DocDB] Initialize new fs root dirs
- [10742] [Spark Connector] Accommodate extra backticks in Spark 3.2.0 Plan
- [10773] [YSQL] [Backups] Change YSQLDump during the backup restoring
- [10792] [ysql] Add YB operations to validate replication info
- [10845] [xCluster] Fix rename universe replication with multiple renames
- [10858] [YSQL] Disable sending DocDB requests with trivially false ANY filters
- [10868] [YSQL] Make ALTER ADD PK persist reloptions
- [10881] [DocDB] Fix "loop variable is always a copy because the range of type"
- [10907] [Backup] [platform] Prevent double config file uploading.
- [10943] [YSQL] Masking ldapbindpasswd in logs after authentication fails
- [10962] Use random_generator_mt19937 which is seeded via /dev/urandom
- [10963] Avoid float division by zero error
- [11008] [YSQL] Fix failures in concurrent refreshes for matviews
- [11054] [YCQL] Aggregate updates to JSONB column before inserting Subdoc
- [adhoc] [DST] Downgrade noisy log when there are no memtables to flush
Known Issues
Yugabyte Platform
N/A
Database
N/A
v2.11.1.0 - December 15, 2021
Build: 2.11.1.0-b305
Downloads
Docker
docker pull yugabytedb/yugabyte:2.11.1.0-b305
New Features
Yugabyte Platform
- [PLAT-526] [UI] UI support for xCluster replication management phase-1
- [PLAT-529] GFlags validation APIs
Database
- [6639] [YSQL] Add ALTER TABLE SET TABLESPACE
- [8242] [DST] Enable automatic tablet splitting by default
- [9468] [YSQL] [Part-1] READ COMMITTED isolation level
- [9984] Support arm64 build on macOS
- [10563] [xCluster] Create Rename Replication Command
- [10655] [YSQL] Add
--postmaster_cgroup
gflag to tserver - [10671] [yugabyted] use env var YB_DISABLE_CALLHOME
Improvements
Yugabyte Platform
- [8517] [6302] [5355] Auto populate provider dropdown, remove parenthesis around range partition and adjust DB version margin (#10229)
- [8517] Add handling for provider input in edit universe scenario
- [PLAT-506] Allow custom port in AWS host base
- [PLAT-1773] Auto refresh of metrics page with intervals dropdown
- [PLAT-1783] Add loading icon for universe list page
- [PLAT-1923] [PLAT-1924] Ability to create universes with AZs count > RF + definition of default region
- [PLAT-1931] Add Prometheus links to metrics panels
- [PLAT-1941] Add status quick filter and table actions
- [PLAT-1944] Allow customers to modify platform log rollover and retention settings
- [PLAT-1950] Collect additional metrics
- [PLAT-1957] Check ports availability in preflight check
- [PLAT-1993] [UI] Show backup config name in list of backups
- [PLAT-2004] Add leader blacklisting to UpgradeTaskBase
- [PLAT-2061] Add PagerDuty and WebHook channels
- [PLAT-2063] YSQL connections count, Leaderless tablets, Under-replicated tablets, Missing master leader alerts
- [PLAT-2064] DB Overload alerts
- [PLAT-2108] NFS backup with Encryption at rest enabled
- [PLAT-2143] [UI] Add an optional field AWS KMS Endpoint while creating KMS config
- [PLAT-2154] Add UI support for new log search API endpoint
- [PLAT-2173] Task Improvement - implement ways to save and read states changed by subtasks
- [PLAT-2195] Add support for multi-universe filter alert count endpoint
- [PLAT-2227] Added a runtime config setting for disabling all the cert validations
- [PLAT-2229] Retrieve YB version via ssh/kubectl during health check
- [PLAT-2237] Add leader blacklisting to stop node in universe
- [PLAT-2244] Update instance creation and listing to accept and return node UUID and Universe UUID.
- [PLAT-2261] Enhancements to /logs UI endpoint
- [PLAT-2303] Change Prometheus link icon in Metrics Page
- [PLAT-2306] Add UI support for GCP user tags
- [PLAT-2345] Show metrics for paused universes
- [PLAT-2348] Increase the configuration name max size to 100
- [PLAT-2361] Filter and sort alert configurations on various fields + return alert count in page API
- [PLAT-2467] [UI] XCluster UI Changes
- Update certs to use certLabel as CN
Database
- [1127] [YSQL] Improve collation upgrade performance.
- [1127] [YSQL] Use attribute collation for SPLIT AT clause
- [1979] Support PG11 text search configuration
- [5395] [docdb] Add metrics for master async tasks
- [7809] [YSQL] Add session flag to enable non-transactional writes on COPY
- [8597] [YSQL] Changing Catalog Version Mismatch in Postgres layer as retryable error
- [10158] [Geo] Selecting different txn status table based on local vs global requirements
- [10190] [YSQL] create and use the pg_yb_tablegroup table
- [10159] [Geo] Added global_transaction YSQL parameter
- [10352] [YSQL] Import Invalidate partitions of table being attached/detached
- [10358] [xCluster] [Tablet-splitting] Handle consumer side splits
- [10428] [DocDB] Improve logging for SST file expiration
- [10388] [YSQL] Import Fix pg_dump for disabled triggers on partitioned tables
- [10431] [YSQL] Import pg_dump: fix mis-dumping of non-global default privileges.
- [10433] [YSQL] Catalog cache refresh improvements
- [10435] [DocDB] Display split depth in the master Tables UI
- [10503] [DocDB] Add GFlag to trust value-level TTL metadata during file expiration.
- [10543] [YCQL] Allow NULL in filtering clauses WHERE/IF inside IN/NOT IN operators in SELECT statement.
- [10576] [YSQL] Import Reject extraneous data after SSL or GSS encryption handshake.
- [10579] [YSQL] Import libpq: reject extraneous data after SSL or GSS encryption handshake.
- [10586] [YSQL] Reduce number of reads from the pg_yb_catalog_version table on staring new connection
- [10604] [YCQL] Handle DeleteIndex while backfilling
- Update cassandra driver version to 3.10.3-yb-2 towards vulnerabilities fixes.
Bug Fixes
Yugabyte Platform
- [PLAT-1643] On-prem provider configuration, "Desired Home Directory" can't be equal to the first mount paths item
- [PLAT-1678] Multitable backup fails with NPE
- [PLAT-1702] [UI] Azure YW provider does not allow port customization
- [PLAT-1795]
/home/yugabyte
not getting cleared out with a custom home dir for onprem universe - [PLAT-1891] [Backup] [IAM-Platform] Backup is hanging for universe with read replicas on IAM-enabled platform
- [PLAT-1948] [UI] Delete release should call delete API, not update release API
- [PLAT-2088] Some primary cluster fields not inherited properly into add read replica page
- [PLAT-2098] fix: Certificate details page shows 'invalid date' for certificate start and expiration fields on Safari Browser only
- [PLAT-2099] Remove taskUUID from audit entry while aborting backup
- [PLAT-2101] fix: Save button doesn't throw field errors when all the fields are empty
- [PLAT-2102] Stop creation of KMS configs with duplicate name
- [PLAT-2103] [UI] [Encr at rest] AWS credentials enabled when IAM is checked in
- [PLAT-2109] Skip hostname validation in certificate
- [PLAT-2121] [UI] [KMS] UI displaying Successfully added even when it fails to add KMS config
- [PLAT-2133] Need to allow platform to repair a server that's stuck in a OOM state
- [PLAT-2148] Unable to change availability zone while configuring new universe
- [PLAT-2158] Getting rid of useHostnames
- [PLAT-2177] Avoid adding duplicate delete backup tasks to tasks queue
- [PLAT-2184] Fix a bug where new leader thinks of itself as remote instance
- [PLAT-2189] Fix universe creation on airgap install
- [PLAT-2214] fix: Cloud provider section overlapping with universe details
- [PLAT-2218] Removing and adding a single AZ to univ placement triggers a full move
- [PLAT-2241] Replace non-unicode symbols on traceback output decode
- [PLAT-2243] Fix chrony for airgap install (aws, gcp)
- [PLAT-2246] Fix Timezone UI Bugs
- [PLAT-2250] [Alerts] [UI] Alert Creation page is in loading state in brand new portal
- [PLAT-2251] Make health check run and store results to DB without health config
- [PLAT-2253] Skip delete release from local filesystem step in case of non-local release
- [PLAT-2257] Provision in AnsibleSetupServer cannot be retried if it fails in the middle because the default SSH port is no longer reachable.
- [PLAT-2259] [xcluster] [UI] Master Node Address unavailable on replication tab
- [PLAT-2265] Resolve missing list key and clean up YBMultiSelect styling.
- [PLAT-2269] Hide quick filter
- [PLAT-2270] Non-transactional backup with list of tables in YCQL fails
- [PLAT-2274] [UI] No way to remove region from provider
- [PLAT-2294] [UI] Disable toggle TLS / cert rotation dialogs in UI for k8s universes
- [PLAT-2298] Allow outOfOrder migrations and ignoreMissingMigrations
- [PLAT-2319] Remove sensitive data from platform log while during universe creation using s3 package
- [PLAT-2320] Fix Prometheus links to have correct timestamp
- [PLAT-2321] [PLAT-2314] Fix backup util behavior on error for onprem providers
- [PLAT-2323] Preparation subtask with error message should be added only if no other subtasks exist
- [PLAT-2325] Fix broken migration in older releases
- [PLAT-2326] Incorrect masters selection for GP universe
- [PLAT-2328] Reuse instance in cloud provider if it matches the universe ID and node ID tags.
- [PLAT-2344] Fix preflight checks
- [PLAT-2349] [UI] Blank screen when trying to add read replica to an universe
- [PLAT-2351] Disable upgrade to systemd for manually provisioned universes
- [PLAT-2373] Get rid of repeated migrations
- [PLAT-2376] Fixing resize node to utilize ssh_user param
- [PLAT-2400] Universe scaling out by adding nodes keeps new nodes in blacklisted state.
- [PLAT-2434] Fix omitted log configurations after application start
- [PLAT-2514] Fix leaderless and underreplicated tablet alerts in case master quorum is missing
- [PLAT-2348] Fix UT failure during change in max size of config name
- [T9574] [T8510] Force delete backup Configuration after deleting backups and schedule associated with it
Database
- [8660] [DocDB] Tablet splitting thresholds should be determined based on number of nodes in a table's placement policy
- [9665] [YSQL] ysql_dump should not need master addresses to be passed explicitly.
- [9929] [2809] [2742] [YSQL] Fix explicit row locking semantics + support SKIP LOCKED for REPEATABLE READ isolation level
- [10163] [DST] Disable large transaction batch apply until it does not affect tablet splitting
- [10193] [YSQL] Disallow deleting tablespace used by tablegroups
- [10236] [YSQL] Properly assign junk_filter_needed value based on type of Relation
- [10256] [DST] [PITR] Fix Incorrect Restore logic for System Catalog tables
- [10262] [DocDB] Tablespace task in the YB-Master must first check whether ysql is enabled
- [10303] [YSQL] fix unexpected transaction state error
- [10472] Use curl instead of wget for client download script
- [10519] Refresh master leader after election
- [10519] Reset master leader on meta cache timeouts
- [10521] [YSQL] Always republish migrations
- [10591] [YSQL] COPY for partitioned table writes to parent instead of child nodes
- [10622] [DocDB] Fix ASAN build
- [10629] [YSQL] Ensure follower reads go to the follower for reads from the index
- [10631] [YSQL] Hide index backfill auth key in logs
- [10646] [YSQL] fix client backfill timeout
- [10737] [backup] [YSQL] yb_backup must use '--masters' argument for ysql_dump.
- [10741] [YSQL] change ybgin substitution msg to LOG
- [10769] [Geo] Fixed data race when updating transaction status hash
- [10185] Check for schema column id mismatch in SetupUniverseReplication
Known Issues
Yugabyte Platform
-
[PLAT-2487] When you add read replicas, the instance type and volume may not show any values. Re-select the provider and the values should populate correctly as primary cluster.
-
[PLAT-2490] You may see a "Warning: cronjobs are not active on some nodes" message on the Universe health check page, even when cron jobs are active on the database nodes. To remove the warning:
-
For Replicated- and Yugabundle-based Platform installs, launch the
devops/bin/edit_universe_details.py
script and globally replace the value ofcronsActive
field fromtrue
tofalse
. The number ofcronsActive
entries corresponds to the number of database nodes in your universe — you need to replace all of them. -
For Kubernetes-based Platform installs, please contact Yugabyte support for help as this requires modifying the values in the database directly.
-
Database
N/A
v2.11.0.1 - December 3, 2021
This is a bug-fix-only release.
Build: 2.11.0.1-b1
Downloads
Docker
docker pull yugabytedb/yugabyte:2.11.0.1-b1
Bug fixes
Yugabyte Platform
- [PLAT-2266] application.log is not available for logs on UI
- [PLAT-2400] Universe scaling out by adding nodes keeps new nodes in blacklisted state.
Database
N/A
v2.11.0.0 - November 22, 2021
Build: 2.11.0.0-b7
Downloads
Docker
docker pull yugabytedb/yugabyte:2.11.0.0-b7
New Features
Yugabyte Platform
- [CLOUDGA-2875] Add additional permissions to
yb_superuser
- [CLOUDGA-3033] Grant additional roles to
yb_superuser
- [PLAT-26] [9612] Add logs purge threshold option to
zip_purge_yb_logs.sh
- [PLAT-580] Add new xCluster create/get/edit/delete APIs and data model
- [PLAT-1669] initial OEL 8 support
- [PLAT-1748] Create POST and GET endpoint to generate support bundle and download support bundle v1
- [PLAT-1817] Add support for new certificate creation when rotating certs
- [PLAT-1856] Support pause/resume for GCP
- [PLAT-1870] Add a table view to universe page
- [PLAT-1941] Add status quick filter and table actions
- [PLAT-2071] Implement read-only user functionality for Alert UIs
- [PLAT-2104] Enable/disable Auth in k8s
Database
- [1127] [YSQL] Collation support
- [2272] [YSQL] Migration framework for YSQL cluster upgrade
- [7850] [YSQL] Implement GIN (YBGIN) indexes
- [8242] Enable automatic tablet splitting by default
- [8422] [YSQL] pg_stat_monitor extension
- [9370] Set
enable_stream_compression
flag to true by default - [9595] [YSQL] Support YBGIN index in
pg_trgm
extension - [10019] [DocDB] Add support for ZLib compression
- [10094] [DocDB] added data_block_key_value_encoding_format option
- [10094] [DocDB] Implemented advanced delta encoding/decoding optimized for DocDB-specific RocksDB keys
- [10141] [DocDB] Remove feature gate on savepoints
- [10150] [YSQL] Add functionality for the
yb_extension
role - [10157] [Geo] Added command to create new transaction status tables
- [10204] [YSQL] Add functionality for the
yb_fdw
role - [10473] Implement YSQL Follower reads
Improvements
Yugabyte Platform
- [PLAT-1506] Enhancement: Support to create/mark Alert Definition Group in Active or Inactive state from UI
- [PLAT-1513] Enhance metrics that use sum without to also exclude namespace_name (#9759)
- [PLAT-1580] Implement OOM killer alert
- [PLAT-1585] k8s example for create universe
- [PLAT-1704] Make Platform health checks more scalable
- [PLAT-1731] Add more logging for Platform HA feature
- [PLAT-1740] Make backup utility python3-compatible for different OS.
- [PLAT-1753] Enable taking backups using custom ports
- [PLAT-1760] Add readable type names
- [Plat-1777] Add basic filtering and sorting
- [Plat-1797] Create a pagination component
- [PLAT-1808] [Alert UI] cleanup tasks
- [PLAT-1867] AWS Provider and Universe examples
- [PLAT-1916] Moved default access token key to configuration
- [PLAT-1934] Adding UI to set KUBE_DOMAIN
- [PLAT-1953] Improve performance of /logs endpoint
- [PLAT-1956] Expose preflight check as a standalone action
- [PLAT-1962] Add optional AWS KMS Endpoint field while creating KMS configuration.
- [PLAT-1967] API Add support for k8s provider creation
- [PLAT-1989] Show alert configuration target in page view
- [PLAT-2032] Append number to self-signed certificate labels when rotating certs
- [PLAT-2033] [Alert] [UI] Move seconds in Duration under conditions similar to Threshold in Alert Definition Page
- [PLAT-2034] Specific task type name for TLS toggle
- [PLAT-2093] Replace pause icon with resume icon for resume universe
Database
- [1127] [YSQL] Improve collation upgrade performance.
- [3745] [DocDB] Added flag for making log cache memory percent-based.
- [5310] [YSQL] Cherry-pick upstream PostgreSQL commit that performs refactor of ExecUpdate() function.
- [5310] [YSQL] Support row-level partition UPDATE across partitions
- [7293] [YSQL] Import Fix tablespace handling for partitioned tables
- [8242] [DocDB] Update defaults for automatic tablet splitting
- [8862] [DocDB] Enable CHANGE_CONFIG_OP to be added to raft log for split tablet
- [9178] [YSQL] Support a way to read from local partitions first
- [9467] [YSQL] Increase scope of cases where transparent retries are performed
- [9468] [YSQL] [Part-1] READ COMMITTED isolation level
- [9512] Add optional bootstrap IDs parameter to AlterUniverseReplication add_tables
- [9606] [DocDB] Add flag --force for command delete_tablet to set state TABLET_DATA_DELETED for tool yb-ts-cli
- [9969] [DocDB] Add a gflag for RocksDB block_restart_interval
- [10038] [YQL] Support for displaying the bind values for a prepared statement(s).
- [10110] [DocDB] Enables compaction file filter during manual compactions
- [10136] [YSQL] Import Reject SELECT ... GROUP BY GROUPING SETS (()) FOR UPDATE.
- [10151] [YSQL] Import Avoid fetching from an already-terminated plan.
- [10199] [YSQL] Import Reset memory context once per tuple in validateForeignKeyConstraint.
- [10208] [YSQL] Adding negative caching for types and metrics collection for catalog cache misses
- [10211] [xCluster] Allow for overriding the default CDCConsumerHandler thread pool size
- [10266] [YSQL] Import In security-restricted operations, block enqueue of at-commit user code.
- [10317] [YSQL] Import
Allow users with BYPASSRLS to alter their own passwords.
- [10335] [YSQL] Import Avoid lockup of a parallel worker when reporting a long error message.
- [10343] [DocDB] Adds a GFlag to ignore value-level TTL during SST file expiration
- [10359] [YCQL] [YSQL] Update dependencies for Java subprojects
- [10377] [DocDB] Add multi drives to TS servers on ExternalMiniCluster
- [10381] [DocDB] enhance debug logs for RWCLock
- [10382] [YSQL] Import Make pg_dump acquire lock on partitioned tables that are to be dumped.
- [10385] [YSQL] Import Add strict_multi_assignment and too_many_rows plpgsql checks
- [10386] [YSQL] Import Fix some errhint and errdetail strings missing a period
- [10406] [YSQL] Create callback for index write
- [10427] [DocDB] Added transaction_table_num_tablets_per_tserver flag
- [10487] [10489] [YSQL] Import Prevent drop of tablespaces used by partitioned relations
- [YSQL] Import Fix cloning of row triggers to sub-partitions
Bug Fixes
Yugabyte Platform
- [CLOUDGA-2800] Fix possible customer removal issue related to persisted metrics
- [PLAT-364] [9391] Incorrect masters selection leads to universe creation failures
- [PLAT-490] Display timezone with timestamp
- [PLAT-1504] Delete release from
yugaware_property
table and local filesystem. - [PLAT-1511] Fix legend overflowing in metrics tab
- [PLAT-1607] Upgrade systemd API fix
- [PLAT-1618] Make TLS Enable/Disable UI to display as default instead of under feature flag
- [PLAT-1634] Backup page is not loading because of empty configuration column
- [PLAT-1716] Import releases modal on releases page doesn't work
- [PLAT-1751] [UI] DB Version field setting getting reset to first item in the dropdown on toggling between the Read Replica and Primary cluster tabs
- [PLAT-1752] Potential resource leak in thread pool for subtasks
- [PLAT-1789] [PLAT-1727] Addition/Removal of default platform gflags does not retain the universe's initial preferences.
- [PLAT-1803] Not able to change cert for client to node in TLS enable feature
- [PLAT-1806] Resolve issue in TlsToggle where certs_for_client_dir is set as empty
- [PLAT-1819] [PLAT-1828] Release backup lock when Platform restarts, and update Backup state
- [PLAT-1824] Improve backup retention in case of backup failure
- [PLAT-1829] [ycql/ysql auth password] Wrong error message
- [PLAT-1831] Fix DB version dropdown from being reset when switching between primary and async cluster forms
- [PLAT-1831] Fix when navigating from home page to Create Universe
- [PLAT-1836] Clean up needless releases data from YB nodes
- [PLAT-1837] Change Replication factor field to be editable for async universe form.
- [PLAT-1840] Fix 30 sec customer_controller list API
- [PLAT-1842] Fix long universe list query
- [PLAT-1845] GET /api/v1/customers/cUUID/universes/uniUUID/leader takes 9 seconds on dev portal
- [PLAT-1853] Frequent error log related to health checks on portal.k8s
- [PLAT-1855] Edit Universe example and missing implicit parameters
- [PLAT-1862] Backup Frequency cannot be negative number
- [PLAT-1886] Set locale on GCP Ubuntu universes.
- [PLAT-1887] Fix creation of read-only on-prem universe + code cleanup
- [PLAT-1892] Remove default template for error log + remove error logs from health check report
- [PLAT-1895] Fix backup failure alert in case restore fails
- [PLAT-1897] Make client_max_body_size configurable in replicated
- [PLAT-1897] Take-2. Make client_max_body_size configurable in replicated
- [PLAT-1907] Mismatching address should not cause standby to overwrite local instance
- [PLAT-1907] Missed a rename of assertYWSE to assertPlatformException
- [PLAT-1921] [Backup] [UI] Disappearance of Encrypt backup toggle in 2.9.1 and 2.9.2 portals
- [PLAT-1923] [PLAT-1924] Ability to create universes with AZs count > RF + definition of default region
- [PLAT-1942] Backup/restore failing on KMS enabled universes
- [PLAT-1952] Correctly mark status of root and client root during add operation
- [PLAT-1953] Add /logs sh script to release package
- [PLAT-1969] [UI] Universe creation - Create button is disabled when YSQL/YCQL auth is disabled
- [PLAT-1972] Check certificates existence
- [PLAT-1976] Fix EditUniverse for on-prem
- [PLAT-1987] Only adding
gcp_internal
flag for GCP provider - [PLAT-1990] Ensure universe size doesn't change dramatically during a full move
- [PLAT-1998] Fix NPE in SystemdUpgrade task for TLS enabled universes
- [PLAT-1999] Update cert directories gflags during cert rotation
- [PLAT-2002] Fixing
zip_purgs_yb_logs
to not error without threshold flag - [PLAT-2015] Remove Sort functionality from "Target universe" in alert listing
- [PLAT-2018] Fix instance restart alert during universe operation
- [PLAT-2019] Fix permission denied issues during find command
- [PLAT-2030] [UI] [Platform]UI should display the name of the newly created cert instead of "Create new cert" option
- [PLAT-2034] Fix migration version
- [PLAT-2045] Minor fix to release name regex
- [PLAT-2046] Yb-client: Possible race condition while getting Master-Leader
- [PLAT-2049] Fix metric storage + fix health check for development and ARM builds
- [PLAT-2053] Fix the wrong error message in TLS configuration modal
- [PLAT-2068] [UI] Screen going blank when removed regions in Edit Universe
- [PLAT-2069] Hiding systemd upgrade option for read-only users
- [PLAT-2073] [UI] Enable Systemd Services toggle shows wrong status
- [PLAT-2074] Alert configuration active status in page view + activate/deactivate from actions + sorting fixes
- [PLAT-2081] Show Error message when trying to create existing user
- [PLAT-2092] Fix Task list default sorting by create time
- [PLAT-2094] Fix k8s universe certificate expiry checks
- [PLAT-2096] [UI] Restore backup UI refresh issue
- [PLAT-2097] Fix repeated migration V68 : approach 2
- [PLAT-2107] Resolve multiple UI fixes in Encryption-at-Rest modal
- [PLAT-2109] Skip hostname validation in certificate
- [PLAT-2110] Fix wrong default destination migration for multi-tenant platforms.
- [PLAT-2111] Systemd Upgrade failing with read replica
- [PLAT-2113] Fix HA failing with entity_too_large
- [PLAT-2124] [Alert] [UI] Select Alert Metrics doesn't load the template if the metrics is created twice
- [PLAT-2126] Fix stopping periodical tasks in case of failure
- [PLAT-2128] Fix alert message field to print the whole message + alert channel error message fix
- [PLAT-2129] [Alert] Full Alert message is not displayed in Alert listing page on selecting the alert
- [PLAT-2134] Fix beforeValidate migration for the case of empty database
- [PLAT-2138] Fix OOM Kill alert query in DB migration
- [PLAT-2157] Flyway plugin patch for ignoreMissingMigration and default java package issue
- [PLAT-2167] Fix 3000 seconds timeout for IAM profile retrieval operation
- [PLAT-2180] Missing error response logging when demoteInstance fails
- [PLAT-2189] Fix universe creation on airgap install
- [PLAT-2200] [UI] Fix regression with HA "standby" overlay
Database
- [2272] [YSQL] Fix OID generation for initdb migration
- [2397] [YSQL] Fix wrong results after modification statement failure in procedure block
- [2866] Add deadline to CdcProducer::GetChanges call
- [5536] [YSQL] fast-path not used when type conversion from timestamp with & without timezone happens
- [7092] [10046] [10222] [10224] [10230] [10251] [10295] Enable Clang 12 ASAN build on AlmaLinux 8 and fix relevant bugs
- [8148] [DocDB] Potential issue on crash after creating post-split tablets
- [8229] [Backup] repartition table if needed on YSQL restore
- [8718] [YSQL] Free Bitmapset used in match_index_to_operand()
- [9541] [YSQL] Restart metrics webserver when postmaster recovers
- [9645] [YSQL] Cleanup DDL transaction state in case of query failure
- [9898] [DocDB] Fix queries on system.partitions when unable to resolve some addresses
- [9936] [YBase] Don't parse RequestHeader protobuf
- [9936] Fix ysql_dump in encrypted k8s environment
- [9957] [YSQL] Fix memory usage when translating decimal data into Postgres's datum format.
- [10044] [DST] [PITR] Fix race in snapshot/schedule cleanup
- [10071] Fix Locking Issues with DeleteTableInMemory
- [10077] [DocDB] Compaction file filter factory uses HistoryRetention instead of Schema
- [10082] Clean up environment on SetupUniverseReplication failure
- [10116] [YSQL] Starting a new cluster with an old YSQL snapshot fails in debug build
- [10164] [DocDB] Max file size for compactions should only affect TTL tables
- [10166] Acquire lock in GetUniverseParamsWithVersion
- [10167] [DocDB] Save source tablet mutations to sys catalog when splitting
- [10207] [DocDB] Make read_buffer_memory_limit a percentage of process memory instead of total memory.
- [10218] CheckLocalHostInMasterAddresses should check all specified RPC addresses
- [10220] [DocDB] splitting: deprecate TabletForSplitPB.tablets_for_split
- [10225] [DST] Adhere to the definitions of
partitions_
andtablets_
duringDeleteTable
- [10240] Add IPv6 address filters to default value of net_address_filter
- [10254] [YSQL] Fix 100% CPU usage regression bug in SELECT with FOR KEY SHARE/IN/missing keys
- [10259] [YSQL] Allow setting tablegroups on tables using WITH
- [10304] [DocDB] fix deadlock in ProcessTabletReportBatch
- [10308] [YSQL] Prevent setting tablespaces for temp tables
- [10314] [YSQL] remove mention of HaveYouForgottenAboutMigration
- [10323] [YBase] Fix outbound call timeout handling
- [10364] [YCQL] Fix issue when dropping col that is not in an existing non-partial secondary index
- [10374] [YSQL] Cannot start a cluster with
--ysql_pg_conf_csv='statement_timeout=1000'
- [10415] [Backup] Backup-restore failures for old backups.
- [10419] [YSQL] Shorten string to get rid of output truncation warning
- [10430] [YSQL] Limit to IPv4 for sys catalog initialization
- [10433] [YSQL] Load pg_depend and
pg_shdepend
on demand - [10496] [YSQL] Adjust cost when
enable_seqscan=off
- [adhoc] [DST] Reword loud log line in raft_consensus.cc to remove the word Failure
Known Issues
Yugabyte Platform
N/A
Database
N/A