The following release notes cover the most recent changes over the last 60 days. For a comprehensive list of product-specific release notes, see the individual product release note pages.
You can also see and filter all release notes in the Google Cloud Console
To get the latest product updates delivered to you, add the URL of this page to your
feed
reader, or add the feed URL directly: https://cloud.google.com/feeds/gcp-release-notes.xml
June 25, 2021
Cloud TasksA Service Level Agreement (SLA) for Cloud Tasks is now in effect.
GKE clusters on some 1.18.18+ and 1.19.10+ versions might fail to create or
apply CustomResourceDefinitions containing integer validation rules using
server-side apply. The following error occurs: failed to convert new object to proper version: unable to convert unstructured object to apiextensions.k8s.io/v1, Kind=CustomResourceDefinition: cannot convert int64 to float64.
The following versions are affected:
- 1.19.11-gke.1700
- 1.19.10-gke.1700
- 1.19.10-gke.1600
- 1.19.10-gke.1000
- 1.18.19-gke.1700
- 1.18.18-gke.1700
- 1.18.18-gke.1100
To resolve this issue, upgrade to a newer version or downgrade to one of the following versions:
- 1.19.9-gke.1900
- 1.18.17-gke.1901
(2021-R21) Version updates
GKE cluster versions have been updated.
New versions available for upgrades and new clusters
The following Kubernetes versions are now available for new clusters and for opt-in control plane upgrades and node upgrades for existing clusters. For more information on versioning and upgrades, see GKE versioning and support and Upgrades.
No channel
- Version 1.19.9-gke.1900 is now the default version.
- The following versions are now available:
- The following versions are no longer available:
- 1.17.17-gke.3700
- 1.17.17-gke.4400
- 1.17.17-gke.4900
- 1.17.17-gke.5400
- 1.17.17-gke.6000
- 1.17.17-gke.6700
- 1.17.17-gke.7200
- 1.17.17-gke.7800
- 1.17.17-gke.8200
- 1.17.17-gke.9100
- Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.17 to version 1.18.17-gke.1901 with this release.
- Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.19 to version 1.19.10-gke.1600 with this release.
Stable channel
- Version 1.18.18-gke.1700 is now available in the Stable channel.
- Version 1.18.17-gke.1900 is no longer available in the Stable channel.
- Version 1.18.18-gke.1100 is no longer available in the Stable channel.
- Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.17 to version 1.18.17-gke.1901 with this release.
Regular channel
- Version 1.19.9-gke.1900 is now the default version in the Regular channel.
- Version 1.19.9-gke.1900 is now available in the Regular channel.
- Version 1.19.10-gke.1600 is no longer available in the Regular channel.
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.18 to 1.19.10-gke.1700 with this release.
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.19 to 1.19.10-gke.1700 with this release.
Rapid channel
- Version 1.20.7-gke.1800 is now the default version in the Rapid channel.
- Version 1.20.7-gke.2200 is now available in the Rapid channel.
- Version 1.21.1-gke.2200 is now available in the Rapid channel.
- Version 1.20.6-gke.1400 is no longer available in the Rapid channel.
- Version 1.21.1-gke.1800 is no longer available in the Rapid channel.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.19 to 1.20.7-gke.1800 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.20 to 1.20.7-gke.1800 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.21 to 1.21.1-gke.2200 with this release.
June 24, 2021
Anthos Config ManagementConfig Connector can no longer be installed via Anthos Config Management. Upgrading to Anthos Config Management v1.8.0 will not affect an existing Config Connector installation, but that installation can no longer be managed with Anthos Config Management. To install or upgrade Config Connector alongside Anthos Config Management v1.8.0 or later, see Advanced installation options > Upgrading from non-operator installations in the Config Connector documentation. The version of Config Connector supported in earlier versions of Anthos Config Management will stop working on Kubernetes versions greater than or equal to 1.19.
The Config Sync admission webhook serving port is switched from 8676 to 10250. If you use Config Sync in multi-repo mode in private GKE clusters, you no longer need to add a firewall rule to open port 8676.
The Hierarchy Controller admission webhook serving port has switched from 9443 to 10250. If you use Hierarchy Controller in private GKE clusters you no longer need to add a firewall rule to open port 9443.
The Anthos Policy Controller admission webhook serving port is switched from 8443 to 10250. If you use Policy Controller in private GKE clusters you no longer need to add a firewall rule to open port 8443.
All Anthos Config Management components have been updated to remove use of v1beta1 APIs scheduled to be removed in Kubernetes 1.22. See the Kubernetes Deprecated API Migration Guide for more details.
Anthos Policy Controller now supports the ability for users to mutate resources as a preview feature. For more information see Mutating resources.
Anthos Policy Controller has been updated to include a more recent build of OPA Gatekeeper (hash: f6c2fe8).
Editing rights to Hierarchical Resource Quotas are now aggregated into the cluster-wide 'edit' and 'admin' Cluster Roles.
1.10.2-asm.2 is now available.
This patch release contains the same bug fixes that are in Istio 1.10.2. For details on upgrading Anthos Service Mesh, refer to the following upgrade guides:
- Upgrading on GKE using the
install_asmscript - Upgrading on Anthos clusters on VMware
Anthos clusters on-premises support Mesh CA.
New installations of Anthos Service Mesh 1.10x on Anthos clusters on VMWare and bare metal support the Anthos Service Mesh certificate authority (Mesh CA). For details on the installation, see Installing Anthos Service Mesh on-premises.
When you install Anthos Service Mesh on-premises with Mesh CA, this enables Cloud Monitoring and Cloud Logging by default. Additionally, you can use Cloud Trace (which you enable separately) as needed for troubleshooting.
Google-managed control plane release channels are available.
Anthos Service Mesh releases updates often, to deliver security updates, fix known issues, and introduce new features. Release channels offer you the ability to balance between stability and the feature set of the Anthos Service Mesh version. Google automatically manages the version and upgrade cadence for each release channel. To learn more, see the following:
Migrating to Mesh CA from Istio CA with little or no downtime.
Migrating to Anthos Service Mesh certificate authority (Mesh CA) from Istio CA (also known as Citadel) requires migrating the root of trust. Prior to Anthos Service Mesh 1.10, if you wanted to migrate from Istio on to Anthos Service Mesh with Mesh CA, you needed to schedule downtime because Anthos Service Mesh was not able to load multiple root certificates, which interrupted mutual TLS (mTLS) traffic during the migration.
With Anthos Service Mesh 1.10 and higher, you can install a new in-cluster control plane with an option that distributes the Mesh CA root of trust to all proxies. After switching to the new control plane and restarting workloads, all proxies are configured with both the Istio CA and Mesh CA root of trust. Next, you install a new in-cluster control plane that has Mesh CA enabled. As you switch workloads over to the new control plane, mTLS traffic isn't interrupt. For details, see Migrating to Mesh CA.
The Istio project recently announced a security vulnerability (CVE-2021-34824) where where credentials specified in the Gateway and DestinationRule credentialName field can be accessed from different namespaces.
For more information, see the GCP-2021-012 security bulletin.
1.8.6-asm.4 and 1.9.6-asm.1 are now available. This release updates the envoy versions for the following Anthos Service Mesh versions:
- 1.8.6-asm.2 uses Envoy v1.16.3.
- 1.9.6-asm.1 uses Envoy v1.17.2.
These patch releases contains a fix for CVE-2021-34824. For details on upgrading Anthos Service Mesh, refer to the following upgrade guides:
- Anthos Service Mesh 1.8.x
- Anthos Service Mesh 1.9.x
New resource types are now available.
The following resource types are now publicly available through the resource search API (SearchAllResources) and policy search API (SearchAllIamPolicies):
- Managed Service For Microsoft Active Directory
managedservices.googapis.com/Domain
The following resource types are now publicly available through the Export APIs (ExportAssets and BatchGetAssetsHistory) and the Feed API:
- Secret Manager (Newly added real-time feed support)
secretmanager.googleapis.com/Secretsecretmanager.googleapis.com/SecretVersion
Cloud SQL for SQL Server now supports SQL Server 2019. The default version continues to be SQL Server 2017 Standard. See Database versions and version policies.
Preview: Use patch alerting to monitor the patch jobs running in your environment. For more information, see Monitoring patch jobs.
Config Controller is available for Public Preview. Config Controller is a managed service to provision and orchestrate Anthos and Google Cloud resources. Config Controller allows you to define and operate with simple, declarative configuration in Kubernetes style. For information on Config Controller, please see Config Controller Overview.
Versions of included products
- Anthos Config Management v1.8.0, release notes
- Config Connector v1.52.0, release notes
Config Controller can be used to deploy a landing zone blueprint.
Internal load balancer subsetting for GKE is now generally available in GKE versions 1.18.19-gke.1400 and later.
- TensorFlow Enterprise 2.3 has been updated to 2.3.3 from 2.3.2
- TensorFlow Enterprise 2.1 has been updated to 2.1.4 from 2.1.3
June 23, 2021
BigQueryBigQuery now supports the following function:
This feature is generally available (GA).
Console Table Management for Cloud Bigtable is now generally available. You can now use the Google Cloud Console to create, edit, and delete Cloud Bigtable tables, column families, and garbage collection policies.
Preview: You can now replicate data continuously and in real time from operational data stores in Oracle into BigQuery using the Oracle (by Datastream) plugin. The plugin is available in Cloud Data Fusion version 6.4.0 or later.
Cloud Router now supports the following:
Cloud SQL storage limits are now increased to support up to 64 TB. See Cloud SQL storage limits for more information.
The following MySQL minor versions have been upgraded:
MySQL 5.6.50 is upgraded to 5.6.51 MySQL 5.7.32 is upgraded to 5.7.33
Cloud SQL storage limits are now increased to support up to 64 TB. See Cloud SQL storage limits for more information.
Cloud SQL storage limits are now increased to support up to 64 TB. See Cloud SQL storage limits for more information.
Cloud SQL storage limits are now increased to support up to 64 TB. See Cloud SQL storage limits for more information.
Cloud SQL storage limits are now increased to support up to 64 TB. See Cloud SQL storage limits for more information.
Cloud SQL storage limits are now increased to support up to 64 TB. See Cloud SQL storage limits for more information.
Best practices are now available for the Compute Engine API.
Added new Memorystore for Memcached region: Melbourne (australia-southeast2).
If you are using Private Service Connect endpoints to access services in another VPC network, and you delete multiple endpoints in a short period of time, one or more of the deletions might fail. To avoid this issue, wait 20 seconds between deletions.
If you are using Private Service Connect endpoints to access services in another VPC network, and you create more endpoints than are allowed by the limit set by the service producer, any endpoints created after the limit is reached have a status of Pending, as expected. However, if you remove endpoints to get below the limit, the status of those endpoints does not change to Accepted.
June 22, 2021
BigQuery Data Transfer ServiceBigQuery Data Transfer Service now supports Google Merchant Center data transfers for local inventories and regional inventories.
BigQuery ML is releasing the following features for preview:
- The
ML.DETECT_ANOMALIESfunction is now available. This function provides anomaly detection for BigQuery ML. The function runs against time-series data usingARIMA_PLUSmodels. The function runs against independent and identically distributed (IID) random variables data usingAUTOENCODERandKMEANSmodels. - The
AUTOENCODERmodel type is now available for CREATE MODEL statements. This is a TensorFlow-based, deep-learning model that supports sparse data representations, and is commonly used in ML tasks such as feature embedding, unsupervised anomaly detection, and non-linear dimensionality reduction. The ML.PREDICT function can use previously built AUTOENCODER models to reduce the dimensionality of query results. - Hyperparameter tuning is now available and can be used to improve model performance by searching for the optimal hyperparameters when training ML models using CREATE MODEL statements. View the BigQuery ML Hypertuning tutorial to learn how to improve model performance by 40%.
External HTTP(S) Load Balancing and Cloud CDN now support HTTP/3. HTTP/3 is based on the IETF QUIC transport protocol. Compared to HTTP/2, it reduces request latency, improves throughput, and mitigates head-of-line blocking. HTTP/3 is already supported on most major web browsers.
To learn how to enable HTTP/3 on your external HTTP(S) load balancer, visit the documentation.
External HTTP(S) Load Balancing and Cloud CDN now support HTTP/3. HTTP/3 is based on the IETF QUIC transport protocol. Compared to HTTP/2, it reduces request latency, improves throughput, and mitigates head-of-line blocking. HTTP/3 is already supported on most major web browsers.
To learn how to enable HTTP/3 on your external HTTP(S) load balancer, visit the documentation.
Symmetric hashing for internal TCP/UDP load balancers as next hops—When load balancing to multiple NICs on the backends, you no longer need to use source network address translation (SNAT). SNAT isn't required because Google Cloud uses symmetric hashing. This means that when packets belong to the same flow, Google Cloud calculates the same hash. In other words, the hash doesn't change when the source IP address:port is swapped with the destination IP address:port.
This feature is in General Availability.
Cloud Run support for WebSockets, HTTP/2, and gRPC streaming are now at general availability (GA).
The Cloud TPU team has released support for TensorFlow 2.4.2. The corresponding Tensorflow release notes are:
Dataflow is now able to use workers, Dataflow Shuffle, Streaming Engine, FlexRS, and regional endpoints in zones in Melbourne (australia-southeast2).
M73 Release
- Upgraded TensorFlow Enterprise 2.1.3 to 2.1.4.
- Upgraded TensorFlow Enterprise 2.3.2 to 2.3.3.
- Miscellaneous bug fixes and updates.
M73 Release
- Upgraded TensorFlow Enterprise 2.1.3 to 2.1.4.
- Upgraded TensorFlow Enterprise 2.3.2 to 2.3.3.
- Disabled automatic updates for Ubuntu to be in line with the behavior in Debian images.
- Miscellaneous bug fixes and updates.
General availability for the following integration:
June 21, 2021
Anthos clusters on bare metalRelease 1.8.0
Anthos clusters on bare metal release 1.8.0 is now available. To upgrade, see Upgrading Anthos on bare metal. Anthos clusters on bare metal 1.8.0 runs on Kubernetes 1.20.
Extended installation support:
- Provided support to use containerd as the container runtime as GA for Anthos clusters on bare metal release 1.8.0. Cluster upgrades to 1.8.0 are blocked for 1.7.x clusters that are configured to use the preview containerd capability. For more information, see Upgrading 1.7.x clusters that use containerd in Known Issues.
- Preview: Improved virtual machine (VM) management capability. Anthos VM Runtime uses KubeVirt to orchestrate VMs on clusters, allowing you to work with your VM-based apps and workloads in a uniform development environment. Anthos VM Runtime has worked with Anthos clusters on bare metal as a preview feature since November 2020 and we have continued to enhance its capability. For more information, see Working with VM-based workloads.
- Added edge profile support for standalone clusters. The edge profile is recommended for edge devices with limited resources. Add
profile: edgeto the cluster config file when you create a standalone cluster to produce a cluster that has significantly reduced system resource requirements. The edge profile is only available for standalone clusters, it is ignored for other cluster types. For more information, see Creating standalone clusters. - Added support to specify provider ID for Nodes (
controlPlane.nodePoolSpec.nodes.providerID) to support deploying on OpenStack using Load Balancing as a Service (LBaaS) resources. For more information, see Configure your clusters to use OpenStack. - Preview: Added support for installing Anthos clusters on bare metal, using your own registry service, instead of
gcr.io. For instructions and additional information, see Installing Anthos Bare Metal using registry mirror.
Improved upgrade:
- Enabled support for upgrading non-SELinux clusters to SELinux. For more information, see Enable SELinux in Upgrading Anthos clusters on bare metal.
- Cluster upgrades are not blocked by excessive Node draining durations. During a cluster upgrade, if the draining process takes longer than 20 minutes for any specific Node, the upgrade process will carry on without waiting for draining to complete.
Updated user cluster lifecycle management:
- Added
bmctlimprovements for resetting user cluster and adding additional preflight checks to confirm machine and network readiness for cluster creation:
Enhanced monitoring and logging:
- Preview: Added Cloud Audit Logging capability, which enables audit logs to be written to Cloud Audit Logs in your Google project. Audit logs are useful for investigating suspicious API requests and for collecting statistics. For more information, see Enable Audit Logging.
Introduced new networking capabilities in preview:
- Preview: Added multi-NIC capability to provide additional interfaces to your Pods.
- Preview: Added egress NAT gateway capability to provide persistent, deterministic routing for the egress traffic from your clusters. For more information, see Configure an egress NAT gateway for external communication.
- Preview: Added option for BGP bundled load balancer for Layer-3 (L3) topologies. This feature can be used with user clusters and admin clusters.
Enhanced security:
- Workload Identity is GA. The Connect Agent Service Account Key is no longer required during installation. Connect Agent uses Workload Identity to authenticate to GCP instead of an exported GCP Service Account Key.
Expanded support for newer versions of operating systems:
- Added support for installing Anthos clusters on bare metal on Red Hat Enterprise Linux (RHEL) 8.4, and CentOS 8.4
Functionality changes:
- Added
--workspace-dirflag tobmctlto allow changing the path and name of the workspace directory from the defaultbmctl-workspace. The workspace directory contains the configuration and log files generated bybmctl. When using thebmctlcommand, pass in a--workspace-dirflag to specify a non-default workspace directory location. If the directory does not exist,bmctlwill create it for you. - Moved away from
iptables-based NodePort and masquerade handling to eBPF-based management. NodePort and masquerade handling are now applied to the Node IP and default gateway interfaces only.
Fixes:
- Resolved, as part of the GA support for using containerd as the container runtime, incorrect cgroup driver use. Newly created 1.8.0 clusters that are configured to use containerd will use the correct
systemdcgroup driver. - Fixed issue that prevented usage metrics for the containerd process from being collected by Cloud Logging. This fix applies to newly created 1.8.0 clusters only.
Known issues:
- If a Node is out of reach, Anthos clusters on bare metal can't start the draining process, which may impact the cluster upgrade process. For more information, see Node draining can't start when Node is out of reach.
- Upgrading from 1.7.x clusters that use containerd as the container runtime to 1.8.0 is blocked. For more information, see Upgrading 1.7.x clusters that use containerd.
- When running Anthos clusters on bare metal with firewalld enabled on either CentOS or Red Hat Enterprise Linux (RHEL), changes to firewalld can remove the Cilium
iptableschains on the host network. The loss of the Cilium iptables chains causes the Pod on the Node to lose network connectivity outside of the Node. for more information, see Modifying firewalld will erase Ciliumiptablechains.
For information about the latest known issues, see Anthos on bare metal known issues in the Troubleshooting section.
Row-level security on table data is now generally available in BigQuery.
BigQuery is now available in the Melbourne (australia-southeast2) region.
BigQuery BI Engine is now available in the Melbourne (australia-southeast2) region.
BigQuery Data Transfer Service is now available in the Melbourne (australia-southeast2) region.
BigQuery ML is now available in the Melbourne (australia-southeast2) region.
Added a new feature for the ImportCustomer API to specify which customer will receive imported Cloud Identity information.
Cloud Bigtable is now available in the australia-southeast2 (Melbourne) region.
Support for australia-southeast2 (Melbourne) region.
Support for australia-southeast2 (Melbourne) region.
A preview enables you to use replication in Cloud SQL for SQL Server. Additionally, the preview enables you to make cross-region replicas.
You can use replication to scale the use of data in a database without degrading performance. Other reasons include migrating or maintaining data duplicates between regions.
For more information, see Replication in Cloud SQL.
Support for australia-southeast2 (Melbourne) region.
Cloud Spanner regional instances can now be created in Melbourne (australia-southeast2).
Melbourne region (australia-southeast2) launched.
- New location for storing your data.
Cloud VPN is now available in region australia-southeast2 (Melbourne, Australia).
Pricing is available on the Cloud VPN pricing page.
Melbourne, Australia australia-southeast2-a,b,c has launched with E2, N2, N1, and M1 machines.
M1 machines are only available in zones b and c.
See VM instance pricing for details.
Config Connector 1.53.0 is now available
Added support for NetworkSecurityClientTLSPolicy
Added support for NetworkSecurityServerTLSPolicy
Added support for strong hierarchal references to several resources:
- Add
spec.projectReftoDataprocAutoScalingPolicy - Add
spec.projectReftoDataprocCluster - Add
spec.projectReftoDataprocWorkflowTemplate - Add
spec.projectReftoMonitoringGroup
Change cnrm-system containers to use HTTP probes for readiness instead of command probes
Dataproc is now available in the australia-southeast2 region (Melbourne).
The australia-southeast2 region in Melbourne is now available.
Added new Memorystore for Redis region: Melbourne (australia-southeast2).
Secret Manager is now available in australia-southeast2 (Melbourne). See Secret Manager locations for more information.
For auto mode VPC networks, added a new subnet 10.192.0.0/20 for the Melbourne australia-southeast2 region. For more information, see Auto mode IP ranges.
June 18, 2021
Compute EngineGenerally available: You can now create application consistent snapshots of disks attached to Linux VMs. For more information, see Creating Linux application consistent snapshots.
Dataproc Component Gateway URLs for any two new clusters that have the same project ID, region, and name will be identical unless Dataproc Personal Cluster Authentication is enabled.
Storage Transfer Service offers Preview support for transferring data from Azure ADLS Gen 2 to Cloud Storage.
June 17, 2021
Anthos clusters on VMwareWhen you upgrade an unregistered Anthos cluster on VMware from a version earlier than 1.7.0 to a version 1.7.0 or later, you need to manually install and configure the Anthos Config Management operator. If you had previously installed Anthos Config Management, you need to re-install it. For details on how to do this, see Installing Anthos Config Management.
If you are using a private registry for software images, upgrading an Anthos cluster on VMware will always require special steps, described in Updating Anthos Config Management using a private registry. Upgrading from a version earlier than 1.7.0 to a version 1.7.0 or later additionally requires that you manually install and configure the Anthos Config Management operator as described in Installing Anthos Config Management.
New versions of Cloud Composer images:
- composer-1.17.0-preview.3-airflow-2.0.1
- composer-1.16.7-airflow-1.10.15
- composer-1.16.7-airflow-1.10.14 (default)
- composer-1.16.7-airflow-1.10.12
GCSfuse version was updated to 0.35.1 (latest release). Cloud Composer uses GCSfuse to sync files between the environment buckets and worker pods. The change improves the stability of the syncing process.
(Airflow 2) Preinstalled packages changed. Removed: google_cloud_build==2.0.0, mock==2.0.0, pbr==5.5.1. Downgraded overrides from 3.1.0 to 2.8.0.
For DAG runs with long-running tasks, task level logs are now periodically updated in the Airflow UI. Before this change, logs were only available in Airflow UI after the task was completed.
It is now possible to create environments with CMEK encryption in projects with enabled domain restricted sharing. Before the fix, an error related to insufficient Cloud Pub/Sub permissions was generated.
(Airflow 2) In the Airflow UI, you can now create connection types from the installed custom Airflow provider packages. Before, these connection types were not available.
Fixed a problem where the Airflow worker health was calculated incorrectly because of leftover queued tasks without DAGs being present in the Airflow database. This led to problems with task execution because Airflow workers were constantly restarted in healthy environments.
Fixed the cause of Liveness probe errored events that appeared in the scheduler and worker pod logs.
Query Insights is now supported for read replicas.
Cloud TPU team just released TF-2.1.4, TF-2.2.3 and TF-2.3.3 on Cloud TPUs. The TensorFlow release notes for these releases are shown below.
You can now customize E2 shared-core machine types. Shared-core machine types provide a fractional vCPU with the ability to burst to 2 vCPU for a short period of time.
E2 shared-core machine types support predefined platforms with Intel or AMD EPYC Rome processors.
The custom memory range is:
- 1 to 2 GB for micro machines
- 1 to 4 GB for small machines
- 1 to 8 GB for medium machines
E2 shared-core custom machine pricing is the same as E2 custom machine pricing. E2 machines are available in all regions and zones.
Create a custom E2 shared-core machine using gcloud or the API.
Memory-optimized M2 machine types are now available in Belgium, europe-west1-b,c.
See VM instance pricing for details.
M72 Release
- Added PyTorch 1.9 and PyTorch/XLA 1.9 containers.
M72 Release
- Added PyTorch 1.9 and PyTorch/XLA 1.9 images.
Added autoscale policies that can automatically expand or shrink a cluster in your private cloud based on factors like CPU utilization or storage capacity thresholds. All clusters begin with a default autoscale policy that adds a node based on a storage capacity threshold.
For details about this feature, see Autoscale policies.
Preview: vSAN data encryption for data at rest now uses keys generated by Cloud Key Management Service for all new private clouds.
For details about this feature, see Configuring vSAN encryption for your private cloud.
Removed vCenter privilege Host > Configuration > Storage partition configuration for role Cloud-Owner-Global-Role. This prevents the mounting of iSCS or NFS storage as a datastore on your private cloud vSphere cluster. If you have any iSCSI or NFS datastore mounted on your private cloud cluster, contact Cloud Customer Care.
Enabled TRIM/UNMAP support on vSAN at the time of private cloud creation for more efficient vSAN storage by default. To enable this feature on existing workload VMs, you must reboot the VMs.
Added the following vCenter privileges to the Cloud-Owner-Global-Role role:
- Guest operation alias modification
- Guest operation alias query
- Guest operation modifications
- Guest operation program execution
- Guest operation queries
Added vSphere content library management privileges to the Cloud-Global-VM-admin-group group. With this change, a VM admin can add, delete, and read content library items.
The Quotas page in the Cloud Console no longer shows VMware Engine node usage as 0 when you have an active private cloud.
The Connectivity Tests dynamic verification feature is now generally available. This feature uses active probing to verify connectivity between VMs. For more information, see How Connectivity Tests analyzes the live data plane.
Text-to-Speech now offers voices in the following new languages. See the supported voices page for a complete list of voices and audio samples.
- ms-MY (Malay, Malaysia)
- nl-BE (Dutch, Belgium)
June 16, 2021
Cloud Asset InventoryNew resource types are now available.
The following resource types are now publicly available through the resource search API (SearchAllResources) and policy search API (SearchAllIamPolicies):
- Google Kubernetes Engine
apps.k8s.io/Deploymentapps.k8s.io/ReplicaSetbatch.k8s.io/Job
- Hub
gkehub.googleapis.com/Membership
- API Gateway
apigateway.googleapis.com/Apiapigateway.googleapis.com/ApiConfigapigateway.googleapis.com/Gateway
- Document AI
documentai.googleapis.com/HumanReviewConfigdocumentai.googleapis.com/LabelerPooldocumentai.googleapis.com/Processor
- Vertex AI
aiplatform.googleapis.com/BatchPredictionJobaiplatform.googleapis.com/CustomJobaiplatform.googleapis.com/DataLabelingJobaiplatform.googleapis.com/Datasetaiplatform.googleapis.com/Endpointaiplatform.googleapis.com/HyperparameterTuningJobaiplatform.googleapis.com/Modelaiplatform.googleapis.com/SpecialistPoolaiplatform.googleapis.com/TrainingPipeline
The SAP accelerator for the order to cash process is now available. It provides sample pipelines that you can use to build your end-to-end order to cash process and analytics with Cloud Data Fusion, BigQuery, and Looker. The accelerator is a sample implementation of the SAP Table Batch Source plugin, which enables bulk data integration from SAP applications with Cloud Data Fusion. The accelerator is available in Cloud Data Fusion environments running in version 6.3.0 and above.
Cloud Run for Anthos on Google Cloud version 0.22.0-gke.6 is now available for the following GKE minor versions:
- 1.19
- 1.20
- 1.21
Cloud Run for Anthos on Google Cloud version 0.23.0-gke.6 is now available for the following GKE minor versions:
- 1.19
- 1.20
- 1.21
Cloud Scheduler is now available in us-west1, asia-east1, and asia-southeast1.
Cloud Tasks is now available in us-west1, asia-east1, and asia-southeast1.
(2021-R20) Version updates
GKE cluster versions have been updated.
New versions available for upgrades and new clusters
The following Kubernetes versions are now available for new clusters and for opt-in control plane upgrades and node upgrades for existing clusters. For more information on versioning and upgrades, see GKE versioning and support and Upgrades.
No channel
- Version 1.19.10-gke.1600 is now the default version.
- The following versions are now available:
- The following versions are no longer available:
- 1.18.17-gke.1200
- 1.18.17-gke.1201
- 1.19.9-gke.1400
- Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.18 to version 1.18.17-gke.1901 with this release.
- Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.19 to version 1.19.9-gke.1900 with this release.
Stable channel
- Version 1.18.17-gke.1901 is now the default version in the Stable channel.
- Version 1.18.18-gke.1100 is now available in the Stable channel.
- Version 1.18.17-gke.1200 is no longer available in the Stable channel.
- Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.18 to version 1.18.17-gke.1901 with this release.
Regular channel
- Version 1.19.10-gke.1600 is now the default version in the Regular channel.
- Version 1.19.10-gke.1700 is now available in the Regular channel.
- Version 1.19.9-gke.1900 is no longer available in the Regular channel.
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.18 to 1.19.10-gke.1600 with this release.
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.19 to 1.19.10-gke.1600 with this release.
Rapid channel
- Version 1.20.7-gke.1800 is now available in the Rapid channel.
- Version 1.21.1-gke.1800 is now available in the Rapid channel.
- Version 1.21.1-gke.400 is no longer available in the Rapid channel.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.21 to 1.21.1-gke.1800 with this release.
Private Service Connect endpoints in consumer networks now won't become unresponsive if they are connected to a service attachment that references a load balancer without backend VMs.
June 15, 2021
Anthos Service MeshGoogle-managed control plane is now a generally available (GA) feature. This feature lets you move from managing Istiod in your clusters to configuring the control plane as a service. Google will manage the availability, scalability and security of the control plane.
In addition, it offers these new features:
- Support for CNI
- Support for private clusters with a public IP address/endpoint access for the control plane
- Support for private clusters with Master Authorized Network (MAN)
Using the Google-managed control plane also simplifies multi-cluster mesh configuration and reduces the Kubernetes Engine privileges needed to install Anthos Service Mesh. For more information see Configuring the Google-managed control plane.
Cloud VPN no longer checks a peer's IKE identity.
This change simplifies the configuration of your VPN peers, because you no longer need to explicitly set a peer's IKE identity to a specific value.
Note: Some Cloud VPN tunnels that were previously unestablished due to unmatched IKE identity might now become established.
If you don't want the affected tunnels to become established, please delete them as needed on the Cloud VPN side, on the on-premises side, or on both sides.
If you want the affected tunnels to become established, no action is required on your part.
Previously, Cloud VPN required peers to use an IKE identity of type ID_IPV4_ADDR, which is equal to the peer's public IP address.
Removing this restriction enables easier interoperation with peers that don't support changing their IKE identity, especially when such peers are located behind NAT (Network Address Translation).
If you have any questions or require assistance, please contact Google Cloud Support.
Support for Identity and Access Management custom roles.
Final reminder: The Dialogflow V1 API shutdown will be finalized during the week of June 21, 2021. All bots (except Actions on Google) using Dialogflow V1 API requests will stop responding. Consider migrating to Dialogflow ES or Dialogflow CX.
Support for Identity and Access Management custom roles.
The issue affecting the Datadog Agent on Autopilot has been resolved in Datadog version 2.13.1.
Kf Operator to manage Kf installation.
Added Operator diagnostics to kf doctor.
Allow target command to take arg instead of flag.
Config Connector can manage the Kf Google Service Account (GSA).
Removed internal routing dependency on internal-gateway.
Inline environment variable printing in kf env.
Config Connector is now required.
Updated Tekton to 0.23.0.
Only check for timeout error for deprovisioning service instances.
Make targeting a non-existent Space an error.
Fixes manifest parsing bug.
June 14, 2021
App Engine flexible environment .NETApp Engine is now available in the us-west1 (Oregon), asia-southeast1 (Singapore), and asia-east1 (Taiwan) regions.
App Engine is now available in the us-west1 (Oregon), asia-southeast1 (Singapore), and asia-east1 (Taiwan) regions.
App Engine is now available in the us-west1 (Oregon), asia-southeast1 (Singapore), and asia-east1 (Taiwan) regions.
App Engine is now available in the us-west1 (Oregon), asia-southeast1 (Singapore), and asia-east1 (Taiwan) regions.
App Engine is now available in the us-west1 (Oregon), asia-southeast1 (Singapore), and asia-east1 (Taiwan) regions.
App Engine is now available in the us-west1 (Oregon), asia-southeast1 (Singapore), and asia-east1 (Taiwan) regions.
App Engine is now available in the us-west1 (Oregon), asia-southeast1 (Singapore), and asia-east1 (Taiwan) regions.
App Engine is now available in the us-west1 (Oregon), asia-southeast1 (Singapore), and asia-east1 (Taiwan) regions.
App Engine is now available in the us-west1 (Oregon), asia-southeast1 (Singapore), and asia-east1 (Taiwan) regions.
App Engine is now available in the us-west1 (Oregon), asia-southeast1 (Singapore), and asia-east1 (Taiwan) regions.
App Engine is now available in the us-west1 (Oregon), asia-southeast1 (Singapore), and asia-east1 (Taiwan) regions.
App Engine is now available in the us-west1 (Oregon), asia-southeast1 (Singapore), and asia-east1 (Taiwan) regions.
App Engine is now available in the us-west1 (Oregon), asia-southeast1 (Singapore), and asia-east1 (Taiwan) regions.
App Engine is now available in the us-west1 (Oregon), asia-southeast1 (Singapore), and asia-east1 (Taiwan) regions.
App Engine is now available in the us-west1 (Oregon), asia-southeast1 (Singapore), and asia-east1 (Taiwan) regions.
App Engine is now available in the us-west1 (Oregon), asia-southeast1 (Singapore), and asia-east1 (Taiwan) regions.
App Engine is now available in the us-west1 (Oregon), asia-southeast1 (Singapore), and asia-east1 (Taiwan) regions.
App Engine is now available in the us-west1 (Oregon), asia-southeast1 (Singapore), and asia-east1 (Taiwan) regions.
Cloud Functions is now available in the following region:
asia-southeast1(Singapore)
See Cloud Functions Locations for details.
In addition to scalar functions, Dataflow SQL now supports aggregate user-defined functions (UDFs) for Java. For more information, see Dataflow SQL user-defined functions. This feature is in Preview.
Support for the following additional locations:
asia-southeast1Singaporeus-west1Oregeonasia-east1Taiwan
See the full list of locations.
Support for the following additional locations:
asia-southeast1Singaporeus-west1Oregeonasia-east1Taiwan
See the full list of locations.
Enabling or disabling PROXY protocol after a Private Service Connect service attachment is created does not change the configuration. However, the status shown in the service attachment details incorrectly shows that the status has changed. To enable or disable PROXY protocol, delete the service attachment and recreate it with the correct PROXY protocol configuration.
June 11, 2021
Cloud SpannerYou can now find common queries for monitoring and troubleshooting on the Query page in the Cloud Console. This page now has query templates to help you to access these introspection system tables: Query Stats, Read Stats, Transaction Stats, Lock Stats, and Oldest active queries.
Config Connector 1.52.0 is now available.
Added support for ComputeURLMap,
DataFusionInstance,
LoggingLogExclusion.
IAMServiceAccount: added support for resourceID.
spec.preservedUnknownFields is set to false for all CRDs, ensuring consistent behavior as the flag is set from true to false across Kubernetes versions.
GKE Multi-cluster Services support for pod-specific addressing is now generally available.
If you use a Router appliance spoke to connect more than 1,000 VMs, you might be unable to establish BGP sessions between the router appliance instance and Cloud Router. The 1,000-VM limit includes any VMs that are accessible through VPC Network Peering.
You can now use a pre-built container to serve predictions from TensorFlow 2.5 models.
You can now use a pre-built container to serve predictions from XGBoost 1.4 models.
June 10, 2021
Cloud Asset InventoryThe following resource types are now publicly available through the Export APIs (ExportAssets, ListAssets, BatchGetAssetsHistory) and the Feed API:
- Serverless VPC Access
vpcaccess.googleapis.com/Connector
- Certificate Authority Service
privateca.googleapis.com/CaPoolprivateca.googleapis.com/CertificateAuthorityprivateca.googleapis.com/CertificateRevocationListprivateca.googleapis.com/CertificateTemplate
The following resource types are now publicly available through the Analyze Policy APIs (AnalyzeIamPolicy and AnalyzeIamPolicyLongrunning):
- Cloud KMS
cloudkms.googleapis.com/KeyRingcloudkms.googleapis.com/CryptoKeycloudkms.googleapis.com/CryptoKeyVersioncloudkms.googleapis.com/ImportJob
- Service Usage
serviceusage.googleapis.com/Service
- Cloud Data Fusion
datafusion.googleapis.com/Instance
NVIDIA® T4 GPUs are now available in the following additional regions and zones:
- St. Ghislain, Belgium:
europe-west1-b,c,d
For more information about using GPUs on Compute Engine, see GPUs on Compute Engine.
Volume snapshots
is now generally available. Starting in GKE version 1.21 and later, you can now
use v1 snapshots; v1beta1 snapshots will continue to operate as expected
until further notice.
Committed use discounts are now generally available to purchase for Google Kubernetes Engine (Autopilot Mode).
Google Kubernetes Engine (Autopilot Mode) committed use discounts apply to all Autopilot Pod workload vCPU, memory, and ephemeral storage usage in the region in which you have committed. Google Kubernetes Engine (Autopilot Mode) committed use discounts do not apply to the cluster management fee or to GKE Standard mode compute nodes.
See the documentation for more details.
For GKE clusters running Windows Server node pools, you can see the version
mapping between GKE versions and Windows Server versions for all available GKE
versions by using a gcloud command. This feature is now available in preview.
For more details, see Use gcloud tool to get version mapping.
The documentation for IAM role recommendations now has more detail about how insights are used to generate recommendations.
Added support for Upgrading the Redis version of an instance with the Google Cloud Console.
Released support for Redis version 6.x (Preview) on Memorystore for Redis. For more details, see Supported versions.
SAP NetWeaver high-availability cluster documentation for SLES
A new load-balancer-based configuration guide for SAP NetWeaver high-availability clusters on SUSE Linux Enterprise Server (SLES) is available for use: HA cluster configuration guide for SAP NetWeaver on SLES.
June 09, 2021
Cloud Load BalancingNetwork Load Balancing now supports load-balancing ESP (Encapsulating Security Payload) and ICMP (Internet Control Message Protocol) traffic. To handle these protocols, you specify the new L3_DEFAULT protocol on the load balancer's forwarding rule.
For details, see:
- Forwarding rule protocols for backend service-based network load balancers
- Setting up Network Load Balancing for multiple protocols
This feature is available in Preview.
Dataflow SQL now supports user-defined functions (UDFs) written using Java. For more information, see Dataflow SQL user-defined functions. This feature is in Preview.
VPC Service Controls
Integration with Document AI VPC Service Controls is now generally available.
(2021-R19) Version updates
GKE cluster versions have been updated.
New versions available for upgrades and new clusters
The following Kubernetes versions are now available for new clusters and for opt-in control plane upgrades and node upgrades for existing clusters. For more information on versioning and upgrades, see GKE versioning and support and Upgrades.
No channel
- Version 1.18.17-gke.1900 is now the default version.
- The following versions are now available:
- The following versions are no longer available:
- 1.18.17-gke.100
- 1.18.17-gke.700
- 1.19.8-gke.1600
- Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.18 to version 1.18.17-gke.1200 with this release.
- Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.20 to version 1.20.6-gke.1000 with this release.
Stable channel
- Version 1.18.17-gke.1900 is now the default version in the Stable channel.
- Version 1.18.17-gke.1901 is now available in the Stable channel.
- Version 1.19.10-gke.1000 is now available in the Stable channel.
- Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.18 to version 1.18.17-gke.1900 with this release.
- Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.19 to version 1.19.10-gke.1000 with this release.
Regular channel
- Version 1.19.10-gke.1600 is now available in the Regular channel.
- Version 1.20.6-gke.1000 is now available in the Regular channel.
- Version 1.19.9-gke.1400 is no longer available in the Regular channel.
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.19 to 1.19.9-gke.1900 with this release.
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.20 to 1.20.6-gke.1000 with this release.
Rapid channel
- Version 1.20.6-gke.1400 is now the default version in the Rapid channel.
- Version 1.21.1-gke.400 is now available in the Rapid channel.
- Version 1.20.6-gke.1000 is no longer available in the Rapid channel.
- Version 1.21.1-gke.100 is no longer available in the Rapid channel.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.20 to 1.20.6-gke.1400 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.21 to 1.21.1-gke.400 with this release.
If you manually upgrade your cluster from 1.18 to 1.19 and the network tier configuration on an existing external network load balancer does not match the network tier annotation in the service spec (if unspecified, defaults to Premium), the load balancer will be deleted and recreated, and the network tier configuration will be enforced.
A domain-scoped project is not supported in GKE version 1.20. The cluster's CertificateSigningRequest will be denied when validating the DNS name and the nodes cannot join the cluster.
1.20 is now generally available
Kubernetes 1.20 is now generally available (GA). Before upgrading, read the Kubernetes 1.20 Release Notes especially the Urgent upgrade notes and Deprecations sections.
The node.k8s.io/v1beta1 RuntimeClass API has graduated to node.k8s.io/v1
with no changes. API clients and manifests should switch to using the
node.k8s.io/v1 API after version 1.20. The node.k8s.io/v1beta1 API is
deprecated and will no longer be served starting in version 1.25.
As of version 1.20, the kubelet no longer creates the target_path for
NodePublishVolume in accordance with the CSI spec. If you have self-managed CSI
drivers deployed in your cluster, ensure that they are idempotent and do any
necessary mount creation or verification. For more information, see Kubernetes
issue #88759.
Starting in version 1.20, timeouts on exec probes are honored, and default to 1 second if unspecified. If you have Pods using exec probes, ensure that they can easily complete in 1 second or explicitly set an appropriate timeout. For more information, see ConfigureProbes.
Non-deterministic treatment of objects with invalid ownerReferences
was fixed in version 1.20.
Run the kubectl-check-ownerreferences
tool prior to upgrade to locate existing objects with invalid ownerReferences.
A namespaced object with an
ownerReferenceto another namespaced object which does not exist in the same namespace is now consistently treated as having a missing owner and is deleted.A cluster-scoped object with an
ownerReferenceto a namespaced object is now consistently treated as having an unresolvable owner, and is ignored by the garbage collector.Starting in version 1.20, when a namespace mismatch between a child and owner object is detected, an event with a reason code of
OwnerRefInvalidNamespaceis recorded.
The metadata.selfLink field, deprecated since version 1.16,
is no longer populated in version 1.20. See Kubernetes issue #1164
for details. A related bug in the k8s.io/client-golibrary
in the GetReference function was fixed in versions 0.15.9 or later, 0.16.4 or
later, and 0.17.0 or later. Clients using the GetReference function should
upgrade to one of those versions of client-go or newer in order to work
correctly against an API Server running version 1.20 or later.
Reminder: Future beta API removals in versions 1.22 and 1.25
Kubernetes versions 1.22 and 1.25 will stop serving several deprecated beta APIs. It is recommended to begin migrating your clients and manifests to the stable replacement APIs now. More information is available in the OSS Kubernetes documentation.
Integration with Document AI VPC Service Controls is now generally available.
If you enable PROXY protocol for a Private Service Connect service attachment, the PROXY protocol header value was previously either 0xEA or 0xE0. Starting today, the value will always be 0xE0.
June 08, 2021
AI Platform PredictionRuntime version 2.5 is now available. You can use runtime version 2.5 to serve online predictions with TensorFlow 2.5.1, scikit-learn 0.24.1, or XGBoost 1.4.0. Runtime version 2.5 does not support batch prediction.
See the full list of updated dependencies in runtime version 2.5.
Anthos clusters on VMware 1.5.4-gke.2 is now available. To upgrade, see Upgrading Anthos clusters on VMware. Anthos clusters on VMware 1.5.4-gke.2 runs on Kubernetes v.1.17.9-gke.4400. The supported versions that offer the latest patches and updates for security vulnerabilities, exposures, and issues impacting Anthos clusters on VMware are 1.7, 1.6, and 1.5.
Fixes
These security vulnerabilities have been fixed:
Fixed CVE-2021-25735 mentioned in the GCP-2021-003 Security Bulletin, CVE-2021-31535, and other medium and low vulnerability CVEs with fixes available.
Committed use discounts for Google Kubernetes Engine (GKE) are now Generally Available to purchase for workloads running on GKE Autopilot.
They provide discounted prices in exchange for your commitment to use a minimum level of resources for a specified term. The spend-based committed use discounts apply to all GKE Autopilot Pod workload CPU, memory, and ephemeral storage usage in the region in which you have committed. This gives you low, predictable costs, without the need to make any manual changes or updates yourself. This flexibility saves you time and helps you to save more by achieving high utilization rates across your commitments.
GKE Autopilot Mode commitments do not apply to the cluster management fee or to GKE Standard mode compute nodes.
See the documentation for more details.
You can check for VPN tunnel overutilization using the VPN tunnel utilization recommender. A recommender is a service in Google Cloud that provides usage recommendations for cloud resources.
Generally available: You can configure how your regional managed instance group distributes instances across zones by using capacity-aware distribution shapes, which can automatically deploy instances to zones where capacity is available and optionally prioritize the use of reservations.
Preview: When rolling out configuration or application updates to a stateful or stateless managed instance group, use the minimum and most disruptive allowed actions to control disruption to your workload.
Custom image limitation: Currently, the following Dataproc image versions are the latest images that can be used as the base for custom images:
- 1.3.89-debian10, 1.3.89-ubuntu18
- 1.4.60-debian10, 1.4.60-ubuntu18
- 1.5.35-debian10, 1.5.35-ubuntu18, 1.5.35-centos8
- 2.0.9-debian10, 2.0.9-ubuntu18, 2.0.11-centos8
Transition the underlying OS used by Migrate for Compute Engine components (Manager, Cloud Extensions, Importers, and Exporters) to use Ubuntu Advantage.
The Resource Settings API has entered general availability. You can use Resource Settings to centrally configure settings for your Google Cloud projects, folders, and organization. For more information, see Resource Settings overview.
June 07, 2021
Anthos clusters on VMwareAnthos clusters on VMware 1.6.3-gke.3 is now available. To upgrade, see Upgrading Anthos clusters on VMware. Anthos clusters on VMware 1.6.3-gke.3 runs on Kubernetes v1.18.18-gke.100. The supported versions offering the latest patches and updates for security vulnerabilities, exposures, and issues impacting Anthos clusters on VMware are 1.7, 1.6, and 1.5.
Fixes
These security vulnerabilities have been fixed:
Fixed CVE-2021-25735 mentioned in the GCP-2021-003 Security Bulletin, CVE-2021-31535, and other medium and low vulnerability CVEs with fixes available.
BigQuery now supports parameterized types. The following parameterized types are supported:
This feature is in Preview.
New resource types are now available.
The following resource types are now publicly available through the Export APIs (ExportAssets and BatchGetAssetsHistory) and the Feed API:
- Cloud Redis
redis.googleapis.com/Instance
New versions of Cloud Composer images:
- composer-1.17.0-preview.2-airflow-2.0.1
- composer-1.16.6-airflow-1.10.15
- composer-1.16.6-airflow-1.10.14 (default)
- composer-1.16.6-airflow-1.10.12
You can now store values for the smtp_password Airflow configuration option in Secret Manager.
Increased the timeout for environment upgrade operations to support upgrades for databases up to 16 GB in size. If an upgrade operation times out and the Airflow database size is more than 10 GB, a warning message about the database size is generated.
Fixed memory issues that occurred while syncing files on machine types with more than 8 vCPUs.
DAG parsing and task processing in Airflow no longer fails because of incorrectly formatted Airflow logs. This happened due to a bug in Airflow log message formatting. Before this fix, errors related to sensor tasks with reschedule intervals shorter than scheduler processing time were not displayed.
(New environments only) Some log messages related to Airflow web server access were previously missing in Cloud Logging. This problem is fixed and these messages now appear in Cloud Logging.
(Available without upgrading) Updating environment labels now correctly overrides previous labels in billing reports.
Cloud Composer 1.10.4 has reached its end of full support period.
Cloud Functions now supports Ruby 2.6 and 2.7 at the General Availability release level.
Cloud SQL now offers faster maintenance, with connectivity dropping for less than 60 seconds on average.
Cloud SQL now offers faster maintenance, with connectivity dropping for less than 60 seconds on average.
Cloud SQL now offers faster maintenance, with connectivity dropping for less than 120 seconds on average.
Cloud TPU now supports Tensorflow 2.5.0. For more information, see Tensorflow 2.5.0 Release Notes
You can now specify the default image type to use for new auto-provisioning node pools. See Using node auto-provisioning for more details.
Security Command Center Legacy, previously known as Cloud Security Command Center, and Event Threat Detection Legacy have been permanently disabled.
To continue benefiting from Security Command Center, you must migrate your organizations to Security Command Center's free Standard tier or Premium tier. Event Threat Detection, a built-in service of Security Command Center, is available only in the Premium tier.
For information on upgrading to Security Command Center Standard or Premium, see Migrate from legacy Security Command Center products. To inquire about flexible pricing options for the Premium tier, complete our Premium inquiry form. You should receive a response within two US business days.
String processing functions are now available in the text module of the Workflows standard library.
June 04, 2021
Artifact RegistryMaven, npm, and Python repositories are now in Preview.
Storage and network egress charges apply to all formats that are in Preview or are generally available.
Cloud Asset Inventory Console Preview is now publicly available. It enables you to see insights about Google Cloud footprint, details and history of resources, and provides powerful and easy filtering and search capabilities.
Both the Cloud SQL Java Connector and Cloud SQL Python Connector now support IAM Authentication for PostgreSQL.
We are replacing the Insert a row and Edit a row data forms in the Cloud Console with pre-populated DML query templates on the Query page. These templates provide you more flexibility when adding and editing data. Learn More
Dialogflow CX will have new pricing on September 1, 2021. For details, see the pricing documentation. In summary, the new pricing will be:
- Text: $0.007/request
- Audio: $0.06/minute
The security community recently disclosed a new security vulnerability CVE-2021-30465 found in runc that has the potential to allow full access to a node filesystem.
For more information, see the GCP-2021-011 security bulletin.
The Private Service Connect Published Services tab in the Google Cloud Console now correctly displays service attachments. You can now view and manage service attachments using the Console, the gcloud command-line tool, or the API
When a Private Service Connect consumer endpoint is deleted, the service attachment details now correctly reflects this change.
June 03, 2021
Anthos GKE on AWSAnthos clusters on AWS 1.7.2-gke.0 is now available.
Anthos clusters on AWS 1.7.2-gke.0 clusters run the following Kubernetes versions:
- 1.16.15-gke.18500
- 1.17.17-gke.8200
- 1.18.18-gke.1500
- 1.19.10-gke.1500
The Anthos clusters on AWS 1.7.2-gke.0 release addresses the following vulnerabilities:
Artifact Registry now supports Access Transparency. Access Transparency provides you with logs of actions that Google staff have taken when accessing your data. To learn more about Access Transparency, see the Overview of Access Transparency.
New resource types are now available.
The following resource types are now publicly available through the Export APIs (ExportAssets and BatchGetAssetsHistory) and the Feed API:
- Cloud Bigtable
bigtableadmin.googleapis.com/AppProfile
Request timeouts up to 60 minutes are now at general availability (GA).
N2D machine types are now available in us-west4-a , Las Vegas, Nevada. See VM instance pricing for details.
June 02, 2021
AnthosAnthos 1.7.2 is now available.
Updated components
Release 1.7.2
Anthos clusters on bare metal release 1.7.2 is now available. To upgrade, see Upgrading Anthos on bare metal. Anthos clusters on bare metal 1.7.2 runs on Kubernetes 1.19.
Fixes:
- Fixed CVE-2021-25735 that could allow node updates to bypass a Validating Admission Webhook. For more details, open the Anthos clusters on bare metal tab of the GCP-2021-003 security bulletin.
- Resolved the
bmctl snapshotcommand failure when the user creates a custom cluster namespace omitting "cluster-" prefix from the cluster config file. The prefix is no longer required for a custom cluster namespace. - Added webhook blocks to prevent users from modifying control plane node pool and load balancer node pool resources directly. Control plane and load balancer node pools for Anthos clusters on bare metal are specified in the cluster resource, using the
spec.controlPlane.nodePoolSpecandspec.LoadBalancer.nodePoolSpecsections of the cluster config file respectively. - Fixed the cluster upgrade command,
bmctl upgrade cluster, to prevent it from interfering with user-installed Anthos Service Mesh (ASM).
Functionality changes:
- Updated the
bmctl check snapshotcommand so that it includes certificate signing requests in the snapshot. - Changed the upgrade process to prevent node drain issues from blocking upgrades. The upgrade process triggers a node drain. Now, if the node drain takes longer than 20 minutes, the upgrade process carries on to completion even when the draining hasn't completed. In this case, the upgrade output reports the incomplete node drain. Excessive drain times signal a problematic with pods. You may need to restart problem pods.
- Updated cluster creation process,
bmctl create cluster, to display logged errors directly on the command line. Prior to this release, detailed error messages were only available in the log files.
Known issues:
- Node logs from nodes with a dot (".") in their name are not exported to Cloud Logging. For workaround instructions, see Node logs aren't exported to Cloud Logging in Anthos clusters on bare metal known issues.
For information about the latest known issues, see Anthos clusters on bare metal known issues in the Troubleshooting section.
MEDICAL_TERM infoType detector is now available in all regions.
Cloud Code plugin updated to v1.12.0.
Update includes the ability to build with Cloud Build when deploying to Cloud Run or Running/Debugging on Kubernetes. Review the Cloud Code release notes for a complete list of features/updates/bug fixes.
Golang plugin updated to v0.23.0.
Update includes improved debugging workflow of attaching to local process, and access to Delve DAP (again). Review the Golang release notes for a complete list of features/updates/bug fixes.
Cloud Shell Editor is now built with Theia v1.14.0
Update includes improved plugin support, better debug configuration handling, as well as support for "goto line and column" in file search. Review the Theia release notes for a complete list of features/updates/bug fixes.
Config Connector 1.51.2 is now available.
Miscellaneous bug fixes.
M71 release
- Upgraded TensorFlow Probability, TensorFlow I/O, and TensorFlow Estimator in TensorFlow 2.5 containers.
M71 Release
- Refreshed the Debian-10 images (Ubuntu images not refreshed in this release).
- Upgraded TensorFlow Probability, TensorFlow I/O, and TensorFlow Estimator in TensorFlow 2.5 images.
- Added support for a Post Startup script and provided status in guest attributes.
- TensorFlow 2.x image names are now available in two formats: tf-xxx-2-y-zzz (the new standard format) tf2-xxx-2-y-zzz (the previous standard format). Image names in the previous standard format will be deprecated in a future release.
Support for Go is added to Traffic Director service security with proxyless gRPC.
Transfer Appliance offers the Transfer Appliance Cloud Setup Application. The application prompts for several settings, and uses the information you provide to configure your Google Cloud permissions, preferred Cloud Storage bucket, and Cloud KMS key for your transfer.
Publishing services and accessing published services using Private Service Connect is now available in Preview.
Private Service Connect service attachment details always show a status of Accepted for consumer endpoints, even if they have a different status. The status is correctly displayed in the consumer endpoint details.
When a Private Service Connect consumer endpoint is deleted, the service attachment details do not reflect this change.
Updating a Private Service Connect service attachment using the PATCH API method requires that you provide all values in the request body, not just the values that you are updating. This affects Managing access requests for a service and Changing the connection preference for a service.
If you enable PROXY protocol for a Private Service Connect service attachment, the PROXY protocol header value might be 0xEA or 0xE0. After General Availability, the value will always be 0xE0.
If you publish a service using Private Service Connect, and the referenced load balancer does not have any backend VMs, all Private Service Connect endpoints in the consumer network might become unresponsive. Make sure that that all load balancers that are referenced by a service attachment have backend VMs.
If you want to create a Private Service Connect endpoint in a Shared VPC network, the endpoint must be created in the same project that contains the virtual machines (VMs) that send requests to the endpoint.
The Private Service Connect Published Services tab in the Google Cloud Console does not display service attachments. Use the gcloud command-line tool or the API to view and manage service attachments.
June 01, 2021
ChronicleChronicle Automated GCP Log Ingestion
Google Cloud customers can now send logs directly to their Chronicle account. Customers can send both Cloud Audit and Cloud DNS logs. See Ingesting GCP Logs in to Chronicle for more information.
A JSON editor has been integrated with the dashboard page. In addition to using the JSON editor to change the contents of the dashboard, you can save the current dashboard definition to a local system, and you can upload a dashboard definition to your Google Cloud project. For more information, see Managing dashboards through the Cloud Console.
CloudSQL for MySQL now supports the MySQL flags expire_logs_days (for MySQL 5.6 and 5.7) and binlog_expire_logs_seconds (for MySQL 8.0). Note that if you enable point-in-time recovery, the expiration period of your binary logs will be determined by the lesser of your transaction log retention period and the value of these flags.
The logical replication and decoding functionality of PostgreSQL is available as a preview. These features enable logical replication workflows and change data capture workflows.
For more information, see Setting up logical replication and decoding.
Cloud SQL for PostgreSQL now supports the pg_similarity extension, which provides support for similarity queries in PostgreSQL.
Also, the default value for the database flag autovacuum_vacuum_cost_delay is changed to 2 milliseconds in PostgreSQL 9.6, 10 and 11.
The minor versions for various extensions have also been upgraded:
| 9.6 | 10 | 11 | 12 | 13 | |
|---|---|---|---|---|---|
| address_standardizer | not avail | 2.4.9 | 2.5.5 | 3.0.2 | 3.0.2 |
| hll | 2.14 | 2.14 | 2.14 | 2.14 | 2.14 |
| pg_repack | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 |
| pgaudit | 1.1.3 | 1.2.3 | 1.3.2 | 1.4.1 | no change |
| pglogical | 2.3.3 | 2.3.3 | 2.3.3 | 2.3.3 | 2.3.3 |
| pl/proxy | 2.10.0 | 2.10.0 | 2.10.0 | 2.10.0 | 2.10.0 |
| postgis | 2.3.11 | 2.4.9 | 2.5.5 | 3.0.2 | 3.0.2 |
New Cloud TPU VMs make training your ML models on TPUs easier than ever
The new Cloud TPU VM architecture makes it easier than ever before to use our industry-leading TPU hardware. The Cloud TPU VMs provide direct access to TPU host machines, offering a new and improved user experience for developing and deploying TensorFlow, PyTorch, and JAX on Cloud TPUs. Instead of accessing Cloud TPUs remotely over the network, Cloud TPU VMs let you set up your own interactive development environment on each TPU host machine. Now you can write and debug an ML model line-by-line using a single TPU VM, and then scale it up on a Cloud TPU Pod slice to take advantage of the super-fast TPU interconnects. You have root access to every TPU VM you create, so you can install and run any code you wish in a tight loop with your TPU accelerators. You can use local storage, execute custom code in your input pipelines, and more easily integrate Cloud TPUs into your research and production workflows. Google supports Cloud TPU integrations with TensorFlow, PyTorch, and JAX, and you can even write your own integrations via a new libtpu shared library on the VM. For more information, see https://cloud.google.com/blog/products/compute/introducing-cloud-tpu-vms
Preview: Access the Compute Engine API using Cloud Client Libraries built on our latest client library model. Updated client libraries are now available in the following languages:
- Java
- .NET
- Node.js
- PHP
- Python
- Ruby
For more information, see Compute Engine client libraries.
New sub-minor versions of Dataproc images: 1.3.91-debian10, 1.3.91-ubuntu18, 1.4.62-debian10, 1.4.62-ubuntu18, 1.5.37-centos8, 1.5.37-debian10, 1.5.37-ubuntu18, 2.0.11-centos8, 2.0.11-debian10, and 2.0.11-ubuntu18.
Image 1.3 - 2.0
All jobs now share a single
JobthreadPool.The number of Job threads in the Agent is configurable with the
dataproc:agent.process.threads.job.minanddataproc:agent.process.threads.job.maxcluster properties, defaulting to 10 and 100, respectively. The previous behavior was to always use 10 Job threads.
Image 2.0
- Added snappy-jar dependency to Hadoop.
- Upgraded versions of Python packages:
nbdime 2.1->3.0,pyarrow 2.0->3.0,spyder 4.2->5.0,spyder-kernels 1.10->2.0,regex 2020.11->2021.4.
Image 1.5 and 2.0
- Agnets no longer publish a
/has_run_beforesentinel file. If you use a fork of connectors initialization-actions, then sync from head.
Image 1.3 - 2.0
- SPARK-35227: Replace Bintray with the new repository service for the spark-packages resolver in SparkSubmit.
Image 2.0
Fixed the problem that the environment variable PATH was not set in YARN containers.
SPARK-34731: ConcurrentModificationException in EventLoggingListener when redacting properties.
As of June 1 2021 all Transfer service for on-premises projects added a per-project service account. Actions are required before September 1, 2021 to ensure minimal disruptions to your transfers. Please check your email for detailed instructions.
May 28, 2021
Google Kubernetes Engine1.21 available in the Rapid channel
Kubernetes version 1.21 is now available in the Rapid channel. Before upgrading, read the Kubernetes 1.21 Release Notes, especially the action required and deprecation sections.
1.21 Features
The following features are introduced in version 1.21:
CronJob (GA)
The CronJob API has graduated to General Availability (GA), bringing performance improvements and allowing scheduled jobs to be run using a stable API.
- This resource is now available in the
batch/v1group/version. - The
batch/v1beta1group/version is deprecated, and will be removed in version 1.25. See the migration guide for details.
PodDisruptionBudget (GA)
The PodDisruptionBudget has graduated to GA, allowing pod evictions to be controlled using a stable API.
- This resource is now available in the
policy/v1group/version. - The
policy/v1beta1group/version is deprecated, and will be removed in version 1.25. See the migration guide for details.
EndpointSlice (GA)
The EndpointSlice API has graduated to GA, bringing performance improvements over the v1 Endpoints API.
- This more scalable API for service discovery is now enabled on all clusters
and is promoted to
discovery.k8s.io/v1. - The
discovery.k8s.io/v1beta1group/version is deprecated, and will be removed in version 1.25. See the migration guide for details.
Default namespace label (Beta)
Namespace API objects now have a kubernetes.io/metadata.name label matching
their metadata.name field to allow selecting any namespace by its name using a
label selector. This can be used for objects which select namespaces by label,
such as admission webhooks
and network policies.
Bound service account token volumes (Beta)
- The API credentials injected into containers at
/var/run/secrets/kubernetes.io/serviceaccount/tokenare now time-limited, auto-refreshed, and invalidated when the containing pod is deleted. - By default, injected tokens are given an extended lifetime so they remain
valid even after a new refreshed token is provided. The metric
serviceaccount_stale_tokens_totaland the audit annotationauthentication.k8s.io/stale-tokencan be used to monitor for workloads that depend on the extended lifetime and are continuing to use tokens even after a refreshed token is provided to the container. - Clients should reload the token from disk periodically (once per minute is
recommended) to ensure they use the refreshed token.
k8s.io/client-goversion 11.0.0+ and 0.15.0+ reload tokens automatically.
In Kubernetes 1.21, newly provisioned PersistentVolumes by gce-pd will use the
topology.kubernetes.io/zone GA label instead of the failure-domain.beta.kubernetes.io/zone
beta label.
1.21 New Beta and Stable APIs
The following Stable APIs are new in 1.21:
- batch/v1 CronJob
- policy/v1 PodDisruptionBudget
- discovery.k8s.io/v1 EndpointSlice
The following Beta APIs are new in 1.21:
- storage.k8s.io/v1beta1 CSIStorageCapacity
1.21 Deprecated APIs
The following APIs are deprecated in the 1.21 release:
- PodSecurityPolicy
- policy/v1beta1 PodSecurityPolicy
- Deprecated in 1.21 with removal targeted for version 1.25.
- The following Beta versions of newly graduated APIs will be removed in 1.25 in favor of GA versions:
- discovery.k8s.io/v1beta1 EndpointSlice
- policy/v1beta1 PodDisruptionBudget
- batch/v1beta1 CronJob
- The following Beta versions of previously graduated APIs will be removed in 1.22 in favor of GA versions:
- admissionregistration.k8s.io/v1beta1, MutatingWebhookConfiguration
- admissionregistration.k8s.io/v1beta1, ValidatingWebhookConfiguration
- apiextensions.k8s.io/v1beta1, CustomResourceDefinition
- apiregistration.k8s.io/v1beta1, APIService
- authentication.k8s.io/v1beta1, TokenReview
- authorization.k8s.io/v1beta1, LocalSubjectAccessReview
- authorization.k8s.io/v1beta1, SelfSubjectAccessReview
- authorization.k8s.io/v1beta1, SubjectAccessReview
- certificates.k8s.io/v1beta1, CertificateSigningRequest
- coordination.k8s.io/v1beta1, Lease
- extensions/v1beta1, Ingress
- networking.k8s.io/v1beta1, Ingress
- networking.k8s.io/v1beta1, IngressClass
- rbac.authorization.k8s.io/v1beta1, ClusterRole
- rbac.authorization.k8s.io/v1beta1, ClusterRoleBinding
- rbac.authorization.k8s.io/v1beta1, Role
- rbac.authorization.k8s.io/v1beta1, RoleBinding
- scheduling.k8s.io/v1beta1, PriorityClass
- storage.k8s.io/v1beta1, CSIDriver
- storage.k8s.io/v1beta1, CSINode
- storage.k8s.io/v1beta1, StorageClass
- storage.k8s.io/v1beta1, VolumeAttachment
(2021-R18) Version updates
GKE cluster versions have been updated.
New versions available for upgrades and new clusters
The following Kubernetes versions are now available for new clusters and for opt-in control plane upgrades and node upgrades for existing clusters. For more information on versioning and upgrades, see GKE versioning and support and Upgrades.
No channel
- Version 1.19.9-gke.1900 is now the default version.
- Version 1.18.18-gke.1700 is now available.
- Version 1.19.10-gke.1700 is now available.
- Version 1.18.17-gke.100 is no longer available.
- Version 1.19.8-gke.1600 is no longer available.
Stable channel
- Version 1.18.17-gke.1200 is now the default version in the Stable channel.
- Version 1.18.17-gke.1900 is now available in the Stable channel.
- Version 1.17.17-gke.4900 is no longer available in the Stable channel.
- Version 1.17.17-gke.5400 is no longer available in the Stable channel.
- Version 1.18.17-gke.700 is no longer available in the Stable channel.
- Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.18 to version 1.18.17-gke.1200 with this release.
Regular channel
- Version 1.19.9-gke.1900 is now the default version in the Regular channel.
Rapid channel
- Version 1.20.6-gke.1400 is now available in the Rapid channel.
- Version 1.21.1-gke.100 is now available in the Rapid channel.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.21 to 1.21.1-gke.100 with this release.
GKE clusters running version 1.18 or later now support container native Cloud DNS (available in Preview). Cloud DNS can be used as the in-cluster DNS provider instead of kube-dns.
May 27, 2021
Anthos clusters on VMwareAnthos clusters on VMware 1.7.2-gke.2 is now available. To upgrade, see Upgrading Anthos clusters on VMware. Anthos clusters on VMware 1.7.2-gke.2 runs on Kubernetes 1.19.10-gke.1602.
The supported versions that offer the latest patches and updates for security vulnerabilities, exposures, and issues impacting Anthos clusters on VMware are 1.7, 1.6, and 1.5.
The Ubuntu node image shipped in version 1.7.2 is qualified with the CIS (Center for Internet Security) L1 Server Benchmark.
Fixes:
These security vulnerabilities have been fixed:
- CVE-2021-25735, which is mentioned in the GCP-2021-001 security bulletin. CVE-2020-29362, CVE-2020-29361, CVE-2021-24031, CVE-2021-31535
Fixed the 1.7.1 issue where Log Forwarder sends an excessive number of OAuth 2.0 requests.
An admin cluster upgrade may fail due to an expired front-proxy-client certificate on the admin control plane node. Make sure that the certificate is not expired, and recreate it if needed. See: Renew an expired certificate.
Cloud Data Fusion version 6.4.1 is now available. To upgrade, see Upgrading instances and pipelines. This release is in parallel with the CDAP 6.4.1 release.
In Cloud Data Fusion version 6.4.1, Replication supports the Datetime data type in BigQuery targets. You can now read and write to tables that contain Datetime fields.
Fixed in 6.4.1 (for more information, see the CDAP release note):
Fixed an issue that caused pipelines with aggregations and Decimal fields to fail with an exception.
Fixed the Join Condition Type so that it is displayed in the Joiner plugin for pipelines that were upgraded from versions before 6.4.0.
Fixed Wrangler so that pipelines fail when there is an error. In Wrangler 6.2 and above, there was a backwards-incompatible change where pipelines did not fail if there was an error and were instead marked as complete.
Fixed an issue that prevented new previews from being scheduled after the preview manager had been stopped ten times.
Fixed an issue while writing non-null values to a nullable field in BigQuery.
Fixed an issue in the BigQuery plugins to correctly delete temporary storage buckets.
Fixed an issue in the BigQuery sink that caused pipelines to fail when the input schema was not provided.
Fixed an issue in the BigQuery sink that caused pipelines to fail or give incorrect results.
Fixed an issue that caused pipelines to fail when a Pub/Sub source Subscription field was a macro.
We've enhanced the experience for creating, updating, and deleting schemas in the Cloud Console. On a database's Overview page you'll now find a Write DDL link to the DDL editor where you can perform all these activities.
Config Connector 1.51.1 is now available
Miscellaneous bug fixes.
Prevent panic in reconcilers when a Space is not found.
Added support for the Reserved Memory configuration for Memorystore for Memcached. For more information, see Memory management best practices.
May 26, 2021
Anthos Config ManagementHierarchy Controller has been updated to use HNC v0.8.0.
Increased reconciler memory limit to 300Mi.
The output of the nomos hydrate command does not pass nomos vet and cannot be synced using Config Sync without modifying the output. To work around this, we recommend removing the following annotations: configmanagement.gke.io/cluster-name , configmanagement.gke.io/source-path and removing label configsync.gke.io/declared-version
from the output so that the output can be successfully synced.
The nomos hydrate command attempts to connect to the API Server even if --no-api-server-check is passed. This behavior can be safely ignored in CI as if the CLI is unable to connect to the API Server it will not produce errors resulting from being unable to connect.
The Cloud Bigtable Service Level Agreement (SLA) has been updated.
Starting May 15, 2021, a newly-created custom static route using a next hop forwarding rule of an internal TCP/UDP load balancer will forward all protocol traffic, not just TCP and UDP traffic.
If a route created before May 15, 2021 is still in operation on August 14, 2021, it will automatically be migrated to forward all protocol traffic starting August 15, 2021. If you don't want to wait until then, you can enable forwarding of traffic for all protocols by creating new routes and deleting the old ones.
For more information, see Processing of TCP, UDP, and other protocol traffic.
Cloud Shell Editor now supports Cloud Code v1.11.0
Preview: Disable simultaneous multithreading (SMT) on VMs. For more information, see Disabling simultaneous multithreading.
Datastream is a serverless and easy-to-use change data capture (CDC) and replication service. It allows you to synchronize data across heterogeneous databases and applications reliably, and with minimal latency and downtime.
Datastream supports streaming from Oracle and MySQL databases into Cloud Storage. The service offers streamlined integration with Dataflow templates to power up-to-date materialized views in BigQuery for analytics, replicate your databases into Cloud SQL or Spanner for database synchronization, or leverage the event stream directly from Cloud Storage to realize event-driven architectures.
Benefits of Datastream include:
- Being serverless so there are no resources to provision or manage, and the service scales up and down automatically, as needed, with minimal downtime.
- Easy-to-use setup and monitoring experiences that achieve super-fast time-to-value.
- Integration across the best of Google Cloud data services' portfolio for data integration across Datastream, Dataflow, Data Fusion, Pub/Sub, BigQuery, and more.
- Synchronizing and unifying data streams across heterogeneous databases and applications.
- Security, with private connectivity options and the security you expect from Google Cloud.
- Being accurate and reliable, with transparent status reporting and robust processing flexibility in the face of data and schema changes.
- Supporting multiple use cases, including analytics, database replication, and synchronization for migrations and hybrid-cloud configurations, and for building event-driven architectures.
Documentation for Datastream includes a quickstart, conceptual content, how to use this service through the user interface, REST API calls, and gcloud, an API tutorial, and reference, support, and resource-related information. Click here to access the documentation.
The Cloud documentation now includes a list of partners whose solutions are integrated with Network Connectivity Center.
The process for migrating a project from one organization to another has released into general availability. To make it easier to see the impact a project migration will have on your organization, you can use the Cloud Asset Inventory Analyze Move API to get a detailed report before performing a move. For more information, see Migrating projects and Analyze project move.
GA: Google Cloud monitoring agent for SAP HANA, version 2
Version 2.0 of the monitoring agent for SAP HANA is now generally available. V2.0 represents a complete refactoring of the monitoring agent for SAP HANA. A new Cloud Monitoring dashboard template for SAP HANA data is now also available for use with V2.0.
For more information, see Monitoring agent for SAP HANA V2.0 planning guide.
May 25, 2021
BigQuery BI EngineThe free trial period for BigQuery BI Engine's SQL interface has been extended to July 15th, 2021. You must enroll to participate in the preview. With this feature, BI Engine now interacts with popular BI tools such as Looker, Tableau, and more, by means of an interactive SQL interface.
Generally Available: Enable nested virtualization directly when creating a VM. For more information, see Nested virtualization overview.
Added security bulletin for the VMware Engine response to VMware security advisory VMSA-2021-0010.
You can now use the Cloud Console to create hubs and spokes in Network Connectivity Center.
May 24, 2021
Cloud Asset InventoryNew resource types are now available.
The following resource types are now publicly available through the Export APIs (ExportAssets and BatchGetAssetsHistory) and the Feed API:
- Artifact Registry
artifactregistry.googleapis.com/Repository
Config Connector 1.51.0 is now available
Added field spec.basic.conditions[].devicePolicy.osConstraints[].requireVerifiedChromeOs to AccessContextManagerAccessLevel
Added field spec.externalDataConfiguration.hivePartitioningOptions.requirePartitionFilter to BigQueryTable
Added field spec.initialGroupConfig to CloudIdentityGroup
Added field spec.initialSize to ComputeNodeGroup
Added field spec.maintenanceWindow to ComputeNodeGroup
Added field spec.replication.userManaged.replicas[].customerManagedEncryption to SecretManagerSecret
Added field spec.encryptionConfig to SpannerDatabase
Added support for specifying an IP address range for the private service access connection mode. For more information, see Custom ranges with private services access.
The Secret Manager SLA has been updated.
Security Command Center Premium has launched project- and folder-level roles in general availability. The feature lets you grant users Identity and Access Management (IAM) roles for specific folders and projects. You have more granular control over who can access what resources throughout your organization. For more information, see Access control.
You must be a Security Command Center Premium customer to use this feature. Security Command Center Standard continues to support granting roles only at the organization level. To subscribe to Security Command Center Premium, contact your sales representative or fill out our inquiry form.
Security Command Center now supports two versions of CIS Benchmarks for Google Cloud Platform Foundation:
- CIS Google Cloud Computing Foundations Benchmark v1.1.0 (CIS Google Cloud Foundation 1.1)
- CIS Google Cloud Computing Foundations Benchmark v1.0.0 (CIS Google Cloud Foundation 1.0)
For more information about supported compliance standards, see Detectors and compliance.
Security Health Analytics, a built-in service of Security Command Center, has expanded the number of detectors in the Standard tier. The Standard tier, which is free of charge, now includes the following detectors:
LEGACY_AUTHORIZATION_ENABLED: Legacy Authorization is enabled on Google Kubernetes Engine (GKE) clusters.OPEN_CISCOSECURE_WEBSM_PORT: A firewall is configured to have an open CISCOSECURE_WEBSM port that allows generic access.OPEN_DIRECTORY_SERVICES_PORT: A firewall is configured to have an open DIRECTORY_SERVICES port that allows generic access.OPEN_TELNET_PORT: A firewall is configured to have an open TELNET port that allows generic access.PUBLIC_COMPUTE_IMAGE: A Compute Engine image is publicly accessible.
For a complete list of detectors in the Standard tier, see Pricing. For detailed information about all Security Health Analytics detectors, see Vulnerabilities findings.
Speech-to-Text now supports Spoken Punctuation and Spoken Emoji as Preview features. See the documentation for details.
May 21, 2021
Anthos clusters on VMwareIn Anthos clusters on VMware 1.7, logs are sent to the parent project of your logging-monitoring service account. That is, logs are sent to the parent project of the service account specified in the stackdriver.serviceAccountKeyPath field of your cluster configuration file. The value of stackdriver.projectID is ignored. This issue will be fixed in an upcoming release.
As a workaround, view logs in the parent project of your logging-monitoring service account.
New versions of Cloud Composer images:
- composer-1.17.0-preview.1-airflow-2.0.1
- composer-1.16.5-airflow-1.10.15
- composer-1.16.5-airflow-1.10.14 (default)
- composer-1.16.5-airflow-1.10.12
Error messages about PyPI package conflicts now contain links to corresponding cluster build logs.
Cloud Composer 1.10.3 has reached its end of full support period.
Network Policy Logging is generally available (GA). Note that Network Policy Logging requires Dataplane V2.
May 20, 2021
Anthos Config ManagementIf Syncing from multiple repositories is enabled on a private GKE cluster, it's required to add a firewall rule to allow port 8676.
In version 1.7.1, the stackdriver-log-forwarder starts to consume significantly increasing memory after a period of time, and the logs show an excessive number of OAuth 2.0 token requests. Follow these steps to mitigate this issue.
- Updated Java SDK to version 1.9.89.
- Upgraded to Jetty version 9.4.41.v20210516.
- Stopped releasing Maven artifact
appengine-api-labs-1.9.xx.jar. Last release is 1.9.88.
BigQuery GIS now supports loading geography data from newline-delimited GeoJSON files. This feature is generally available (GA). For more information, see Loading GeoJSON data.
BigQuery GIS now supports the following functions. These functions are generally available (GA).
These functions return a point of a linestring geography as a point geography.
Policy Analyzer now supports evaluations on time-based conditions. See the user guide for more information.
Asset Insights are now available. See the user guide for more information.
Upgraded to Docker server version 20.10.6.
Cloud DNS monitoring dashboard is available in GA.
You can customize the Conda environment during cluster creation using new Conda-related cluster properties. See Using Conda-related cluster properties.
Added validation for clusters created with Dataproc Metastore services to determine compatibility between the Dataproc image's Hive version and the DPMS service's hive version
In GKE version 1.20 and later, audit logging does not occur for Binary Authorization fail open events.
May 19, 2021
Anthos Service MeshAnthos Service Mesh 1.6 is no longer supported. For more information see Supported versions.
BigQuery now supports the ability to rename tables using SQL. See ALTER TABLE RENAME TO. This feature is generally available (GA).
The Cloud KMS and Cloud HSM SLA has been updated.
Cloud SQL supports the preview version of the out-of-disk recommender. This feature proactively generates recommendations that helps you reduce the risk of downtime that might be caused by your instances running out of disk space. These recommendations can be applied when a Cloud SQL instance is trending towards the storage limit.
For information about pricing, prerequisites, and instructions for how to view the out-of-disk recommender, see Cloud SQL out of disk recommender.
Cloud SQL supports the preview version of the out-of-disk recommender. This feature proactively generates recommendations that helps you reduce the risk of downtime that might be caused by your instances running out of disk space. These recommendations can be applied when a Cloud SQL instance is trending towards the storage limit.
For information about pricing, prerequisites, and instructions for how to view the out-of-disk recommender, see Cloud SQL out of disk recommender.
Cloud SQL supports the preview version of the out-of-disk recommender. This feature proactively generates recommendations that helps you reduce the risk of downtime that might be caused by your instances running out of disk space. These recommendations can be applied when a Cloud SQL instance is trending towards the storage limit.
For information about pricing, prerequisites, and instructions for how to view the out-of-disk recommender, see Cloud SQL out of disk recommender.
Generally Available: You can now create VM instances with V100, A100, and T4 GPUs that support network bandwidths of up to 100 Gbps. See Using network bandwidths of up to 100 Gbps.
(2021-R17) Version updates
GKE cluster versions have been updated.
New versions available for upgrades and new clusters
The following Kubernetes versions are now available for new clusters and for opt-in control plane upgrades and node upgrades for existing clusters. For more information on the Kubernetes versioning scheme, see Versioning.
No channel
- Version 1.17.17-gke.8200 is now available.
- Version 1.18.18-gke.1100 is now available.
- Version 1.19.10-gke.1600 is now available.
- Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.17 to version 1.18.17-gke.700 with this release.
- Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.18 to version 1.18.17-gke.700 with this release.
Stable channel
- Version 1.18.17-gke.700 is now the default version in the Stable channel.
- Version 1.18.17-gke.1200 is now available in the Stable channel.
- Version 1.18.17-gke.100 is no longer available in the Stable channel.
- Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.17 to version 1.18.17-gke.700 with this release.
- Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.18 to version 1.18.17-gke.700 with this release.
Regular channel
- Version 1.19.9-gke.1900 is now available in the Regular channel.
- Version 1.18.17-gke.700 is no longer available in the Regular channel.
Rapid channel
- Version 1.20.6-gke.1000 is now the default version in the Rapid channel.
- Version 1.19.9-gke.1900 is no longer available in the Rapid channel.
- Version 1.19.10-gke.1000 is no longer available in the Rapid channel.
- The following control planes and nodes with auto-upgrade enabled in the
Rapid channel will be upgraded with this release:
- From version 1.18 to 1.19.9-gke.1900.
- From version 1.19 to 1.20.6-gke.1000.
- From version 1.20 to 1.20.6-gke.1000.
For GKE clusters running 1.18.18-gke.1200 or later, Ingress Controller only syncs NEGs that were created by the controller. Custom named NEGs that were created outside of the controller will no longer be synced.
Removed from the legacy PV-based Migrate for Anthos versions a Webhook that was simplifying the definition of Migrate for Anthos pods. This Webhook was not being used in any subsequent versions, including the latest 1.6 and 1.7 releases.
162275866: When generating migration artifacts, you no longer see the following error:
Error: failed to update vgenerateartifactsflow.kb.io
Traffic Director security service with GKE is now available in Public Preview. This provides the following:
Authentication and encryption using transport layer security (TLS) and mutual TLS (mTLS) for both Traffic Director with Envoy and proxyless gRPC applications. Server TLS policies and client TLS policies control whether services need to prove their identities to each other and use encrypted communication channels.
Authorization, based on characteristics of the client and the request. Authorization policies control whether a service is permitted to access another service, and which actions are allowed. Authorization is currently available only for Traffic Director with Envoy.
May 18, 2021
BigQuery MLThe CREATE MODEL statement for training AutoML Tables models is now generally available (GA). AutoML Tables enable you to automatically build state-of-the-art machine learning models on structured data at massively increased speed and scale. For more information, see CREATE MODEL statement for training AutoML Tables models.
Events for Cloud Run for Anthos version 0.21.0-gke.108 is now available for the following GKE minor versions:
- 1.19
- 1.20
- 1.21
AI Platform (Unified) is now Vertex AI.
Vertex AI has added support for custom model training, custom model batch prediction, custom model online prediction, and a limited number of other services in the following regions:
- us-west1
- us-east1
- us-east4
- northamerica-northeast1
- europe-west2
- europe-west1
- asia-southeast1
- asia-northeast1
- australia-southeast1
- asia-northeast3
Vertex AI now supports forecasting with time series data for AutoML tabular models, in Preview. You can use forecasting to predict a series of numeric values that extend into the future.
Vertex Pipelines is now available in Preview. Vertex Pipelines helps you to automate, monitor, and govern your ML systems by orchestrating your ML workflow.
Vertex Model Monitoring is now available in Preview. Vertex Model Monitoring enables you to monitor model quality over time.
Vertex Feature Store is now available in Preview. Vertex Feature Store provides a centralized repository for organizing, storing, and serving ML features.
Vertex ML Metadata is now available in Preview. Vertex ML Metadata lets you record the metadata and artifacts produced by your ML system so you can analyze the performance of your ML system.
Vertex Matching Engine is now available in Preview. Vertex Matching Engine enables vector similarity search.
Vertex TensorBoard is now available in Preview. Vertex TensorBoard enables you to track, visualize, and compare ML experiments.
May 17, 2021
Anthos Service Mesh1.9.5-asm.2, 1.8.6-asm.3, and 1.7.8-asm.8 are now available.
This release fixes the following security vulnerabilities:
For details on upgrading Anthos Service Mesh, refer to the following upgrade guides:
Anthos Service Mesh uses a proxy that is based on OSS Envoy. The Envoy version that the Anthos Service Mesh proxy uses differs by Anthos Service Mesh version, as follows:
- 1.9.5-asm.2: Envoy v1.17.1
- 1.8.6-asm.3: Envoy v1.16.3
- 1.7.8-asm.8: Envoy v1.15.4
Release 1.6.3
Anthos clusters on bare metal release 1.6.3 is now available. To upgrade, see Upgrading Anthos clusters on bare metal. Anthos clusters on bare metal 1.6.3 runs on Kubernetes 1.18.
Fixed:
- Fixed CVE-2021-25735 that could allow node updates to bypass a Validating Admission Webhook. For more details, open the Anthos clusters on bare metal tab of the GCP-2021-003 security bulletin.
- Fixed CVE-2021-28683, CVE-2021-28682, and CVE-2021-29258. For more details, open the Anthos clusters on bare metal tab of the GCP-2021-004 security bulletin.
Known issues:
When you upgrade Anthos clusters on bare metal from a version with a security patch to the next minor release, we recommend you upgrade to the highest patch version to ensure you have the latest security fixes. Always review the release notes before upgrading so you're aware of what has changed, including security fixes and known issues. Upgrading to a lower release version isn't supported.
For information about the latest known issues, see Anthos clusters on bare metal known issues in the Troubleshooting section.
Config Connector version 1.50.0 is now available.
Resource CRDs are now using apiextensions.k8s.io/v1. The minimum required Kubernetes version for using Config Connector v1.50.0 and above is Kubernetes 1.16. This change is in preparation for the removal of apiextensions.k8s.io/v1beta1 in Kubernetes 1.22.
Fixed the issue that Project creation failed if spec.resourceID was set. (Issue #462)
Fixed the issue that Storage resources couldn't be deleted if the referenced StorageBucket was deleted first. (Issue #463)
Fixed the IAM resource references in go-client. (Issue #413)
VMware Engine nodes are now available in the following additional region:
- Mumbai, India, APAC (
asia-south1)
The UpgradeAvailableEvent notification is now generally available.
May 15, 2021
ChronicleArchive Rules
You can now archive rules specified for the Detection Engine. Archiving a rule hides the security data related to that rule (and all of its versions) without actually deleting the rule. See Archive rules for more information.
May 14, 2021
Cloud StorageXML API multipart uploadsPreview launched.
You can now enable logging of human-readable hot keys. For more information, see the hot key entry in Pipeline options.
M70 Release
- Added TensorFlow Enterprise 2.5 containers. Note this is an Enterprise version but not a Long Term Support (LTS) version.
M70 Release
- Added TensorFlow Enterprise 2.5 images. Note this is an Enterprise version but not a Long Term Support (LTS) version.
Preview launch of Twilio telephony integration.
You can now use the Google Cloud Console to manage workload identity federation. For details, see the documentation for your identity provider:
Secret Manager now supports etags for optimistic concurrency control. This feature is available in Preview.
See Etags to learn more.
May 13, 2021
AnthosAnthos 1.7.1 is now available.
Updated components
Anthos Policy Controller has been updated to include a more recent build of OPA Gatekeeper (hash: 9b5e4cf).
A bug in Anthos Config Management 1.7.0 which broke nomos hydrate --no-api-server-check has been fixed.
The Config Sync admission webhook in Anthos Config Management 1.7.0 would block requests when a managed resource in the cluster copied annotations to another resource.
Config Sync container images are now correctly updated when Anthos Config Management is upgraded.
A bug in Anthos Config Management 1.7.0 which caused nomos status to return errors when both unstructured repos and Hierarchy Controller were being used has been fixed.
Committed use discounts are now available for public preview to purchase for Cloud Run. They provide discounted prices in exchange for your commitment to use a minimum level of resources for a specified term. The spend-based committed use discounts apply to all aggregated Cloud Run CPU, memory, and request usage in a region, giving you low, predictable costs when your code is running in one of the supported container ecosystems.
Cloud Run commitments do not apply to networking changes.
See the documentation for more details.
Preview: Cloud Composer supports Airflow 2. For more information about transferring from environments with Airflow 1 to Airflow 2, see Migrate environments to Airflow 2.
Airflow 2.0.1 is available in Cloud Composer images.
You can now break down costs associated with particular Cloud Composer environments. User labels that you assign to your environments now appear in billing reports.
New versions of Cloud Composer images:
- composer-1.17.0-preview.0-airflow-2.0.1
- composer-1.16.4-airflow-1.10.15
- composer-1.16.4-airflow-1.10.14 (default)
- composer-1.16.4-airflow-1.10.12
For new Cloud Composer environments with Airflow 2, SMTP configuration properties for Airflow have new default values:
smtp_useris set to an empty value by default.smtp_passwordis set to an empty value by default.smtp_mail_fromis set to a default value used by Airflow.
Improved the error message that is generated when the specified service account does not have enough permissions to run Airflow workloads.
Added troubleshooting information to error messages generated on Airflow web server deployment failures.
GKE clusters of new Cloud Composer environments use Container-Optimized OS with Containerd (cos_containerd) image type.
Kerberos client (krb5-user) package is pre-installed in Cloud Composer container images.
Some environment operations that failed because of networking problems are now retried instead of failing.
Database passwords are now redacted in error messages that appear in Composer Agent logs.
Error messages about dependency conflicts that happen when installing Python packages are now correctly reported.
When an environment upgrade fails because of package dependency conflicts, the error message contains detailed information about the conflict.
Preview: You can use OS configuration management to deploy and automate software configurations on your virtual machine (VM) instances using gcloud command-line and OS Config API.
With the release of OS configuration management (preview), you can now rollout policies from the Cloud console, control the rollout pace, use more VM filter options, and view compliance reports. For more information, see OS configuration management (preview).
M69 Release
- Updated cuDNN from 8.0.4 to 8.0.5.
M69 Release
- Migrated Collection Agent to Cloud Monitoring version 2.
Fixed an issue where the Services user interface would display a warning if a service had a mix of healthy backend groups (x out of x healthy endpoints) and empty backend groups (0 out of 0 healthy endpoints). Now, services that have a mix of healthy backend groups and empty backend groups are shown as healthy.
May 12, 2021
Cloud DNSConfiguring Cloud DNS scopes is now available in Preview.
Cloud Debugger has updated the configuration file naming and keywords that you use to block access to sensitive data. For the updated configuration, see Hiding sensitive data.
Cloud Monitoring is introducing metrics scopes. For a Google Cloud project, its metrics scope defines the projects whose metrics the project can view and monitor:
- When you create a project, its metrics scope is set to self.
- You can modify a project's metrics scope to include other Google Cloud projects, or to include AWS accounts. For more information, see Viewing metrics for multiple projects.
- A Google Cloud project can be included in multiple metrics scopes.
For more information about metrics scopes, see Configuring your project for Cloud Monitoring.
The replacement of Cloud Monitoring Workspaces with metrics scopes is complete.
All of your existing Cloud Monitoring Workspaces have been migrated to the new data model.
- To access the metrics for a Google Cloud project, select that project in the Console project picker and then access the Monitoring page.
- To determine the projects whose metrics the current project can view, see Determining visibility of metrics.
- For information about metrics scopes, see Configuring your project for Cloud Monitoring.
Committed use discounts are now available for Cloud Run . (Available in public preview.)
Customer managed encryption keys are now available for use with Cloud Run. (Available in public preview.)
You can now use Binary authorization with Cloud Run to enforce policy-based deployment of Cloud Run services. (Available in public preview.)
Recommender now provides recommendations for securing Cloud Run services by creating dedicated service accounts. (Available in public preview.)
Cloud Run now provides UI, command line, and YAML support for referencing Secret Manager Secrets. (Available in public preview.)
N2 machines are now available in the following regions and zones:
- Osaka, Japan:
asia-northeast2-a,b,c - Seoul, South Korea:
asia-northeast3-a,b,c
See VM instance pricing for details.
(2021-R16) Version updates
GKE cluster versions have been updated.
New versions available for upgrades and new clusters
The following Kubernetes versions are now available for new clusters and for opt-in control plane upgrades and node upgrades for existing clusters. For more information on the Kubernetes versioning scheme, see Versioning.
No channel
- Version 1.19.9-gke.1400 is now the default version.
- Version 1.17.17-gke.7800 is now available.
- Version 1.19.10-gke.1000 is now available.
- The following versions are no longer available:
- 1.18.15-gke.1501
- 1.18.15-gke.1502
- 1.18.16-gke.1201
- 1.18.16-gke.2100
- 1.18.16-gke.300
- 1.18.16-gke.302
- 1.18.16-gke.502
- The following control planes and nodes with auto-upgrade enabled will be
upgraded with this release:
- From version 1.17 to 1.18.17-gke.100.
- From version 1.18 to 1.18.17-gke.100.
- From version 1.19 to 1.19.9-gke.1400.
Stable channel
- Version 1.18.17-gke.700 is now available in the Stable channel.
- The following control planes and nodes with auto-upgrade enabled in the
Stable channel will be upgraded with this release:
- From version 1.17 to 1.18.17-gke.100.
- From version 1.18 to 1.18.17-gke.100.
Regular channel
- Version 1.19.9-gke.1400 is now the default version in the Regular channel.
- Version 1.18.17-gke.100 is no longer available in the Regular channel.
- Version 1.19.8-gke.1600 is no longer available in the Regular channel.
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.18 to version 1.19.9-gke.1400 with this release.
Rapid channel
- Version 1.19.10-gke.1000 is now available in the Rapid channel.
- Version 1.20.6-gke.1000 is now available in the Rapid channel.
- Version 1.20.5-gke.2000 is no longer available in the Rapid channel.
- The following control planes and nodes with auto-upgrade enabled in the
Rapid channel will be upgraded with this release:
- From version 1.18 to 1.19.9-gke.1900.
- From version 1.19 to 1.19.9-gke.1900.
- From version 1.20 to 1.20.6-gke.1000.
Dataplane V2 is generally available in newly created clusters using GKE versions 1.20.6-gke.700 and later.
The GKE Gateway controller, Google Cloud's implementation of the Gateway API, is available in Preview in GKE version 1.20 and later. See Deploying Gateways for how to expose applications using Gateway.
In GKE version 1.20 and later, the GKE Gateway controller introduces the new gateway.networking.x-k8s.io resource.
This is similar but different from the gateway.networking.istio.io resource. This may cause the kubectl get
gateway command to return the incorrect Gateway resource unless the fully qualified resource name is used. To avoid
seeing unexpected results when using kubectl, see Kubernetes Gateways and Istio Gateways.
The Istio project recently disclosed a new security vulnerability (CVE-2021-31920) affecting Istio. For more information, see the GCP-2021-006 security bulletin.
Secret Manager integration with Cloud Run
Cloud Run now provides UI, command line, and YAML support for using secrets. This feature is available in Preview.
May 11, 2021
Anthos clusters on VMwareA recently discovered vulnerability, CVE-2021-31920, affects Istio in respect to its authorization policies. Istio contains a remotely exploitable vulnerability where an HTTP request with multiple slashes or escaped slash characters can bypass Istio authorization policy when path-based authorization rules are used. While Anthos clusters on VMware uses an Istio Gateway object for network ingress traffic into clusters, authorization policies are not a supported or intended use case for Istio as part of the Anthos clusters on VMware prerequisites. For more details, refer to the Istio security bulletin.
Updated version of ODBC driver for BigQuery includes bug fixes and install guide improvements.
Updated version of JDBC driver for BigQuery includes bug fixes, service account keyfile support, connection property enhancements, and BigQuery client library updates.
New resource types are now available.
The following resource types are now publicly available through the Export APIs (ExportAssets and BatchGetAssetsHistory) and the Feed API:
- Cloud Bigtable
bigtableadmin.googleapis.com/Backup
The Cloud Bigtable documentation on schema design for time series data has been updated with an emphasis on recommended design patterns.
CVE-2021-31920 affects Istio, a component used by Cloud Run for Anthos. The CVE specifically impacts Istio's path-based AuthorizationPolicy configurations.
To ensure that your Cloud Run for Anthos clusters are not affected by the CVE, see the security best practices guide to learn more about mitigating this vulnerability.
Dataflow Shuffle is now the default mode for all batch pipelines.
May 10, 2021
BigQueryBigQuery now supports the following SQL query clauses and operators:
This feature is in Preview.
You can now use IAM conditions to define and enforce conditional access control for Cloud Bigtable instances, clusters, and tables. This feature is generally available.
Cloud Billing Reports now show the target budget amount when you open the report from a budget
In the Cloud Billing Console, Billing Budgets are linked to the Billing Reports page. If you open the Reports page from a Budget, the budget's scopes are used to set the report's filters and the report opens displaying the costs tracked by the budget. Additionally, the budget's target amount appears in the report chart as a red, dashed line, helping you to visualize the budget amount in the report while you are analyzing the specific, budget-related costs. You can open the cost report from the list of budgets, or from a budget's cost trend chart.
For more details about how budgets and cost reports are linked, see Viewing a budget in your report.
N2D machines are now available in Tokyo asia-northeast1-c.
See VM instance pricing for details.
The ability to attach service accounts to resources in other projects is now generally available.
Google Support does not provide support for Istio installations. For more information, see the Istio support statement.
Workflows is HIPAA compliant.
May 07, 2021
Cloud BigtableNew guidance is available to help you schedule Cloud Bigtable backups using Cloud Scheduler, Pub/Sub, and Cloud Functions.
Cloud Interconnect support for GRE traffic is available in General Availability. For more information, see the Cloud Interconnect overview.
Cloud VPN support for GRE traffic is available in General Availability. For more information, see the Cloud VPN overview.
The Speech-to-Text model adaptation feature is now a GA feature. See the model adaptation concepts page for more information about using this feature.
gRPC's observability features can now be used with services that use Traffic Director, including monitoring and tracing metrics that help you solve issues with your deployment. For more details, see Observability with proxyless gRPC applications.
Proxyless gRPC applications can now use these advanced traffic management features:
- Circuit breaking
- Fault injection
- Max stream duration
For complete information, see Setting up proxyless gRPC services with advanced traffic management
GRE support for VPC networks is now available in General Availability.
May 06, 2021
Anthos clusters on VMwareThe Envoy and Istio projects recently announced several new security vulnerabilities (CVE-2021-28683, CVE-2021-28682, and CVE-2021-29258) that could allow an attacker to crash Envoy.
For more information, see the GCP-2021-004 security bulletin.
Security bulletin (1.6 and 1.7)
The Envoy and Istio projects recently announced several new security vulnerabilities (CVE-2021-28683, CVE-2021-28682, and CVE-2021-29258) that could allow an attacker to crash Envoy.
For more information, see the GCP-2021-004 security bulletin.
Cloud Bigtable now provides a Cloud Monitoring metric that reports the amount of logical storage bytes that a backup is using. The metric is backup/bytes_used, and it includes information about the source table and storage type.
The Logs Explorer Histogram offers new time controls, including zooming and scrolling, to give you more in-depth analysis of your logs data. For details, see Analyzing logs using time controls.
You can now enable and configure OS Login for private GKE clusters and nodes. This feature is enabled for private GKE clusters running node pool versions 1.20.5 or later.
The Envoy and Istio projects recently announced several new security vulnerabilities ( CVE-2021-28683, CVE-2021-28682, and CVE-2021-29258) that could allow an attacker to crash Envoy.
For more information, see the GCP-2021-004 security bulletin.
General availability for the following integration:
May 05, 2021
Anthos clusters on VMwareAnthos clusters on VMware 1.7.1-gke.4 is now available. To upgrade, see Upgrading Anthos clusters on VMware. Anthos clusters on VMware 1.7.1-gke.4 runs on Kubernetes 1.19.7-gke.2400.
The supported versions that offer the latest patches and updates for security vulnerabilities, exposures, and issues impacting Anthos clusters on VMware are 1.7, 1.6, and 1.5.
If you upgrade the admin cluster before you upgrade the associated user clusters within the same minor version, such as from 1.7.0 to 1.7.1, the user control-planes will be upgraded together with the admin cluster. This applies even if you use the flag --force-upgrade-admin. This behavior, in versions 1.7.0 and later, is different from versions 1.6 and earlier, and is expected behavior.
Fixes:
Fixed a bug, so that the hardware version of a virtual machine is determined based on the ESXi host apiVersion instead of the host version. When host ESXi apiVersion is at least 6.7U2, VMs with version vmx-15 are created. Also, the CSI preflight checks validate the ESXi host API version instead of the host version.
Fixed a bug, so that if
vSphereCSIDisabledis set totrue, Container Storage Interface (CSI) preflight checks do not run when you execute commands such asgkectl check-configorcreate loadbalancerorcreate cluster.Fixed CVE-2021-3444, CVE-2021-3449, CVE-2021-3450, CVE-2021-3492, CVE-2021-3493, and CVE-2021-29154 on the Ubuntu operating system used by the admin workstation, cluster nodes, and Seesaw.
Fixed a bug where attempting to install or upgrade GKE on-prem 1.7.0 failed with an "/STSService/ 400 Bad Request" when the vCenter is installed with the external platform services controller. Installations where the vCenter server is a single appliance are not affected. Note that VMware deprecated the external platform services controller in 2018.
Fixed a bug where auto repair failed to trigger for unhealthy nodes if the cluster-health-controller was restarted while a previously issued repair was in progress.
Fixed a bug so that the command
gkectl diagnose snapshotoutput includes the list of containers and the containerd daemon log on Container-Optimized OS (COS) nodes.Fixed a bug that caused
gkectl update adminto generate anInternalFieldsdiff unexpectedly.Fixed the issue that the stackdriver-log-forwarder pod was sometimes in crashloop because of fluent-bit segfault.
There is an issue in the BigQuery sink plugin version 0.17.0, which causes data pipelines to fail or give incorrect results. This issue is resolved in BigQuery sink plugin version 0.17.1. For more information, see the Cloud Data Fusion Troubleshooting page.
Cloud Monitoring has added new ways to interact with charts. You can now select a range of lines displayed on chart, shift the time axis by using your pointer, and have new controls to expand the chart around a specific point in time. Charts displaying distribution data include 50th, 95th, and 99th percentile lines as an optional overlay. For more information, see Exploring charted data.
M68 Release
- Upgraded R containers from 3.6 to 4.0.
- Added xai-tabular-widget onto all TensorFlow containers.
- Miscellaneous bug fixes and updates.
M68 Release
- Upgraded R Images from 3.6 to 4.0.
- Added xai-tabular-widget onto all TensorFlow images.
- Miscellaneous bug fixes and updates.
Updated SAP HANA certification of the 6 TB m2-megamem-416 machine type
For OLAP workloads, the SAP certification of the Compute Engine 6 TB m2-megamem-416 machine type now includes:
- Scale-out configurations up to 16 nodes.
- Compute Engine persistent disks for storage in scale-up or scale-out configurations.
For more information, see Certified Compute Engine VMs for SAP HANA.
Security Command Center Premium has launched Continuous Exports for Pub/Sub in general availability. The feature simplifies the process of creating a NotificationConfig and automates the export of new findings to Pub/Sub.
You must be a Security Command Center Premium customer to use the feature. Security Command Center Standard continues to support one-time exports. To subscribe to Security Command Center Premium, contact your sales representative or fill out our inquiry form.
Security Health Analytics, a built-in service of Security Command Center, has launched a new detector, PUBSUB_CMEK_DISABLED, in general availability. The detector, available to Security Command Center Premium customers, identifies Pub/Sub topics that are not encrypted with customer-managed encryption keys (CMEK). For more information, see the PUBSUB_SCANNER table in Vulnerabilities findings.
Event Threat Detection, a built-in service of Security Command Center, has launched a new detector in general availability. Discovery: Service Account Self-Investigation detects when a service account credential is used to investigate the roles associated with that same service account. For more information on detectors, see Event Threat Detection conceptual overview.
Documentation
Event Threat Detection and Container Threat Detection documentation now includes examples of JSON output for findings. The examples show the data structure, objects, and properties present in findings. For more information, see the Example finding formats sections of Using Event Threat Detection and Using Container Threat Detection.
Security Command Center documentation now includes guidance on Optimizing Security Command Center and an overview of Data and infrastructure security.
Security Health Analytics documentation now includes instructions for enabling detectors that are not turned on by default. For more information, see Enabling Security Health Analytics detectors.
Beta stage support for the following integration:
May 04, 2021
Cloud Healthcare APIThe defaultSearchHandlingStrict field in the projects.locations.datasets.fhirStores.FhirStore resource is now available in the v1 version of the Cloud Healthcare API.
Zonal NEGs (with GCE_VM_IP network endpoints) can now be used as backends for internal TCP/UDP load balancers. For more information on this type of zonal NEG, see Zonal NEGs overview. For instructions on how to set up an internal TCP/UDP load balancer with a zonal NEG backend, see Setting up Internal TCP/UDP Load Balancing with zonal NEGs
This feature is in General Availability.
The Query Editor for Monitoring Query Language (MQL) has been reimplemented. In addition to autocompletion and error detection, it now supports code folding and a find-and-replace capability. For more information, see Using the Query Editor.
Starting in Cloud Run for Anthos versions 0.21 and later, the new default progress deadline for deployments is up to 10 minutes. For example, it can take 10 mins before a bad revision will reach a failed state. To specify a different deadline, see Configuring progress deadlines.
Config Connector version 1.49.1 is now available.
Miscellaneous bug fixes.
(2021-R15) Version updates
GKE cluster versions have been updated.
New versions available for upgrades and new clusters
The following Kubernetes versions are now available for new clusters and for opt-in control plane upgrades and node upgrades for existing clusters. For more information on the Kubernetes versioning scheme, see Versioning.
No channel
- Version 1.18.17-gke.100 is now the default version.
- Version 1.17.17-gke.7200 is now available.
- The following versions are no longer available:
- 1.16.15-gke.12500
- 1.16.15-gke.14800
- 1.17.17-gke.1101
- 1.17.17-gke.1500
- 1.17.17-gke.2800
- 1.17.17-gke.3000
- The following control planes and nodes with auto-upgrade enabled will be
upgraded with this release:
- From version 1.17 to 1.18.17-gke.100.
- From version 1.18 to 1.18.17-gke.100.
- From version 1.19 to 1.19.8-gke.1600.
Stable channel
- Version 1.18.17-gke.100 is now the default version in the Stable channel.
- Version 1.17.17-gke.5400 is now available in the Stable channel.
- The following versions are no longer available in the Stable channel:
- 1.17.17-gke.3700
- 1.18.16-gke.2100
- The following control planes and nodes with auto-upgrade enabled in the
Stable channel will be upgraded with this release:
- From version 1.17 to 1.18.17-gke.100.
- From version 1.18 to 1.18.17-gke.100.
Regular channel
- Version 1.18.17-gke.100 is now the default version in the Regular channel.
- The following versions are now available in the Regular channel:
- Version 1.18.16-gke.2100 is no longer available in the Regular channel.
- The following control planes and nodes with auto-upgrade enabled in the
Regular channel will be upgraded with this release:
- From version 1.17 to 1.18.17-gke.100.
- From version 1.18 to 1.18.17-gke.100.
Rapid channel
- Version 1.19.9-gke.1900 is now the default version in the Rapid channel.
- Version 1.19.9-gke.1400 is no longer available in the Rapid channel.
- The following control planes and nodes with auto-upgrade enabled in the
Rapid channel will be upgraded with this release:
- From version 1.18 to 1.19.9-gke.1900.
- From version 1.19 to 1.19.9-gke.1900.
Pub/Sub Lite is now available in the following regions:
- Hong Kong (
asia-east2) - Tokyo (
asia-northeast1) - Osaka (
asia-northeast2) - Seoul (
asia-northeast3) - Mumbai (
asia-south1) - Jakarta (
asia-southeast2) - Warsaw (
europe-central2) - Montreal (
northamerica-northeast1) - Sao Paulo (
southamerica-east1) - Northern Virginia (
us-east4) - Salt Lake City (
us-west3) - Las Vegas (
us-west4)
For the full list of available regions, see Pub/Sub Lite locations.
Pub/Sub Lite is now available in the following regions:
- Hong Kong (
asia-east2) - Tokyo (
asia-northeast1) - Osaka (
asia-northeast2) - Seoul (
asia-northeast3) - Mumbai (
asia-south1) - Jakarta (
asia-southeast2) - Warsaw (
europe-central2) - Montreal (
northamerica-northeast1) - Sao Paulo (
southamerica-east1) - Northern Virginia (
us-east4) - Salt Lake City (
us-west3) - Las Vegas (
us-west4)
For the full list of available regions, see Pub/Sub Lite locations.
The following features are available in the Video Intelligence API version v1:
Face detection: Locate faces within a video, and identify attributes such as glasses being worn. Learn more
Person detection: Locate people in a video, and identify attributes and 2D landmarks. Learn more
This GA launch brings significant quality improvement to both features.
May 03, 2021
Artifact RegistryArtifact Registry now supports audit logging for container images in Cloud Audit Logs.
The ability to restore from a Cloud Bigtable backup to a different instance is now generally available. This feature enhancement lets you use backups for a wider variety of use cases.
You can now add custom fields in the Logs Explorer to better analyze logs and refine your queries. For more information, see Adding fields to Log fields pane .
The Inventory tab on the Cloud Monitoring VM Instances dashboard now offers the ability to filter and sort the instance table by any combination of columns. In addition, new health scorecards report a variety of metrics and statistics related to the health and status of your VMs and agents.
By default, the memory allocated to each container instance of a new service is 512MiB. The new default applies to new services. Existing services retain their allocated memory.
You can now use Identity-aware Proxy with Cloud Run to use identity and context to guard access to your applications. (Available in public preview.)
Generally available: Create virtual machines for high performance computing (HPC) workloads using the HPC VM image.
The kubelet graceful node shutdown feature is now enabled on preemptible and GPU accelerator nodes running versions 1.20.5-gke.500 or later.
You can now use a pre-built container to serve predictions from TensorFlow 2.4 models.
You can now use a pre-built container to serve predictions from scikit-learn 0.24 models.
You can now use a pre-built container to serve predictions from XGBoost 1.3 models.
April 30, 2021
Anthos GKE on AWSAnthos clusters on AWS 1.7.1-gke.1 is now available.
Anthos clusters on AWS 1.7.1-gke.1 clusters run the following Kubernetes versions:
- 1.16.15-gke.17300
- 1.17.17-gke.7000
- 1.18.18-gke.300
- 1.19.9-gke.900
The Anthos clusters on AWS 1.7.1-gke.1 patch release addresses the following security vulnerabilities:
Release 1.7.1
Anthos clusters on bare metal release 1.7.1 is now available. To upgrade, see Upgrading Anthos clusters on bare metal. Anthos clusters on bare metal 1.7.1 runs on Kubernetes 1.19.
Functionality changes:
- Customers can now take cluster snapshots regardless of whether the admin cluster control plane is running. This is helpful for diagnosing installation issues.
- Deploying Anthos clusters on bare metal with SELinux is now fully supported on supported versions of Redhat Enterprise Linux. This applies for new installations of Anthos clusters on bare metal cases only.
- User cluster creation with
bmctlsupports credential inheritance from the admin cluster by default. Credential overrides for the user cluster can be specified in the config file during cluster creation.
Fixes:
- (Updated May 12, 2021) Fixed CVE-2021-28683, CVE-2021-28682, CVE-2021-29258. For more details, see the GCP-2021-004 security bulletin.
- Fixed potential stuck upgrade from 1.6.x to 1.7.0. The bug was caused by a rare race condition when the coredns configmap failed to be backed up and restored during the upgrade.
- Fixed potential missing GKE connect agent during installation due to a rare race condition.
- Fixed issue that prevented automatic updates to the control plane load balancer config when adding/removing node(s) from the control plane node pool.
- Addressed problem with syncing NodePool taints and labels that resulted in deletion of pre-existing items. Syncs will now append, update, or delete items that are added by taints and labels themselves only.
Known issues:
- Upgrading the container runtime from containerd to Docker will fail in Anthos clusters on bare metal release 1.7.1. This operation is not supported while the containerd runtime option is in preview.
bmctl snapshotcommand fails when the user creates a custom cluster namespace omittingcluster-prefix from the cluster config file. To avoid this issue, the cluster namespace should follow thecluster-$CLUSTER_NAMEnaming convention.
For information about the latest known issues, see Anthos on bare metal known issues in the Troubleshooting section.
Assured Workloads now provides support for CJIS and FedRAMP High, and a more streamlined provisioning experience for some compliance regimes. For more information, see the Assured Workloads documentation.
BigQuery now supports the following data definition language (DDL) statements:
This feature is in GA.
New resource types are now available.
The following resource types are now publicly available through the Export APIs (ExportAssets and BatchGetAssetsHistory) and the Feed API:
- Cloud Monitoring
monitoring.googleapis.com/AlertPolicy
- Cloud Filestore
file.googleapis.com/Backup
The following version upgrade applies to Cloud SQL for SQL Server:
- SQL Server 2017 is upgraded from 14.0.3257.3 to 14.0.3370.1
If you use maintenance windows, the new version will be available after your maintenance update. For information about maintenance windows, and to manage maintenance updates, see Finding and setting maintenance windows.
Config Connector version 1.49.0 is now available.
Hierarchical reference field is optional for BigQueryDataset, ComputeDisk, Folder, and Project (Fixes a follow-up issue in #349).
April 29, 2021
Binary AuthorizationBinary Authorization now supports Continuous Validation. See Continuous Validation documentation.
New versions of Cloud Composer images:
- composer-1.16.3-airflow-1.10.15
- composer-1.16.3-airflow-1.10.14 (default)
- composer-1.16.3-airflow-1.10.12
When Airflow configuration is updated, an erroneous log message about a web server update failure no longer appears in logs.
Fixed problems with execution date in environment health monitoring when Airflow uses a custom time zone.
Cloud Composer versions 1.8.3 to 1.10.2 have reached their end of full support period.
Preview: With the introduction of OS inventory management v2.0, you can now query the OS Config API to get inventory and vulnerability report data for your VMs in a specific zone, see OS inventory management.
You can now create extreme persistent disks in certain regions. With consistently high performance for both random access workloads and bulk throughput, extreme persistent disks are designed for high-end database workloads.
For more information, see Extreme persistent disks.
For GKE clusters with Windows Server nodes, node names will now be limited to 15-characters to allow for Active Directory joining.
Fixes for the following GKE Autopilot clusters issues are rolling out to the Rapid release channel:
- Pods with a priority lower than -10 would not trigger scale up.
- Pod anti-affinity might cause overscaling.
April 28, 2021
Cloud Load BalancingInternal TCP/UDP Load Balancing now supports session affinity for the UDP protocol. This feature is available in General Availability.
C2 machines are available in the following regions and zones:
- Osaka
asia-northeast2-a
See VM instance pricing for details.
April 27, 2021
Access ApprovalGoogle Kubernetes Engine is supported by Access Approval in Preview stage.
Cloud Spanner is supported by Access Approval in GA stage.
Automatic scaling elements min_instances and min_idle_instances will now only apply to versions of a service that have been configured to receive traffic. This change is to reduce unexpected billing due to instances running old versions that are not intended to receive traffic.
Automatic scaling elements min_instances and min_idle_instances will now only apply to versions of a service that have been configured to receive traffic. This change is to reduce unexpected billing due to instances running old versions that are not intended to receive traffic.
Automatic scaling elements min_instances and min_idle_instances will now only apply to versions of a service that have been configured to receive traffic. This change is to reduce unexpected billing due to instances running old versions that are not intended to receive traffic.
Automatic scaling elements min_instances and min_idle_instances will now only apply to versions of a service that have been configured to receive traffic. This change is to reduce unexpected billing due to instances running old versions that are not intended to receive traffic.
Automatic scaling elements min_instances and min_idle_instances will now only apply to versions of a service that have been configured to receive traffic. This change is to reduce unexpected billing due to instances running old versions that are not intended to receive traffic.
Automatic scaling elements min_instances and min_idle_instances will now only apply to versions of a service that have been configured to receive traffic. This change is to reduce unexpected billing due to instances running old versions that are not intended to receive traffic.
The create, delete, get, list, and patch Customer APIs can now use an alternate parent binding to specify the customer's Channel Partner. The returned resource name follows the format accounts/*/customers/* regardless of the parent binding.
Added LICENSE_CAP_CHANGED to the list of EntitlementEvent.Type.ENUM_VALUES to deliver notifications for a new Pub/Sub event type.
Webhook triggers are now generally available. Learn more about using webhook triggers to build repos hosted on Gitlab, Bitbucket Cloud, and Bitbucket Server.
Users can now run manual triggers on a schedule. For more information, see Scheduling builds.
You can now install the Cloud Logging agent, Cloud Monitoring agent, and Ops Agent on VMs running OpenSUSE Leap versions 15, 15.1, and 15.2.
You can now install the Cloud Logging agent, Cloud Monitoring agent, and Ops Agent on VMs running OpenSUSE Leap versions 15, 15.1, and 15.2.
You can now compose objects using source objects that were encrypted with Cloud KMS keys.
N2D machines are available in the following regions and zones:
- Osaka
asia-northeast2-c - Montréal
northamerica-northeast1-a,c - Finland
europe-north1-a,b,c
See VM instance pricing for details.
Config Connector version 1.48.0 is now available.
ComputeDisk added support for projectRef
Added go-clients for GKEHubMembership and CloudIdentityGroup
(2021-R14) Version updates
GKE cluster versions have been updated.
New versions available for upgrades and new clusters
The following Kubernetes versions are now available for new clusters and for opt-in control plane upgrades and node upgrades for existing clusters. For more information on the Kubernetes versioning scheme, see Versioning.
No channel
- The following versions are now available:
- Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.18 to version 1.18.16-gke.2100 with this release.
Stable channel
- Version 1.17.17-gke.4900 is now available in the Stable channel.
- Version 1.18.17-gke.100 is now available in the Stable channel
- Version 1.18.16-gke.302 is no longer available in the Stable channel.
- Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.18 to version 1.18.16-gke.2100 with this release.
Regular channel
- Version 1.18.16-gke.2100 is now the default version in the Regular channel.
- Version 1.18.17-gke.100 is now available in the Regular channel.
- Version 1.18.16-gke.502 is no longer available in the Regular channel.
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.17 to version 1.18.16-gke.2100 with this release.
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.18 to version 1.18.16-gke.2100 with this release.
Rapid channel
- Version 1.19.9-gke.1400 is now the default version in the Rapid channel.
- Version 1.19.9-gke.1900 is now available in the Rapid channel.
- Version 1.20.5-gke.2000 is now available in the Rapid channel.
- Version 1.19.9-gke.700 is no longer available in the Rapid channel.
- Version 1.20.5-gke.1300 is no longer available in the Rapid channel.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.18 to version 1.19.9-gke.1400 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.19 to version 1.19.9-gke.1400 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.20 to version 1.20.5-gke.2000 with this release.
Multi-Instance GPU on GKE is available in Preview.
Vizier is now available in preview. Vizier is a feature of AI Platform (Unified) that you can use to perform black-box optimization. You can use Vizier to tune hyperparameters or optimize any evaluable system.

Formed in 2009, the Archive Team (not to be confused with the archive.org Archive-It Team) is a rogue archivist collective dedicated to saving copies of rapidly dying or deleted websites for the sake of history and digital heritage. The group is 100% composed of volunteers and interested parties, and has expanded into a large amount of related projects for saving online and digital history.
