New Google tool helps double speed of cloud storage downloads
>
Google Cloud is going to launch a new tool that allows users to create and manage
certain resources and services directly, and also provides a performance advantage.
The cloud giant claims that the tool, called “gcloud storage CLI”, enables up to 94% faster data transfers when using its cloud storage.
Users could previously customize their Google Cloud resources at the command line or via scripts via Google Cloud CLI, but the new tool is supposedly set up to modernize the experience.
How does it work?
Google claims that the faster transfer speeds are the result of two primary innovations within gcloud storage.
First, gcloud storage apparently uses faster hashing tools for checking CRC32C data integrity that skip the complicated installation required for gsutil, the tool’s Python-based predecessor.
Second, the new tool uses a new parallelization strategy that treats task management as a graphing problem, allowing “more work to be done in parallel with much less overhead”.
When transferring 100 files of 100MB, Google claims that gcloud storage is 79% faster than gsutil when downloading and 33% faster when uploading using a parallel composite upload strategy.
In addition to the performance improvements, Google is also presenting the new tool as a “consistent way” to manage all Google Cloud resources such as Cloud Storage buckets, Compute Engine VMs, and Google Kubernetes Engine clusters.
For example, gcloud storage reportedly significantly reduces the number of top-level commands users must use to manage their Cloud Storage resources by grouping commands under common headings.
gcloud storage CLI is currently available and ready to use at no additional cost. You can install or upgrade to the latest version of the Google Cloud SDK here (opens in new tab) to access the new CLI.
If you want to know more about how gcloud storage CLI works, you can refer to the documentation here (opens in new tab).