LeaderGPU will offer customers who need infrastructure for AI workloads rental access to Nvidia GeForce RTX 6000 Ada graphics cards, one of the best GPUs available, starting in late November 2023.
The server configuration offered includes eight RTX 6000 Ada GPUs with eight units of 48 GB GDDR6 RAM, and each contains 18,176 CUDA cores. It also has a memory bandwidth of up to 960 GB/s.
CUDA cores, built by Nvidia, are similar to CPU cores and are designed to handle multiple computations simultaneously – and you would need hundreds of thousands of them to effectively run the most intensive generative AI workloads, with the more CUDA cores you have access to, the better.
Unleash AI through the cloud
These configurations, which can be rented for €0.25 (or 27¢) per minute, also include two Intel Xeon Gold 6248R CPUs, mounted alongside 384 GB of RAM, as well as 2 TB of NVMe storage capacity. They can run on both Ubuntu and Windows Server.
Starting November 30, you can rent this configuration for €5,682.22 ($6,060) per month, €1,420.55 ($1,515) per week or €284.11 ($300) per day.
For those looking for an hourly rate, this equates to just €15 ($16), meaning renting up to one million CUDA cores would only cost you €105 ($110) per hour.
The hardware you need to run AI workloads is incredibly expensive to purchase, maintain, and operate, not to mention it’s incredibly power intensive. As a result, the prospect of leasing the necessary IT infrastructure – especially GPUs – is becoming tempting for more and more organizations.
This is where entities like LeaderGPU come into the picture, with the The cloud is becoming a much more viable route for companies to run their AI workloads.
The Japanese company Third Wave also last month has announced a GPU Cloudgiving customers access to a fleet of the best GPUs at relatively affordable prices.