Jules Urbach, CEO of OTOY, a company specialized in holographic rendering in the cloud, took advantage of his own OctaneBench benchmark to reveal the performance of the world’s most powerful GPU, and this is none other than the Nvidia A100, the first Nvidia graphics card. which employs the Ampere architecture and 7nm manufacturing process.
At a die size of 826mm2, the Nvidia A100 offers no less than 54 billion transistors, 6912 CUDA Cores @ 1410 MHz, and 432 Tensor Cores. Despite the great show of muscle, this is not full silicon, so larger creatures may still come. This translates to 19.5 TFLOPs FP32 performance, 9.7 TFLOPs FP64 performance, and 19.5 TFLOPs FP64 Tensor Core performance, and is accompanied by 40GB of HBM2E memory and a PCI-Express 4.0 or SXM4 interface depending on variant.
As revealed by the CEO, the Nvidia A100 is the fastest graphics card passed by the benchmark, which gave a score of 446 OB4 (in Linux with RayTracing disabled), which means that the Ampere architecture is 43 percent faster than Turing. If we want examples that sound simpler, in that same benchmark, the Nvidia A100 is 48% faster than the Nvidia GeForce RTX 2080 Ti.