CPU vs GPU Benchmark: Mixed-Precision Matmul
A self-contained benchmark measuring how much an NVIDIA GPU accelerates the core operation behind deep learning, large dense matrix multiplication, compared to the CPU. Tests four numeric precisions (FP32, TF32, FP16, BF16) to expose the speed-versus-accuracy trade-off that mixed-precision training relies on. Up to 59x speedup on an RTX 3060 Laptop.
CUDAGPUPyTorchBenchmarkingMixed PrecisionDeep LearningPerformance