Performance Resources

Performance Recommendations

• Tensor Core Performance Guide
  • Arithmetic intensity
  • Tensor Core (TC) refresher
  • TC alignment requirements, tile quantization, wave quantization
• 2-mins video on TensorCore Performance Guidance
• DL Performance Documentation: recommendations that apply to most deep learning operations.
• Tips for Optimizing GPU Performance Using Tensor Cores

Device Capabilities

• GPU Compute Capability: Lists the SM version of various NVIDIA devices.
• Supported Precisions: Contains a table listing which precision modes various NVIDIA devices support.