Designing High-Performance GPU Kernels with TileLang: Tensor-Core GEMM, Fused Softmax, FlashAttention, and Autotuning

This hands-on tutorial covers designing FlashAttention, tensor-core GEMM, and fused softmax for efficient deep learning workloads

Raccontata damarktechpost.com