Presentation
STCG: Sparse Tensor Code Generation via Adaptive Tile Scheduling on GPUs with Tensor Cores
DescriptionSparse tensor operations underpin graph neural networks, scientific simulations, and data analytics, yet irregular sparsity leads to highly uneven tile densities and irregular memory access patterns, preventing GPUs from effectively utilizing Tensor Cores and CUDA cores. We present STCG, a compiler–runtime framework for sparse tensor code generation with adaptive tile scheduling on modern GPUs. STCG introduces a four-level IR that separates algebraic lowering, tiling, micro-kernel construction, and heterogeneous kernel assembly. The compiler emits a unified GPU kernel that embeds both WMMA-based Tensor Core micro-kernels and coordinate-indexed FMA kernels under a consistent memory and warp layout, ensuring stable register and shared-memory usage despite irregular sparsity. At runtime, lightweight tile descriptors enable constant-time, per-tile selection between the WMMA and FMA paths, providing data-aware load balancing and eliminating the need for kernel regeneration or manual tuning. On an NVIDIA A100, STCG achieves a 1.13$\times$ geometric-mean speedup over the per-dataset best existing method on SpMM and a 5.06$\times$ speedup on SpTTM, demonstrating the effectiveness and advancement of our approach across diverse sparsity patterns.
Event Type
Research Manuscript
TimeMonday, July 272:21pm - 2:34pm PDT
LocationMtg Room 203C
Similar Presentations
