PyGraph : compiler support for efficient and transparent use of CUDA graphs
- Bangalore : Indian Institute of Science. 2024.
- vii, 41 p. : col. ill. e-Thesis 1.670 Mb
Includes bibliographical references.
MTech(Res);2025;Computer Science and Automation.
CUDA Graphs --- a recent hardware feature introduced for NVIDIA GPUs --- aim to reduce CPU launch overhead by capturing and launching a series of GPU tasks (kernels) as a DAG. However, deploying CUDA Graphs faces several challenges today due to the static structure of a graph. It also incurs performance overhead due to data copy. In fact, we show a counter-intuitive result --- deploying CUDA Graphs hurts performance in many cases.
GPUs Hardware-software interface Performance GPU software ML Compilers CUDA Graphs