Ghosh, Abhishek

PyGraph : compiler support for efficient and transparent use of CUDA graphs - Bangalore : Indian Institute of Science. 2024. - vii, 41 p. : col. ill. e-Thesis 1.670 Mb

Includes bibliographical references.

MTech(Res);2025;Computer Science and Automation.

CUDA Graphs --- a recent hardware feature introduced for NVIDIA GPUs --- aim to reduce CPU launch overhead by capturing and launching a series of GPU tasks (kernels) as a DAG. However, deploying CUDA Graphs faces several challenges today due to the static structure of a graph. It also incurs performance overhead due to data copy. In fact, we show a counter-intuitive result --- deploying CUDA Graphs hurts performance in many cases.


GPUs
Hardware-software interface
Performance
GPU software
ML Compilers
CUDA Graphs

621.39 / BAS