Tech News
← Home  ·  All topics

Nvrtc

1 GoKawiil brief on this topic

Developer releases open-source agentic CUDA kernel optimizer built on LangGraph

A Show HN post introduces a tool that automatically generates, tests, benchmarks and refines CUDA GPU kernels from a workload description. It uses an LLM agent via LangGraph to propose code and launch-configuration changes, a C++/NVRTC harness to compile and run candidates, and Python to validate outputs against NumPy references, keeping only the fastest kernel that passes all correctness checks. The project was developed on Windows with an RTX 3060 Laptop GPU and requires Python 3.12+, CMake, a C++17 compiler and an OpenAI API key.