Buba Shrimp
Optimized code for each kernel is listed under respective folder
Core trick
Stores reference GPU kernels per competition problem so a bot can benchmark submitted kernels against them.
Description
Optimized code for each kernel is listed under respective folder
gpu-mode/reference-kernels★ 321160 forksPythonNOASSERTIONCreated Jan 17, 2025 · last push Sep 18, 2026
README excerpt
## Reference Kernels This repo holds reference kernels for the KernelBot which hosts regular competitions on [discord.gg/gpumode](discord.gg/gpumode). You can see what's going on [gpumode.com](https://www.gpumode.com/) ## Competitions 1. [PMPP practice problems](https://github.com/gpu-mode/reference-kernels/tree/main/problems/pmpp_v2) 2. [AMD $100K kernel competition](problems/amd) 3. [BioML kernels](problems/bioml) 4. [AMD $100K distributed kernel competition](problems/amd_distributed) 5. [NVIDIA Blackwell NVFP4 competition](problems/nvidia) 6. [AMD $1.1M competition](problems/amd_202602) 7. [Helion IRL hackathon](problems/helion) 8. [Linear Algebra Problems](problems/linalg) We also work with universities on hosting the infrastructure for their classes: - [Stanford CS149 assignment 5 kernels](https://github.com/stanford-cs149/asst5-kernels) - [Tri Dao's Princeton parallel programming class](problems/princeton) ## Contributing New Problems To add a new problem, create a new folder in the `problems/glory` directory where you need to add the following files: - `reference.py` - This is the PyTorch reference implementation of the problem. - `task.yml` - This is the problem specification that will be used to generate test cases for different shapes - `task.py` - Specifies the schema of the inputs and outputs for the problem For NVIDIA problems, follow [Adding Nsight Compute support](docs/ncu-profiling.md) to implement the evaluator profile path and verify captured kernels