KernIt_Raj
Leaderboard name: bloomberg9383 All 5 kernels implemented in Helion DSL for Gated DeltaNet on B200: 1.
Core trick
Five Helion DSL kernels use hl.dot matmuls with per-shape autotuned configs and persistent blocked scheduling for L2 locality.
Tags
Description
Leaderboard name: bloomberg9383
All 5 kernels implemented in Helion DSL for Gated DeltaNet on B200:
1. fp8_quant: FP8 group quantization — computes per-group absmax and scales, quantizes to float8_e4m3fn. Straightforward elementwise kernel.
2. causal_conv1d: Causal depthwise 1D convolution — eliminated input padding by computing directly on raw input with clamped indices and validity masking, halving memory bandwidth. Uses [1,512] block tiling with 1 warp for maximum S-dimension coalescing. ~10.5μs geomean across benchmark shapes.
3. gated_deltanet_chunk_fwd_h: Inter-chunk state recurrence (h = decay * h + key^T * value) — sequential across chunks with hl.dot() matmuls. Autotuned per-shape configs with pointer indexing.
4. gated_deltanet_chunk_fwd_o: Intra/inter-chunk output computation with causal attention masking — uses hl.dot() for all matmuls (QK^T, attention*V, state contribution). Optimized with persistent_blocked scheduling, block_ptr indexing, and range flattening. ~17.7μs geomean.
5. gated_deltanet_recompute_w_u: WY-transform forward pass — parallel matmul-heavy kernel using hl.dot() for matrix products. Autotuned with per-shape block sizes and warp counts.
Key optimizations: removed baseline redundant computations, replaced element-wise accumulation with hl.dot(), per-shape autotuned configs with static_shapes=True, persistent_blocked PID scheduling for L2 locality.
README excerpt
## Reference Kernels This repo holds reference kernels for the KernelBot which hosts regular competitions on [discord.gg/gpumode](discord.gg/gpumode). You can see what's going on [gpumode.com](https://www.gpumode.com/) ## Competition 1. [PMPP practice problems](https://github.com/gpu-mode/reference-kernels/tree/main/problems/pmpp_v2) 2. [AMD $100K kernel competition](problems/amd) 3. [BioML kernels](problems/bioml) 4. [AMD $100K distributed kernel competition](problems/amd_distributed) 5. [NVIDIA Blackwell NVFP4 competition](problems/nvidia) ## Making a Leaderboard Submission Please take a look at `vectoradd_py` to see multiple examples of expected submisisons ranging from PyTorch code to Triton to inline CUDA. ## Contributing New Problems To add a new problem, create a new folder in the `problems/glory` directory where you need to add the following files: - `reference.py` - This is the PyTorch reference implementation of the problem. - `task.yml` - This is the problem specification that will be used to generate test cases for different shapes - `task.py` - Specifies the schema of the inputs and outputs for the problem You can evaluate problems with your own Modal account (they give you a free $30) by borrowing this [neat script from @gau-nernst](https://github.com/gpu-mode/reference-kernels/pull/96#issue-3850136894)