Back to Study Plans
35 Problems

CUDA Kernels

Write CUDA C++ kernels and run them against correctness tests on real GPU hardware.

17 Easy15 Medium3 Hard
6 sections
Vector AdditionVector SubtractionReLUSigmoidTanhLeaky ReLUSoftmaxGELUSwishCUDA Kernel Foundations Quiz10 questions
Matrix AdditionMatrix TransposeMatrix MultiplicationOuter ProductHadamard ProductLayer NormalizationMatrix-Vector MultiplicationRMS NormalizationCUDA Matrix Operations Quiz10 questions
Dot ProductSum of ArrayL1 NormalizationL2 NormalizationMean and VarianceMax of ArrayMin of ArrayArgmaxArgminCUDA Reductions Quiz10 questions
1D Convolution2D Convolution3D ConvolutionMax Pool 2DCUDA Convolutions Quiz10 questions
Cross-Entropy LossDropoutScaled Dot-Product AttentionCosine SimilarityCUDA ML Primitives Quiz10 questions
Tiled Matrix MultiplicationCUDA Performance Quiz10 questions