Hey, ⚠ I’m looking for a full-time position (ML/AI) starting in April/May 2025. A brief bio is ↓.

\(\rightarrow\) Some CUDA/C++ learning notes:

• GPU architecture and warp scheduling.
• Occupancy, Compute intensity, and Tiling.
• DRAM banks and why it matters for code optimization.
• CUDA block indexing, and coalesced memory accesses

\(\rightarrow\) Random C++:

• Loading MNIST dataset in C++

\(\rightarrow\) Technical

• Handling checkpoints from terminal - some useful tricks.
• Quick reset of my compute pod.
• Speed up your migration to VIM.

\(\rightarrow\) LLMs

• Recent trends to speed up autoregressive inference of LLMs (unifinished).

\(\rightarrow\) Math:

• Matrix Differential Calculus.
• Convergence Rates of SGD in convex and non-convex cases.

Some GitHub repos:

• Training ML models with CUDA/C++: \(\rightarrow\) Github link.
• GPT2 factorized with (multiple) Kronecker Factors: \(\rightarrow\) Github link.
• Backpropagation from scratch \(\rightarrow\) Github link.
• Randomized Algorithms \(\rightarrow\) Github link.
• Reinforcement Learning \(\rightarrow\) Github link.

Bio/Contact:

I’m based in Passau, Germany. I’m a part-time ML research assistant @Uni Passau, working on LLMs. I graduated with a master’s degree in software engineering in 2019. “On the side”, I’m also pursuing a second Master’s degree in Computational Math.

• Gmail: ayoub.benayad.467 ; LinkedIn ; Instagram.