LoopFill: Pipelined Multi-Token Speculative Decoding for Looped Transformers
Training-free, pipelined speculative decoding for looped language models.
My contribution
Trained DFlash draft models, explored training strategies for smaller and faster drafters, and reproduced LoopAhead without publicly available source code.