FlashAttention
Definition
An IO-aware exact attention algorithm optimizing GPU memory accesses.
Example Case
vLLM implementing FlashAttention-2 for speed.
An IO-aware exact attention algorithm optimizing GPU memory accesses.