Add heads_per_tile (multi-head-per-tile) support to Ulysses ring attention#444
Open
edgexyz wants to merge 4 commits into
Open
Add heads_per_tile (multi-head-per-tile) support to Ulysses ring attention#444edgexyz wants to merge 4 commits into
heads_per_tile (multi-head-per-tile) support to Ulysses ring attention#444edgexyz wants to merge 4 commits into
