symmetric-power-transformer

rope ,  power-attention ,  symmetric-power-transformer ,  symmetric-power-embeddings