We demonstrate that CLEX can be seamlessly incorporated into LLMs equipped with Rotary Position Embedding, such as LLaMA and GPT-NeoX, with negligible impact on training and inference latency.
Some results have been hidden because they may be inaccessible to you
Show inaccessible results