[ICLR 2024] Efficient Streaming Language Models with Attention Sinks
Why do you think that https://github.com/OpenNMT/CTranslate2 is a good alternative to streaming-llm
[ICLR 2024] Efficient Streaming Language Models with Attention Sinks
Why do you think that https://github.com/OpenNMT/CTranslate2 is a good alternative to streaming-llm