The GeoV model is a large langauge model designed by Georges Harik and uses Rotary Positional Embeddings with Relative distances (RoPER). We have shared a pre-trained 9B parameter model.
Why do you think that https://github.com/THUDM/ChatGLM-6B is a good alternative to geov