tiktoken is a fast BPE tokeniser for use with OpenAI's models.
Why do you think that https://github.com/cogentapps/chat-with-gpt is a good alternative to tiktoken
tiktoken is a fast BPE tokeniser for use with OpenAI's models.
Why do you think that https://github.com/cogentapps/chat-with-gpt is a good alternative to tiktoken