-
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
Look at AI Dungeon or KoboldAI, there are some tricks there as others mentioned. Also look here, this one seems to have some cool ideas as well: https://github.com/Kav-K/GPT3Discord
I have seen token aware truncating being used here https://github.com/marqo-ai/marqo/blob/mainline/examples/GPT-examples/article/article.md. Its helpful because it allows you to truncate/expand text based on the actual token distance, not character distance. Langchain might have more functionality for this as well although last I checked they did not have the same set as in the article (might be different now though).