Microsoft Research proposes new framework, LongMem, allowing for unlimited context length along with reduced GPU memory usage and faster inference speed. Code will be open-sourced

This page summarizes the projects mentioned and recommended in the original post on /r/LocalLLaMA

Our great sponsors
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • WorkOS - The modern API for authentication & user identity.
  • Onboard AI - ChatGPT with full context of any GitHub repo.
  • semantic-kernel

    Integrate cutting-edge LLM technology quickly and easily into your apps

  • guidance

    A guidance language for controlling large language models. [Moved to: https://github.com/guidance-ai/guidance] (by microsoft)

    Also https://github.com/microsoft/guidance

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  • DeepSpeed

    DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

    And https://github.com/microsoft/deepspeed

  • AGiXT

    AGiXT is a dynamic AI Agent Automation Platform that seamlessly orchestrates instruction management and complex task execution across diverse AI providers. Combining adaptive memory, smart features, and a versatile plugin system, AGiXT delivers efficient and comprehensive AI solutions.

    That's exactly my goal right now too! I have been trying to figure out how to use AGiXT agents to read and write to an "Adventurer's Log" text file to try to mimic a long term memory but honestly I'm not good enough with any of this to get it working yet. The idea I've got rn is that there'd be a DM agent which takes your input and then there'd be "memory" agents which would check text files such as "Adventurer's Log" and "Character Interactions/Relationships" to keep a contiguous understanding of what each character has done, who they've met, what they've been told/haven't been told by certain characters about their motivations. I'm sure there's someone *much* more talented than me working on this already, at this point I've sort of given up on the idea and I'm just waiting for someone to come out with a Tavern style interface where I can paste in world details and character details and just get going!

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts