A few less Googleable questions about local LLMs

This page summarizes the projects mentioned and recommended in the original post on /r/LocalLLaMA

Our great sponsors
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • WorkOS - The modern identity platform for B2B SaaS
  • SaaSHub - Software Alternatives and Reviews
  • Sandboxie

    Sandboxie Plus & Classic

    You can allow applications inside a Sandboxie to communicate with each other through sockets even when network access by Sandboxie is blocked1. You can enable Sandboxie network access and use Windows firewall outside Sandboxie to block all applications inside the Sandboxie from accessing the network1. It is also possible to specify ports that cannot be accessed by boxed applications2. However, it is not possible to specify IP’s or IP ranges that cannot be accessed by boxed applications2.

  • YaLM-100B

    Pretrained language model with 100B parameters

    There is a 100b model published on pache 2.0 license. Though there is no information about finetuning it or using in 4-bit with smth like llama.cpp. Trying to figure out how to try it without renting extremely expensive gpu set. https://github.com/yandex/YaLM-100B

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  • simplewall

    Discontinued Simple tool to configure Windows Filtering Platform (WFP) which can configure network activity on your computer.

    I'm glad you liked it. I allow internet access in Sandboxie and then outside the sandbox I use a firewall (Simplewall) which prompts me on what to do whenever an app wants to access the internet.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts