Run Llama 2 Uncensored Locally

• ollama

  229 72,781 9.9 Go

  Get up and running with Llama 3, Mistral, Gemma, and other large language models.

  

Ollama is the best I have seen if you want to play around with LLMs.

After installing the application and running it, you run "ollama run " and it handles everything and drops you into a chat with the LLM. There are no dependencies for you to manage -- just one application.

Check out the README: https://github.com/jmorganca/ollama#readme

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• llm-attacks

  9 2,979 5.2 Python

  Universal and Transferable Attacks on Aligned Language Models

  

I think Facebook did a very good job with Llama2, i was skeptical at first with all that talk about 'safe AI'. Their Llama-2 base model is not censored in any way, and it's not fine-tuned as well. It's the pure raw base model, i did some tests as soon as it released and i was surprised with how far i could go (i actually didn't get any warning whatsoever with any of my prompts). The Llama-2-chat model is fine-tuned for chat and censored.

The fact that they provided us the raw model so we could fine-tune on our own without the hassle of trying to 'uncensor' a botched model is a really great example on how it should be done: give user the choice! Instead, you just have to fine-tune it for chat and other purposes.

The Llama-2-chat fine-tune is very censored, none of my jailbreaks worked, except for this one[1], and it is a great option for production. The overall quality of the model (i tested the 7b version) has improved a lot, and for the ones interested, it can role-play better than any model i have seen out there with no fine-tune.

1: https://github.com/llm-attacks/llm-attacks/

Suggest a related project