Can't load exl2 model with 3060ti(8GB)

This page summarizes the projects mentioned and recommended in the original post on /r/Oobabooga
hardware-buttons scrape-images linkedin-bot

InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured

  • text-generation-webui-docker

    Docker variants of oobabooga's text-generation-webui, including pre-built images.

    • Hi guys, I am using Text Gen Webui-docker,I want to load an exl2 model with ExLlamav2_HF. I have tried 34B,13B and 7B,and none of them worked,while I can load it with llama.cpp with .gguf files. Everytime I load the models it gave me sam errors: ``` Traceback (most recent call last):

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • Deploy Docker Image to AWS EC2 in 5 minutes

    1 project | dev.to | 12 Jun 2024

  • Alnoda-workspaces: Flexible and extendable containerized workspaces

    1 project | news.ycombinator.com | 1 Jun 2024

  • Alpine-Multics – Running Multics mainframe time sharing operating system

    1 project | news.ycombinator.com | 23 May 2024

  • Windows GitHub Self Hosted Runner inside a Linux Container

    4 projects | dev.to | 18 May 2024

  • Basic setup for projects with Golang

    1 project | dev.to | 13 May 2024