Lora

Open-source projects categorized as Lora

Top 23 Lora Open-Source Projects

  • Chinese-LLaMA-Alpaca

    中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

  • Project mention: Chinese-Alpaca-Plus-13B-GPTQ | /r/LocalLLaMA | 2023-05-30

    I'd like to share with you today the Chinese-Alpaca-Plus-13B-GPTQ model, which is the GPTQ format quantised 4bit models of Yiming Cui's Chinese-LLaMA-Alpaca 13B for GPU reference.

  • LLaMA-Factory

    Unify Efficient Fine-Tuning of 100+ LLMs

  • Project mention: Show HN: GPU Prices on eBay | news.ycombinator.com | 2024-02-23

    Depends what model you want to train, and how well you want your computer to keep working while you're doing it.

    If you're interested in large language models there's a table of vram requirements for fine-tuning at [1] which says you could do the most basic type of fine-tuning on a 7B parameter model with 8GB VRAM.

    You'll find that training takes quite a long time, and as a lot of the GPU power is going on training, your computer's responsiveness will suffer - even basic things like scrolling in your web browser or changing tabs uses the GPU, after all.

    Spend a bit more and you'll probably have a better time.

    [1] https://github.com/hiyouga/LLaMA-Factory?tab=readme-ov-file#...

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • stable-diffusion-webui-colab

    stable diffusion webui colab

  • Project mention: Stable-Diffusion-Webui-Colab | news.ycombinator.com | 2023-07-24
  • peft

    🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

  • Project mention: LoftQ: LoRA-fine-tuning-aware Quantization | news.ycombinator.com | 2023-12-19
  • LoRA

    Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

  • Project mention: DECT NR+: A technical dive into non-cellular 5G | news.ycombinator.com | 2024-04-02

    This seems to be an order of magnitude better than LoRa (https://lora-alliance.org/ not https://arxiv.org/abs/2106.09685). LoRa doesn't have all the features this one does like OFDM, TDM, FDM, and HARQ. I didn't know there's spectrum dedicated for DECT use.

  • BELLE

    BELLE: Be Everyone's Large Language model Engine(开源中文对话大模型) (by LianjiaTech)

  • Project mention: Open Source Chinese LLMs | news.ycombinator.com | 2023-04-23
  • lora

    Using Low-rank adaptation to quickly fine-tune diffusion models. (by cloneofsimo)

  • Project mention: You can now train a 70B language model at home | news.ycombinator.com | 2024-03-07

    Diffusion unet has an "extended" version nowadays that applies to the resnet part as well as the cross-attention: https://github.com/cloneofsimo/lora

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo
  • OpenMQTTGateway

    MQTT gateway for ESP8266 or ESP32 with bidirectional 433mhz/315mhz/868mhz, Infrared communications, BLE, Bluetooth, beacons detection, mi flora, mi jia, LYWSD02, LYWSD03MMC, Mi Scale, TPMS, BBQ thermometer compatibility & LoRa.

  • Project mention: Making BLE Remote Smart | /r/smarthome | 2023-12-06

    What do you think about https://docs.openmqttgateway.com/ ?

  • ExpressLRS

    STM32/ESP32/ESP8285-based High-Performance Radio Link for RC applications

  • Project mention: ExpressLRS-Configurator rant | /r/ExpressLRS | 2023-10-05

    Just put the firmware builds under https://github.com/ExpressLRS/ExpressLRS/releases

  • Anima

    33B Chinese LLM, DPO QLORA, 100K context, AirLLM 70B inference with single 4GB GPU

  • Project mention: AirLLM | news.ycombinator.com | 2023-12-28
  • firmware

    Meshtastic device firmware (by meshtastic)

  • Project mention: Show HN: Extend Zigbee sensor range with LoRaWAN | news.ycombinator.com | 2024-03-18

    This is a fantastic idea, thanks for sharing. I feel like LoRaWAN and LoRAMESH are the perfect solution for shuffling messaging around for home and property sensors, easily traversing a couple miles in poor conditions.

    Prior to seeing this I was thinking about how to use the Meshtastic [0] project to fundamentally provide simple UDP services for message brokering over LoRa. There are so many sensors that could easily hook or connect to devices acting as network routers that could bridge other protocols across long distances very easily.

    Have you looked at doing something similar with ZWave at all?

    [0] https://meshtastic.org/

  • xTuring

    Build, customize and control you own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6

  • Project mention: I'm developing an open-source AI tool called xTuring, enabling anyone to construct a Language Model with just 5 lines of code. I'd love to hear your thoughts! | /r/machinelearningnews | 2023-09-07

    Explore the project on GitHub here.

  • LongLoRA

    Code and documents of LongLoRA and LongAlpaca (ICLR 2024 Oral)

  • Project mention: Ask HN: AI/ML papers to catch up with current state of AI? | news.ycombinator.com | 2023-12-15

    LongAlpaca / One of many ways to extend context, and a useful dataset / https://arxiv.org/abs/2309.12307

  • adapters

    A Unified Library for Parameter-Efficient and Modular Transfer Learning

  • ESP32-Paxcounter

    Wifi & BLE driven passenger flow metering with cheap ESP32 boards

  • Project mention: Building an occupancy sensor with a $5 ESP32 and a serverless DB | news.ycombinator.com | 2023-11-13

    Theres this using ESP32 and LoRa, where you can order readymade hardware: https://cyberman54.github.io/ESP32-Paxcounter/

  • Reticulum

    The cryptography-based networking stack for building unstoppable networks with LoRa, Packet Radio, WiFi and everything in between.

  • Project mention: Meshtastic: An open source, off-grid, decentralized, mesh network | news.ycombinator.com | 2023-12-31

    Any views/comparison reagarding freakwan versus reticulum https://github.com/markqvist/Reticulum ?

  • Lua-RTOS-ESP32

    Lua RTOS for ESP32

  • onediff

    OneDiff: An out-of-the-box acceleration library for diffusion models.

  • Project mention: Accelerating Stable Video Diffusion 3x Faster with OneDiff DeepCache and Int8 | news.ycombinator.com | 2024-01-29

    --output-video path/to/output_image.mp4

    Run with ComfyUI

    Run with OneDiff workflow: https://github.com/siliconflow/onediff/blob/main/onediff_com...

    Run with OneDiff + DeepCache workflow: https://github.com/siliconflow/onediff/blob/main/onediff_com...

    The use of Int8 can be referenced in the workflow: https://github.com/siliconflow/onediff/blob/main/onediff_com...

  • OneTrainer

    OneTrainer is a one-stop solution for all your stable diffusion training needs.

  • Project mention: Now You Can Full Fine Tune / DreamBooth Stable Diffusion XL (SDXL) with only 10.3 GB VRAM via OneTrainer | dev.to | 2024-03-25

    Used SG161222/RealVisXL_V4.0 as a base model and OneTrainer to train on Windows 10 : https://github.com/Nerogar/OneTrainer

  • lorawan-server

    Compact server for private LoRaWAN networks

  • lorawan-stack

    The Things Stack, an Open Source LoRaWAN Network Server

  • punica

    Serving multiple LoRA finetuned LLM as one

  • Project mention: Punica: Serving multiple LoRA finetuned LLM as one | news.ycombinator.com | 2023-11-08
  • SoftRF

    :airplane: Multi-functional, compatible DIY general aviation proximity awareness system

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2024-04-02.

Lora related posts

Index

What are some of the best open-source Lora projects? This list will help you:

Project Stars
1 Chinese-LLaMA-Alpaca 17,140
2 LLaMA-Factory 16,319
3 stable-diffusion-webui-colab 15,209
4 peft 13,670
5 LoRA 8,890
6 BELLE 7,491
7 lora 6,579
8 OpenMQTTGateway 3,412
9 ExpressLRS 3,072
10 Anima 2,770
11 firmware 2,702
12 xTuring 2,510
13 LongLoRA 2,417
14 adapters 2,382
15 ESP32-Paxcounter 1,645
16 Reticulum 1,519
17 Lua-RTOS-ESP32 1,147
18 onediff 1,094
19 OneTrainer 1,076
20 lorawan-server 912
21 lorawan-stack 900
22 punica 801
23 SoftRF 702
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com