unilm
darling
unilm | darling | |
---|---|---|
41 | 116 | |
18,614 | 11,092 | |
3.0% | 1.1% | |
9.0 | 8.1 | |
3 days ago | 3 days ago | |
Python | Objective-C | |
MIT License | GNU General Public License v3.0 only |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
unilm
- The Era of 1-Bit LLMs: Training_Tips, Code And_FAQ [pdf]
- The Era of 1-Bit LLMs: Training Tips, Code and FAQ
-
The Era of 1-bit LLMs: ternary parameters for cost-effective computing
+1 On this, the real proof would have been testing both models side-by-side.
It seems that it may be published on GitHub [1] according to HuggingFace [2].
[1] https://github.com/microsoft/unilm/tree/master/bitnet
[2] https://huggingface.co/papers/2402.17764
- I'm an Old Fart and AI Makes Me Sad
-
On building a semantic search engine
e5-mistral is essentially a distillation from gpt-4 to a smaller model. You can see here https://github.com/microsoft/unilm/blob/16da2f193b9c1dab0a69...
they actually have custom prompts for each dataset being tested.
Question would be, if you haven't seen the task before, what is a good prompt to prepend for your task?
IMO e5-mistral is overfit to MTEB
-
Leveraging GPT-4 for PDF Data Extraction: A Comprehensive Guide
Layout LM v1, v2 and v3 models [ Github ] DocBERT [ Github ]
-
Microsoft Publishes LongNet: Scaling Transformers to 1,000,000,000 Tokens
The repository is available here.
-
Recommended open LLMs with image input modality?
It is missing kosmos-2. I remember its image captioning was(demo currently down) really good and it's almost as fast as llava and lavin.
-
LongNet: Scaling Transformers to 1,000,000,000 Tokens
Should be this: https://github.com/microsoft/unilm/
-
[R] LongNet: Scaling Transformers to 1,000,000,000 Tokens
This is from Microsoft Research (Asia). https://aka.ms/GeneralAI
darling
- Zed is now open source
-
MacOS like WINE
There is actually a Wine-like transplier called Darling. The problem is that development is very slow because there is not as much need for MacOS programs on Linux, and there is a huge shortage of volunteers and manpower. And it has been rendered almost obsolete because Apple moved to ARM. Additionally 90% of Apple's API is closed source despite Apple claiming to champion open source.
-
RavynOS Finesse of macOS. Freedom of FreeBSD
Unfortunately not. Darling [0] is still at the point that it can only run command line applications. Only the most basic GUI applications are supported. That's still a massive accomplishment that I don't want to diminish, but it's nowhere near the point that WINE was at even quite a long time ago.
[0] https://www.darlinghq.org/
-
Darling: Run macOS Software on Linux
xcodebuild CLI to compile iOS apps without a Mac. Seems possible in theory, although there's an ongoing issue some are seeing apparently: https://github.com/darlinghq/darling/issues/488
- Whisky: Wine Supercharged with the Power of Apple's Game Porting Toolkit
- The first conformant M1 GPU driver
- Darling – macOS Emulation Layer for Linux
-
Building a Custom Mach-O Memory Loader for macOS
I wonder if there's opportunity for overlap with darling (https://www.darlinghq.org/) here, somewhat like using WINE on top of actual Windows.
-
Darling: The Wine of MacOS!
Hi guys, just wanted to make a quick shoutout to Darling since not a lot people seem to know about it, which is a compatibility layer like Wine for Linux, but it allows for MacOS applications instead of Windows apps to be able to run on Linux!
What are some alternatives?
transformers - 🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
text-generation-webui - A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
ERNIE - Official implementations for various pre-training models of ERNIE-family, covering topics of Language Understanding & Generation, Multimodal Understanding & Generation, and beyond.
macOS-Simple-KVM - Tools to set up a quick macOS VM in QEMU, accelerated by KVM.
involution - [CVPR 2021] Involution: Inverting the Inherence of Convolution for Visual Recognition, a brand new neural operator
ravynos - A BSD-based OS project that aims to provide source and binary compatibility with macOS® and a similar user experience.
gensim - Topic Modelling for Humans
Lenovo-Thinkpad-T450-T450s-Hackintosh-Guide-Opencore - This repo contains the installation guide and EFI files required to get a perfectly functional Catalina and Big Sur hackintosh on your Brodwell (5th gen) T450 or T450s. Everything is stable and functional as described in the Readme.
maelstrom - A workbench for writing toy implementations of distributed systems.
macos-virtualbox - Push-button installer of macOS Catalina, Mojave, and High Sierra guests in Virtualbox on x86 CPUs for Windows, Linux, and macOS
rasa - 💬 Open source machine learning framework to automate text- and voice-based conversations: NLU, dialogue management, connect to Slack, Facebook, and more - Create chatbots and voice assistants
nonguix - Nonguix mirror – pull requests ignored, please use upstream for that