leptonai
ivy
| leptonai | ivy | |
|---|---|---|
| 2 | 17 | |
| 2,469 | 14,025 | |
| 5.7% | 0.1% | |
| 9.7 | 10.0 | |
| 3 days ago | 11 days ago | |
| Python | Python | |
| Apache License 2.0 | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
leptonai
-
Show HN: Running LLMs in one line of Python without Docker
Hello Hacker News! We're Yangqing, Xiang and JJ from lepton.ai. We are building a platform to run any AI models as easy as writing local code, and to get your favorite models in minutes. It's like container for AI, but without the hassle of actually building a docker image.
We built and contributed to some of the world's most popular AI software - PyTorch 1.0, ONNX, Caffe, etcd, Kubernetes, etc. We also managed hundreds of thousands of computers in our previous jobs. And we found that the AI software stack is usually unnecessarily complex - and we want to change that.
Imagine if you are a developer who sees a good model on github, or HuggingFace. To make it a production ready service, the current solution usually requires you to build a docker image. But think about it - I have a few python code and a few python dependencies. That sounds like a huge overhead, right?
lepton.ai is really a pythonic way to free you from such difficulties. You write a simple python scaffold around your PyTorch / TensorFlow code, and lepton launches it as a full-fledged service callable via python, javascript, or any language that understands OpenAPI. We use containers under the hood, but you don't need to worry about all the infrastructure nuts and bolts.
We have made the python library open-source at https://github.com/leptonai/leptonai/. With it, launching a common HuggingFace model is as simple as a one liner. For example, if you have a GPU, Stable Diffusion XL is as simple as:
```
- Lepton: An open-source library (Apache 2.0) for scaling model inference
ivy
-
Keras 3.0
See also https://github.com/unifyai/ivy which I have not tried but seems along the lines of what you are describing, working with all the major frameworks
-
Show HN: Carton – Run any ML model from any programming language
is this ancillary to what [these guys](https://github.com/unifyai/ivy) are trying to do?
- Ivy: All in one machine learning framework
- Ivy ML Transpiler and Framework
-
[D] Keras 3.0 Announcement: Keras for TensorFlow, JAX, and PyTorch
https://unify.ai/ They are trying to do what Ivy is doing already.
-
Ask for help: what is the best way to have code both support torch and numpy?
Check Ivy.
-
CoreML Stable Diffusion
ROCm's great for data centers, but good luck finding anything about desktop GPUs on their site apart from this lone blog post: https://community.amd.com/t5/instinct-accelerators/exploring...
There's a good explanation of AMD's ROCm targets here: https://news.ycombinator.com/item?id=28200477
It's currently a PITA to get common Python libs like Numba to even talk to AMD cards (admittedly Numba won't talk to older Nvidia cards either and they deprecate ruthlessly; I had to downgrade 8 versions to get it working with a 5yo mobile workstation). YC-backed Ivy claims to be working on unifying ML frameworks in a hardware-agnostic way but I don't have enough experience to assess how well they're succeeding yet: https://lets-unify.ai
I was happy to see DiffusionBee does talk the GPU in my late-model intel Mac, though for some reason it only uses 50% of its power right now. I'm sure the situation will improve as Metal 3.0 and Vulkan get more established.
-
DL Frameworks in a nutshell
Won't it all come together with https://lets-unify.ai/ ?
- Unified Machine Learning
-
[Discussion] Opinions on unify AI
What do you think about unify AI https://lets-unify.ai.
What are some alternatives?
examples - Lepton Examples
PaddleNLP - 👑 Easy-to-use and powerful NLP and LLM library with 🤗 Awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications, including 🗂Text Classification, 🔍 Neural Search, ❓ Question Answering, ℹ️ Information Extraction, 📄 Document Intelligence, 💌 Sentiment Analysis etc.
Pytorch - Tensors and Dynamic neural networks in Python with strong GPU acceleration
ColossalAI - Making large AI models cheaper, faster and more accessible
chainer - A flexible framework of neural networks for deep learning
DeepFaceLive - Real-time face swap for PC streaming or video calls
ivy - The Unified Machine Learning Framework [Moved to: https://github.com/unifyai/ivy]
PaddleOCR - Awesome multilingual OCR toolkits based on PaddlePaddle (practical ultra lightweight OCR system, support 80+ languages recognition, provide data annotation and synthesis tools, support training and deployment among server, mobile, embedded and IoT devices)
server - The Triton Inference Server provides an optimized cloud and edge inferencing solution.
lisp - Toy Lisp 1.5 interpreter
ImageAI - A python library built to empower developers to build applications and systems with self-contained Computer Vision capabilities
Kornia - Geometric Computer Vision Library for Spatial AI