Llama-2-Onnx
pytorch-forecasting
| Llama-2-Onnx | pytorch-forecasting | |
|---|---|---|
| 3 | 9 | |
| 990 | 3,648 | |
| 2.3% | - | |
| 6.7 | 8.6 | |
| 5 months ago | 5 days ago | |
| Python | Python | |
| GNU General Public License v3.0 or later | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Llama-2-Onnx
-
Show HN: Fine-tune your own Llama 2 to replace GPT-3.5/4
System: Here's some docs, answer concisely in a sentence.
YMMV on cost still, depends on cloud vendor, and my intuition & viewpoint agrees with yours, GPT-3.5 is priced low enough that there isn't a case where it makes sense to use another model.
It strikes me now that _very_ likely and not just our intuition: OpenAI's $/GPU hour is likely <= any other vendor's.
The next big step will come from formalizing the stuff rolling around the local LLM community, for months now it's either been one-off $X.c stunts that run on desktop, and the vast majority of the _actual_ usage and progress is coming from porn-y stuff, like all nascent tech.
Microsoft has LLaMa-2 ONNX available on GitHub[1]. There's budding but very small projects in different languages to wrap ONNX. Once there's a genuine cross-platform[2] ONNX wrapper that makes running LLaMa-2 easy, there will be a step change. It'll be "free"[3] to run your fine-tuned model that does as well as GPT-4 .
It's not clear to me exactly when this will occur. It's "difficult" now, but only because the _actual usage_ in the local LLM community doesn't have a reason to invest in ONNX, and it's extremely intimidating to figure out how exactly to get LLaMa-2 running in ONNX. Microsoft kinda threw it up on GitHub and moved on, the sample code even still needs a PyTorch model. I see at least one very small company on HuggingFace that _may_ have figured out full ONNX.
[1] https://github.com/microsoft/Llama-2-Onnx
- FLaNK Stack Weekly for 14 Aug 2023
- Llama 2 on ONNX runs locally
pytorch-forecasting
- FLaNK Stack Weekly for 14 Aug 2023
-
Pytorch Lstm
Source: Conversation with Bing, 4/5/2023 (1) jdb78/pytorch-forecasting: Time series forecasting with PyTorch - GitHub. https://github.com/jdb78/pytorch-forecasting. (2) Time Series Prediction with LSTM Using PyTorch - Colaboratory. https://colab.research.google.com/github/dlmacedo/starter-academic/blob/master/content/courses/deeplearning/notebooks/pytorch/Time_Series_Prediction_with_LSTM_Using_PyTorch.ipynb. (3) time-series-classification · GitHub Topics · GitHub. https://github.com/topics/time-series-classification. (4) PyTorch: Dataloader for time series task - Stack Overflow. https://stackoverflow.com/questions/57893415/pytorch-dataloader-for-time-series-task.
-
[D] What is the best approach to create embeddings for time series with additional historical events to use with Transformers model?
Temporal fusion transformer https://github.com/jdb78/pytorch-forecasting
-
LSTM/CNN architectures for time series forecasting[Discussion]
Pytorch-forecasting
- Can someone help me with this? It's been days that i struggle with this problem, Forecasting w DeepAR
- Can someone help me with this? it's been days that i struggle with this problem
-
[P] Beware of false (FB-)Prophets: Introducing the fastest implementation of auto ARIMA [ever].
To name a few: https://github.com/jdb78/pytorch-forecasting, https://github.com/unit8co/darts, https://github.com/Nixtla/neuralforecast
-
When to go for an 'easy' time-series model vs. using a complex deep learning model (when having experience with the latter)
I'm a data trainee at this organisation. I wrote my master thesis about using an event clustering mechanism to enrich an existing dataset to improve short-term demand predictions, using Pytorch Forecasting using the temporal fusion transformer component, and LightGBM (and compare the models with and w/o the event feature, so 4 runs in total).
-
A python library for easy manipulation and forecasting of time series.
Darts is a pretty nice one. I've recently been using pytorch-forecasting for larger models like the Temporal Fusion Transformer. https://github.com/jdb78/pytorch-forecasting
What are some alternatives?
vllm - A high-throughput and memory-efficient inference and serving engine for LLMs
darts - A python library for user-friendly forecasting and anomaly detection on time series.
pkgx - the last thing you’ll install
Prophet - Tool for producing high quality forecasts for time series data that has multiple seasonality with linear or non-linear growth.
onnx-coreml - ONNX to Core ML Converter
neuralforecast - Scalable and user friendly neural :brain: forecasting algorithms.
OpenPipe - Turn expensive prompts into cheap fine-tuned models
Lime-For-Time - Application of the LIME algorithm by Marco Tulio Ribeiro, Sameer Singh, Carlos Guestrin to the domain of time series classification
awesome-data-temporality - A curated list to help you manage temporal data across many modalities 🚀.
pytorch-lightning - Build high-performance AI models with PyTorch Lightning (organized PyTorch). Deploy models with Lightning Apps (organized Python to build end-to-end ML systems). [Moved to: https://github.com/Lightning-AI/lightning]
llama.cpp - LLM inference in C/C++
tslearn - The machine learning toolkit for time series analysis in Python