Our great sponsors
-
repugnant-pickle
Low effort scraping Python's pickle format in Rust. It is to complete pickle parsing as BeautifulSoup was to complete HTML parsing.
-
smolrsrwkv
A relatively basic implementation of RWKV in Rust written by someone with very little math and ML knowledge. Supports 32, 8 and 4 bit evaluation. It can also directly load PyTorch RWKV models.
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
The repo has a detailed README: https://github.com/KerfuffleV2/repugnant-pickle
For an example of actually using it, you can look at my little project for running inference on RWKV models: https://github.com/KerfuffleV2/smolrsrwkv It uses repugnant-pickle to enable loading PyTorch models directly with no conversion requirement or Python dependencies.
Related posts
- Is GPT-4 still just a language model trying to predict text?
- I created a simple implementation of the RWKV language model (RWKV competes with the dominant Transformers-based approach which is the "T" in GPT)
- ChatGPT saved this dog's life...
- People who've used RWKV, whats your wishlist for it?
- Onnx Runtime: “Cross-Platform Accelerated Machine Learning”