synthesizer
pytorch-lightning
| synthesizer | pytorch-lightning | |
|---|---|---|
| 4 | 1 | |
| 566 | 18,249 | |
| - | - | |
| 10.0 | 9.9 | |
| 5 months ago | about 2 years ago | |
| Python | Python | |
| Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
synthesizer
-
Phibrarian Alpha - the first model checkpoint from SciPhi's Mistral-7b
The run is a few days in on a 8x 80gb A100 cluster, and I quietly released the first epoch checkpoint here. I am building the model in association with our synthetic data efforts here, at SciPhi.
-
With LLMs we can create a fully open-source Library of Alexandria.
I am updating because we have another interesting result - by going deeper instead of broader, and by combining new techniques like RAG, we can make incredibly descriptive textbooks. This one here was generated by a ~fully AI pipeline. The pipeline goes MIT OCW -> Syllabus -> Table of Contents -> Textbook. The last step is grounded through vector-lookups over the whole of Wikipedia.
- Textbook was authored with an AI pipeline
-
Looking for fine-tuners who want to build an exciting new model -
The timing is great, because yesterday I introduced RAG into the synthetic generation pipeline [here](https://github.com/emrgnt-cmplxty/sciphi/tree/main). I'm in the process of indexing the entirety of this pypi dataset using ChromaDB in the cloud. It will be relatively easy to plug this into SciPhi when done.
pytorch-lightning
-
Introduction to PyTorch
PyTorch Lightning
What are some alternatives?
spaCy - 💫 Industrial-strength Natural Language Processing (NLP) in Python
autoscraper - A Smart, Automatic, Fast and Lightweight Web Scraper for Python
pytorch_geometric - Graph Neural Network Library for PyTorch [Moved to: https://github.com/pyg-team/pytorch_geometric]
thinc - 🔮 A refreshing functional take on deep learning, compatible with your favorite libraries
data-centric-ai - Resources for Data Centric AI
pytorch-lightning - Pretrain, finetune and deploy AI models on multiple GPUs, TPUs with zero code changes.
PyTorch-NLP - Basic Utilities for PyTorch Natural Language Processing (NLP)
stableagents - Stable, Semi-Autonomous, Reliable and Steerable LLM Agents for production use cases.
breaching - Breaching privacy in federated learning scenarios for vision and text
cover-agent - CodiumAI Cover-Agent: An AI-Powered Tool for Automated Test Generation and Code Coverage Enhancement! 💻🤖🧪🐞
tutorials - PyTorch tutorials.