squirrel-core
datasets
squirrel-core | datasets | |
---|---|---|
1 | 15 | |
279 | 18,411 | |
0.7% | 0.8% | |
5.6 | 9.5 | |
6 days ago | 6 days ago | |
Python | Python | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
squirrel-core
-
[P] Squirrel: A new OS library for fast & flexible large-scale data loading
Today we open-sourced Squirrel, a data infrastructure library that my colleagues and I have been working on over the past 1.5 years: https://github.com/merantix-momentum/squirrel-core
datasets
- 🐍🐍 23 issues to grow yourself as an exceptional open-source Python expert 🧑💻 🥇
- Mastering ROUGE Matrix: Your Guide to Large Language Model Evaluation for Summarization with Examples
-
How to Train Large Models on Many GPUs?
https://github.com/huggingface/datasets
https://github.com/huggingface/transformers
-
[D] Can we use Ray for distributed training on vertex ai ? Can someone provide me examples for the same ? Also which dataframe libraries you guys used for training machine learning models on huge datasets (100 gb+) (because pandas can't handle huge data).
https://huggingface.co/docs/datasets backed with an Arrow file or buffer
- Need help with a data science project
-
Is there a text evaluation metric that does not need reference text?
I'm looking for an automatic evaluation metric that can score the first text higher (since it's more grammatically correct/better for other reasons). All the metrics for NLG I found require some reference text to match the generated text with, which I don't have.
-
FauxPilot – an open-source GitHub Copilot server
And then pass that my_code.json as the dataset name.
[1] https://github.com/huggingface/datasets
-
Hugging Face Introduces ‘Datasets’: A Lightweight Community Library For Natural Language Processing (NLP)
Code for https://arxiv.org/abs/2109.02846 found: https://github.com/huggingface/datasets
Quick Read | Paper | Github
- Datasets: A Community Library for Natural Language Processing
What are some alternatives?
squirrel-datasets-core - Squirrel dataset hub
sentence-transformers - Multilingual Sentence & Image Embeddings with BERT
talking-head-anime-3-demo - Demo Programs for the "Talking Head(?) Anime from a Single Image 3: Now the Body Too" Project
datumaro - Dataset Management Framework, a Python library and a CLI tool to build, analyze and manage Computer Vision datasets.
ML-YouTube-Courses - 📺 Discover the latest machine learning / AI courses on YouTube.
cypress-realworld-app - A payment application to demonstrate real-world usage of Cypress testing methods, patterns, and workflows.
PDEBench - PDEBench: An Extensive Benchmark for Scientific Machine Learning
edex-ui - A cross-platform, customizable science fiction terminal emulator with advanced monitoring & touchscreen support.
deeplake - Database for AI. Store Vectors, Images, Texts, Videos, etc. Use with LLMs/LangChain. Store, query, version, & visualize any AI data. Stream data in real-time to PyTorch/TensorFlow. https://activeloop.ai
first-contributions - 🚀✨ Help beginners to contribute to open source projects
speaking_with_plato - Exploring Plato's philosophy with AI - A Data Spiral blog article
frankmocap - A Strong and Easy-to-use Single View 3D Hand+Body Pose Estimator