datasets
openlibrary
datasets | openlibrary | |
---|---|---|
15 | 409 | |
18,443 | 4,848 | |
1.0% | 1.3% | |
9.5 | 9.9 | |
1 day ago | 4 days ago | |
Python | Python | |
Apache License 2.0 | GNU Affero General Public License v3.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
datasets
- 🐍🐍 23 issues to grow yourself as an exceptional open-source Python expert 🧑💻 🥇
- Mastering ROUGE Matrix: Your Guide to Large Language Model Evaluation for Summarization with Examples
-
How to Train Large Models on Many GPUs?
https://github.com/huggingface/datasets
https://github.com/huggingface/transformers
-
[D] Can we use Ray for distributed training on vertex ai ? Can someone provide me examples for the same ? Also which dataframe libraries you guys used for training machine learning models on huge datasets (100 gb+) (because pandas can't handle huge data).
https://huggingface.co/docs/datasets backed with an Arrow file or buffer
- Need help with a data science project
-
Is there a text evaluation metric that does not need reference text?
I'm looking for an automatic evaluation metric that can score the first text higher (since it's more grammatically correct/better for other reasons). All the metrics for NLG I found require some reference text to match the generated text with, which I don't have.
-
FauxPilot – an open-source GitHub Copilot server
And then pass that my_code.json as the dataset name.
[1] https://github.com/huggingface/datasets
-
Hugging Face Introduces ‘Datasets’: A Lightweight Community Library For Natural Language Processing (NLP)
Code for https://arxiv.org/abs/2109.02846 found: https://github.com/huggingface/datasets
Quick Read | Paper | Github
- Datasets: A Community Library for Natural Language Processing
openlibrary
- Internet Archive: Open Library
-
Ask HN: Anyone looking for contributors for their open source projects
I'd like to make a pitch for Openlibrary.org the free online library from Internet Archive that includes a fulltext search of millions of books.
I've been volunteering with them on and off for several years and it's always a lovely experience. Their backend is python and frontend mostly from python templates and some Vue for librarian stuff.
Every Tuesday they have a call on Zoom that everyone is welcome to join to share what they're working on, ask for help, and generally chat a bit. It's a great time.
Depending on what you're interested in there's a lot to do from helping build import pipelines for more book entries, writing bots to cleanup data, Performance improvements, better documenting public APIs, etc
I'm currently slowly working on a wikidata integration for their authors page. We also could use some help upgrading to Vue 3, mentors for Google summer of code would be helpful, find of ML projects needing help, moving away from old jQuery libraries, etc.
They can be quite responsive to PRs too like I blogged about here: https://blog.rayberger.org/idea-to-merged-in-less-than-30-mi...
For example, here's a small issue that could use some help on the python side: https://github.com/internetarchive/openlibrary/issues/8928
-
Building an Open Source Decentralized E-Book Search Engine
OpenLibrary does provide search access to full texts. For example: https://openlibrary.org/search/inside?q=%22institutional+thi...
It is open source and they're always looking for contributors. I think they'd especially welcome help improving search!
https://github.com/internetarchive/openlibrary/
- Show HN: Mutable.ai – Turn your codebase into a Wiki
-
MLIS books available digitally?
Check out https://openlibrary.org. You can search ´library science’, librarian’, etc, and something should come up. Just select the ‘ebooks’ option to search for items within the collection. And you can narrow the search by subject, etc.
- HMF a “legal” website to download books
-
NaNoWriMo: National Novel Writing Month
Right now I'm in the middle of the chicken and the egg problem where we don't have enough authors cataloging their publications and b/c of that obviously readers are not interested in using the site.
I've gone back and forth with taking Open Libray's [0] catalog as that would at least flesh out our collection of books but then I'd have to deal with verifying authors to accounts so they can access their books. Which sounds like a major headache and also just defeats the concept of building a community.
Since this is really a weekend project, I'm just going to keep building the tools out to perfection and hope people will trickle in over time.
Luckily for me I just want to write, so the tools I'm building are exactly what works for my writing goals and I think overtime others will find the same value.
[0] https://openlibrary.org
-
is there any way to read books for free?
Here's one: https://openlibrary.org/
-
YSK: You can access many old and out of print hiking books from the Internet Archive's Open Library
The Internet Archive runs what they call the Open Library, which is a unique concept on the traditional library. You can sign-up with minimal details and digitally check out many scanned books from libraries all over the world. The only caveat is that almost all of the books are older editions - ones that would be impossible to find locally. It's great if you're looking for old routes, a look back in time, details about obscure areas, or just prefer to read a book rather than browse AllTrails. Please do still support local authors whenever you can as guidebooks take hundreds of hours to create and are slowly going extinct.
-
🐍🐍 23 issues to grow yourself as an exceptional open-source Python expert 🧑💻 🥇
Repo : https://github.com/internetarchive/openlibrary
What are some alternatives?
sentence-transformers - Multilingual Sentence & Image Embeddings with BERT
DeDRM_tools - DeDRM tools for ebooks
datumaro - Dataset Management Framework, a Python library and a CLI tool to build, analyze and manage Computer Vision datasets.
calibre - The official source code repository for the calibre ebook manager
cypress-realworld-app - A payment application to demonstrate real-world usage of Cypress testing methods, patterns, and workflows.
bypass-paywalls-chrome - Bypass Paywalls web browser extension for Chrome and Firefox.
edex-ui - A cross-platform, customizable science fiction terminal emulator with advanced monitoring & touchscreen support.
launcher - Launcher for Flashpoint Archive
first-contributions - 🚀✨ Help beginners to contribute to open source projects
ArchiveBox - 🗃 Open source self-hosted web archiving. Takes URLs/browser history/bookmarks/Pocket/Pinboard/etc., saves HTML, JS, PDFs, media, and more...
frankmocap - A Strong and Easy-to-use Single View 3D Hand+Body Pose Estimator
web - The source code for the Standard Ebooks website.