paperetl
covid19
Our great sponsors
| paperetl | covid19 | |
|---|---|---|
| 12 | 1 | |
| 315 | 6 | |
| 7.6% | - | |
| 6.3 | 0.0 | |
| 4 months ago | 9 months ago | |
| Python | Vue | |
| Apache License 2.0 | GNU General Public License v3.0 only |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
paperetl
- Show HN: Open-source Rule-based PDF parser for RAG
-
Oracle of Zotero: LLM QA of Your Research Library
Nice project!
I've spent quite a lot of time in the medical/scientific literature space. With regards to LLMs, specifically RAG, how the data is chunked is quite important. With that, I have a couple projects that might be beneficial additions.
paperetl (https://github.com/neuml/paperetl) - supports parsing arXiv, PubMed and integrates with GROBID to handle parsing metadata and text from arbitrary papers.
paperai (https://github.com/neuml/paperai) - builds embeddings databases of medical/scientific papers. Supports LLM prompting, semantic workflows and vector search. Built with txtai (https://github.com/neuml/txtai).
While arbitrary chunking/splitting can work, I've found that integrating parsing that has knowledge of medical/scientific paper structure increases the overall accuracy and experience of downstream applications.
-
[P] Parse research papers into structured data
paperai | paperetl
-
Seeking Advice: How to extract Abstract from scientific journals (.pdfs) 10k+.
paperai and paperetl are a set of projects to consider for this task.
- paperetl: ETL processes for medical and scientific papers
covid19
We haven't tracked posts mentioning covid19 yet.
Tracking mentions began in Dec 2020.
What are some alternatives?
SciencePlots - Matplotlib styles for scientific plotting
tika-python - Tika-Python is a Python binding to the Apache Tika™ REST services allowing Tika to be called natively in the Python community.
ciscoconfparse - Parse, Audit, Query, Build, and Modify Cisco IOS-style configurations.
paperai - 📄 🤖 Semantic search and workflows for medical/scientific papers
dagster - An orchestration platform for the development, production, and observation of data assets.
rdm - Our regulatory documentation manager. Streamlines 62304, 14971, and 510(k) documentation for software projects.
science-parse - Science Parse parses scientific papers (in PDF form) and returns them in structured form.
dashboard - The Rancher UI
llmsherpa - Developer APIs to Accelerate LLM Projects
grobid - A machine learning software for extracting information from scholarly documents