SaaSHub helps you find the best software and product alternatives Learn more β
Top 17 Python information-extraction Projects
-
PaddleNLP
π Easy-to-use and powerful NLP and LLM library with π€ Awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications, including πText Classification, π Neural Search, β Question Answering, βΉοΈ Information Extraction, π Document Intelligence, π Sentiment Analysis etc.
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
RomBuster
RomBuster is a router exploitation tool that allows to disclosure network router admin password.
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
-
IRCP
A robust information gathering tool for large scale reconnaissance on Internet Relay Chat servers π°οΈ (by internet-relay-chat)
-
CyberSecurityAuditScript
Security audit script decreases info gathering from average of 5 minutes, to 20 seconds, and returns everything into a textfile.
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
Project mention: Would this method work to increase the memory of the model? Saving summaries generated by a 2nd model and injecting them depending on the current topic. | /r/LocalLLaMA | 2023-06-09
Check out kor
First time coming across this, looks very cool! Definitely some ideas there that I'd like to implement for osintbuddy. Another project I'm going to be taking some ideas from is: https://github.com/ail-project/ail-framework - a modular framework to analyse potential information leaks
Project mention: A LLM trained to follow annotation guidelines, for information extraction tasks | news.ycombinator.com | 2023-10-30
Project mention: IRCP: A robust information gathering tool for large scale reconnaissance on Internet Relay Chat servers | /r/netsec | 2023-06-07
Conventional Knowledge Graph Construction (KGC) approaches typically follow the static information extraction paradigm with a closed set of pre-defined schema. As a result, such approaches fall short when applied to dynamic scenarios or domains, whereas a new type of knowledge emerges. This necessitates a system that can handle evolving schema automatically to extract information for KGC. To address this need, we propose a new task called schema-adaptable KGC, which aims to continually extract entity, relation, and event based on a dynamically changing schema graph without re-training. We first split and convert existing datasets based on three principles to build a benchmark, i.e., horizontal schema expansion, vertical schema expansion, and hybrid schema expansion; then investigate the schema-adaptable performance of several well-known approaches such as Text2Event, TANL, UIE and GPT-3. We further propose a simple yet effective baseline dubbed AdaKGC, which contains schema-enriched prefix instructor and schema-conditioned dynamic decoding to better handle evolving schema. Comprehensive experimental results illustrate that AdaKGC can outperform baselines but still have room for improvement. We hope the proposed work can deliver benefits to the community. Code and datasets will be available in https://github.com/zjunlp/AdaKGC.
Python information-extraction related posts
- Pydentic in prompt engineering
- 27-Jun-2023
- Guidance on creating a very lightweight model that does one task very well
- Kor: Extract structured data using LLMs
- Kor: Extract structured data using LLMs
- A minimal design pattern for LLM-powered microservices with FastAPI & LangChain
- Information extraction in large documents with LLMs
-
A note from our sponsor - SaaSHub
www.saashub.com | 26 Apr 2024
Index
What are some of the best open-source information-extraction projects in Python? This list will help you:
Project | Stars | |
---|---|---|
1 | PaddleNLP | 11,423 |
2 | DeepKE | 2,929 |
3 | InvoiceNet | 2,382 |
4 | kor | 1,501 |
5 | 007-TheBond | 1,030 |
6 | ail-framework | 495 |
7 | RomBuster | 423 |
8 | medaCy | 412 |
9 | MedCAT | 408 |
10 | GoLLIE | 204 |
11 | huspacy | 147 |
12 | htmldate | 106 |
13 | targetedSummarization | 87 |
14 | KIE_invoice_minimal | 49 |
15 | IRCP | 44 |
16 | AdaKGC | 16 |
17 | CyberSecurityAuditScript | 9 |
Sponsored