ChatGPT_for_IE
ARElight
| ChatGPT_for_IE | ARElight | |
|---|---|---|
| 1 | 3 | |
| 133 | 35 | |
| -0.8% | - | |
| 8.1 | 8.7 | |
| 7 months ago | about 1 month ago | |
| Python | Python | |
| Apache License 2.0 | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
ChatGPT_for_IE
-
Evaluating ChatGPT's Information Extraction Capabilities: An Assessment
Abstract: The capability of Large Language Models (LLMs) like ChatGPT to comprehend user intent and provide reasonable responses has made them extremely popular lately. In this paper, we focus on assessing the overall ability of ChatGPT using 7 fine-grained information extraction (IE) tasks. Specially, we present the systematically analysis by measuring ChatGPT's performance, explainability, calibration, and faithfulness, and resulting in 15 keys from either the ChatGPT or domain experts. Our findings reveal that ChatGPT's performance in Standard-IE setting is poor, but it surprisingly exhibits excellent performance in the OpenIE setting, as evidenced by human evaluation. In addition, our research indicates that ChatGPT provides high-quality and trustworthy explanations for its decisions. However, there is an issue of ChatGPT being overconfident in its predictions, which resulting in low calibration. Furthermore, ChatGPT demonstrates a high level of faithfulness to the original text in the majority of cases. We manually annotate and release the test sets of 7 fine-grained IE tasks contains 14 datasets to further promote the research. The datasets and code are available at this https URL - https://github.com/pkuserc/ChatGPT_for_IE
ARElight
-
Hacker News top posts: Jun 19, 2022
Show HN: ARElight – A Mass-Media Processing Application for Relation Extraction\ (8 comments)
- Show HN: ARElight – A Mass-Media Processing Application for Relation Extraction
What are some alternatives?
zshot - Zero and Few shot named entity & relationships recognition
DeepKE - [EMNLP 2022] An Open Toolkit for Knowledge Graph Extraction and Construction
FinBERT-QA - Financial Domain Question Answering with pre-trained BERT Language Model
ABSA-PyTorch - Aspect Based Sentiment Analysis, PyTorch Implementations. 基于方面的情感分析，使用PyTorch实现。
typeish - A runtime type checker for bash.... in bash. I'm not sorry.
PIXIU - This repository introduces PIXIU, an open-source resource featuring the first financial large language models (LLMs), instruction tuning data, and evaluation benchmarks to holistically assess financial LLMs. Our goal is to continually push forward the open-source development of financial artificial intelligence (AI).
neural-networks-for-attitude-ex
AREkit - Document level Attitude and Relation Extraction toolkit (AREkit) for sampling and processing large text collections with ML and for ML
BERT-Relation-Extraction - PyTorch implementation for "Matching the Blanks: Distributional Similarity for Relation Learning" paper
awesome-sentiment-attitude-extraction - A curated list of awesome sentiment analysis studies, in which attitude corresponds to the text position conveyed by Subject towards other Object mentioned in text such as: entities, events, etc.
TextFooler - A Model for Natural Language Attack on Text Classification and Inference