ChatLog

⏳ ChatLog: Recording and Analysing ChatGPT Across Time (by THU-KEG)

ChatLog Alternatives

Similar projects and alternatives to ChatLog based on common topics and language

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better ChatLog alternative or higher similarity.

ChatLog reviews and mentions

Posts with mentions or reviews of ChatLog. We have used some of these posts to build our list of alternatives and similar projects.
  • ChatLog: Recording and Analyzing ChatGPT Across Time
    1 project | /r/BotNews | 28 Apr 2023
    While there are abundant researches about evaluating ChatGPT on natural language understanding and generation tasks, few studies have investigated how ChatGPT's behavior changes over time. In this paper, we collect a coarse-to-fine temporal dataset called ChatLog, consisting of two parts that update monthly and daily: ChatLog-Monthly is a dataset of 38,730 question-answer pairs collected every month including questions from both the reasoning and classification tasks. ChatLog-Daily, on the other hand, consists of ChatGPT's responses to 1000 identical questions for long-form generation every day. We conduct comprehensive automatic and human evaluation to provide the evidence for the existence of ChatGPT evolving patterns. We further analyze the unchanged characteristics of ChatGPT over time by extracting its knowledge and linguistic features. We find some stable features to improve the robustness of a RoBERTa-based detector on new versions of ChatGPT. We will continuously maintain our project at https://github.com/THU-KEG/ChatLog.

Stats

Basic ChatLog repo stats
1
93
5.9
7 days ago

THU-KEG/ChatLog is an open source project licensed under MIT License which is an OSI approved license.

The primary programming language of ChatLog is Jupyter Notebook.


Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com