medical_chat_performance_evaluation
claude-unofficial-api
| medical_chat_performance_evaluation | claude-unofficial-api | |
|---|---|---|
| 2 | 2 | |
| 7 | 730 | |
| - | - | |
| 4.8 | 8.2 | |
| 4 months ago | 10 months ago | |
| JavaScript | JavaScript | |
| MIT | The Unlicense |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
medical_chat_performance_evaluation
-
Show HN: Medical LLM on Par with Google Med-Palm 98% Usmle Accuracy
I’d like to share a medical question-answering API which has state-of-the-art performance on the USMLE self-assessment exam. You can try out Medical Chat here [https://medical.chat-data.com/chat]. We also provide the end-to-end medical chat deployment and API service through (Chat Data)[https://www.chat-data.com/]
So. what's the selling point of (Medical Chat)[https://medical.chat-data.com] because the either Gemi or ChatGPT can answer the medical questions as well.
Well, that's true but that's not everything. There are lots of things we get your covered but those competiors don't.
1. Accuracy: We have achieved 98.1% (637/649) on the USMLE sample test. We also have achieved 97.8% (1245/1273) accuracy on the MedQA sample test. You can review this detailed report( https://medical.chat-data.com/evaluate ) for the full evaluation process. The evaluation procedure is also open sourced in this GitHub repository ( https://github.com/chat-data-llc/medical_chat_performance_ev... ). Anyone can reproduce the evaluation procedure.
2. Authentication of cited sources: Our medical chatbot is built on reliable medical literature, including textbooks and manuals, and provides answers with direct citations to original sources, unlike ChatGPT and Gemini, which may offer unverified results without sources.
3. Privacy protection & HIPAA compliance: Engaging with Gemini and ChatGPT does not safeguard your privacy. Conversations regarding health matters shared with OpenAI or Gemini may be utilized for training purposes. Our medical chatbot adheres to HIPAA standards. Despite incorporating OpenAI's API within our Resource Augmentation Generator (RAG) retrieval workflow, we have a Business Associate (BA) with OpenAI to ensure HIPAA compliance (https://medical.chat-data.com/hippa.pdf). Interactions with ChatGPT by the general public do not receive the same level of protection.
We’d love to hear feedback from this community! People can use the Medical Chat model to implement a healthcare chatbot for initial diagnosis without code in 20 mins through Chat Data. Here is an example: https://lungcanceranswer.com/
- Medical Question-Answer AI Model Evaluation Framework
claude-unofficial-api
What are some alternatives?
menubar - AI Chat Browser: Fast, Full webapp access to ChatGPT / Claude / Bard / Bing / Llama2! I use this 20 times a day. [Moved to: https://github.com/smol-ai/GodMode]
langchain - ⚡ Building applications with LLMs through composability ⚡ [Moved to: https://github.com/langchain-ai/langchain]
aider - aider is AI pair programming in your terminal
gpt-api-docker - Deploy your own GPT-3 API endpoint with ease using Docker and Fly!
node_characterai - Unofficial Character AI wrapper for node.
node-chatgpt-api - A client implementation for ChatGPT and Bing AI. Available as a Node.js module, REST API server, and CLI app.