Top 3 Python eval Projects
-
vectorboard
Open Source Embeddings Optimisation and Eval Framework for RAG/LLM Applications. Documentations at https://docs.vectorboard.ai/introduction
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
Project mention: Exploring Methods to Improve Text Chunking in RAG Models (and other things...) | /r/GPT3 | 2023-10-22Hi, about chunking, if the text is structured (markdown or html), you can take headding and paragraph as a chunking unit, but the result is also affected by the applied embeddings, which can be evaluated separately first, for standard chunking methods with different chunk lengths, for example with this tool https://github.com/VectorBoard/vectorboard.
Project mention: evalidate - Safe evaluation of untrusted user-supplied python expression | /r/Python | 2023-05-30Here comes evalidate. Evalidate parses expression into AST-tree, and validates every node of tree. For example, you can forbid every function call (example with smartphone will still work, but os.system() will not) or you can whitelist specific safe functions like int(). It's simple to use:
Project mention: evalidate - Safe evaluation of untrusted user-supplied python expression | /r/Python | 2023-05-30There is asteval project. It makes more poweful (ans slower) virtual python interpreter which you can use to run many commands in shared context. My benchmark (100 000 runs of simple python expressions):
Python eval related posts
Index
What are some of the best open-source eval projects in Python? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | vectorboard | 43 |
| 2 | evalidate | 21 |
| 3 | asteval | 0 |
Sponsored