evaluate
pycm
| evaluate | pycm | |
|---|---|---|
| 3 | 18 | |
| 1,819 | 1,429 | |
| 2.4% | - | |
| 6.1 | 5.0 | |
| 1 day ago | 3 months ago | |
| Python | Python | |
| Apache License 2.0 | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
evaluate
- [D] The MMSegmentation library from OpenMMLab appears to return the wrong results when computing basic image segmentation metrics such as the Jaccard index (IoU - intersection-over-union). It appears to compute recall (sensitivity) instead of IoU, which artificially inflates the performance metrics.
- [P] Releasing 🤗 Evaluate - an evaluation library for ML
- HuggingFace/evaluate: A library for easily evaluating ML models and datasets
pycm
- PyCM 4.0 Released: Multilabel Confusion Matrix Support
- PyCM 3.9 Released: Log-loss Support
- PyCM 3.8 Released: Distance/Similarity Support
-
[P] PyCM 3.7 released: ROC curve and Precision-Recall curve are added
The complete change log of this version is available here.
- PyCM 3.7 Released: ROC/PR Curve Support
- PyCM 3.6 released: Multi-class confusion matrix library in Python
- PyCM 3.5 released: Multi-class confusion matrix library in Python
- PyCM 3.4 released: Multi-class confusion matrix library in Python
- [P] PyCM 3.3 released: Comparison of Classifiers Based on Confusion Matrix
What are some alternatives?
torch-fidelity - High-fidelity performance metrics for generative models in PyTorch
seq2seq - A general-purpose encoder-decoder framework for Tensorflow
datasets - 🤗 The largest hub of ready-to-use datasets for ML models with fast, easy-to-use and efficient data manipulation tools
spaCy - 💫 Industrial-strength Natural Language Processing (NLP) in Python
EvalAI - :cloud: :rocket: :bar_chart: :chart_with_upwards_trend: Evaluating state of the art in AI
AI-Expert-Roadmap - Roadmap to becoming an Artificial Intelligence Expert in 2022
avalanche - Avalanche: an End-to-End Library for Continual Learning based on PyTorch.
InvoiceNet - Deep neural network to extract intelligent information from invoice documents.
semantic-kitti-api - SemanticKITTI API for visualizing dataset, processing data, and evaluating results.
pretty-print-confusion-matrix - Confusion Matrix in Python: plot a pretty confusion matrix (like Matlab) in python using seaborn and matplotlib
rexmex - A general purpose recommender metrics library for fair evaluation.
pyod - A Comprehensive and Scalable Python Library for Outlier Detection (Anomaly Detection)