avalanche
evaluate
Our great sponsors
| avalanche | evaluate | |
|---|---|---|
| 1 | 3 | |
| 1,666 | 1,809 | |
| 3.2% | 4.1% | |
| 9.4 | 5.2 | |
| 11 days ago | 4 days ago | |
| Python | Python | |
| MIT License | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
avalanche
-
[R] Single-task Continual/Incremental/Online/Life-Long learning.
Lastly, there are several github repo, but the most popular one is ContinualAI/avalanche, which already implement some of above algorithm, for the purpose of reproducibility i.e. can be applied to your task (probably)
evaluate
- [D] The MMSegmentation library from OpenMMLab appears to return the wrong results when computing basic image segmentation metrics such as the Jaccard index (IoU - intersection-over-union). It appears to compute recall (sensitivity) instead of IoU, which artificially inflates the performance metrics.
- [P] Releasing 🤗 Evaluate - an evaluation library for ML
- HuggingFace/evaluate: A library for easily evaluating ML models and datasets
What are some alternatives?
torch-fidelity - High-fidelity performance metrics for generative models in PyTorch
datasets - 🤗 The largest hub of ready-to-use datasets for ML models with fast, easy-to-use and efficient data manipulation tools
pytorch-accelerated - A lightweight library designed to accelerate the process of training PyTorch models by providing a minimal, but extensible training loop which is flexible enough to handle the majority of use cases, and capable of utilizing different hardware options with no code changes required. Docs: https://pytorch-accelerated.readthedocs.io/en/latest/
EvalAI - :cloud: :rocket: :bar_chart: :chart_with_upwards_trend: Evaluating state of the art in AI
rexmex - A general purpose recommender metrics library for fair evaluation.
semantic-kitti-api - SemanticKITTI API for visualizing dataset, processing data, and evaluating results.
trajectopy - Trajectopy - Trajectory Evaluation in Python
pycm - Multi-class confusion matrix library in Python
continuum - A clean and simple data loading library for Continual Learning