covalent
pubmedflow
covalent | pubmedflow | |
---|---|---|
4 | 3 | |
692 | 31 | |
2.5% | - | |
8.6 | 0.0 | |
7 days ago | over 1 year ago | |
Python | Python | |
Apache License 2.0 | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
covalent
-
Remote execution of code
Pretty interesting request, if SSH is not used, i would try using something like dask which uses tcp to connect and execute assuming your workers are in another machine.I also think something like covalent can be used to extend your own custom plugin in their ecosystem to connect how you want. We have a very custom private plugin written on top of covalent's to have a custom protocol to connect our central on-prem GPU machines to our local laptops that is rpc based, mostly for high performance as well as some mandate security from where the GPU machines are. Once done it is pretty much something like
-
Prefect alternatives meant for Slurm (HPC)
Does anyone here have any suggestions of alternatives tailored for Slurm on HPC? I know Covalent is one option, but I'm curious about others as well. Ideally the platform should be Pythonic, have a GUI, and be reasonably active/well-maintained.
- Show HN: Covalent – distributed computing for ML, HPC and Quantum (open source)
-
Your strategies for offloading computation
Came across this new tool exactly for this - https://github.com/AgnostiqHQ/covalent
pubmedflow
-
Pubmedflow: One stop tool for performing natural language processing with medical domain in few lines of python code.
Github URL: https://github.com/nfflow/pubmedflow
- One big challenge medical domain faces is: Data collection. It is a pain to write scripts to scrape websites everytime when you need useful data in this domain. Pubmed is a great source where medical domain data lies. We have built an easy tool to scrape this data for you
- Solving issues in medical domain for medical domain data collection with a pubmed website scraping API
What are some alternatives?
SmartSim - SmartSim Infrastructure Library.
client - DagsHub client libraries
kestra - Infinitely scalable, event-driven, language-agnostic orchestration and scheduling platform to manage millions of workflows declaratively in code.
transformers - 🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
cadence-python - Python framework for Cadence Workflow Service
redditflow - Do everything from data collection from reddit to training a machine learning model in just two lines of python code!
mlnotify - 🔔 No need to keep checking your training - just one import line and you'll know the second it's done.
nalcos - Search Git commits in natural language
dagster - An orchestration platform for the development, production, and observation of data assets.
mycroft-core - Mycroft Core, the Mycroft Artificial Intelligence platform.
bytehub - ByteHub: making feature stores simple
bootcamp - Dealing with all unstructured data, such as reverse image search, audio search, molecular search, video analysis, question and answer systems, NLP, etc.