spotty
sagemaker-run-notebook
spotty | sagemaker-run-notebook | |
---|---|---|
3 | 2 | |
491 | 139 | |
0.2% | -1.4% | |
0.0 | 0.0 | |
7 months ago | 7 months ago | |
Python | Python | |
MIT License | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
spotty
-
[D] Interactive Compute Platform Recommendations for ML Research
Use spotty https://github.com/spotty-cloud/spotty to launch AWS Spot instances that you can use ssh port forwarding with to run GPU experiments from a jupyer notebook.
-
[P]Spotml.io: Seamless ML training on AWS Spot instances, with docker (training 3X cheaper)
SpotML is a command line tool that automatically manages ML training on AWS spot instances. It lets you handle spot interruptions by resuming training using the latest checkpoint. Documentation link to try it out Looking for feedback from early testers. You would be an ideal candidate if you have a side project that you're spending your own money to train. Acknowledgement: - SpotML is built on top of existing open source library Spotty
-
Show HN: Seamless ML training on AWS Spot instances
- SpotML is built on top of existing open source library Spotty: https://github.com/spotty-cloud/spotty
sagemaker-run-notebook
-
Experience migrating from Databricks to various AWS services
Notebooks are more of a tech/design debt. Job was originally created in notebooks and never refactored into a more maintainable solution. Do you have a recommendation on services to use with the papermill library? I saw the Sagemaker Convenience Package seems to rely on this a bit, but seems a little out of place for Sagemaker.
-
Parameters for Jupyterlab GUI notebook scheduler using sagemaker-run-notebook
I am used to working on jupyter notebooks and have some experience with python scripting for extracting data. I created a notebook that extracts comments, runs sentiment analysis, and dumps data to S3- however, I am struggling with the CRON aspect of things. I want to automate running of the script every day at a set time. I am using the sagemaker-run-notebook package to do this, specifically using the GUI Jupyterlab extension. However, I am not sure what the parameters need to be. I tried a few combinations, and this is my best guess at the values. I am getting a JSON error, which I am not sure I understand. Can someone with experience working with on the sagemaker-run-notebook extension please help me out?
What are some alternatives?
ethereum-etl - Python scripts for ETL (extract, transform and load) jobs for Ethereum blocks, transactions, ERC20 / ERC721 tokens, transfers, receipts, logs, contracts, internal transactions. Data is available in Google BigQuery https://goo.gl/oY5BCQ
elyra - Elyra extends JupyterLab with an AI centric approach.
sagemaker-training-toolkit - Train machine learning models within a 🐳 Docker container using 🧠 Amazon SageMaker.
jupytext - Jupyter Notebooks as Markdown Documents, Julia, Python or R scripts
sagemaker-tensorflow-training-toolkit - Toolkit for running TensorFlow training scripts on SageMaker. Dockerfiles used for building SageMaker TensorFlow Containers are at https://github.com/aws/deep-learning-containers.
ipycanvas - Interactive Canvas in Jupyter
micro-service-email - Deploy a self-hosted gmail microservice in minutes
jupyterlab_templates - Support for jupyter notebook templates in jupyterlab
sagemaker-distribution - A set of Docker images that include popular frameworks for machine learning, data science and visualization.