APM, error tracking, and dashboards for modern web apps. Ten-minute setup, transparent flat pricing, and support from engineers who actually use the product. Learn more →
Top 12 Jupyter Notebook Inference Projects
-
amazon-sagemaker-examples
Example 📓 Jupyter notebooks that demonstrate how to build, train, and deploy machine learning models using 🧠Amazon SageMaker.
-
AppSignal
Monitoring that respects your time & budget. APM, error tracking, and dashboards for modern web apps. Ten-minute setup, transparent flat pricing, and support from engineers who actually use the product.
-
-
-
-
kglab
Graph Data Science: an abstraction layer in Python for building knowledge graphs, integrated with popular graph libraries – atop Pandas, NetworkX, RAPIDS, RDFlib, pySHACL, PyVis, morph-kgc, pslpython, pyarrow, etc.
-
-
Deepdive-llama3-from-scratch
Achieve the llama3 inference step-by-step, grasp the core concepts, master the process derivation, implement the code.
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
-
-
aws-lambda-docker-serverless-inference
Serve scikit-learn, XGBoost, TensorFlow, and PyTorch models with AWS Lambda container images support.
-
-
H.E.I.M.D.A.L.L
H.E.I.M.D.A.L.L looks at fleet telemetry and gives you natural-language insights. GPU data loading (cuDF), local LLM inference (Gemma 2), and production NIM on GKE. Open the notebooks, run cells, get answers! Quick start should not take longer than 10 minutes and the T4 path is completely free!
Project mention: Show HN: H.e.i.m.d.a.l.l – Telemetry-to-insight pipeline for fleet telemetry | news.ycombinator.com | 2026-02-17 -
laya-cuda-bench
How many decisions/s can one NVIDIA GPU serve under a p99 SLO, and what does a million cost? Reproducible benchmark of the Laya 421M decision models on RTX 2000 Ada, RTX PRO 5000/6000 Blackwell and H100 (+MIG), with TensorRT, torch.compile, ONNX Runtime, and LLM/API baselines.
Project mention: We Tested a 35B LLM Against Typed-Decision Models on 12,000 Real RFQs—Confidence Changed the Winner | dev.to | 2026-09-24Companion CUDA study: laya-cuda-bench
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
Jupyter Notebook Inference discussion
Jupyter Notebook Inference related posts
-
Wav2Lip: Accurately Lip-Syncing Videos and OpenVINO
-
DeepDive: In-Depth Decryption of LLMs Construction and Inference from Scratch
-
DeepDive in everything of Llama3: revealing detailed insights and implementation
-
DeepDive in everything of Llama3: revealing detailed insights and implementation
-
AI engineering Academy – open-source AI Engineering roadmap
-
Optimum Intel OpenVino Performance
-
Trouvez-la plus vite
-
A note from our sponsor - AppSignal
www.appsignal.com | 10 Oct 2026
Index
What are some of the best open-source Inference projects in Jupyter Notebook? This list will help you:
| # | Project | Stars |
|---|---|---|
| 1 | amazon-sagemaker-examples | 10,990 |
| 2 | openvino_notebooks | 3,221 |
| 3 | AI-Engineering.academy | 2,382 |
| 4 | Nanoflow | 975 |
| 5 | kglab | 694 |
| 6 | TrainYourOwnYOLO | 675 |
| 7 | Deepdive-llama3-from-scratch | 631 |
| 8 | optimum-intel | 622 |
| 9 | aws-lambda-docker-serverless-inference | 100 |
| 10 | csv-schema-inference | 36 |
| 11 | H.E.I.M.D.A.L.L | 17 |
| 12 | laya-cuda-bench | 0 |
Sponsored
Monitoring that respects your time & budget
APM, error tracking, and dashboards for modern web apps. Ten-minute setup, transparent flat pricing, and support from engineers who actually use the product.
www.appsignal.com