Jupyter Notebook Inference

Open-source Jupyter Notebook projects categorized as Inference

Top 11 Jupyter Notebook Inference Projects

  1. amazon-sagemaker-examples

    Example πŸ““ Jupyter notebooks that demonstrate how to build, train, and deploy machine learning models using 🧠 Amazon SageMaker.

  2. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
  3. openvino_notebooks

    πŸ“š Jupyter notebook tutorials for OpenVINOβ„’

  4. AI-Engineering.academy

    Mastering Applied AI, One Concept at a Time

  5. Nanoflow

    A throughput-oriented high-performance serving framework for LLMs

  6. kglab

    Graph Data Science: an abstraction layer in Python for building knowledge graphs, integrated with popular graph libraries – atop Pandas, NetworkX, RAPIDS, RDFlib, pySHACL, PyVis, morph-kgc, pslpython, pyarrow, etc.

  7. TrainYourOwnYOLO

    Train a state-of-the-art yolov3 object detector from scratch!

  8. Deepdive-llama3-from-scratch

    Achieve the llama3 inference step-by-step, grasp the core concepts, master the process derivation, implement the code.

  9. optimum-intel

    πŸ€— Optimum Intel: Accelerate inference with Intel optimization tools

  10. aws-lambda-docker-serverless-inference

    Serve scikit-learn, XGBoost, TensorFlow, and PyTorch models with AWS Lambda container images support.

  11. csv-schema-inference

    A tool to automatically infer columns data types in .csv files

  12. H.E.I.M.D.A.L.L

    H.E.I.M.D.A.L.L looks at fleet telemetry and gives you natural-language insights. GPU data loading (cuDF), local LLM inference (Gemma 2), and production NIM on GKE. Open the notebooks, run cells, get answers! Quick start should not take longer than 10 minutes and the T4 path is completely free!

    Project mention: Show HN: H.e.i.m.d.a.l.l – Telemetry-to-insight pipeline for fleet telemetry | news.ycombinator.com | 2026-02-17
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Jupyter Notebook Inference discussion

Log in or Post with

Jupyter Notebook Inference related posts

  • Wav2Lip: Accurately Lip-Syncing Videos and OpenVINO

    1 project | news.ycombinator.com | 14 May 2025
  • DeepDive: In-Depth Decryption of LLMs Construction and Inference from Scratch

    1 project | news.ycombinator.com | 26 Feb 2025
  • DeepDive in everything of Llama3: revealing detailed insights and implementation

    1 project | dev.to | 22 Feb 2025
  • DeepDive in everything of Llama3: revealing detailed insights and implementation

    2 projects | news.ycombinator.com | 21 Feb 2025
  • AI engineering Academy – open-source AI Engineering roadmap

    1 project | news.ycombinator.com | 4 Dec 2024
  • Optimum Intel OpenVino Performance

    2 projects | /r/LocalLLaMA | 5 Dec 2023
  • Trouvez-la plus vite

    1 project | /r/u_IntelBusiness | 27 Oct 2023
  • A note from our sponsor - SaaSHub
    www.saashub.com | 12 Jul 2026
    SaaSHub helps you find the best software and product alternatives Learn more β†’

Index

What are some of the best open-source Inference projects in Jupyter Notebook? This list will help you:

# Project Stars
1 amazon-sagemaker-examples 10,971
2 openvino_notebooks 3,178
3 AI-Engineering.academy 2,352
4 Nanoflow 966
5 kglab 687
6 TrainYourOwnYOLO 674
7 Deepdive-llama3-from-scratch 629
8 optimum-intel 603
9 aws-lambda-docker-serverless-inference 100
10 csv-schema-inference 37
11 H.E.I.M.D.A.L.L 17

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com

Did you know that Jupyter Notebook is
the 15th most popular programming language
based on number of references?