Building Llama as a Service (LaaS)

This page summarizes the projects mentioned and recommended in the original post on dev.to

Our great sponsors
  • SurveyJS - Open-Source JSON Form Builder to Create Dynamic Forms Right in Your App
  • WorkOS - The modern identity platform for B2B SaaS
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • minikube

    Run Kubernetes locally

  • With the containerized Node.js/Express API, I could run multiple containers, scaling to handle more traffic. Using a tool called minikube, we can easily spin up a local Kubernetes cluster to horizontally scale Docker containers. It was possible to keep one shared instance of the database, and many APIs were routed with an internal Kubernetes load balancer.

  • RabbitMQ

    Open source RabbitMQ: core server and tier 1 (built-in) plugins

  • Although they did not make it into production, I experimented with the RabbitMQ message broker, Python (Django, Flask), Kubernetes + minikube, JWT, and NGINX. This was a hobby project, but I intended to learn about microservices along the way.

  • SurveyJS

    Open-Source JSON Form Builder to Create Dynamic Forms Right in Your App. With SurveyJS form UI libraries, you can build and style forms in a fully-integrated drag & drop form builder, render them in your JS app, and store form submission data in any backend, inc. PHP, ASP.NET Core, and Node.js.

    SurveyJS logo
  • kubernetes

    Production-Grade Container Scheduling and Management

  • With the containerized Node.js/Express API, I could run multiple containers, scaling to handle more traffic. Using a tool called minikube, we can easily spin up a local Kubernetes cluster to horizontally scale Docker containers. It was possible to keep one shared instance of the database, and many APIs were routed with an internal Kubernetes load balancer.

  • MongoDB

    The MongoDB Database

  • I built each API with Node.js, Express, and Docker. Services connected to a NoSQL MongoDB database.

  • frontend

    Frontend for Llama as a Service (LaaS) 🦙 (by llama-as-a-service)

  • Frontend - github.com/llama-as-a-service/frontend

  • images-service

    Images API Service for Llama as a Service (Laas) 🦙

  • Images API - github.com/llama-as-a-service/images-service

  • auth-service

    Authentication API Service for Llama as a Service (Laas) 🦙

  • Authentication API - github.com/llama-as-a-service/auth-service

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo
  • gateway-service

    Gateway API Service for Llama as a Service (Laas) 🦙

  • Gateway API - github.com/llama-as-a-service/gateway-service

  • express-docker-boilerplate

    NodeJS, Express, and Docker Boilerplate. CI/CD using GitHub Actions. Published to GitHub Container Registry.

  • If you want to have a repository with Node.js, Express, and Docker set up with GitHub Actions, check out the boilerplate repository here

  • docker

    Docker - the open-source application container engine (by microsoft)

  • With each app containerized with Docker, this allows it to be run on any other developer's machine also running Docker. Although I had automated deployments to Heroku without this, I decided to upload each service to a container registry.

  • artillery

    Load testing at cloud-scale. Serverless & distributed out-of-the-box. Load test with Playwright. Load test HTTP APIs, GraphQL, WebSocket, and more. Use any Node.js module. Never fail to scale with Artillery!

  • I found a tool for load testing called Artillery. Following this guide I installed Artillery and began research for the test configuration.

  • react-buddy-react

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • For this project, there is a frontend built with React hosted on Netlify, connected to the backend.

  • frank_jwt

    JSON Web Token implementation in Rust.

  • Although they did not make it into production, I experimented with the RabbitMQ message broker, Python (Django, Flask), Kubernetes + minikube, JWT, and NGINX. This was a hobby project, but I intended to learn about microservices along the way.

  • Bulma

    Modern CSS framework based on Flexbox

  • I would talk about building the frontend, but it is just a single page React app I built quickly. It does use a CSS library called Bulma, which is similar to tailwind and worth checking out. I did spend a day implementing a login/signup page, but this was just for the learning experience, and not what I wanted in the final product.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts