A platform for building Gen-AI applications on Spark

This page summarizes the projects mentioned and recommended in the original post on /r/datascience
data-engineering generative-ai Machine Learning Pipeline Spark

InfluxDB
Our great sponsors
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • WorkOS - The modern identity platform for B2B SaaS
  • SaaSHub - Software Alternatives and Reviews
Our great sponsors

  • spark-ai

    Toolbox for building Generative AI applications on top of Apache Spark.

    • We've just released our product's latest version, making it easier for teams to build data pipelines for LLM-based applications. As part of the release, we're also open-sourcing the toolbox for Spark (https://github.com/prophecy-io/spark-ai) that contains useful connectors, transformations, and agents for building Gen-AI applications.

  • gen-ai-chatbot-template

    Template that enables you to build a chatbot based on your private data in minutes!

    • Hopefully, this allows some of you to build your apps easier and make them more robust and scalable from day one. Quick getting started example available here: https://github.com/prophecy-samples/gen-ai-chatbot-template (all code is open-source too).

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts