spark-ai
haystack
| spark-ai | haystack | |
|---|---|---|
| 2 | 55 | |
| 36 | 14,197 | |
| - | 4.0% | |
| 6.8 | 9.9 | |
| 5 months ago | 4 days ago | |
| Python | Python | |
| Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
spark-ai
-
A platform for building Gen-AI applications on Spark
We've just released our product's latest version, making it easier for teams to build data pipelines for LLM-based applications. As part of the release, we're also open-sourcing the toolbox for Spark (https://github.com/prophecy-io/spark-ai) that contains useful connectors, transformations, and agents for building Gen-AI applications.
-
Show HN: Platform for building Gen-AI applications applications on Spark
Hey HN, I'm Maciej, one of the co-founders of Prophecy (https://prophecy.io) - low code for Data Transformations and Generative-AI.
We've just released the latest version of our product, which makes it easier for teams to build data pipelines for LLM-based applications. As part of the release, we're also open-sourcing the toolbox for Spark (https://github.com/prophecy-io/spark-ai) that contains useful connectors, transformations, and agents for building Gen-AI applications.
Hopefully, this allows some of you to build your apps easier and make them more robust and scalable from day one. Quick getting started example available here: https://github.com/prophecy-samples/gen-ai-chatbot-template (all code is open-source too).
While our product is already mature, the toolbox shared above is still in a pretty early stage but will be completely OSS. Any thoughts on the concept and ideas for what's important to the community would be super appreciated!
haystack
-
Haystack DB – 10x faster than FAISS with binary embeddings by default
I was confused for a bit but there is no relation to https://haystack.deepset.ai/
-
Release Radar • March 2024 Edition
View on GitHub
-
First 15 Open Source Advent projects
4. Haystack by Deepset | Github | tutorial
-
Generative AI Frameworks and Tools Every Developer Should Know!
Haystack can be classified as an end-to-end framework for building applications powered by various NLP technologies, including but not limited to generative AI. While it doesn't directly focus on building generative models from scratch, it provides a robust platform for:
-
Best way to programmatically extract data from a set of .pdf files?
But if you want an API that you can use to develop your own flow, Haystack from Deepset could be worth a look.
-
Which LLM framework(s) do you use in production and why?
Haystack for production. We cannot afford breaking changes in our production apps. Its stable, documentation is excellent and did I mention its' STABLE!??
- Overview: AI Assembly Architectures
-
Llama2 and Haystack on Colab
I recently conducted some experiments with Llama2 and Haystack (https://github.com/deepset-ai/haystack), the NLP/LLM framework.
The notebook can be helpful for those trying to load Llama2 on Colab.
1) Installed Transformers from the main branch (and other libraries)
- Build with LLMs for production with Haystack – has 10k stars on GitHub
- Show HN: Haystack – Production-Ready LLM Framework
What are some alternatives?
gen-ai-chatbot-template - Template that enables you to build a chatbot based on your private data in minutes!
langchain - 🦜🔗 Build context-aware reasoning applications
langchain - ⚡ Building applications with LLMs through composability ⚡ [Moved to: https://github.com/langchain-ai/langchain]
gpt-neo - An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.
BentoML - The easiest way to serve AI/ML models in production - Build Model Inference Service, LLM APIs, Multi-model Inference Graph/Pipelines, LLM/RAG apps, and more!
label-studio - Label Studio is a multi-type data labeling and annotation tool with standardized output format
jina - ☁️ Build multimodal AI applications with cloud-native stack
BERT-pytorch - Google AI 2018 BERT pytorch implementation
BERT-NER - Pytorch-Named-Entity-Recognition-with-BERT
gpt-neox - An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries
jina-financial-qa-search
scibert - A BERT model for scientific text.