nfcompose
retake
nfcompose | retake | |
---|---|---|
6 | 4 | |
32 | 757 | |
- | - | |
8.9 | 10.0 | |
19 days ago | 8 months ago | |
Python | Rust | |
Mozilla Public License 2.0 | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
nfcompose
-
Implementing system-versioned tables in Postgres
I have implemented this for our tool NF Compose that allows us to build REST APIs without writing a single line of code [0]. I didn't go the route of triggers because we generate database tables automatically and we used to have a crazy versioning scheme that was inspired by data vault and anchor modelling where we stored every change on every attribute as a new record.
Sounded cool, but in practice it was really slow. The techniques that are usually employed by Data Vault to fix this issue seemed too complex. Over time we moved to an implementation that handles the historization dynamically at runtime by generating SQL queries ourselves [1]. On a sidenote: Generating SQL in python sounds dangerous, but we spent a lot of time on making it secure. We even have a linter that checks that everything is escaped properly whenever we are in dev mode [2]
[0] https://github.com/neuroforgede/nfcompose/
- Show HN: NF Compose – An API to Build/Generate REST APIs
- GitHub - neuroforgede/nfcompose: Build REST APIs/Integrations in minutes instead of hours
- GitHub - neuroforgede/nfcompose: NF Compose is a (data) integration platform that allows developers to define REST APIs in seconds instead of hours. Generated REST APIs are backed by postgres and support automatic consumer notifications on data changes out of the box.
-
NF Compose – define REST APIs in seconds instead of hours
As part of our services we also provide support for building integrations between (our) systems and external systems. As we didn't want to keep building the same REST APIs every time, we set out to build a standardized data integratin platform that allows for a quick way to generate user specified REST API definitions via a REST API. This has become NF Compose (https://github.com/neuroforgede/nfcompose).
- Show HN: NF Compose – define REST APIs in seconds instead of minutes
retake
-
Show HN: Retake – Open-Source Hybrid Search for Postgres
https://github.com/getretake/retake/pull/198 is a refreshing change given the recent rug pulls, so thank you for that
-
We created an open-source semantic search Python package on top of Postgres
We found it difficult to do well with standard vector databases and so we ended up making a nice open-source package to layer semantic search on top of Postgres with just a few lines of code. It supports Python backends right now, always stays in sync with Postgres via Kafka, doubles as a vector store, and can be deployed anywhere.
- Show HN: Open-Source Infrastructure for Vector Data Streams
What are some alternatives?
airbyte - The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
bionicgpt - BionicGPT is an on-premise replacement for ChatGPT, offering the advantages of Generative AI while maintaining strict data confidentiality [Moved to: https://github.com/bionic-gpt/bionic-gpt]
sgr - sgr (command line client for Splitgraph) and the splitgraph Python library
embedditor - ⚡ GUI for editing LLM vector embeddings. No more blind chunking. Upload content in any file extension, join and split chunks, edit metadata and embedding tokens + remove stop-words and punctuation with one click, add images, and download in .veml to share it with your team.
frappe - Low code web framework for real world applications, in Python and Javascript
vectorflow - VectorFlow is a high volume vector embedding pipeline that ingests raw data, transforms it into vectors and writes it to a vector DB of your choice.
nfcompose-examples
tinyvector - A tiny embedding database in pure Rust.
webhooks-bridge - A simple webhook receiver that filters, transforms and forwards webhooks
pgsync - Postgres to Elasticsearch/OpenSearch sync
drizzle-pg-notify-audit-table - example project of using pg-notify and custom trigger for audit table
prism - Prism is the easiest way to develop, orchestrate, and execute data pipelines in Python.