practical-data-engineering
go-hnsw
| practical-data-engineering | go-hnsw | |
|---|---|---|
| 4 | 2 | |
| 455 | 71 | |
| 6.6% | - | |
| 7.7 | 10.0 | |
| about 2 months ago | almost 7 years ago | |
| Jupyter Notebook | Go | |
| - | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
practical-data-engineering
- Show HN: Hands-On Data Engineering with a Real-Estate Project Guide
-
What's your favorite end-to-end tech stack?
Or in a side project: I combined an extensive amount of tools for web-scraping real-estates, uploading them to S3 with MinIO, Spark, and Delta Lake, adding some Data Science magic with Jupyter Notebooks, ingesting into Data Warehouse Apache Druid, visualizing dashboards with Superset and managing everything with Dagster (blog, github)
-
✨ 5 Open Source Data Engineering Projects 🔥
2️⃣ Building a Data Engineering Project in 20 Minutes
-
Building a Data Engineering Project in 20 Minutes
The source-code you can find on practical-data-engineering for the data pipeline or in data-engineering-devops with all it’s details to set things up. Although not all is finished, you can observe the current status of the project on real-estate-project.
go-hnsw
-
Rye, meet GPT3 ... and vice versa :)
vector index libraries in go: - https://github.com/Bithack/go-hnsw/blob/master/examples/simple.go - https://github.com/41tair/go-faiss/blob/master/example/example.go
-
What's your favorite end-to-end tech stack?
Side Projects: Golang, Makefile for orchestration, Parquet on self hosted Minio or R2, DuckDB, and go-hsnw, for vectors. If I'm not self hosting, Google Cloud Autopilot Kubernetes is my preferred cloud deployment environment.
What are some alternatives?
faros-community-edition - BI, API and Automation layer for your Engineering Operations data
redis_hnsw - HSNW module for Redis
ngods-stocks - New Generation Opensource Data Stack Demo
go-faiss - This is a go library for faiss
open-data-stack - Open Data Stack Projects: Examples of End to End Data Engineering Projects
pgvector-go - pgvector support for Go
PANDAS-TUTORIAL - Jupyter Notebooks and Data Sets for Pandas Library
data-engineering-devops - Full stack data engineering tools and infrastructure set-up
awesome-vector-search - Collections of vector search related libraries, service and research papers
Data-Engineering-Projects - Personal Data Engineering Projects
sqlite-vss - A SQLite extension for efficient vector search, based on Faiss!