data-pipeline-evolution-batch-streaming-apache-flink
awesome-public-real-time-datasets
| data-pipeline-evolution-batch-streaming-apache-flink | awesome-public-real-time-datasets | |
|---|---|---|
| 1 | 8 | |
| 3 | 397 | |
| - | 17.4% | |
| 7.0 | 5.1 | |
| 9 months ago | 7 days ago | |
| Shell | ||
| Apache License 2.0 | Creative Commons Zero v1.0 Universal |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
data-pipeline-evolution-batch-streaming-apache-flink
awesome-public-real-time-datasets
- List of publicly available datasets with real-time data
- FLaNK Stack Weekly for 20 Nov 2023
- Bytewax: Stream processing library built using Python and Rust
- Public Real-Time Datasets and Sources
-
What are some good publicly available real-time data sources?
Added for now - https://github.com/bytewax/awesome-public-real-time-datasets/commit/94ca4a3d40dc212690c6cdc22c107289b4268661
I am attempting to source via the wisdom of the crowd here. I often find it hard to find good real-time data sources for learning about streaming, prototyping, or building hobby projects. I started researching and then created an "Awesome List" in a GitHub repo - https://github.com/bytewax/awesome-public-real-time-datasets.
-
Ask HN: What are some public real-time data sources?
I started an awesome list with real-time data sources here: https://github.com/bytewax/awesome-public-real-time-datasets . Have any datasets or data sources I should add to this list? Comment below or PRs welcome :).
What are some alternatives?
sql-cli-for-apache-flink-docker - SQL CLI for Apache Flink® via docker-compose
datagen - Generate authentic looking mock data based on a SQL, JSON or Avro schema and produce to Kafka in JSON or Avro format.
depthai-python - DepthAI Python Library
screenshot-to-code - Drop in a screenshot and convert it to clean code (HTML/Tailwind/React/Vue)
TinyLlama - The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.
RedfinScraper - Scrapes Redfin data.
memq - MemQ is an efficient, scalable cloud native PubSub system
superset - Apache Superset is a Data Visualization and Data Exploration Platform
mockingbird - Mockingbird is a mock streaming data generator
Scada-LTS - Scada-LTS is an Open Source, web-based, multi-platform solution for building your own SCADA (Supervisory Control and Data Acquisition) system.
torchgeo - TorchGeo: datasets, samplers, transforms, and pre-trained models for geospatial data