web-tables-demo
win10-storage-spaces
web-tables-demo | win10-storage-spaces | |
---|---|---|
3 | 10 | |
14 | 213 | |
- | - | |
0.8 | 3.7 | |
about 1 year ago | 3 months ago | |
PowerShell | ||
- | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
web-tables-demo
-
Solving the 100GB Game Download
We've recently made a similar thing for databases: https://github.com/ClickHouse/web-tables-demo
It downloads the database on demand and optionally caches on the client side: https://presentations.clickhouse.com/meetup73/new_features/#...
But it is not a new idea; for example, it was already implemented for SQLite a long time ago.
-
Cloud Backed SQLite
I recommend checking a similar project - storing ClickHouse databases on GitHub pages for serverless analytical queries: https://github.com/ClickHouse/web-tables-demo
-
Throwing lots of data at DuckDB and Athena
I've added a benchmark of ClickHouse and Athena to ClickBench:
https://pastila.nl/?0198061e/f2e0e7b2d61d0fe322607b58fc7200b...
When ClickHouse operates in a "data lake" mode - simply by processing a bunch of parquet files on S3. Obviously it is faster than Athena. But I also want to add Presto, Trino, Spark, Databricks, Redshift Spectrum, and Boilingdata, that are currently missing from the benchmark.
Please help me adding them: https://github.com/ClickHouse/ClickBench
Also, it includes another mode of ClickHouse, named "web" - MergeTree tables hosted on a HTTP server (which is more efficient than parquet). See https://github.com/ClickHouse/web-tables-demo
About R2 - it is currently slow, and also incompatible with S3 (e.g., no multipart uploads).
win10-storage-spaces
-
Solving the 100GB Game Download
seconded. Primocache is wonderful, and doesn't suffer from the glaring issue using the powershell hack of Windows Storage Spaces [1]. You can set this up, with proper powershell scripts/commands, but Xbox games won't install to a Storage Space. It boggled my mind when I finally tracked this down.
Primo Cache [2] has one disadvantage over storage spaces - the SSD cache space is dedicated as Cache, and does not add to the total space of the drive. 1TB SSD + 4TB hdd = 4TB available, vs storage spaces which will give you 5TB. This minor (to me) downside is outweighed by the fact it works for everything. It shows up as a normal drive, not a virtual disk, and it just works. I recommend it highly for anyone who has limited SSD space.
1: https://github.com/freemansoft/win10-storage-spaces
-
3 tier storage for Windows PC possible?
This guy did the legwork: https://github.com/freemansoft/win10-storage-spaces
-
How to establish SSD as write-cache for HDDs?
https://www.reddit.com/r/DataHoarder/comments/lsjs5j/adding\_an\_ssd\_to\_microsoft\_storage\_spaces\_to\_act/ https://github.com/freemansoft/win10-storage-spaces
- Windows 10 Pro Storage Spaces Tiered Storage
- Question about adding SSD
-
Hidetaka Miyazaki says Elden Ring’s release was ‘not a very pleasant time’
if you have extra small ssd/nvme you can pair it with that 4tb. There is good guide for it https://github.com/freemansoft/win10-storage-spaces
- StoreMI(Current) vs Fuzedrive(Last/Latest)?
- I've got a couple of questions about Windows Storage Spaces.
- Adding an SSD to Microsoft Storage Spaces to act as a cache
-
Help with Windows 10 Storage Spaces with tiering
Found the solution: win10-storage-spaces/new-storage-space.ps1 at master · freemansoft/win10-storage-spaces · GitHub
What are some alternatives?
transcript.fish - Unofficial No Such Thing As A Fish episode transcripts.
ClickBench - ClickBench: a Benchmark For Analytical Databases
puffin - Serverless HTAP cloud data platform powered by Arrow × DuckDB × Iceberg
s3fs-fuse - FUSE-based file system backed by Amazon S3
sql.js-httpvfs - Hosting read-only SQLite databases on static file hosters like Github Pages