webcrystal

An archiving HTTP proxy and on-disk archival format for websites. (by davidfstr)

Webcrystal Alternatives

Similar projects and alternatives to webcrystal

  • searxng

    SearXNG is a free internet metasearch engine which aggregates results from various search services and databases. Users are neither tracked nor profiled.

  • warcprox

    WARC writing MITM HTTP/S proxy

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • wikiteam

    Tools for downloading and preserving wikis. We archive wikis, from Wikipedia to tiniest wikis. As of 2023, WikiTeam has preserved more than 350,000 wikis.

  • diskimageprocessor

    Tool for automated processing of disk images in BitCurator

  • proxy.py

    ⚡ Fast • 🪶 Lightweight • 0️⃣ Dependency • 🔌 Pluggable • 😈 TLS interception • 🔒 DNS-over-HTTPS • 🔥 Poor Man's VPN • ⏪ Reverse & ⏩ Forward • 👮🏿 "Proxy Server" framework • 🌐 "Web Server" framework • ➵ ➶ ➷ ➠ "PubSub" framework • 👷 "Work" acceptor & executor framework

  • tor-proxy

    Run your any python service over tor using tor-proxy

  • http-proxy-list

    Discontinued It is a lightweight project that, every 10 minutes, scrapes lots of free-proxy sites, validates if it works, and serves a clean proxy list. [GET https://api.github.com/repos/mertguvencli/http-proxy-list: 403 - Repository access blocked]

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better webcrystal alternative or higher similarity.

webcrystal reviews and mentions

Posts with mentions or reviews of webcrystal. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2024-04-05.
  • SearXNG is a free internet metasearch engine
    3 projects | news.ycombinator.com | 5 Apr 2024
    While it lacks a search feature last I checked there's always https://github.com/davidfstr/webcrystal

    One .py file. Only one dependency (urllib3).n with a little love the concept could become a full transparent proxy.

  • Offpunk 2.0
    2 projects | news.ycombinator.com | 25 Nov 2023
    From the the project page it says:

    > The offline content is stored in ~/.cache/offpunk/ as plain .gmi/.html files. The structure of the Gemini-space is tentatively recreated. One key element of the design is to avoid any database. The cache can thus be modified by hand, content can be removed, used or added by software other than offpunk.

    One ambition I have it to setup

    https://github.com/davidfstr/webcrystal

    > An archiving HTTP proxy and on-disk archival format for websites.

    so that all my regular web browsing is auto archived at some level.

    It would sure be neat if the archive formats could be compatible. It would allow for a setup where everything I’ve seen with my eyes is then immediately accessible programmatically or in a terminal. I feel that could open some significant productive advantages, especially in the age of LLMs also in the terminal.

  • Auto-scraping web browser?
    1 project | /r/DataHoarder | 10 Jan 2023
    Webcrystal?
  • A note from our sponsor - InfluxDB
    www.influxdata.com | 11 May 2024
    Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →

Stats

Basic webcrystal repo stats
3
24
10.0
over 1 year ago

davidfstr/webcrystal is an open source project licensed under MIT License which is an OSI approved license.

The primary programming language of webcrystal is Python.


Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com