Django-link-archive
Filestash
Django-link-archive | Filestash | |
---|---|---|
12 | 108 | |
13 | 9,474 | |
- | - | |
9.6 | 9.3 | |
5 days ago | 3 days ago | |
Python | JavaScript | |
GNU General Public License v3.0 only | GNU Affero General Public License v3.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Django-link-archive
-
Google fights Invidious (a privacy YouTube Front end)
I am running my of YouTube front-end.
Link: https://github.com/rumca-js/Django-link-archive
Demo: https://renegat0x0.ddns.net/apps/catalog
Allows me to add channels, download individual videos, bookmark videos, etc. Uses iframe to display the video.
I have no problems with viewing videos:
- I use ff with adblock
- videos are embedded using no-referrer-when-downgrade policy
I have literally no ads.
There are some drawbacks:
- YouTube may change their policies, change embedding strategies
- To have control over videos, you still have to manually download them
-
Show HN: Free Plain-Text Bookmarking
I wrote bookmark manager in Django.
https://github.com/rumca-js/Django-link-archive
You can self host it.
You can add RSS sources and auto import new links regularly.
It may not be stare of the art, but gets the job done.
Demo below, but may not be working when you look at it. It runs on raspberry pi.
https://renegat0x0.ddns.net/apps/catalog/entry/11503/
-
A search engine in 80 lines of Python
I have myself dabbled a little bit in that subject. Some of my notes:
- some RSS feeds are protected by cloudflare. It is true however that it is not necessary for majority of blogs. If you would like to do more then selenium would be a way to solve "cloudflare" protected links
- sometimes even selenium headless is not enough and full blown browser in selenium is necessary to fool it's protection
- sometimes even that is not enough
- then I started to wonder, why some RSS feeds are so well protected by cloudflare, but who am I to judge?
- sometimes it is beneficial to cover user agent. I feel bad for setting my user agent to chrome, but again, why RSS feeds are so well protected?
- you cannot parse, read entire Internet, therefore you always need to think about compromises. For example I have narrowed area of my searches in one of my projects to domains only. Now I can find most of the common domains, and I sort them by their "importance"
- RSS links do change. There need to be automated means to disable some feeds automatically to prevent checking inactive domains
- I do not see any configurable timeout for reading a page, but I am not familiar with aiohttp. Some pages might waste your time
- I hate that some RSS feeds are not configured properly. Some sites do not provide a valid meta "link" with "application/rss+xml". Some RSS feeds have naive titles like "Home", or no title at all. Such a waste of opportunity
My RSS feed parser, link archiver, web crawler: https://github.com/rumca-js/Django-link-archive. Especially interesting could be file rsshistory/webtools.py. It is not advanced programming craft, but it got the job done.
Additionally, in other project I have collected around 2378 of personal sites. I collect domains in https://github.com/rumca-js/Internet-Places-Database/tree/ma... . These files are JSONs. All personal sites have tag "personal".
Most of the things are collected from:
https://nownownow.com/
https://searchmysite.net/
I wanted also to process domains from https://downloads.marginalia.nu/, but haven't got time to read structure of the files
-
Is YouTube starting to protect channel RSS feeds?
"""
Disclaimer: I have a automated RSS reader enabled in my network: https://github.com/rumca-js/Django-link-archive
-
Is Google Getting Worse? A Longitudinal Investigation of SEO Spam in Search [pdf]
On the other hand it is not 1995. Time has moved on. I wrote a Simple RSS feed, that also serves as search engine for bookmarks.
I am able to run it in attick on raspberry pi. We do not have to rely so heavily on google.
https://github.com/rumca-js/Django-link-archive
It is true that it does not serve me as google, or kagi replacement. It is a very nice addition though.
With a little bit off determination I do not have to be so dependent on google.
Here is also a dump of known domains. Some are personal.
https://github.com/rumca-js/Internet-Places-Database
...and my bookmarks
https://github.com/rumca-js/RSS-Link-Database
Some more years, and google can go to hell.
-
Ask HN: What apps have you created for your own use?
[4] https://github.com/rumca-js/Django-link-archive
These are exported then to github repositories:
[5] https://github.com/rumca-js/RSS-Link-Database - bookmarks
[6] https://github.com/rumca-js/RSS-Link-Database-2023 - 2023 year news headlines
[7] https://github.com/rumca-js/Internet-Places-Database - all known to me domains, and RSS feeds
-
The Small Website Discoverability Crisis
My own repositories:
- bookmarked entries https://github.com/rumca-js/RSS-Link-Database
- mostly domains https://github.com/rumca-js/Internet-Places-Database
- all 'news' from 2023 https://github.com/rumca-js/RSS-Link-Database-2023
I am using my own Django program to capture and manage links https://github.com/rumca-js/Django-link-archive.
-
Homebrew Website Club
A list od blogs mentioned by hacker news, some were adres manually by me:
https://github.com/rumca-js/Django-link-archive/blob/main/an...
-
Ask HN: Tell us about your project that's not done yet but you want feedback on
I have a project. I have posted it once herenon HN. I have not received any feedback then, it hasn't received much traction.
It is a link aggregation. Can be used as a RSS client, or YouTube front end for subscriptions.
It is intended for light, personal use, therefore it is not much scalable, but supports user management.
https://github.com/rumca-js/Django-link-archive
-
Self hosted YouTube media server – Tube Archivist
Ha, I have also wrote something similar
https://github.com/rumca-js/Django-link-archive
I support not only youtube, but also any RSS source.
It functions as link aggregation software. I can also fetch meta for all videos in channel, and download videos, audios.
I am using standard Django auth module.
It still lacks polish, and it is under development. I am not a webdev, so I am still struggling with overall architecture
Filestash
- Ask HN: What Underrated Open Source Project Deserves More Recognition?
-
A list of SaaS, PaaS and IaaS offerings that have free tiers of interest to devops and infradev
Filestash — A Dropbox-like file manager that connects to a range of protocols and platforms: S3, FTP, SFTP, Minio, Git, WebDAV, Backblaze, LDAP and more.
-
Ask HN: What apps have you created for your own use?
I made https://github.com/mickael-kerjean/filestash out of the need to collaborate on org mode documents with non emacs users. Once the first release was done, I got to reflect on the infamous top comment of the Dropbox HN to make an attempt at abstracting the storage aspect of Dropbox so those org document could be made stored on a FTP server, SFTP, S3, ....
-
Ask HN: Experience using your user's Google Drive instead of a database?
> we need an abstraction for just this. "Bring your own storage"
I made exactly this: https://github.com/mickael-kerjean/filestash and there's an API from which you can abstract any kind of storage: S3, SFTP, FTP, GIT, WebDav, Samba, Local FS, NFS, Backblaze, Storj, Artifactory, .... There's even some funky ones like Mysql from which you have an abstraction where first level folders are databases, second level folders are tables and files are the actual rows
-
Let's learn how modern JavaScript frameworks work by building one
Yes, I rewrote my react app onto vanilla JS using nothing else than rxjs, didn't have the time to document it all yet but it looks like this: https://github.com/mickael-kerjean/filestash/blob/master/pub...
-
Found the ultimate Nextcloud / Owncloud replacement!
I'm not familiar with Cloudreve, but FileStash is a similar application often recommended on this subreddit.
-
HTML Web Components
I do use them on my OSS work (https://github.com/mickael-kerjean/filestash/tree/master/pub...) which is used by many thousands of people
-
UI frameworks are stuck in the last decade
- [2] current state of the rewrite where you can see this pattern in action https://github.com/mickael-kerjean/filestash-rewrite/tree/ma...
-
Ask HN: Tell us about your project that's not done yet but you want feedback on
https://github.com/mickael-kerjean/filestash
This is what I wish Dropbox was, a simple layer that make interacting with your FTP server easy so nobody has to own your data. The end game is both to be feature complete with Dropbox and be able to change every aspect of the application through plugin so everyone can get out what they want from it.
-
Meta pledges Three-Year sponsorship for Python if GIL removal is accepted
> but I don't think its the companies responsibility to give back to open source just because they use it
As someone who does quite a bit of OSS, the reality is most people are asking for things but aren't willing to pay for it. Take Microsoft, I had one of their employee asking me to support their azure stuff: https://github.com/mickael-kerjean/filestash/issues/180. When I found out the dude was actually employed by Microsoft, he started to talk some nonsense and ended up running away.
What are some alternatives?
hoyolab-rss-feeds - RSS feed (JSON & Atom) generator for Genshin Impact's official Hoyolab news feed
filemanager - 📂 Web File Browser
org-clive
SFTPGo - Full-featured and highly configurable SFTP, HTTP/S, FTP/S and WebDAV server - S3, Google Cloud Storage, Azure Blob
Django-rss-feed - Link archive for a NAS drive [Moved to: https://github.com/rumca-js/Django-link-archive]
filegator - Powerful Multi-User File Manager
RSS-Link-Database - Bookmarked archived links
minio - The Object Store for AI Data Infrastructure
catwiki_p3 - CatWiki (using Python 3)
h5ai - HTTP web server index for Apache httpd, lighttpd and nginx.
ytdl-pvr - A script/Docker image to continuously archive YouTube videos using ytdlp.
Apaxy - a simple, customisable theme for your apache directory listing