trafilatura VS floccus

The feature list answers that question pretty well: https://github.com/adbar/trafilatura#features

Basically: you could implement all of this on top of BeautifulSoup - polite crawling policies, sitemap and feed parsing, URL de-duplication, parallel processing, download queues, heuristics for extracting just the main article content, metadata extraction, language detection... but it would require writing an enormous amount of extra code.

The WebScraper tool uses Trafilatura [1] to scrape and parse HTML—nothing too fancy. "Scraping" a React site would require a totally different approach, probably something more akin to Adept's ACT-1 [2].

I run a local chat app built with Griptape and I use it to give me summaries of web pages or answer specific questions all the time :)

1. https://github.com/adbar/trafilatura/

I've been playing with Trafilatura lately, and it's very good. There are a few very thorough comparisons to other projects and it really shines. It doesn't do anything headless from what I can tell, but it doesn't have to do the scraping itself. Maybe an option could be to use Playwright to scrape, then Trafilatura to parse. Food for thought.

Cool! If you care to explain me further... :) ... I tried parsing a page using: https://github.com/adbar/trafilatura, json stringify it and passing it to https://platform.openai.com/docs/api-reference/embeddings/create. How do I use the response as an input later? <3

I want to test how easy it is to install a package plus special extra dependencies to run a certain script in that package: https://github.com/adbar/trafilatura

floccus bookmark sync (version 5000002): Sync your bookmarks privately across browsers and devices

There are solutions external to the browsers that work pretty well and where you have control on your data :

Floccus for bookmarks (https://floccus.org/) : it works also on mobile devices : a great plus ! You need only a webdav server (or a Nextcloud account), I use Dave (https://github.com/micromata/dave)

Vaultwarden for the passwords (https://github.com/dani-garcia/vaultwarden)

A huge advantage of this solution is that you can have synchronization also between different browsers and on mobile devices.

I have used things like xsync, raindrop and others over the years and recently started using Floccus (https://floccus.org/) which is free and opensource just does not support Safari. Private bookmarks on my own sync system and can keep any chromium or firefox based browsers bookmarks and tabs synced.

xBrowserSync and Floccus.

Try floccus if you want to sync between different browsers.

maybe this: floccus

I've got floccus running between browsers for the bookmarks I use more often, and benotes for the ones I want to keep for reference or for later.

Floccus https://floccus.org/