opengraph VS TWINT

To explore more Open Graph properties, visit this website: Open Graph Protocol.

Since Netlify introduced Edge Functions we've had an ideal way to add a tiny bit of logic into our link shortener which will return a page template of our own to anything looking to unfurl the URL to display its opengraph image.

Very true. Google's Brotli and Facebook's Open Graph are standards these days everyone uses. They certainly have a lot of controversy, but what they have contributed to open source can't be overlooked or avoided in many cases.

- The page is not returning opengraph metadata (if it's an html page, not a direct image/video link): https://ogp.me/

The company Meta, formerly known as Facebook, developed the Open Graph protocol and Facebook uses it to display its cards view on sharing links. In this way, the Open Graph became a social sharing standard available on the web and this is stated on its home page:

Optimized og:description based on content

Metadata needs a description. You should also be leveraging OpenGraph metadata https://ogp.me/ to improve how your content will appear when shared on other websites (e.g Facebook, Twitter, etc). And ideally JSON+LD as well.

The tool doesn't work anymore since Twitter changed its APIs, but a good example is twint. Most people in OSINT are not highly technical and don't know their way around a CLI. On the other hand, a CLI tool is one of the quickest, lowest (dev) cost ways to release a tool to the public, and many developers who build tools for the OSINT community do so for free (open source).

Related but archived (scraper): https://github.com/twintproject/twint

In the examples for usage if you scroll down all use usernames. I just skimmed over the code and I find references to twitter search api calls. Not sure what they mean by "without using twitter api". Example: https://github.com/twintproject/twint/blob/master/twint/url.py

They do have examples that don't specify a username such as number 3 on this page or this one on the main page: "twint -g="48.880048,2.385939,1km" -o file.csv --csv - Scrape Tweets from a radius of 1km around a place in Paris and export them to a csv file."

this was 2 years ago, but i used to use twint to scrape 10's of millions of tweets. twint didnt require any acct and i used a VPN.

!git clone --depth=1 https://github.com/twintproject/twint.git

Twint is archived and old.

How is your script compared to twint? https://github.com/twintproject/twint