metadata-extractor VS datahub

Alternatively and much more easily, you can use a library like Apache Commons Imaging or Metadata-Extractor, or run a shell command to read it.

I've been playing around with https://datahubproject.io which is in quite active development.

Relative;y mature open source projects for this are: https://www.amundsen.io/ and https://datahubproject.io/

DataHub is really nice.

git clone https://github.com/linkedin/datahub.git

Go look up DataHub on Github. https://github.com/linkedin/datahub If they finished the DBT integration and what their writing says is true, then I think you'd be interested

An important requirement for data privacy and protection is to find and catalog tables and columns that contain PII or PHI data in a data warehouse. Open source data catalogs like Datahub and Amundsen enable cataloging of information in data warehouses. Moreover, tables and columns can be tagged including PII and type of PII tags.

I've had the same issue with finding more concrete details about it. I've read an entire book on data mesh, and while I get all the concepts, I sense that it's more like agile (a loose methodology) in the sense that it's not going to be something that can be taken off the shelf and applied to all organizations the same way. Basically, here's all these ways to make data handling successful, but how you do it will be specific to your company. Guidelines to follow and pitfalls to avoid as opposed to a specific technology.

That said, check out https://datahubproject.io/ . It's the closest OSS I've found that is following the spirit of Data Mesh.

Congrats on launching!

So how do you compare to a Data Catalog like datahub? https://datahubproject.io/

From the video you looked very similar to them as a metadata consumer and they provide extensive API integrations so you can add basically any set of metadata you want including slack, jira etc.

Metadata Engine: - Datahub https://github.com/linkedin/datahub - Amundsen https://github.com/amundsen-io/amundsen/ - Marquez https://marquezproject.github.io/ - Egeria - Open Metadata and Governance https://egeria.odpi.org

Having done that, then if you opt later down the road to use something like (amundsen)[https://www.amundsen.io/) or DataHub (https://github.com/linkedin/datahub) or the commercial Alation (www.alation.com), it can read those comments and populate their UI automatically.