magika VS Uppy

As someone that has worked in a space that has to deal with uploaded files for the last few years, and someone who maintains a WASM libmagic Node package ( https://github.com/moshen/wasmagic ) , I have to say I really love seeing new entries into the file type detection space.

Though I have to say when looking at the Node module, I don't understand why they released it.

Their docs say it's slow:

https://github.com/google/magika/blob/120205323e260dad4e5877...

It loads the model an runtime:

https://github.com/google/magika/blob/120205323e260dad4e5877...

They mark it as Experimental in the documentation, but it seems like it was just made for the web demo.

Also as others have mentioned. The model appears to only detect 116 file types:

https://github.com/google/magika/blob/120205323e260dad4e5877...

Where libmagic detects... a lot. Over 1600 last time I checked:

https://github.com/file/file/tree/4cbd5c8f0851201d203755b76c...

I guess I'm confused by this release. Sure it detected most of my list of sample files, but in a sample set of 4 zip files, it misidentified one.

We are very excited to announce the release of Magika our AI powered fast and efficient file type identification lib and tool - https://opensource.googleblog.com/2024/02/magika-ai-powered-fast-and-efficient-file-type-identification.html

Thanks to its optimized Keras model, large scale training dataset, and Onnx Magika massively outperform other file identification tools while be very fast even on CPU.

Magika python code and model is open sourced on Github: https://github.com/google/magika and we also provide an experimental TFJS based npm package https://www.npmjs.com/package/magika

With the team we hope you will find Magika useful for your own projects. Let us know what you think or if you have any question!

Look at https://uppy.io/ open source and lot of integrations. You can keep moving to different levels of abstraction as required and see some good practices of how things are done.

I just found uppy. This will be the next one I use. https://uppy.io/

I’m building a photo sharing website and want to make it incredibly easy to upload photos. Of course I could just utilize AWS official packages but that’s pretty bare bones. I could also use next-s3-upload which is purpose built for Next and simplifies some things but is still fairly basic. But then there’s things like uppy that provides everything you’d ever need in an uploaded (third party sources, camera, etc.) that would be nice to haves, but apparently doesn’t play well with Next without a separate Node server.

Media file uploads with the Uppy JavaScript uploader plugin

Check out Uppy and Uppy Companion: https://github.com/transloadit/uppy/

I would look at Uppy.js, I've used it in an enterprise application and it works super well, makes it super easy to do what you're trying to achieve with progress bars for each file.

I started to try out https://uppy.io/ but their lack of good documentation makes my life a bit difficult. However, uppy seems to be the only available solution out there in the React land (i dont want to implement it by myself).

🔀 Repositório no GitHub