magika

Detect file content types with deep learning (by google)

Magika Alternatives

Similar projects and alternatives to magika

  • xonsh

    112 magika VS xonsh

    :shell: Python-powered, cross-platform, Unix-gazing shell.

  • prql

    106 magika VS prql

    PRQL is a modern language for transforming data — a simple, powerful, pipelined SQL replacement

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • FLiPStackWeekly

    FLaNK AI Weekly covering Apache NiFi, Apache Flink, Apache Kafka, Apache Spark, Apache Iceberg, Apache Ozone, Apache Pulsar, and more...

  • OCRmyPDF

    77 magika VS OCRmyPDF

    OCRmyPDF adds an OCR text layer to scanned PDF files, allowing them to be searched

  • plotly.js

    39 magika VS plotly.js

    Open-source JavaScript charting library behind Plotly and Dash

  • clamav

    ClamAV - Documentation is here: https://docs.clamav.net

  • nifi

    35 magika VS nifi

    Apache NiFi

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo
  • mwmbl

    27 magika VS mwmbl

    An open source, non-profit search engine implemented in python

  • osv.dev

    19 magika VS osv.dev

    Open source vulnerability DB and triage service.

  • file

    Read-only mirror of file CVS repository, updated every half hour. NOTE: do not make pull requests here, nor comment any commits, submit them usual way to bug tracker or to the mailing list. Maintainer(s) are not tracking this git mirror.

  • spark-nlp-workshop

    16 magika VS spark-nlp-workshop

    Public runnable examples of using John Snow Labs' NLP for Apache Spark.

  • mimemagic

    Mime type detection in ruby via file extension or file content

  • dstack

    15 magika VS dstack

    dstack is an open-source orchestration engine for running AI workloads at scale in any cloud or data center. https://discord.gg/u8SmfwPpMd

  • sent

    a simple plaintext presentation tool

  • noseyparker

    Nosey Parker is a command-line program that finds secrets and sensitive information in textual data and Git history.

  • cve-bin-tool

    The CVE Binary Tool helps you determine if your system includes known vulnerabilities. You can scan binaries for over 200 common, vulnerable components (openssl, libpng, libxml2, expat and others), or if you know the components used, you can get a list of known vulnerabilities associated with an SBOM or a list of components and versions.

  • magic

    Racket implementation of the Unix file command's magic language (by jjsimpso)

  • recon-ng

    4 magika VS recon-ng

    Open Source Intelligence gathering tool aimed at reducing the time spent harvesting information from open sources.

  • gnn

    3 magika VS gnn

    TensorFlow GNN is a library to build Graph Neural Networks on the TensorFlow platform.

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better magika alternative or higher similarity.

magika reviews and mentions

Posts with mentions or reviews of magika. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2024-02-19.
  • FLaNK Stack Weekly 19 Feb 2024
    50 projects | dev.to | 19 Feb 2024
  • Magika: AI powered fast and efficient file type identification
    15 projects | news.ycombinator.com | 15 Feb 2024
    As someone that has worked in a space that has to deal with uploaded files for the last few years, and someone who maintains a WASM libmagic Node package ( https://github.com/moshen/wasmagic ) , I have to say I really love seeing new entries into the file type detection space.

    Though I have to say when looking at the Node module, I don't understand why they released it.

    Their docs say it's slow:

    https://github.com/google/magika/blob/120205323e260dad4e5877...

    It loads the model an runtime:

    https://github.com/google/magika/blob/120205323e260dad4e5877...

    They mark it as Experimental in the documentation, but it seems like it was just made for the web demo.

    Also as others have mentioned. The model appears to only detect 116 file types:

    https://github.com/google/magika/blob/120205323e260dad4e5877...

    Where libmagic detects... a lot. Over 1600 last time I checked:

    https://github.com/file/file/tree/4cbd5c8f0851201d203755b76c...

    I guess I'm confused by this release. Sure it detected most of my list of sample files, but in a sample set of 4 zip files, it misidentified one.

  • Show HN: Magika: AI powered fast and efficient file type identification
    1 project | news.ycombinator.com | 15 Feb 2024
    We are very excited to announce the release of Magika our AI powered fast and efficient file type identification lib and tool - https://opensource.googleblog.com/2024/02/magika-ai-powered-fast-and-efficient-file-type-identification.html

    Thanks to its optimized Keras model, large scale training dataset, and Onnx Magika massively outperform other file identification tools while be very fast even on CPU.

    Magika python code and model is open sourced on Github: https://github.com/google/magika and we also provide an experimental TFJS based npm package https://www.npmjs.com/package/magika

    With the team we hope you will find Magika useful for your own projects. Let us know what you think or if you have any question!

  • A note from our sponsor - SaaSHub
    www.saashub.com | 27 Apr 2024
    SaaSHub helps you find the best software and product alternatives Learn more →

Stats

Basic magika repo stats
4
7,344
9.8
2 days ago

google/magika is an open source project licensed under Apache License 2.0 which is an OSI approved license.

The primary programming language of magika is Python.


Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com