Python Analysis

Open-source Python projects categorized as Analysis
Edit details
Topics: Python Data Python3 Machine Learning Database
Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
Sponsored

Top 23 Python Analysis Projects

  • Osintgram

    Osintgram is a OSINT tool on Instagram. It offers an interactive shell to perform analysis on Instagram account of any users by its nickname

    • Project mention: facebook hack | /r/Kalilinux | 2023-06-28

    If the tattoo studios aren't necessary to have been from facebook specifically, Osintgram is a pretty effective tool for scraping shit from Instagram really quickly that could theoretically be used to achieve this, if not perhaps in a roundabout sort of way like starting from one business you know and getting shit from their friends' info and so on. I could swear that I had known about a similar tool for facebook, but I'm drawing a blank right now...

  • angr

    A powerful and user-friendly binary analysis platform!

    • Project mention: 30 Years of Decompilation and the Unsolved Structuring Problem: Part 1 | news.ycombinator.com | 2024-01-03

    That's awesome! That's exactly how modern decompilers deal with a special type of goto occurrence. They reduce gotos (or completely eliminate them) by introducing a `while(true)` loop, followed by corresponding `continue` and `breaks`... we all, of course, know that `while(true)` did not exist in the source, but it's a nice hack!

    We even do this in the angr decompiler, found here: https://github.com/angr/angr/blob/8e48d001e18a913ecd4ed2e995...

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • qiling

    A True Instrumentable Binary Emulation Framework

    • Project mention: Qiling: A True Instrumentable Binary Emulation Framework | news.ycombinator.com | 2024-04-01

  • streamalert

    StreamAlert is a serverless, realtime data analysis framework which empowers you to ingest, analyze, and alert on data from any environment, using datasources and alerting logic you define.

  • PySceneDetect

    :movie_camera: Python and OpenCV-based scene cut/transition detection program & library.

    • Project mention: VidCutter: A program for lossless video cutting | news.ycombinator.com | 2023-08-20

    If you mean scene changes, this library works: https://github.com/Breakthrough/PySceneDetect

  • timesketch

    Collaborative forensic timeline analysis

  • nba_api

    An API Client package to access the APIs for NBA.com

    • Project mention: An Analysis of How Chris Paul Has Affected His Teams (And How It May Impact the Warriors) | /r/nba | 2023-11-04

    Thanks to the people putting together the open source nba_api, as well as the people at Basketball Reference and the NBA stats page.

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo

  • codechecker

    CodeChecker is an analyzer tooling, defect database and viewer extension for the Clang Static Analyzer and Clang Tidy

  • Sooty

    The SOC Analysts all-in-one CLI tool to automate and speed up workflow.

  • finviz

    Unofficial API for finviz.com

  • 6DRepNet

    Official Pytorch implementation of 6DRepNet: 6D Rotation representation for unconstrained head pose estimation.

  • dython

    A set of data tools in Python

  • vermin

    Concurrently detect the minimum Python versions needed to run code

    • Project mention: Vermin: Concurrently detect the minimum Python versions needed to run code | news.ycombinator.com | 2024-01-12

  • django-slick-reporting

    Reporting engine for Django, Create dashboards, reports and charts effectively and effortlessly.

  • Python-NSE-Option-Chain-Analyzer

    The NSE has a website which displays the option chain in near real-time. This program retrieves this data from the NSE site and then generates useful analysis of the Option Chain for the specified Index or Stock. It also continuously refreshes the Option Chain and visually displays the trend in various indicators useful for Technical Analysis.

    • Project mention: Python-NSE-Option-Chain-Analyzer: NEW Data - star count:282.0 | /r/algoprojects | 2023-06-03

  • pycbc

    Core package to analyze gravitational-wave data, find signals, and study their parameters. This package was used in the first direct detection of gravitational waves (GW150914), and is used in the ongoing analysis of LIGO/Virgo data.

  • mwdb-core

    Malware repository component for samples & static configuration with REST API interface.

    • Project mention: Advices for an automated malware analysis lab project | /r/Malware | 2023-07-11

  • uproot5

    ROOT I/O in pure Python and NumPy.

    • Project mention: Potential of the Julia programming language for high energy physics computing | news.ycombinator.com | 2023-12-04

    > I wasn't proposing ROOT to be reimplemented in JS. That was what the GP attributed to me.

    Sorry for assuming that. I really felt the pain of thinking of possibility of combining two things I hate so much together (JS+ROOT)

    > "Laypeople" may also think that code is optimized to the last cycle in something like HEP simulations. It's made fast enough and the optimization is nowhere near the level of e.g. graphics heavy games.

    I understand that in other areas there might be more sophisticated optimizations, but does not change things much inside HEP field community. And it is not optimized only for simulations but for other things too. It is not one problem optimization.

    > Real-time usage like high frequency large data collection will probably never happen on the "single language". But I'd guess ROOT is not used at that level either? Also at least last time I checked, ROOT is moving to Python (probably not for the hottest loops of the simulation though).

    I did not mean to indicate that ROOT is being used to handle the online processing (In HEP terms). It is usually handled via optimized C++ compiled code. My idea is that you will probably never use JS or any interpreted language (or anything other than C++ to be pessimistic) for that. ROOT at the end of the day is much closer to C++ than anything else. So learning curve wouldn't be that much if you come with some C++ knowledge initially.

    > Also at least last time I checked, ROOT is moving to Python (probably not for the hottest loops of the simulation though).

    I think you mean PyROOT [1]? This is the official python ROOT interface It provides a set of Python bindings to the ROOT C++ libraries, allowing Python scripts to interact directly with ROOT classes and methods as if they were native Python. But that does not represent and re-writing. It makes things easier for end users who are doing analysis though, while be efficient in terms of performance, especially for operations that are heavily optimized in ROOT.

    There is also uproot [2] which is a purely Python-based reader and writer of ROOT files. It is not a part of the official ROOT project and does not depend on the ROOT libraries. Instead, uproot re-implements the I/O functionalities of ROOT in Python. However, it does not provide an interface to the full range of ROOT functionalities. It is particularly useful for integrating ROOT data into a Python-based data analysis pipeline, where libraries like NumPy, SciPy, Matplotlib, and Pandas ..etc are used.

    > Off-topic: C++ interpretation like done in ROOT seems like a really bad idea.)

    I will agree with you. But to be fair the purpose of ROOT is interactive data analysis but over the decades a lot of things gets added, and many experiments had their own soft forks and things started to get very messy quickly. So that there is no much inertia to fix problems and introduce improvements.

    [1] https://root.cern/manual/python/

    [2] https://github.com/scikit-hep/uproot5

  • debloat

    A GUI and CLI tool for removing bloat from executables

    • Project mention: Scanning big files in Virustotal | /r/Malware | 2023-06-06

    Could this be an option? https://github.com/Squiblydoo/debloat

  • reddit-detective

    Play detective on Reddit: Discover political disinformation campaigns, secret influencers and more

  • SpaceXtract

    Extraction and analysis of telemetry from rocket launch webcasts (from SpaceX and RocketLab)

  • MISP-maltego

    Set of Maltego transforms to inferface with a MISP Threat Sharing instance, and also to explore the whole MITRE ATT&CK dataset.

  • cytoflow

    A Python toolbox for quantitative, reproducible flow cytometry analysis

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Python Analysis related posts

Index

What are some of the best open-source Analysis projects in Python? This list will help you:

Project Stars
1 Osintgram 8,658
2 angr 7,203
3 qiling 4,834
4 streamalert 2,828
5 PySceneDetect 2,774
6 timesketch 2,489
7 nba_api 2,238
8 codechecker 2,084
9 Sooty 1,282
10 finviz 1,008
11 6DRepNet 496
12 dython 492
13 vermin 424
14 django-slick-reporting 423
15 Python-NSE-Option-Chain-Analyzer 370
16 pycbc 294
17 mwdb-core 292
18 uproot5 217
19 debloat 209
20 reddit-detective 206
21 SpaceXtract 172
22 MISP-maltego 165
23 cytoflow 162

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com