Python CSV

Open-source Python projects categorized as CSV | Edit details
Related topics: #Python #JSON #Python3 #SQL #Pandas

Top 23 Python CSV Projects

  • q

    q - Run SQL directly on delimited files and multi-file sqlite databases (by harelba)

    Project mention: OpenOffice. Necesito ver una hoja de cálculo que tiene 6 millones de columnas, pero no puedo | reddit.com/r/AskArgentina | 2022-05-15
  • datasette

    An open source multi-tool for exploring and publishing data

    Project mention: The domain for the Python Requests library is expired | news.ycombinator.com | 2022-05-24

    Weirdly, when I'm evaluating open source libraries having their own domain name rather than a site on GitHub pages or ReadTheDocs is a very slight mark against them in my book - because of exactly this.

    If a project has its own domain name, it has better be VERY confident that it will be renewing that domain for decades to come. If it's a relatively concise library I would much rather it use a trustworthy service to host its documentation as opposed to some custom domain that's likely to expire and break links in the future.

    (My own open source projects now mostly hang off my https://datasette.io/ domain, but I was a few years into that project before I committed to a domain name that I plan to renew for the rest of my life.)

  • Scout APM

    Less time debugging, more time building. Scout APM allows you to find and fix performance issues with no hassle. Now with error monitoring and external services monitoring, Scout is a developer's best friend when it comes to application development.

  • visidata

    A terminal spreadsheet multitool for discovering and arranging data

    Project mention: Show HN: USV = Unicode Separated Values | news.ycombinator.com | 2022-05-04

    Would you be open to filing an issue with these details? https://github.com/saulpw/visidata/issues/new?assignees=&lab...

    We do not have anyone who is deeply familiar with USV spec details on the team, and could use your help to understand what needs to be fixed.

  • csvkit

    A suite of utilities for converting to and working with CSV, the king of tabular file formats.

    Project mention: Do you know of any website that has a bunch of files for CSV parser edge case testing? | reddit.com/r/vba | 2021-06-23
  • django-import-export

    Django application and library for importing and exporting data with admin integration.

  • ethereum-etl

    Python scripts for ETL (extract, transform and load) jobs for Ethereum blocks, transactions, ERC20 / ERC721 tokens, transfers, receipts, logs, contracts, internal transactions. Data is available in Google BigQuery https://goo.gl/oY5BCQ

    Project mention: data engineering in web3 | reddit.com/r/dataengineering | 2022-05-20

    I'm surprised this is the only good response in this thread so far. Blockchain data is completely open but requires some organization in order to perform analytics. Nansen for example is a product that is built on top of ethereum-etl which you can checkout here

  • pygraphistry

    PyGraphistry is a Python library to quickly load, shape, embed, and explore big graphs with the GPU-accelerated Graphistry visual graph analyzer

    Project mention: Handbook of Graph Drawing and Visualization | news.ycombinator.com | 2021-12-30

    This! We do it all the time in fraud, genomics, social media, security, etc

    We do one more thing: connect the nearest neighbors to make an interactive similarity graph. Takes just a few lines in total: https://github.com/graphistry/pygraphistry/blob/master/demos...

  • SonarQube

    Static code analysis for 29 languages.. Your projects are multi-language. So is SonarQube analysis. Find Bugs, Vulnerabilities, Security Hotspots, and Code Smells so you can release quality code every time. Get started analyzing your projects today for free.

  • JobFunnel

    Scrape job websites into a single spreadsheet with no duplicates.

  • pyexcel

    Single API for reading, manipulating and writing data in csv, ods, xls, xlsx and xlsm files

  • datamodel-code-generator

    Pydantic model generator for easy conversion of JSON, OpenAPI, JSON Schema, and YAML data sources.

    Project mention: PSA: I think this JSON to Pydantic converter is extremely useful for boilerplate model creation | reddit.com/r/FastAPI | 2022-04-23

    Not sure who owns/hosts the site, but its based on this github repo.

  • DataProfiler

    What's in your data? Extract schema, statistics and entities from datasets

    Project mention: Miller – tool for querying, shaping, reformatting data in CSV, TSV, and JSON | news.ycombinator.com | 2021-12-22

    My team built a similar tool in Python to load any delimited file, json, parquet and Avro with one command:

    https://github.com/capitalone/DataProfiler

    Effectively loads anything into a dataframe

  • finviz

    Unofficial API for finviz.com

    Project mention: Question about (somewhat) live market volume data | reddit.com/r/algotrading | 2022-03-12

    Try https://www.tiingo.com/ pretty cheap data. You might be able to also scrape https://finviz.com/screener.ashx?v=161&ft=2&o=pe and store the data and compare. Useful python package I have previously used. https://github.com/mariostoev/finviz

  • csvs-to-sqlite

    Convert CSV files into a SQLite database

    Project mention: Turning database into a searchable dashboard? | reddit.com/r/datascience | 2021-10-21

    Oh what's that you say, your data is in CSV and you don't want to write code to load them up into a database, well try this https://github.com/simonw/csvs-to-sqlite

  • pytablewriter

    pytablewriter is a Python library to write a table in various formats: AsciiDoc / CSV / Elasticsearch / HTML / JavaScript / JSON / LaTeX / LDJSON / LTSV / Markdown / MediaWiki / NumPy / Excel / Pandas / Python / reStructuredText / SQLite / TOML / TSV.

    Project mention: Github style table | reddit.com/r/learnpython | 2022-02-19

    Check out pytablewriter: https://github.com/thombashi/pytablewriter

  • rainbow_csv

    🌈Rainbow CSV - Vim plugin: Highlight columns in CSV and TSV files and run queries in SQL-like language

    Project mention: IT Pro Tuesday #177 - Network Config Analysis, MSI Tool, QoS Tip & More | reddit.com/r/ITProTuesday | 2021-11-23

    Rainbow CSV is a Vim plugin that highlights columns in different colors in your CSV and TSV files and runs queries in a built-in SQL-like language. Provides additional information about a column when you hover, plus an automatic consistency check for CSV files. Recommended by digitaltransmutation.

  • python-benedict

    :blue_book: dict subclass with keylist/keypath support, normalized I/O operations (base64, csv, ini, json, pickle, plist, query-string, toml, xml, yaml) and many utilities.

  • ExportTools.bundle

    Export tools for Plex

    Project mention: WebTools-NG vs Old ExportTools | reddit.com/r/PleX | 2022-05-11
  • test-lists

    URL testing lists intended for discovering website censorship

    Project mention: How are anti-BJP and anti-hindutva sites blocked in India? | reddit.com/r/india | 2022-01-01

    Just opened a PR for piratebay.live: https://github.com/citizenlab/test-lists/pull/875

  • pysonDB

    A Simple , ☁️ Lightweight , 💪 Efficent JSON based database for 🐍 Python.

    Project mention: Cattle RFID Tags | reddit.com/r/RFID | 2022-04-04

    Choice of database depends on your needs and network requirements. If you just want timestamp and a tag ID connected to it I’d recommend pysonDB a simple JSON-based database. If you need to be able to access data outside of the network I’d recommend you to use Googles Firebase with firestore / real-time DB (any should be fine) which would allow you to subscribe to real-time updates. If you want a fancy website connected to this I’d recommend using firebase as it allows for free hosting

  • sterraxcyl

    Instagram OSINT tool to export and analyse followers | following with their details

    Project mention: Problems running / using Sterra | reddit.com/r/OSINT | 2022-02-12

    Has anybody trying using Sterra?

  • sheet2dict

    Simple XLSX and CSV to dictionary converter

  • bank2ynab

    Easily convert and import your bank's statements into YNAB. This project consolidates other conversion efforts into one universal tool.

    Project mention: Automatic export from NAB for YNAB | reddit.com/r/AusFinance | 2022-04-25

    Once it’s exported I can feed it into YNAB automatically using bank2ynab, it’s the getting the transaction information from NAB automatically that is the issue.

  • rightmove_webscraper.py

    Python class to scrape data from rightmove.co.uk and return listings in a pandas DataFrame object

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2022-05-24.

Python CSV related posts

Index

What are some of the best open-source CSV projects in Python? This list will help you:

Project Stars
1 q 9,059
2 datasette 6,081
3 visidata 5,451
4 csvkit 4,983
5 django-import-export 2,404
6 ethereum-etl 1,785
7 pygraphistry 1,603
8 JobFunnel 1,553
9 pyexcel 1,018
10 datamodel-code-generator 984
11 DataProfiler 805
12 finviz 765
13 csvs-to-sqlite 692
14 pytablewriter 485
15 rainbow_csv 400
16 python-benedict 384
17 ExportTools.bundle 314
18 test-lists 301
19 pysonDB 236
20 sterraxcyl 213
21 sheet2dict 206
22 bank2ynab 171
23 rightmove_webscraper.py 170
Find remote jobs at our new job board 99remotejobs.com. There are 7 new remote jobs listed recently.
Are you hiring? Post a new remote job listing for free.
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com