Top 23 Python CSV Projects
q - Run SQL directly on delimited files and multi-file sqlite databases (by harelba)Project mention: OpenOffice. Necesito ver una hoja de cálculo que tiene 6 millones de columnas, pero no puedo | reddit.com/r/AskArgentina | 2022-05-15
An open source multi-tool for exploring and publishing dataProject mention: The domain for the Python Requests library is expired | news.ycombinator.com | 2022-05-24
Weirdly, when I'm evaluating open source libraries having their own domain name rather than a site on GitHub pages or ReadTheDocs is a very slight mark against them in my book - because of exactly this.
If a project has its own domain name, it has better be VERY confident that it will be renewing that domain for decades to come. If it's a relatively concise library I would much rather it use a trustworthy service to host its documentation as opposed to some custom domain that's likely to expire and break links in the future.
(My own open source projects now mostly hang off my https://datasette.io/ domain, but I was a few years into that project before I committed to a domain name that I plan to renew for the rest of my life.)
Less time debugging, more time building. Scout APM allows you to find and fix performance issues with no hassle. Now with error monitoring and external services monitoring, Scout is a developer's best friend when it comes to application development.
A terminal spreadsheet multitool for discovering and arranging dataProject mention: Show HN: USV = Unicode Separated Values | news.ycombinator.com | 2022-05-04
Would you be open to filing an issue with these details? https://github.com/saulpw/visidata/issues/new?assignees=&lab...
We do not have anyone who is deeply familiar with USV spec details on the team, and could use your help to understand what needs to be fixed.
A suite of utilities for converting to and working with CSV, the king of tabular file formats.Project mention: Do you know of any website that has a bunch of files for CSV parser edge case testing? | reddit.com/r/vba | 2021-06-23
Django application and library for importing and exporting data with admin integration.
Python scripts for ETL (extract, transform and load) jobs for Ethereum blocks, transactions, ERC20 / ERC721 tokens, transfers, receipts, logs, contracts, internal transactions. Data is available in Google BigQuery https://goo.gl/oY5BCQProject mention: data engineering in web3 | reddit.com/r/dataengineering | 2022-05-20
I'm surprised this is the only good response in this thread so far. Blockchain data is completely open but requires some organization in order to perform analytics. Nansen for example is a product that is built on top of ethereum-etl which you can checkout here
PyGraphistry is a Python library to quickly load, shape, embed, and explore big graphs with the GPU-accelerated Graphistry visual graph analyzerProject mention: Handbook of Graph Drawing and Visualization | news.ycombinator.com | 2021-12-30
This! We do it all the time in fraud, genomics, social media, security, etc
We do one more thing: connect the nearest neighbors to make an interactive similarity graph. Takes just a few lines in total: https://github.com/graphistry/pygraphistry/blob/master/demos...
Static code analysis for 29 languages.. Your projects are multi-language. So is SonarQube analysis. Find Bugs, Vulnerabilities, Security Hotspots, and Code Smells so you can release quality code every time. Get started analyzing your projects today for free.
Scrape job websites into a single spreadsheet with no duplicates.
Single API for reading, manipulating and writing data in csv, ods, xls, xlsx and xlsm files
Pydantic model generator for easy conversion of JSON, OpenAPI, JSON Schema, and YAML data sources.Project mention: PSA: I think this JSON to Pydantic converter is extremely useful for boilerplate model creation | reddit.com/r/FastAPI | 2022-04-23
Not sure who owns/hosts the site, but its based on this github repo.
What's in your data? Extract schema, statistics and entities from datasetsProject mention: Miller – tool for querying, shaping, reformatting data in CSV, TSV, and JSON | news.ycombinator.com | 2021-12-22
My team built a similar tool in Python to load any delimited file, json, parquet and Avro with one command:
Effectively loads anything into a dataframe
Unofficial API for finviz.comProject mention: Question about (somewhat) live market volume data | reddit.com/r/algotrading | 2022-03-12
Try https://www.tiingo.com/ pretty cheap data. You might be able to also scrape https://finviz.com/screener.ashx?v=161&ft=2&o=pe and store the data and compare. Useful python package I have previously used. https://github.com/mariostoev/finviz
Convert CSV files into a SQLite databaseProject mention: Turning database into a searchable dashboard? | reddit.com/r/datascience | 2021-10-21
Oh what's that you say, your data is in CSV and you don't want to write code to load them up into a database, well try this https://github.com/simonw/csvs-to-sqlite
Check out pytablewriter: https://github.com/thombashi/pytablewriter
🌈Rainbow CSV - Vim plugin: Highlight columns in CSV and TSV files and run queries in SQL-like languageProject mention: IT Pro Tuesday #177 - Network Config Analysis, MSI Tool, QoS Tip & More | reddit.com/r/ITProTuesday | 2021-11-23
Rainbow CSV is a Vim plugin that highlights columns in different colors in your CSV and TSV files and runs queries in a built-in SQL-like language. Provides additional information about a column when you hover, plus an automatic consistency check for CSV files. Recommended by digitaltransmutation.
:blue_book: dict subclass with keylist/keypath support, normalized I/O operations (base64, csv, ini, json, pickle, plist, query-string, toml, xml, yaml) and many utilities.
Export tools for PlexProject mention: WebTools-NG vs Old ExportTools | reddit.com/r/PleX | 2022-05-11
URL testing lists intended for discovering website censorshipProject mention: How are anti-BJP and anti-hindutva sites blocked in India? | reddit.com/r/india | 2022-01-01
Just opened a PR for piratebay.live: https://github.com/citizenlab/test-lists/pull/875
A Simple , ☁️ Lightweight , 💪 Efficent JSON based database for 🐍 Python.Project mention: Cattle RFID Tags | reddit.com/r/RFID | 2022-04-04
Choice of database depends on your needs and network requirements. If you just want timestamp and a tag ID connected to it I’d recommend pysonDB a simple JSON-based database. If you need to be able to access data outside of the network I’d recommend you to use Googles Firebase with firestore / real-time DB (any should be fine) which would allow you to subscribe to real-time updates. If you want a fancy website connected to this I’d recommend using firebase as it allows for free hosting
Instagram OSINT tool to export and analyse followers | following with their detailsProject mention: Problems running / using Sterra | reddit.com/r/OSINT | 2022-02-12
Has anybody trying using Sterra?
Simple XLSX and CSV to dictionary converter
Easily convert and import your bank's statements into YNAB. This project consolidates other conversion efforts into one universal tool.Project mention: Automatic export from NAB for YNAB | reddit.com/r/AusFinance | 2022-04-25
Once it’s exported I can feed it into YNAB automatically using bank2ynab, it’s the getting the transaction information from NAB automatically that is the issue.
Python class to scrape data from rightmove.co.uk and return listings in a pandas DataFrame object
Python CSV related posts
data engineering in web3
1 project | reddit.com/r/dataengineering | 20 May 2022
Show HN: USV = Unicode Separated Values
2 projects | news.ycombinator.com | 4 May 2022
WebTools-NG vs Old ExportTools
2 projects | reddit.com/r/PleX | 11 May 2022
Why isn’t there a decent file format for tabular data?
13 projects | news.ycombinator.com | 3 May 2022
Find Your Libraries Average Rotten Tomatoes Score?
1 project | reddit.com/r/PleX | 3 May 2022
Caffè Italia * 12/04/22
2 projects | reddit.com/r/italy | 12 Apr 2022
Daily Chat Thread - April 08, 2022
1 project | reddit.com/r/cscareerquestions | 8 Apr 2022
What are some of the best open-source CSV projects in Python? This list will help you:
Are you hiring? Post a new remote job listing for free.