Opendata

Open-source projects categorized as Opendata
Edit details
Language: + Python + Ruby + CSS + Java + Rust + Jupyter Notebook
Topics: Football CSV API JSON open-data
Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured

Top 23 Opendata Open-Source Projects

  • awesome-public-datasets

    A topic-centric list of HQ open datasets.

    • Project mention: Awesome Public Datasets | news.ycombinator.com | 2024-05-03

  • OpenRefine

    OpenRefine is a free, open source power tool for working with messy data and improving it

    • Project mention: Ask HN: What Underrated Open Source Project Deserves More Recognition? | news.ycombinator.com | 2024-03-07

    "OpenRefine is a powerful free, open source tool for working with messy data: cleaning it; transforming it from one format into another; and extending it with web services and external data." https://openrefine.org/

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • visidata

    A terminal spreadsheet multitool for discovering and arranging data

    • Project mention: Data Science at the Command Line, 2nd Edition (2021) | news.ycombinator.com | 2024-05-06

    I'd like to call out one of my favorite pieces of software from the past 10 years: VisiData [1] has completely changed the way I do ad-hoc data processing, and is now my go-to for pretty much all use cases that I previously used spreadsheets for, and about half of those I previously used databases for.

    It's a TUI application, not strictly CLI, but scriptable, and I figure anyone building pipelines using tools like jq, q, awk, grep, etc. to process tabular data will find it extremely useful.

    ----

    [1]: https://visidata.org

  • openapi-directory

    🌐 Wikipedia for Web APIs. Directory of REST API definitions in OpenAPI 2.0/3.x format

    • Project mention: What is API Discovery, and How to Use it to Reduce Your Attack Surface | dev.to | 2024-03-07

    Use APIs.gurufor exploring well-documented OpenAPI files. For example, imagine you are interested in integrating a weather API. By searching for "weather" on APIs.guru, you find several options.

  • qsv

    CSVs sliced, diced & analyzed.

    • Project mention: Qsv: Efficient CSV CLI Toolkit | news.ycombinator.com | 2023-12-22

    Thanks for the detailed feedback @snidane!

    As maintainer of qsv, here's my reply:

    - Given qsv's rapid release cycle (173 releases over three years), the auto-update check is essential at the moment. Once we reach 1.0, I'll turn it off. For now, given your feedback, I've only made it check 10% of the time.

    - Pivot is in the backlog and I'll be sure to add unpivot when I implement it. (https://github.com/jqnatividad/qsv/issues/799)

    - I'll add a dedicated summing command with the group by (-by) and window by (-over) capability (https://github.com/jqnatividad/qsv/issues/1514). Do note that `stats` has basic sum as @ezequiel-garzon pointed out.

    - With the `enum` command, qsv can achieve what you proposed with `laminate`. E.g. qsv enum --new-column newcol --constant newconstant mydata.csv --output laminated-data.csv

    - With the cat rowskey command, qsv can already concatenate files with mismatched headers.

    - other file formats. qsv supports parquet, csv, tsv, excel, ods, datapackage, sqlite and more (see https://github.com/jqnatividad/qsv/tree/master#file-formats). Fixed-format though is not supported yet and quite interesting, and have added it to the backlog (https://github.com/jqnatividad/qsv/issues/1515)

    - as to "enable embedding outputs of commands", qsv is composable by design, so you can use standard stdin/stdout redirection/piping techniques to have it work with other CLI tools like jq, awk, etc.

    Finally, just released v0.120.0 that already incorporates the less aggressive self-update check. https://github.com/jqnatividad/qsv/releases/tag/0.120.0

  • FinMind

    Open Data, more than 50 financial data. 提供超過 50 個金融資料(台股為主)，每天更新 https://finmind.github.io/

    • Project mention: FinMind: NEW Data - star count:1937.0 | /r/algoprojects | 2023-08-15

  • factbook.json

    World Factbook Country Profiles in JSON - Free Open Public Domain Data - No API Key Required ;-)

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo

  • WoBike

    Documentation of Bike Sharing APIs 🚴🛴🛵

  • reality

    Comprehensive data proxy to knowledge about real world (by molybdenum-99)

  • UhttBarcodeReference

    Universe-HTT barcode reference

  • football.json

    Free open public domain football data in JSON incl. English Premier League, Bundesliga, Primera División, Serie A and more - No API key required ;-)

  • FootballData

    A hodgepodge of JSON and CSV Football/Soccer data

  • awesome-data-catalogs

    📙 Awesome Data Catalogs and Observability Platforms.

  • awesome-openstreetmap

    😎 Curated list of awesome OpenSteetMap-projects

  • socios-brasil

    Captura os dados de sócios das empresas brasileiras na Receita Federal e exporta para um formato legível por humanos

  • worldcup

    Free open public domain football data for the World Cup (incl. Qatar 2022, Russia 2018, Brazil 2014, etc.) and World Cup Quali(fiers) (by openfootball)

  • covid19-opendata-vaccini

    Open Data su consegna e somministrazione dei vaccini anti COVID-19 in Italia - Commissario straordinario per l'emergenza Covid-19

  • england

    Free open public domain football data for England (and Wales) incl. English Premier League (EPL) etc.

  • osgeo

    The Open Source Geospatial Foundation is not-for-profit organization to empower everyone with open source geospatial. Directly supports projects as an outreach and advocacy organization providing financial, organizational and legal support. Works with our sponsors and partners for open software, standards, data, research and education.

    • Project mention: Does anyone else wish the geospatial community was more open (like GitHub)? | /r/geospatial | 2023-11-13

    Outside of data (which is getting more open by the day), I'd argue that GIS is a very open field. There's a vast open source ecosystem from the foundation onwards (even ESRI uses GDAL) with a large community around it, ubiquitous standards via the OGC and so on.

  • awesome-italian-public-datasets

    A selection of interesting Open dataset from the Italian Public Administration and Civic Data use cases

  • sport.db

    sport.db - open sports database (e.g. football.db, formula1.db etc.) command line tool and libraries

  • worldcup.json

    Free open public domain football data for the world cups in JSON incl. Qatar 2022, Russia 2018 and more - No API key required ;-)

  • awesome-bikeprojects

    A curated list of awesome projects around the bicycle 🚲

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Opendata related posts

Index

What are some of the best open-source Opendata projects? This list will help you:

Project Stars
1 awesome-public-datasets 58,470
2 OpenRefine 10,498
3 visidata 7,432
4 openapi-directory 3,664
5 qsv 2,234
6 FinMind 2,050
7 factbook.json 965
8 WoBike 936
9 reality 812
10 UhttBarcodeReference 779
11 football.json 723
12 FootballData 652
13 awesome-data-catalogs 586
14 awesome-openstreetmap 568
15 socios-brasil 548
16 worldcup 542
17 covid19-opendata-vaccini 528
18 england 402
19 osgeo 344
20 awesome-italian-public-datasets 250
21 sport.db 218
22 worldcup.json 176
23 awesome-bikeprojects 168

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com