Advanced Scientific Data Format

This page summarizes the projects mentioned and recommended in the original post on news.ycombinator.com
Version Manager Asdf Spark Ruby advanced-scientific-data-format

InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured

  • asdf

    ASDF (Advanced Scientific Data Format) is a next generation interchange format for scientific data (by asdf-format)

  • asdf

    Extendable version manager with support for Ruby, Node.js, Elixir, Erlang & more

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • uvfs

    Microscopic C++20 archive format

    • I had started a little bit of work towards that recently: https://github.com/celtera/uvfs

    It's very optimized towards my specific needs but could be a basis for what you mention

  • sito

    sito: A serialization suite

  • adam

    ADAM is a genomics analysis platform with specialized file formats built using Apache Avro, Apache Spark, and Apache Parquet. Apache 2 licensed.

    • We presented using Parquet formats for bioinformatics 2012/13-ish at the Bioinformatics Open Source Conference (BOSC) and got laughed out of the place.

    While using Apache Spark for bioinformatics [0] never really took off, I still think Parquet formats for bioinformatics [1] is a good idea, especially with DuckDB, Apache Arrow, etc. supporting Parquet out of the box.

    0 - https://github.com/bigdatagenomics/adam

    1 - https://github.com/bigdatagenomics/bdg-formats

  • bdg-formats

    Open source formats for scalable genomic processing systems using Avro. Apache 2 licensed.

    • We presented using Parquet formats for bioinformatics 2012/13-ish at the Bioinformatics Open Source Conference (BOSC) and got laughed out of the place.

    While using Apache Spark for bioinformatics [0] never really took off, I still think Parquet formats for bioinformatics [1] is a good idea, especially with DuckDB, Apache Arrow, etc. supporting Parquet out of the box.

    0 - https://github.com/bigdatagenomics/adam

    1 - https://github.com/bigdatagenomics/bdg-formats

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • Criando seu ambiente com ASDF

    4 projects | dev.to | 29 Dec 2023

  • Nunca mais assisto video pela metade.

    2 projects | /r/brdev | 17 May 2023

  • Add "asdf" (version manager) to sidebar?

    3 projects | /r/rails | 26 Aug 2022

  • Question: Is there an rbenv for Crystal?

    4 projects | /r/crystal_programming | 11 Nov 2021

  • Aren't there Apt package?

    4 projects | /r/Zig | 8 Oct 2021