Show HN: Split CSV into multiple files to avoid the Excel's 1M row limitation

This page summarizes the projects mentioned and recommended in the original post on news.ycombinator.com

InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured
  • LargeFileSplitter

    You have a large file (CSV, txt,etc). Let's split its contents into multiple files.

  • Why is this a yearly cost? I don’t understand.

    There’s already open source utilities [0] for users who aren’t proficient in Unix commands.

    If anything this should be the definition of a one time fee.

    You’re free to charge whatever you like, but it seems odd that anyone would pay you year after year to use your app.

    It’s not the price, as $40 isn’t that much, but the value and principle of the thing.

    [0] https://github.com/philoushka/LargeFileSplitter

  • zsv

    zsv+lib: tabular data swiss-army knife CLI + world's fastest (simd) CSV parser

  • }

    ```

    This of course assumes that each line is a single record, so you'll need some preprocessing if your CSV might contain embedded line-ends. For the preprocessing, you can use something like the `2tsv` command of https://github.com/liquidaty/zsv (disclaimer: I'm its author), which converts CSV to TSV and replaces newline with \n.

    You can also use something like `xsv split` (see https://lib.rs/crates/xsv) which frankly is probably your best option as of today (though zsv will be getting its own shard command soon)

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • The File Filesystem

    7 projects | news.ycombinator.com | 30 Apr 2024
  • ESpeak-ng: speech synthesizer with more than one hundred languages and accents

    1 project | news.ycombinator.com | 1 May 2024
  • Ubuntu 24.04 LTS is so buggy you can't install the OS [video]

    1 project | news.ycombinator.com | 1 May 2024
  • Semi-Scripted Conversational Applications

    1 project | dev.to | 1 May 2024
  • Dune 3D 1.1.0 Released

    2 projects | news.ycombinator.com | 1 May 2024