1B Row Challenge Shows Java Can Process 1B Rows File in 2 Seconds

• 1brc

  28 5,246 9.8 Java

  1️⃣🐝🏎️ The One Billion Row Challenge -- A fun exploration of how quickly 1B rows from a text file can be aggregated with Java

The official challenge is in Java, but there are unofficial solutions in the "Show and tell" categories, using other languages, databases, and stuff (even a Fortran solution that takes 3 seconds without going too far in optimization):

https://github.com/gunnarmorling/1brc/discussions/categories...

I like this discussion because while the original is about "what can you do in 2024 stock java", I'm more interested in "what can you do if you use naive, obvious solutions". AWK does this in 6 minutes but, as pointed in this comment:

https://github.com/gunnarmorling/1brc/discussions/171#discus...

> It's either 6 minutes with 20 lines of AWK written in five minutes. Or 6 seconds in 300 lines of java written in five days. Classic "XKCD: Is It Worth the Time?".

• 1brc

  1 25 9.0 Rust

I maintain cross-language results. There will be a huge update soon, including AWS metal instances running on many combinations of cores/HT-threads.

What you mention from Rust is this: https://github.com/RagnarGrootKoerkamp/1brc/

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• 1brc

  2 261 8.1 F#

  1️⃣🐝🏎️ The One Billion Row Challenge - .NET Edition (by praeclarum)

Suggest a related project