1brc
1️⃣🐝🏎️ The One Billion Row Challenge -- A fun exploration of how quickly 1B rows from a text file can be aggregated with Java (by gunnarmorling)
java
Java bindings for TensorFlow (by tensorflow)
| 1brc | java | |
|---|---|---|
| 35 | 6 | |
| 6,809 | 860 | |
| 1.5% | 2.3% | |
| 9.6 | 6.8 | |
| 7 months ago | 11 days ago | |
| Java | Java | |
| Apache License 2.0 | Apache License 2.0 |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
1brc
Posts with mentions or reviews of 1brc.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2025-01-31.
-
1 Billion Rows Challenge in PHP
We have already created the file measurements.txt with 1 million lines using the semi-official tool create_measurements.py:
-
1BRC Coding Challenge: Nerd Sniping the Java Community
Looking at the fastest solution, the convertIntoNumber() function is where the magic happens.
Specifically, line 318 - https://github.com/gunnarmorling/1brc/blob/main/src/main/jav...
The line above (long digits ... ) converts from ASCII digits ('0'-'9') to actual numeric digits (range 0-9)
- Why I'm skeptical of rewriting JavaScript tools in "faster" languages
- 20 milhões de linhas em 20s
- Resolvendo o desafio de um bilhão de linhas em Go (de 1m40s para 8,4s)
-
Node vs Bun: One Billion Row Challenge
You can generate the file using a python script from here.
-
The One Billion Row Challenge in CUDA: from 17 minutes to 17 seconds
This would be the code to beat. Ideally with only 8 cores but any number of cores is also very interesting.
https://github.com/gunnarmorling/1brc/discussions/710
-
One Billion Row Challenge in Golang - From 95s to 1.96s
Given that 1-billion-line-file is approximately 13GB, instead of providing a fixed database, the official repository offers a script to generate synthetic data with random readings. Just follow the instructions to create your own database.
-
1BRC Merykitty's Magic SWAR: 8 Lines of Code Explained in 3k Words
Local disk I/O is no longer the bottleneck on modern systems: https://benhoyt.com/writings/io-is-no-longer-the-bottleneck/
In addition, the official 1BRC explicitly evaluated results on a RAM disk to avoid I/O speed entirely: https://github.com/gunnarmorling/1brc?tab=readme-ov-file#eva... "Programs are run from a RAM disk (i.o. the IO overhead for loading the file from disk is not relevant)"
-
Processing One Billion Rows in PHP!
You may have heard of the "The One Billion Row Challenge" (1brc) and in case you don't, go checkout Gunnar Morlings's 1brc repo.
java
Posts with mentions or reviews of java.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2024-01-08.
- FLaNK Weekly 08 Jan 2024
-
What libraries do you use for machine learning and data visualizing in scala?
There are Java bindings for TensorFlow, but that's quite low level. I tried to see if I can get some Keras API for Scala, but I'm no expert and haven't had enough time to invest in this, so it's stuck in alpha. Maybe I develop it slow burning over the next year. A bit envious that Kotlin has a Keras-like library.
- Choosing Java as your language for a Machine Learning project
-
TensorFlow introduction that works with Java
Hope this is not too late to answer your question. In theory there are no official Java tutorials for Tensorflow 2. The Java implementation is still under development at https://github.com/tensorflow/java
-
[D] Java vs Python for Machine learning
To give a contrasting perspective, I think the Java ecosystem is much better suited for many data science tasks, and has a growing and well-maintained set of libraries for general purpose machine learning. I won't list them all, but TF-Java, DJL et al. have implementations of many modern architectures and there are a number of excellent libraries (CoreNLP, Lucene et al.) for working with text.
-
Can we use the keras model in another programming language, such as java or etcs?
Here's the latest java git repo https://github.com/tensorflow/java
What are some alternatives?
When comparing 1brc and java you can also consider the following projects:
nodejs - 1️⃣🐝🏎️ The One Billion Row Challenge with Node.js -- A fun exploration of how quickly 1B rows from a text file can be aggregated with different languages.
cortex.cpp - Local AI API Platform
csvlens - Command line csv viewer
JNA - Java Native Access
yolov7-object-tracking - YOLOv7 Object Tracking Using PyTorch, OpenCV and Sort Tracking