ishan/one-billion-rows-challenge
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
https://www.morling.dev/blog/one-billion-row-challenge/
7 Commits 1 Branch 0 Tags 42 KiB
Rust 100%
4fdef18833
Go to file
Ishan Jain 4fdef18833
added multithreaded version, no mmap optimization
2024-01-11 04:13:46 +05:30
src added multithreaded version, no mmap optimization 2024-01-11 04:13:46 +05:30
.gitignore init 2024-01-11 00:23:49 +05:30
Cargo.lock fxhash 2024-01-11 03:14:45 +05:30
Cargo.toml added multithreaded version, no mmap optimization 2024-01-11 04:13:46 +05:30
README.md added multithreaded version, no mmap optimization 2024-01-11 04:13:46 +05:30

README.md

One billion row challenge

  • Fastest single threaded runtime: 29.7s (4.5s to read the file into memory, 24s to process rows and ~150micros to generate the output)

  • Fastest multi threaded runtime on a machine with 12 cores: read = 4.682276171s processed = 2.057576429s output_gen = 188.113µs